Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
76 changes: 76 additions & 0 deletions .github/ISSUE_TEMPLATE/test_results.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
---
name: Test results
about: Share speed, capacity or stability results measured on your hardware. People and coding agents can both fill this in.
title: "Test results: "
labels: ["test results"]
---

<!--
Instructions (for people and for coding agents):
- Fill in every section. Write "not measured" instead of deleting a section.
- Keep the keys in the Summary block; put units in the values.
- Remove credentials, tokens and private paths from commands and logs.
- For a problem or a crash, use the bug report form instead.
- To compare with the release tables, see the method in docs/performance.md
("Reference system, MTP4"). Any method is welcome; describe the one you used.
- If you open this issue through the API or `gh issue create`, the label may not be
applied automatically; the maintainers add it.
-->

## Summary

```text
revolta_version:
install: # PyPI wheel, Docker image tag, or source
gpus: # model x count, memory per GPU
power_limit_w:
interconnect: # PCIe switch with P2P, PCIe without P2P, NVLink, or other
host_memory: # host RAM, container limit, /dev/shm size
checkpoint: # owner/repository @ revision
drafter: # owner/repository @ revision, or none
speculative_method: # MTP, DFlash2, or none
draft_sample_method:
kv_cache_dtype:
cpu_kv_offload_gib:
max_model_len:
gpu_memory_utilization:
```

## Topology

<!-- Output of `nvidia-smi topo -m`. -->

```text

```

## Launch command and environment

<!-- The complete command, including --speculative-config and --kv-transfer-config,
and every VLLM_*, NCCL_* and PYTORCH_* variable you set. -->

```bash

```

## Startup log lines

<!-- The `ReVolta profile {...}` line, the `SM70 interconnect=` lines and the
`GPU KV cache size` line. -->

```text

```

## How you measured

<!-- Prompts or prompt types, response length, thinking on or off, temperature,
concurrency levels, repetitions, and whether rates include the time to first token. -->

## Results

<!-- Tables are welcome. Give the unit of every number. -->

## Stability and notes

<!-- Errors, out-of-memory events, restarts, and any deviation from the README. -->
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,10 @@ command, relevant environment, model revision, host/container memory limits,
offload settings, `nvidia-smi topo -m`, and the `ReVolta profile` /
`SM70 interconnect=` log lines. Remove credentials.

Reports from NVLink V100 owners are especially welcome; thanks to
Reports from NVLink V100 owners are especially welcome; share measured results with the
[Test results](https://github.com/Leonccaa/ReVolta/issues/new?template=test_results.md) template
([`.github/ISSUE_TEMPLATE/test_results.md`](.github/ISSUE_TEMPLATE/test_results.md); agents can fill it in and
open the issue through the API). Thanks to
[@jttdev](https://github.com/jttdev) for sharing their results ([#2](https://github.com/Leonccaa/ReVolta/issues/2)). Report security issues
through GitHub private vulnerability reporting.

Expand Down
Loading