Skip to content

Commit

Permalink
Auto-merge updates from master branch
Browse files Browse the repository at this point in the history
  • Loading branch information
github-actions committed Jan 21, 2025
2 parents 2f4d5ae + 25bba8f commit fe517ed
Show file tree
Hide file tree
Showing 3 changed files with 20 additions and 10 deletions.
9 changes: 9 additions & 0 deletions compliance/nvidia/TEST01/rgat/audit.conf
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# The format of this config file is 'key = value'.
# The key has the format 'model.scenario.key'. Value is mostly int64_t.
# Model maybe '*' as wildcard. In that case the value applies to all models.
# All times are in milli seconds

# mode dictionary (0 = submission, 1 = accuracy, 2 = performance, 3 = find peak perf)
*.*.mode = 2
*.*.accuracy_log_rng_seed = 720381539243781796
*.*.accuracy_log_sampling_target = 4096
19 changes: 10 additions & 9 deletions graph/R-GAT/benchmark-checklist.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,11 +48,11 @@ Documented whether **Equal Issue Mode** is applicable in
---

#### **9. Reference Implementation Dataset Coverage**
- [ ] Reference implementation successfully processes the entire validation dataset during:
- [ ] Performance runs
- [ ] Accuracy runs
- [ ] Compliance runs
- [ ] Valid log files passing the submission checker are generated for all runs.
- [X] Reference implementation successfully processes the entire validation dataset during:
- [X] Performance runs
- [X] Accuracy runs
- [X] Compliance runs
- [X] Valid log files passing the submission checker are generated for all runs - [link](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/tree/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1).

---

Expand Down Expand Up @@ -81,7 +81,8 @@ Documented whether **Equal Issue Mode** is applicable in
---

#### **14. Sample Log Files**
- [ ] Include sample logs for all the applicable scenario runs:
- [ ] `mlperf_log_summary.txt`
- [ ] `mlperf_log_detail.txt`
- [ ] Ensure sample logs successfully pass the submission checker and applicable compliance runs.
- [X] Include sample logs for all the applicable scenario runs:
- [X] Offline
- [X] [`mlperf_log_summary.txt`](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1/mlperf_log_summary.txt)
- [X] [`mlperf_log_detail.txt`](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1/mlperf_log_detail.txt)
- [X] Ensure sample logs successfully pass the submission checker and applicable compliance runs. [Link](https://htmlpreview.github.io/?https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/refs/heads/auto-update/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/summary.html)
2 changes: 1 addition & 1 deletion loadgen/VERSION.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
5.0.12
5.0.13

0 comments on commit fe517ed

Please sign in to comment.