Skip to content

Commit

Permalink
ci: Fix bench-pr-comment.yml permissions (#350)
Browse files Browse the repository at this point in the history
  • Loading branch information
@samuelburnham
samuelburnham authored Feb 27, 2024
1 parent 9c4b1ec commit 2770a40
Showing 1 changed file with 1 addition and 6 deletions.
7 changes: 1 addition & 6 deletions .github/workflows/bench_pr_comment.yml → .github/workflows/bench-pr-comment.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,8 @@ concurrency:
jobs:
benchmark:
name: Comparative PR benchmark comment
if:
github.event.issue.pull_request
&& github.event.issue.state == 'open'
&& contains(github.event.comment.body, '!benchmark')
&& (github.event.comment.author_association == 'MEMBER' || github.event.comment.author_association == 'OWNER')
uses: lurk-lab/ci-workflows/.github/workflows/bench-pr-comment.yml@main
with:
default-runner: "self-hosted,gpu-bench"
default-benches: "supernova-ci"
default-env: "ARECIBO_BENCH_OUTPUT=pr-comment ARECIBO_BENCH_NUM_CONS=16384,524288"
default-env: "ARECIBO_BENCH_OUTPUT=pr-comment ARECIBO_BENCH_NUM_CONS=16384,524288"

1 comment on commit 2770a40

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmarks

Table of Contents

Overview

This benchmark report shows the Arecibo GPU benchmarks.
NVIDIA L4
Intel(R) Xeon(R) CPU @ 2.20GHz
32 vCPUs
125 GB RAM
Workflow run: https://github.com/lurk-lab/arecibo/actions/runs/8058295339

Benchmark Results

RecursiveSNARK-NIVC-2

ref=9c4b1ec ref=2770a40
Prove-NumCons-6540 44.16 ms (✅ 1.00x) 44.28 ms (✅ 1.00x slower)
Verify-NumCons-6540 34.22 ms (✅ 1.00x) 34.17 ms (✅ 1.00x faster)
Prove-NumCons-1028888 320.00 ms (✅ 1.00x) 319.78 ms (✅ 1.00x faster)
Verify-NumCons-1028888 250.15 ms (✅ 1.00x) 251.04 ms (✅ 1.00x slower)

CompressedSNARK-NIVC-Commitments-2

ref=9c4b1ec ref=2770a40
Prove-NumCons-6540 10.53 s (✅ 1.00x) 10.72 s (✅ 1.02x slower)
Verify-NumCons-6540 50.95 ms (✅ 1.00x) 50.94 ms (✅ 1.00x faster)
Prove-NumCons-1028888 52.49 s (✅ 1.00x) 53.05 s (✅ 1.01x slower)
Verify-NumCons-1028888 50.94 ms (✅ 1.00x) 51.07 ms (✅ 1.00x slower)

Made with criterion-table

Please sign in to comment.