feat: benchmarking (#999)

* feat: add benchmarking dashboard, CI hook on PR, and store lifetime results

* refactor: change python env to 3.13 in benchmarks

* refactor: add verbosity, use 3.11 for benchmarking

* fix: OSError: [Errno 7] Argument list too long

* refactor: add debug statements

* refactor: remove extraneous -e

* refactor: fix tests and linter errors

* fix: track main package in coverage

* refactor: fix test coverage testing

* refactor: fix repo owner name in benchmark on pushing comment

* refactor: add asv monkeypatch to docs workflow

* refactor: temporarily allow building docs in forks

* refactor: use py 3.13 for benchmarking

* refactor: run only a single benchmark for PRs to speed them up

* refactor: install asv in the docs build workflow

* refactor: use hatch docs env to generate benhcmarks in docs CI

* refactor: more trying

* refactor: move tests

* Add benchmark results for 0.137

* Trigger Build

* Add benchmark results for 0.138

* refactor: set constant machine name when benchmarking

* Add benchmark results for 0.139

* refactor: fix issue with paths too long

* Add benchmark results for 0.140

* docs: update comment

* refactor: remove test benchmarking data

* refactor: fix comment

* refactor: allow the benchmark workflow to write to PRs

* refactor: use personal access token to set up the PR benchmark bot

* refactor: split the benchmark PR flow into two to make it work with PRs from forks

* refactor: update deprecated actions/upload-artifact@v3 to v4

* refactor: fix missing directory in benchmarking workflow

* refactor: fix triggering of second workflow

* refactor: fix workflow finally?

* docs: add comments to cut-offs and direct people to benchmarks PR

---------

Co-authored-by: github-actions <github-actions@github.com>
This commit is contained in:
Juro Oravec 2025-02-23 16:18:57 +01:00 committed by GitHub
parent dcd4203eea
commit f36581ed86
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
90 changed files with 40817 additions and 443 deletions

View file

@ -0,0 +1 @@
[[1566, [52121600.0, 54030336.0]], [1569, [52006912.0, 54030336.0]]]

View file

@ -0,0 +1 @@
[[1566, [52129792.0, 54525952.0]], [1569, [52019200.0, 54542336.0]]]

View file

@ -0,0 +1 @@
[[1566, [43671552.0, 43925504.0]], [1569, [43667456.0, 43921408.0]]]

View file

@ -0,0 +1 @@
[[1566, [43675648.0, 43929600.0]], [1569, [43671552.0, 43925504.0]]]

View file

@ -0,0 +1 @@
[[1566, [0.06844023999997262, 0.25948228500001846]], [1569, [0.0695505670000216, 0.2585547080000197]]]

View file

@ -0,0 +1 @@
[[1566, [0.03282115399997565, 0.1461098879999838]], [1569, [0.03280580699998836, 0.14556000400000357]]]

View file

@ -0,0 +1 @@
[[1566, [0.0035044859999970868, 0.004806205000022601]], [1569, [0.003512746000012612, 0.004752005000000281]]]

View file

@ -0,0 +1 @@
[[1566, [9.84330000051159e-05, 0.000542360999986613]], [1569, [9.899399998403169e-05, 0.0005454930000041713]]]

View file

@ -0,0 +1 @@
[[1566, [0.21055065100000547, 0.20605139500003133]], [1569, [0.20886826499997824, 0.20461195600000792]]]

View file

@ -0,0 +1 @@
[[1566, 0.19086866300000338], [1569, 0.1891247499999622]]

View file

@ -0,0 +1 @@
[[1566, [54018048.0, 53542912.0]], [1569, [53940224.0, 53530624.0]]]

View file

@ -0,0 +1 @@
[[1566, [54571008.0, 54530048.0]], [1569, [54566912.0, 54525952.0]]]

View file

@ -0,0 +1 @@
[[1566, [43925504.0, 43925504.0]], [1569, [43921408.0, 43687936.0]]]

View file

@ -0,0 +1 @@
[[1566, [43929600.0, 43929600.0]], [1569, [43925504.0, 43925504.0]]]

View file

@ -0,0 +1 @@
[[1566, [0.2582084590000022, 0.2630794039999955]], [1569, [0.2609166309999864, 0.26201485799998636]]]

View file

@ -0,0 +1 @@
[[1566, [0.14612163999998984, 0.15001642000004267]], [1569, [0.14627813999999262, 0.15037803699999586]]]

View file

@ -0,0 +1 @@
[[1566, [0.004762013999993542, 0.004786298999988503]], [1569, [0.004790214000024662, 0.004819428000018888]]]

View file

@ -0,0 +1 @@
[[1566, [0.0005448759999922004, 0.0005334049999987656]], [1569, [0.0005436999999801628, 0.0005416959999706705]]]

View file

@ -0,0 +1 @@
[[1566, [0.2058522649999759, 0.2053180329999691]], [1569, [0.20448447999996233, 0.2037191150000126]]]

View file

@ -0,0 +1 @@
[[1566, 53067386.97974115], [1569, 53008970.27562818]]

View file

@ -0,0 +1 @@
[[1566, 53314412.08868371], [1569, 53265830.36855053]]

View file

@ -0,0 +1 @@
[[1566, 43798343.942005485], [1569, 43794247.92479085]]

View file

@ -0,0 +1 @@
[[1566, 43802439.95921688], [1569, 43798343.942005485]]

View file

@ -0,0 +1 @@
[[1566, 0.13326301010086242], [1569, 0.13409931596367813]]

View file

@ -0,0 +1 @@
[[1566, 0.06924951360815947], [1569, 0.06910291888293614]]

View file

@ -0,0 +1 @@
[[1566, 0.0041040563026955666], [1569, 0.0040856561964745545]]

View file

@ -0,0 +1 @@
[[1566, 0.00023105458297652734], [1569, 0.00023238014982717938]]

View file

@ -0,0 +1 @@
[[1566, 0.20828887477903343], [1569, 0.20672915674372966]]

View file

@ -0,0 +1 @@
[[1566, 0.19086866300000338], [1569, 0.1891247499999622]]

View file

@ -0,0 +1 @@
[[1566, 53779955.28517828], [1569, 53735033.72493383]]

View file

@ -0,0 +1 @@
[[1566, 54550524.155578785], [1569, 54546428.1552901]]

View file

@ -0,0 +1 @@
[[1566, 43925504.00000001], [1569, 43804516.45360199]]

View file

@ -0,0 +1 @@
[[1566, 43929599.99999999], [1569, 43925504.00000001]]

View file

@ -0,0 +1 @@
[[1566, 0.2606325526511949], [1569, 0.26146516789296487]]

View file

@ -0,0 +1 @@
[[1566, 0.14805622350084952], [1569, 0.1483139223040422]]

View file

@ -0,0 +1 @@
[[1566, 0.004774141058462804], [1569, 0.004804798796807347]]

View file

@ -0,0 +1 @@
[[1566, 0.0005391099913516415], [1569, 0.0005426970749629188]]

View file

@ -0,0 +1 @@
[[1566, 0.20558497546849924], [1569, 0.20410143874267547]]