Skip to content

nix: fix fetching crates via user agent#415

Open
siddarthkay wants to merge 1 commit into
masterfrom
fix-fetching-of-crates
Open

nix: fix fetching crates via user agent#415
siddarthkay wants to merge 1 commit into
masterfrom
fix-fetching-of-crates

Conversation

@siddarthkay
Copy link
Copy Markdown

@siddarthkay siddarthkay commented May 28, 2026

Else in status-go CI we get this failure :

crate-alloy-rlp>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-crypto-primitives>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-alloy-rlp> curl: (22) The requested URL returned error: 403
crate-ark-crypto-primitives> curl: (22) The requested URL returned error: 403
crate-ark-ec>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-ec> curl: (22) The requested URL returned error: 403
crate-ark-ff>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-ff> curl: (22) The requested URL returned error: 403
crate-ark-groth16>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-groth16> curl: (22) The requested URL returned error: 403
crate-ark-poly>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-poly> curl: (22) The requested URL returned error: 403
crate-ark-snark>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-snark> curl: (22) The requested URL returned error: 403
crate-ethers-core>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ark-serialize>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-ethers-core> curl: (22) The requested URL returned error: 403
crate-ark-serialize> curl: (22) The requested URL returned error: 403
crate-scale-info>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
crate-scale-info> curl: (22) The requested URL returned error: 403
crate-ark-crypto-primitives> error: cannot download crate-ark-crypto-primitives-0.4.0.tar.gz from any mirror
error: Cannot build '/nix/store/lm210ryfadn6vvs361w5p95bnnnhdf1g-crate-ark-crypto-primitives-0.4.0.tar.gz.drv'.
       Reason: builder failed with exit code 1.
       Output paths:
         /nix/store/d4rxr5imz7q8gnpz33abpny8rv7qbryd-crate-ark-crypto-primitives-0.4.0.tar.gz
       Last 17 log lines:
       >
       > trying https://crates.io/api/v1/crates/ark-crypto-primitives/0.4.0/download
       >   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
       >                                  Dload  Upload   Total   Spent    Left  Speed
       >   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
       > curl: (22) The requested URL returned error: 403
       > Warning: Problem (retrying all errors). Will retry in 1 second. 3 retries left.
       >   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
       > curl: (22) The requested URL returned error: 403
       > Warning: Problem (retrying all errors). Will retry in 2 seconds. 2 retries
       > Warning: left.
       >   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
       > curl: (22) The requested URL returned error: 403
       > Warning: Problem (retrying all errors). Will retry in 4 seconds. 1 retry left.
       >   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
       > curl: (22) The requested URL returned error: 403
       > error: cannot download crate-ark-crypto-primitives-0.4.0.tar.gz from any mirror
       For full logs, run:
         nix log /nix/store/lm210ryfadn6vvs361w5p95bnnnhdf1g-crate-ark-crypto-primitives-0.4.0.tar.gz.drv
error: Cannot build '/nix/store/lqamh3mbnq2w5klyndgdkx7rlyxsrkpk-ark-crypto-primitives-0.4.0.drv'.
       Reason: 1 dependency failed.
       Output paths:
         /nix/store/vlgn4msdjb31i499grnmj3vz6c3f9jh8-ark-crypto-primitives-0.4.0
error: Build failed due to failed dependency
error: Cannot build '/nix/store/c27fnbqrqaagcxn81y04izj1yfg82c25-cargo-vendor-dir.drv'.
       Reason: 1 dependency failed.
       Output paths:
         /nix/store/jfd5p6gl3a1sdc6aqxn720n0qcf91ayh-cargo-vendor-dir
error: Build failed due to failed dependency
error: Cannot build '/nix/store/bn8s4c113hhsvhg46lmazj0p04z45fba-circom-compat-ffi-0.1.0.drv'.
       Reason: 1 dependency failed.
       Output paths:
         /nix/store/7myhxaq2yyqdw74pspmpnsd6ywwiqypg-circom-compat-ffi-0.1.0
error: Build failed due to failed dependency
error: Cannot build '/nix/store/7s1kqgpvb03a4wn970kkkil1kk33wv52-storage-0.1.0-3c09f008.drv'.
       Reason: 1 dependency failed.
       Output paths:
         /nix/store/z1ia4xdcl9dlib0164zm6iia1s80nmah-storage-0.1.0-3c09f008
error: Build failed due to failed dependency
error: Cannot build '/nix/store/5pah3l0yx5hl0wxyvp40xh3x5a7zd2xy-status-go-61245b6e12d3fe29d432e466a12b8feaec391b36.drv'.
       Reason: 1 dependency failed.
       Output paths:
         /nix/store/ackv4j3m28w9rivslvc7nhi8vll28wx9-status-go-61245b6e12d3fe29d432e466a12b8feaec391b36
error: Build failed due to failed dependency
script returned exit code 1

@siddarthkay siddarthkay self-assigned this May 28, 2026
@siddarthkay siddarthkay requested a review from jakubgs May 28, 2026 13:23
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 28, 2026

Benchmark for b0bb410

Click to view benchmark
Test Base PR %
FullMerkleTree::::full_depth_gen 11.1±0.10ms 11.0±0.09ms -0.90%
OptimalMerkleTree::::full_depth_gen 674.5±3.82µs 680.9±3.26µs +0.95%
Pmtree::delete 53.6±0.28µs 53.6±0.39µs 0.00%
Pmtree::get 319.7±3.69ns 319.9±3.99ns +0.06%
Pmtree::get_empty_leaves_indices 8.5±0.25ns 8.5±0.07ns 0.00%
Pmtree::get_subtree_root 391.2±7.36ns 373.1±3.79ns -4.63%
Pmtree::override_range 106.3±0.66µs 106.1±1.34µs -0.19%
Pmtree::set 53.6±0.57µs 53.8±0.50µs +0.37%
Set/FullMerkleTree::::set/1 511.4±2.27µs 513.5±9.05µs +0.41%
Set/FullMerkleTree::::set/10 5.1±0.04ms 5.1±0.01ms 0.00%
Set/FullMerkleTree::::set/100 51.6±0.12ms 51.7±0.13ms +0.19%
Set/FullMerkleTree::::set_range/1 512.4±6.08µs 512.8±3.51µs +0.08%
Set/FullMerkleTree::::set_range/10 692.1±10.03µs 690.9±4.76µs -0.17%
Set/FullMerkleTree::::set_range/100 2.0±0.02ms 2.0±0.02ms 0.00%
Set/OptimalMerkleTree::::set/1 516.6±11.83µs 512.7±2.88µs -0.75%
Set/OptimalMerkleTree::::set/10 5.1±0.01ms 5.1±0.01ms 0.00%
Set/OptimalMerkleTree::::set/100 51.9±0.18ms 51.8±0.16ms -0.19%
Set/OptimalMerkleTree::::set_range/1 515.6±8.79µs 511.6±2.45µs -0.78%
Set/OptimalMerkleTree::::set_range/10 713.5±9.48µs 716.9±13.03µs +0.48%
Set/OptimalMerkleTree::::set_range/100 1973.4±41.28µs 1974.2±41.18µs +0.04%
rln_finish_partial_proof 74.0±1.02ms 74.1±1.17ms +0.14%
rln_full_proof 201.2±1.80ms 201.9±6.77ms +0.35%
rln_partial_proof_generation 138.5±1.32ms 139.4±3.10ms +0.65%

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 28, 2026

Benchmark for b0bb410

Click to view benchmark
Test Base PR %
FullMerkleTree::delete 16.4±0.42µs 16.5±0.32µs +0.61%
FullMerkleTree::get 0.7±0.01ns 0.7±0.01ns 0.00%
FullMerkleTree::get_empty_leaves_indices 861.4±10.23µs 865.9±21.42µs +0.52%
FullMerkleTree::get_subtree_root 8.5±0.07ns 8.5±0.18ns 0.00%
FullMerkleTree::override_range 1661.0±26.40µs 1660.4±41.81µs -0.04%
FullMerkleTree::set 8.1±0.16µs 8.1±0.13µs 0.00%
OptimalMerkleTree::delete 18.8±0.21µs 19.0±0.30µs +1.06%
OptimalMerkleTree::get 27.4±0.60ns 27.1±0.27ns -1.09%
OptimalMerkleTree::get_empty_leaves_indices 859.7±1.91µs 861.1±7.26µs +0.16%
OptimalMerkleTree::get_subtree_root 19.5±0.16ns 19.5±0.34ns 0.00%
OptimalMerkleTree::override_range 3.5±0.12ms 4.0±0.15ms +14.29%
OptimalMerkleTree::set 9.5±0.19µs 9.6±0.22µs +1.05%
poseidon Fr/Array hash/10 118.2±1.16µs 82.6 KElem/sec N/A N/A
poseidon Fr/Array hash/100 1229.5±7.13µs 79.4 KElem/sec N/A N/A
poseidon Fr/Array hash/1000 13.1±0.23ms 74.6 KElem/sec N/A N/A
poseidon Fr/Single hash 11.8±0.10µs 80.7 MElem/sec N/A N/A
validate_override_range/FullMerkleTree/override_range/1024 419.2±8.61µs 423.7±19.64µs +1.07%
validate_override_range/FullMerkleTree/override_range/64 63.1±2.95µs 63.4±2.85µs +0.48%
validate_override_range/FullMerkleTree/override_range/65536 370.6±5.51ms 374.4±8.08ms +1.03%
validate_override_range/FullMerkleTree/override_range/8192 7.3±0.10ms 7.5±0.06ms +2.74%
validate_override_range/OptimalMerkleTree/override_range/1024 552.4±12.22µs 554.0±12.54µs +0.29%
validate_override_range/OptimalMerkleTree/override_range/64 76.9±2.13µs 76.4±1.71µs -0.65%
validate_override_range/OptimalMerkleTree/override_range/65536 386.3±5.28ms 384.7±10.01ms -0.41%
validate_override_range/OptimalMerkleTree/override_range/8192 8.4±0.08ms 8.4±0.21ms 0.00%
validate_override_range/validate_only/1024 6.9±0.07µs 7.0±0.12µs +1.45%
validate_override_range/validate_only/64 277.8±2.09ns 277.4±4.96ns -0.14%
validate_override_range/validate_only/65536 685.1±6.54µs 683.7±7.06µs -0.20%
validate_override_range/validate_only/8192 70.1±0.31µs 70.4±0.87µs +0.43%

@siddarthkay siddarthkay mentioned this pull request May 28, 2026
Merged
@siddarthkay siddarthkay force-pushed the fix-fetching-of-crates branch from f14a071 to 5e98222 Compare May 28, 2026 14:13
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 28, 2026

Benchmark for 4031d89

Click to view benchmark
Test Base PR %
FullMerkleTree::::full_depth_gen 9.8±0.34ms 9.0±0.14ms -8.16%
OptimalMerkleTree::::full_depth_gen 523.7±2.86µs 1305.5±28.55µs +149.28%
Pmtree::delete 41.7±0.60µs 41.8±0.91µs +0.24%
Pmtree::get 274.5±13.61ns 264.4±3.59ns -3.68%
Pmtree::get_empty_leaves_indices 6.6±0.14ns 6.6±0.07ns 0.00%
Pmtree::get_subtree_root 307.5±2.57ns 304.5±3.16ns -0.98%
Pmtree::override_range 82.8±1.98µs 81.4±3.59µs -1.69%
Pmtree::set 41.7±0.59µs 41.7±0.50µs 0.00%
Set/FullMerkleTree::::set/1 396.8±2.49µs 400.7±9.44µs +0.98%
Set/FullMerkleTree::::set/10 4.0±0.07ms 4.0±0.03ms 0.00%
Set/FullMerkleTree::::set/100 40.1±0.66ms 40.0±0.07ms -0.25%
Set/FullMerkleTree::::set_range/1 396.6±1.52µs 397.9±5.73µs +0.33%
Set/FullMerkleTree::::set_range/10 536.9±8.09µs 536.0±4.02µs -0.17%
Set/FullMerkleTree::::set_range/100 1568.4±31.25µs 1571.0±34.43µs +0.17%
Set/OptimalMerkleTree::::set/1 412.8±5.55µs 397.4±1.49µs -3.73%
Set/OptimalMerkleTree::::set/10 4.1±0.04ms 4.0±0.10ms -2.44%
Set/OptimalMerkleTree::::set/100 41.6±0.38ms 40.2±0.62ms -3.37%
Set/OptimalMerkleTree::::set_range/1 407.5±6.20µs 397.7±1.78µs -2.40%
Set/OptimalMerkleTree::::set_range/10 561.1±17.68µs 551.2±12.00µs -1.76%
Set/OptimalMerkleTree::::set_range/100 1526.2±24.63µs 1523.7±35.62µs -0.16%
rln_finish_partial_proof 57.4±0.80ms 57.3±0.78ms -0.17%
rln_full_proof 156.0±1.23ms 156.6±5.39ms +0.38%
rln_partial_proof_generation 107.7±0.96ms 107.7±1.26ms 0.00%

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 28, 2026

Benchmark for 4031d89

Click to view benchmark
Test Base PR %
FullMerkleTree::delete 18.1±0.22µs 18.1±0.21µs 0.00%
FullMerkleTree::get 0.8±0.01ns 0.8±0.01ns 0.00%
FullMerkleTree::get_empty_leaves_indices 982.2±6.15µs 981.8±4.25µs -0.04%
FullMerkleTree::get_subtree_root 10.2±0.14ns 10.2±0.09ns 0.00%
FullMerkleTree::override_range 1911.4±39.97µs 1913.9±58.29µs +0.13%
FullMerkleTree::set 8.9±0.07µs 9.0±0.07µs +1.12%
OptimalMerkleTree::delete 20.7±0.24µs 20.8±0.31µs +0.48%
OptimalMerkleTree::get 50.7±0.79ns 51.4±0.46ns +1.38%
OptimalMerkleTree::get_empty_leaves_indices 982.3±5.68µs 986.1±24.87µs +0.39%
OptimalMerkleTree::get_subtree_root 26.0±0.23ns 26.0±0.30ns 0.00%
OptimalMerkleTree::override_range 3.6±0.13ms 3.7±0.11ms +2.78%
OptimalMerkleTree::set 10.4±0.08µs 10.4±0.18µs 0.00%
poseidon Fr/Array hash/10 140.1±0.74µs 69.7 KElem/sec N/A N/A
poseidon Fr/Array hash/100 1503.7±2.28µs 64.9 KElem/sec N/A N/A
poseidon Fr/Array hash/1000 15.2±0.02ms 64.4 KElem/sec N/A N/A
poseidon Fr/Single hash 13.9±0.01µs 68.8 MElem/sec N/A N/A
validate_override_range/FullMerkleTree/override_range/1024 476.3±10.40µs 475.9±13.29µs -0.08%
validate_override_range/FullMerkleTree/override_range/64 70.0±3.65µs 70.5±2.69µs +0.71%
validate_override_range/FullMerkleTree/override_range/65536 418.0±9.13ms 438.0±1.62ms +4.78%
validate_override_range/FullMerkleTree/override_range/8192 8.6±0.07ms 8.6±0.09ms 0.00%
validate_override_range/OptimalMerkleTree/override_range/1024 645.9±13.99µs 651.2±12.96µs +0.82%
validate_override_range/OptimalMerkleTree/override_range/64 94.3±5.15µs 96.2±5.42µs +2.01%
validate_override_range/OptimalMerkleTree/override_range/65536 434.5±11.62ms 450.0±4.71ms +3.57%
validate_override_range/OptimalMerkleTree/override_range/8192 9.9±0.06ms 9.9±0.07ms 0.00%
validate_override_range/validate_only/1024 10.6±0.11µs 10.8±0.09µs +1.89%
validate_override_range/validate_only/64 339.7±2.76ns 343.1±3.43ns +1.00%
validate_override_range/validate_only/65536 849.3±6.76µs 848.6±6.46µs -0.08%
validate_override_range/validate_only/8192 105.4±1.41µs 103.8±1.89µs -1.52%

@igor-sirotin igor-sirotin mentioned this pull request May 28, 2026
Open
jakubgs
jakubgs approved these changes May 29, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

@jakubgs jakubgs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this was already fixed in nixpkgs, so we could just update to latest nixos-25.11:

Wouldn't that be cleaner?

If updating nixpkgs is a problem this MIGHT be fine, but it's really hacky.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jakubgs jakubgs jakubgs approved these changes

Assignees

@siddarthkay siddarthkay

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@siddarthkay @jakubgs