benchmarks: prepare args outside benchmark - #10388
Conversation
|
GNU testsuite comparison: |
Merging this PR will regress 7 benchmarks
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | cksum_crc32b |
40.9 ms | 44.1 ms | -7.26% |
| ❌ | Simulation | cksum_default |
38.2 ms | 40.4 ms | -5.28% |
| ❌ | Simulation | expand_custom_tabstops[50000] |
29.8 ms | 31.4 ms | -4.97% |
| ❌ | Simulation | cksum_raw_output |
38.2 ms | 39.8 ms | -3.85% |
| ❌ | Simulation | cksum_multiple_files |
58.3 ms | 60.6 ms | -3.79% |
| ❌ | Simulation | cksum_crc |
39.4 ms | 40.9 ms | -3.75% |
| ❌ | Simulation | expand_many_lines[100000] |
112.3 ms | 116.4 ms | -3.51% |
| ⚡ | Memory | du_deep_tree[(100, 3)] |
3,209.6 KB | 93 KB | ×35 |
| ⚡ | Simulation | du_wide_tree[(5000, 500)] |
22.3 ms | 19.5 ms | +14.59% |
| ⚡ | Simulation | du_deep_tree[(100, 3)] |
2.6 ms | 2.3 ms | +11.81% |
| ⚡ | Simulation | unexpand_large_file[10] |
285.2 ms | 267 ms | +6.81% |
| ⚡ | Simulation | unexpand_many_lines[100000] |
136.3 ms | 127.6 ms | +6.8% |
| ⚡ | Simulation | du_all_wide_tree[(5000, 500)] |
41.8 ms | 39.9 ms | +4.64% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing xtqqczze:get_benchmark_args (330e0bc) with main (cb8b2b8)2
Footnotes
-
46 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
-
No successful run was found on
main(a730551) during the generation of this report, so cb8b2b8 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩
|
@sylvestre Please could you confirm whether these changes are viable to apply in full? |
|
i guess ? :) |
|
Need to refactor to handle the following case: coreutils/src/uu/cp/benches/cp_bench.rs Lines 27 to 33 in 456252f |
75ad901 to
1936e7b
Compare
|
Should we wait working about #10486 until your PR was merged? |
|
GNU testsuite comparison: |
|
is this able to merge? |
I couldn't work out how to handle all the cases, such as #10388 (comment) |
|
How about splitting this PR? |
bf8fbe3 to
b2aedf9
Compare
|
GNU testsuite comparison: |
This comment was marked as outdated.
This comment was marked as outdated.
|
Any progress about this? |
b2aedf9 to
ae7ca7b
Compare
|
GNU testsuite comparison: |
ae7ca7b to
8b71b7f
Compare
|
GNU testsuite comparison: |
8b71b7f to
2ba6b6a
Compare
|
GNU testsuite comparison: |
2ba6b6a to
1dedff9
Compare
|
GNU testsuite comparison: |
1dedff9 to
a2788c0
Compare
Finally, I have clean benchmark results |
|
GNU testsuite comparison: |
a2788c0 to
984e285
Compare
|
GNU testsuite comparison: |
984e285 to
4ca86fd
Compare
4ca86fd to
330e0bc
Compare
|
Thanks! |
Currently, we construct
uucore::Argswithin the measured section of benchmarks. That adds allocation and conversion overhead and will skew the results.Not all benchmarks are converted yet, but perhaps we can take this as a first step.