Add perf comparison: setup-java v5.3.0 (CommonJS) vs main (ESM)#4
Open
brunoborges wants to merge 4 commits into
Open
Add perf comparison: setup-java v5.3.0 (CommonJS) vs main (ESM)#4brunoborges wants to merge 4 commits into
brunoborges wants to merge 4 commits into
Conversation
Measures setup-java step wall-time, cache-hit, and .m2 cache size across Ubuntu/Windows/macOS in cold (cache miss + save) and warm (cache restore) phases, then prints a side-by-side comparison table to the job summary. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
….0.0) Parallels perf-compare.yml but pins the CommonJS leg to v5.5.0 (0f481fc) and the ESM leg to current main (f848fd1, v6.0.0). Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Decomposes setup-java warm time into T_nocache (bootstrap+JDK) and T_restore (cache download+extract) for v5.5.0 vs main, with ACTIONS_STEP_DEBUG enabled on warm jobs. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
New workflow
perf-compare.ymlthat benchmarkssetup-javav5.3.0 (last CommonJS release, commitad2b381) againstmain(now ESM, refreshed deps + cache/logging enhancements, commitfe9b749). Both declareusing: node24, so this isolates the effect of the ESM rewrite + dependency bumps + cache handling on real setup time.How it measures
Identical scenario (Temurin 21 + Maven build) run per OS (Ubuntu / Windows / macOS) and per version, in two phases:
github.run_id), sosetup-javarestores nothing and saves the cache in post.needs: cold, so the cache saved by COLD is restored (cache-hit=true). WARM vs COLD shows the cache benefit; v5.3.0 vs main shows the version delta.Captured per leg:
setup_ms— wall-clock of thesetup-javastep, bracketed withDate.now()from the runner's node (portable across all three OSes).cache_hit— the action's Maven cache-hit output.m2_kb— size of~/.m2/repository(cache footprint).The
comparejob aggregates all metrics artifacts and writes two tables to the run summary: raw measurements, and a v5.3.0 vs main delta per OS + phase.Notes
Open the workflow run's Summary to see the comparison tables.