Skip to content

Add integrated, scaling, and per-record benchmarks; correct README perf claims - #48

Merged
eitamring merged 1 commit into
mainfrom
bench/methodology
Jul 11, 2026
Merged

Add integrated, scaling, and per-record benchmarks; correct README perf claims#48
eitamring merged 1 commit into
mainfrom
bench/methodology

Conversation

@eitamring

@eitamring eitamring commented Jul 11, 2026

Copy link
Copy Markdown
Contributor

Benchmark and docs

  • New benchmarks: integrated text pipeline (source -> rules -> JSONL sink), structured pipeline, sink to io.Discard vs file, per-record engine allocations across worker counts, ruleset scaling at 20/100/1000 rules, middle-hit, and the unprefilterable-regex miss.
  • Rules benchmarks now check errors.Is instead of comparing error strings; ruleset construction moved out of the timed region.
  • README: the worst-case row is relabeled as the benchmark ruleset's 20-rule regex-heavy miss, with a note that patterns without an extractable literal pay full regex cost (~101 us at 20 rules, reproducible via the named benchmark); added the integrated-pipeline row so the discard-sink number is not mistaken for what a CLI run pays.

make bench covers all new benchmarks and completes in ~75s.

@eitamring
eitamring force-pushed the bench/methodology branch from fda71aa to 442889b Compare July 11, 2026 06:31
@eitamring
eitamring force-pushed the bench/methodology branch from 442889b to 2f1c3ff Compare July 11, 2026 06:33
@eitamring
eitamring merged commit 88571a2 into main Jul 11, 2026
4 checks passed
@eitamring
eitamring deleted the bench/methodology branch July 11, 2026 07:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant