Zero four zero - #1
Merged
Merged
Conversation
CLI: - --glob <pattern> file collection (multiple) alongside --input - --manifest <file> idempotent incremental runs (blake3 source hashes) - --watch hot-folder daemon with --poll-interval - --jobs N rayon concurrency cap, --force to bypass manifest - JSON output carries source_hash + chunk_hash dedup keys - --embed (on-device OrtEmbedder) behind the opt-in 'embed' cargo feature (off by default; prebuilt ort needs glibc >= 2.38 which ubuntu-22.04 lacks) - strategy shown in config log (semantic strategy plumbed from core 0.2.0) - repoint bitvanes-core to tag v0.2.0; bump to 0.2.0 - README ingestion section; CI smoke covers glob/manifest/dedup keys
…ovements - Changed dependency on bitvanes-core to use local path for development and updated to version 0.4.0. - Added support for additional document formats: DOCX, PPTX, XLSX, EPUB, and RTF. - Introduced new CLI options for minimum confidence in PII scrubbing and contextual anchor window. - Enhanced headless processing with streaming output for Arrow IPC format. - Improved progress reporting during file processing with multi-level progress bars. - Added functionality to write a default configuration file (bitvanes.toml) with `--init` flag. - Updated README to reflect new features and usage instructions. - Refactored code for better handling of PII findings and metadata attachment.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.