Skip to content

Create missing ASN lookup database file#2704

Open
BharatDeva wants to merge 1 commit into
certtools:developfrom
BharatDeva:fix/asn-update-create-database
Open

Create missing ASN lookup database file#2704
BharatDeva wants to merge 1 commit into
certtools:developfrom
BharatDeva:fix/asn-update-create-database

Conversation

@BharatDeva
Copy link
Copy Markdown

Fixes #2689

Description

The ASN lookup updater currently checks that each configured database path already exists as a file before it downloads and parses the RouteViews data. That makes a first-time database update fail unless the target file is manually created first.

This change keeps the safety checks for paths that already exist, but allows a missing target file so the updater can create the parent directory and write the generated pyasn database as intended.

Tests

I ran the focused regression test and the ASN lookup test module under WSL:

PYTHONWARNINGS=ignore::PendingDeprecationWarning /home/codexuser/codex-work/intelmq/.venv/bin/python -m unittest intelmq.tests.bots.experts.asn_lookup.test_expert.TestASNLookupDatabaseUpdate.test_update_database_creates_missing_database_file
# Ran 1 test in 0.005s
# OK
PYTHONWARNINGS=ignore::PendingDeprecationWarning /home/codexuser/codex-work/intelmq/.venv/bin/python -m unittest intelmq.tests.bots.experts.asn_lookup.test_expert
# Ran 5 tests in 0.007s
# OK (skipped=4)

The skipped tests are the existing exotic ASN lookup tests, which require the optional test flag/dependency path. The new update-database regression test ran successfully.

/home/codexuser/codex-work/intelmq/.venv/bin/python -m flake8 intelmq/bots/experts/asn_lookup/expert.py intelmq/tests/bots/experts/asn_lookup/test_expert.py
# no output
git diff --check
# clean

The ASN lookup database updater rejected missing database files before it reached the code that creates the destination directory and writes the generated pyasn data.

Allow a missing target file while still rejecting existing non-files and non-writable files. Add a mocked update-database regression test that writes a new database path and reloads the affected bot.

Signed-off-by: BharatDeva <278575558+BharatDeva@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

asn expert database update fails if file does not already exist

1 participant