Skip to content

Add more provider module categories to the provider page#70190

Open
Lee-W wants to merge 4 commits into
apache:mainfrom
astronomer:add-more-registry-module-categories
Open

Add more provider module categories to the provider page#70190
Lee-W wants to merge 4 commits into
apache:mainfrom
astronomer:add-more-registry-module-categories

Conversation

@Lee-W

@Lee-W Lee-W commented Jul 21, 2026

Copy link
Copy Markdown
Member

Why

Follow up of #70122. Extra links, queues, plugins, auth managers, DB managers, and dialects were not browsable in the registry

What

Add extra links, queues, plugins, auth managers, DB managers, and dialects. Each of them now gets it own category tab. The row now sorted by module count and tail collapses into a "More" menu so the page won't be too messy

image image
Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

Comment thread dev/registry/extract_parameters.py Outdated
Comment thread dev/registry/registry_tools/types.py
Comment thread dev/registry/registry_tools/types.py
@Lee-W
Lee-W force-pushed the add-more-registry-module-categories branch 3 times, most recently from 1bae222 to e0be06b Compare July 22, 2026 05:43
@Lee-W
Lee-W requested a review from kaxil July 22, 2026 10:12
Comment thread dev/registry/registry_tools/types.py
@Lee-W
Lee-W force-pushed the add-more-registry-module-categories branch 2 times, most recently from a1ffe7e to 4ab25a3 Compare July 23, 2026 07:10
@Lee-W
Lee-W force-pushed the add-more-registry-module-categories branch from 29c43b0 to 00935eb Compare July 23, 2026 09:46
Lee-W added 4 commits July 23, 2026 18:04
extract_versions.py hardcoded a 4-entry FQCN_SECTIONS map, so
backfilled (older) provider version pages only showed notifications,
secrets backends, logging, and executors. The newer categories added
for the provider page (extra links, queues, auth managers, db
managers) only showed up on the latest version page, which used a
separate code path already wired to all categories.

extract_versions.py now derives its category list from
CLASS_LEVEL_SECTIONS instead of duplicating it, and the category
overrides that used to live only in extract_parameters.py move to a
shared CLASS_LEVEL_CATEGORY_OVERRIDES constant so both scripts stay in
sync going forward.
"Queues" was easy to confuse with the "queue" argument on
BaseOperator, which is unrelated to message queue providers.
Class-level sections, plugins, dialects, and task-decorators each
repeated the same split/import/getattr logic for resolving a dotted
class or function path, making it easy for the failure handling in
one copy to drift from the others. Also widens
_get_first_docstring_line's parameter type to object, since it only
ever reads __doc__ and doesn't require an actual class -- mypy caught
the mismatch once the new helper's return type stopped inferring as
Any at the task-decorators call site.
@Lee-W
Lee-W force-pushed the add-more-registry-module-categories branch from 00935eb to 3f6d9dc Compare July 23, 2026 10:04
@Lee-W

Lee-W commented Jul 23, 2026

Copy link
Copy Markdown
Member Author
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

4 participants