Skip to content

Feature/pull interface #63

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
denyost wants to merge 203 commits into
base: main
Choose a base branch
from
Open

Feature/pull interface #63

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
203 commits
Select commit Hold shift + click to select a range
181ea95
extend TargetSource CRD by http token
denyost Apr 16, 2026
2fddddf
add pull logic as poc
denyost Apr 16, 2026
64a83cd
fix request header typo
denyost Apr 16, 2026
98823e8
refactor pull implementation
denyost Apr 16, 2026
cfe0273
Merge branch 'feature/target-loading-architecture' of https://github.…
denyost Apr 16, 2026
e76c6f3
restructure discovery structs
denyost Apr 17, 2026
3c18fb5
offload sending logic from loader implementation
denyost Apr 17, 2026
86ab0f3
implement type assertion based on received message
denyost Apr 17, 2026
10a9978
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 17, 2026
8b36d7d
add http_push skeleton
denyost Apr 17, 2026
efbf727
add http_push skeleton
denyost Apr 17, 2026
60a5eb3
refactor targetsource_controller.go
denyost Apr 17, 2026
1bc5d2b
remove targetsource ressource to not impact main
denyost Apr 17, 2026
14e7765
add batching to DiscoveryEvent's
denyost Apr 17, 2026
b4337ea
refactored sender.go
denyost Apr 17, 2026
30f3ecb
load buffer and chunk size from env variable
denyost Apr 17, 2026
201ccb3
Merge branch 'feature/targetsource-crd-fields' into feature/limit-tar…
mcdillson Apr 21, 2026
c8dfdf1
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 22, 2026
6cc0eb1
Merge branch 'feature/target-loading-architecture' of https://github.…
denyost Apr 22, 2026
e7ff5f8
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 22, 2026
3cb9160
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 22, 2026
586001e
rename file to helpers
denyost Apr 22, 2026
7430815
rebuild and reformat
denyost Apr 22, 2026
255a1f3
consolidate pull and push to http
denyost Apr 23, 2026
bd2b45f
rename target manager to target applier
denyost Apr 23, 2026
5a561a7
implement a generic registry
denyost Apr 23, 2026
f5481b8
add a discoveryTegistry to share targetchannel between apiserver and …
denyost Apr 23, 2026
22683f4
remove unused event action from DiscoverySnapshot
denyost Apr 23, 2026
922bbc6
rename target manager to target applier
denyost Apr 24, 2026
733927f
implement key for registry as a comparable
denyost Apr 24, 2026
9d30560
fix error message and add a word of caution for key comparables
denyost Apr 24, 2026
dafa82b
consistently use namespaced name as refference to the targetsource
denyost Apr 24, 2026
2973c03
improve context cancling and error handling
denyost Apr 24, 2026
c95bdaf
add supervised goroutines
denyost Apr 24, 2026
0aa883d
refactor target applier
denyost Apr 24, 2026
27b2b1f
add supervisor for the discovery pipelines
denyost Apr 24, 2026
22fe2d8
improve readability
denyost Apr 24, 2026
58538c7
remove side-effects from getter getTargetSource
denyost Apr 24, 2026
4f0457e
redesign supervisor
denyost Apr 24, 2026
60491be
add dependency handling of discovery pipeline components
denyost Apr 25, 2026
b8a6d27
refactor code
denyost Apr 25, 2026
eedfedf
improve context handling of and target applier semantics
denyost Apr 25, 2026
a66accb
moved finalizer label into const file
mcdillson Apr 27, 2026
3b2d925
fixed typo
mcdillson Apr 27, 2026
3ba86cb
restructured loaders package
mcdillson Apr 27, 2026
d0ac86b
restructured target handler
mcdillson Apr 27, 2026
240a2bc
ran go mod tidy
mcdillson Apr 27, 2026
7ef1281
renamed target applier to message processor & created client.go for g…
mcdillson Apr 27, 2026
7bcbcc0
added const file for common labels
mcdillson Apr 24, 2026
4fa58b6
Merge branch 'feature/limit-target-loading' into feature/restructuring
mcdillson Apr 27, 2026
d10fc9a
removed all package
mcdillson Apr 27, 2026
108bd2d
changed error lookup to apierrors
mcdillson Apr 27, 2026
b7dd036
remove unused fiels
denyost Apr 29, 2026
d3a9b5c
rename files and restructure packages
denyost Apr 29, 2026
0c80394
rename target handler to target reconciler
denyost Apr 29, 2026
04208bf
rename handler to reconciler
denyost Apr 29, 2026
c3818ce
clarify interface files
denyost Apr 29, 2026
e4df0d4
define EventAction to be go idomatic
denyost Apr 29, 2026
86c0af0
add webhook activation info to metadata of DiscoveryRegistry
denyost Apr 29, 2026
284b1f2
moved reconciler files to discovery
mcdillson Apr 29, 2026
b59897c
renamed messageProcessor to targetReconciler
mcdillson Apr 29, 2026
c268808
moved registry.go to discovery
mcdillson Apr 29, 2026
0295896
moved supervisor to discovery
mcdillson Apr 29, 2026
4d32c40
moved factory.go to discovery/loaders.go
mcdillson Apr 29, 2026
7671c1a
moved send.go to loaders package
mcdillson Apr 29, 2026
5f1e9cb
eliminated message.go
mcdillson Apr 29, 2026
6d67537
moved const.go to discovery.go
mcdillson Apr 29, 2026
3914630
renamed core package within targetsource controller
mcdillson Apr 29, 2026
46a201f
changed events to delete / apply
mcdillson Apr 29, 2026
7b17f7e
moved send.go into separate utils for loaders
mcdillson Apr 29, 2026
4540163
replaced legacy registry package
mcdillson Apr 29, 2026
2c3260e
Merge pull request #57 from gnmic/feature/restructuring
mcdillson Apr 29, 2026
f269a85
Merge branch 'main' of https://github.com/gnmic/operator into feature…
denyost Apr 30, 2026
c728fa2
add supervisor restart policy to targetsource spec configuration
denyost Apr 30, 2026
589bc9f
add targetsource example for lab
denyost Apr 30, 2026
a5dde06
remove targetsource example to not add unnecassary logging to main
denyost Apr 30, 2026
4be9c27
update gitignore to not push targetsources in order to prevent loggin…
denyost Apr 30, 2026
65eb7f6
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 30, 2026
7337541
add component info to logging
denyost Apr 30, 2026
4ec0bb6
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 30, 2026
41d5498
make snapshot id a bit smaller
denyost Apr 30, 2026
3ec3203
if context is canceled return with ctx.Err() not a clean exit
denyost Apr 30, 2026
0eaffdc
applied kubebuilder best-practise logging
denyost Apr 30, 2026
5140605
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 30, 2026
e447b3b
improved logging
denyost Apr 30, 2026
fca37e0
improved logging
denyost Apr 30, 2026
fd4abe7
improved logging
denyost Apr 30, 2026
a6bc114
simplified pipeline context handling
denyost Apr 30, 2026
34cd51e
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost Apr 30, 2026
54c41fd
add timeout as a const
denyost Apr 30, 2026
535ee49
rename target reconciler to message processor
denyost May 1, 2026
c09c68f
rename pipeline to runtime
denyost May 1, 2026
e4c01ba
removed supervisor
denyost May 1, 2026
77dbd7e
tidy loader configuration abstraction
denyost May 1, 2026
fe900e3
regenearte manifests without restartPolicy
denyost May 1, 2026
c1d7a91
tidy up comments
denyost May 1, 2026
05c7538
move webhook spec into provider and rename it to acceptPush
denyost May 1, 2026
061d4b8
regenerate manifests
denyost May 1, 2026
41655a0
remove spec from laoder config
denyost May 1, 2026
97849ae
update LoaderConfig in registry
denyost May 1, 2026
426e27a
fix: use defined variable
denyost May 4, 2026
c472f48
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost May 6, 2026
a6e449d
load spec into loader
denyost May 6, 2026
e908953
update httpconfig
denyost May 6, 2026
85278df
use httpconfig within loader
denyost May 6, 2026
6c82320
refactor
denyost May 6, 2026
deb9e90
git ignore sonar scanner
denyost May 8, 2026
b088db2
add defaulting for targetsource crd
denyost May 8, 2026
9208766
remove closeChannel and fix cleanup logic
denyost May 13, 2026
209948e
fix: resolved pointer and returns smells
denyost May 13, 2026
1a0f447
improved logging message
denyost May 13, 2026
d94c23f
improved error handling
denyost May 13, 2026
e3f18d8
refactor: ctx should flow not be stored
denyost May 13, 2026
bc1b350
refactor: resetSnapshot
denyost May 13, 2026
020be5a
refactor: context cancellation
denyost May 13, 2026
3280229
refactor: default error handling now logs errors instead of terminati…
denyost May 13, 2026
cf49f83
Merge branch 'feature/limit-target-loading' of https://github.com/gnm…
denyost May 13, 2026
39f1650
refactor: pointer missuse
denyost May 13, 2026
f1d8c31
move defaulting logic to kubebuilder:default
denyost May 13, 2026
b0c63ff
remove pointer from bool
denyost May 13, 2026
c422dff
update deepcopy
denyost May 13, 2026
abb7180
fix: pointer issue
denyost May 13, 2026
36cf9fd
add helper to read secrets
denyost May 14, 2026
4f70c43
implement basic and token authentication
denyost May 14, 2026
966cd59
support .Key for TokenSecretRef
denyost May 14, 2026
862e28d
update targetsource
denyost May 14, 2026
e6e9439
support TLS verification
denyost May 14, 2026
055bfb0
make manifest and generate
denyost May 14, 2026
1deb8cc
fix CRD issues
denyost May 14, 2026
816b04f
add support for pagination
denyost May 15, 2026
c01b199
refactor
denyost May 15, 2026
5d95c90
add support for JSONPath mapping
denyost May 15, 2026
6a83f49
add support for TargetProfile supplied by provider
denyost May 15, 2026
1e9feb6
refactor
denyost May 15, 2026
0e8ea1a
fix interfaces
denyost May 15, 2026
262760c
fix incorrect conversion between integer types
denyost May 15, 2026
9d35608
update targetsource
denyost May 14, 2026
bcc0b4f
cherry-pick 5d95c90: DiscoveredTarget type changes
mcdillson May 20, 2026
d523adb
renamed IP to Address
mcdillson May 20, 2026
2c0d7cb
disabled JWTAuthSpec validations
mcdillson May 20, 2026
77a5bd4
cherry-pick 6a83f49: added TargetProfile variable to DiscoveredTarget
mcdillson May 21, 2026
85571f4
return if pagination field is empty
denyost May 21, 2026
8cdd529
refactor
denyost May 21, 2026
f94e8d1
use itemsField independent of pagination
denyost May 21, 2026
29f201f
rename ItemsField to TargetsField
denyost May 21, 2026
4d008c2
make tls caBundle more user friendly
denyost May 21, 2026
a69abdd
increase default poll interval
denyost May 21, 2026
4342d66
refactor fetchTargetsFromHTTPEndpoint
denyost May 21, 2026
4f06a21
Merge branch 'main' into feature/type-updates
mcdillson May 21, 2026
0d744ba
added port + targetProfile handling to mapper
mcdillson May 21, 2026
5b612f2
added webhook spec for authorization
mcdillson May 21, 2026
58b77d4
removed inline credential fields
mcdillson May 21, 2026
aa023ab
use itemsField independent of pagination
denyost May 21, 2026
fc6008d
rename ItemsField to TargetsField
denyost May 21, 2026
0c1b414
changed assertion to new webhook spec
mcdillson May 21, 2026
7e06e14
moved TargetsField to ResponseMappingSpec
mcdillson May 21, 2026
421d40f
changed validation rule for url or webhook
mcdillson May 21, 2026
85c46b5
reworked kubebuilder validations
mcdillson May 21, 2026
e7a62df
generated manifests
mcdillson May 21, 2026
513e539
update targetsource CRD
denyost May 22, 2026
bc2182f
cleanup secret fetching
denyost May 22, 2026
022ed92
refactor
denyost May 22, 2026
214810c
removed old webhook statements
mcdillson May 22, 2026
89bfbf5
changed pushSpec comment
mcdillson May 22, 2026
feb3717
Merge branch 'feature/type-updates' of https://github.com/gnmic/opera…
denyost May 22, 2026
0e14751
update webhook to push
denyost May 22, 2026
8d9730f
Merge branch 'feature/type-updates' of https://github.com/gnmic/opera…
denyost May 22, 2026
51cbf8c
Merge branch 'feature/type-updates' of https://github.com/gnmic/opera…
denyost May 22, 2026
e8c298e
fix after unlean merge
denyost May 22, 2026
b62f3f5
refactor CRD
denyost May 22, 2026
b3f4bbb
Merge branch 'feature/type-updates' of https://github.com/gnmic/opera…
denyost May 22, 2026
f390eae
fixes after merge
denyost May 22, 2026
722f53c
fix ip/address after merge
denyost May 22, 2026
d5be9a8
implement secret and configmap fetcher
denyost May 22, 2026
647e2a9
replace JSONPath mapping with CEL mapping
denyost May 22, 2026
1a486b1
update targetsource base
denyost May 22, 2026
b931a02
mapping of labels via CEL
denyost May 23, 2026
c2d49cb
fix nil pointer issue
denyost May 25, 2026
a9ddacd
remove missleading old comment
denyost May 25, 2026
f4fcf78
enable CEL extensions for advanced mapping
denyost May 25, 2026
0995dfe
fix: add optional types for CEL regex
denyost May 25, 2026
5c337e6
fix CEL OptionalTypes order
denyost May 25, 2026
eecee72
add support for POST and custom headers and body
denyost May 25, 2026
8a17aad
Handle different map representations returned by CEL
denyost May 25, 2026
1316082
changed interface{} to any
denyost May 25, 2026
c4a553c
normalize CEL returns
denyost May 25, 2026
9396550
simplify normalization of maps for CEL
denyost May 27, 2026
aea803e
refactor improve readability of getLabels
denyost May 27, 2026
dfbdc54
set default http method in targetsource_types
denyost May 27, 2026
522e8bf
refactor buildHTTPClient and add guards
denyost May 27, 2026
3ef7a45
refactor timeout error
denyost May 27, 2026
01c28b4
add guards for default values
denyost May 27, 2026
3f77f8a
refactor basic auth authorization
denyost May 27, 2026
99d32a8
refactor reduce complexity of applyAuthorization
denyost May 27, 2026
6ab7731
refactor: reduce complexity of buildHTTPClient
denyost May 27, 2026
a020b2a
add unit tests
denyost May 27, 2026
bc3c2c6
fixed http integration test resources based on type changes
mcdillson May 28, 2026
69bab6b
go mod tidy
mcdillson May 29, 2026
7e11067
ran go mod tidy
mcdillson May 29, 2026
00db2cc
update default values
denyost May 29, 2026
67b546c
remove todos
denyost May 29, 2026
63504e4
remove info logging for development
denyost May 29, 2026
5152917
update pagination: add scheme for Link headers and support CEL for se…
denyost May 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,3 +34,10 @@ docs/public
docs/resources/_gen/
docs/.hugo_build.lock
test/integration/**/clab-*


# Only for development and testing purposes
# To be removed after development of targetsource
# ignored in order to not add unnecassary logging messages
lab/dev/resources/targetsources
.scannerwork/
Loading
Loading