Skip to content

Add GlueCatalogBatchDeletePartitionOperator#66721

Open
john-jac wants to merge 1 commit into
apache:mainfrom
john-jac:add-glue-catalog-batch-delete-partition
Open

Add GlueCatalogBatchDeletePartitionOperator#66721
john-jac wants to merge 1 commit into
apache:mainfrom
john-jac:add-glue-catalog-batch-delete-partition

Conversation

@john-jac
Copy link
Copy Markdown
Contributor

Adds GlueCatalogBatchDeletePartitionOperator to delete one or more partitions from an AWS Glue Data Catalog table.

  • Operator returns error list for partial failures
  • Unit tests including error-response scenario
  • System test with markers
  • Docs with exampleinclude

Comment on lines +398 to +400
errors = response.get("Errors", [])
if errors:
self.log.warning("Errors deleting partitions: %s", errors)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In case of errors the operator would fail? I am also surprised, what kind of error can be returned? Usually, if there is an error, boto3 returns an exception. Here, the call would be successfully but would return a list of errors?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants