From b7944bfa72632145fcff360f65220a76b41a8507 Mon Sep 17 00:00:00 2001 From: Marcel Rebro Date: Tue, 28 Jul 2026 11:33:19 +0200 Subject: [PATCH 1/4] docs: enrich Airbyte and GitHub integration pages Salvage still-useful content from two help-center articles being retired: - Airbyte: add a section on triggering an Airbyte sync automatically from an Apify webhook when an Actor run succeeds. - GitHub: clarify that a linked Actor is rebuilt manually by default, and the push webhook is what makes rebuilds automatic. Co-Authored-By: Claude Opus 4.8 (1M context) --- .../integrations/data-and-storage/airbyte.md | 38 +++++++++++++++++++ .../integrations/programming/github.md | 2 +- 2 files changed, 39 insertions(+), 1 deletion(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index b9598353a1..52b2e3a0b1 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -39,3 +39,41 @@ To find your Apify API token, you need to navigate to the **Settings** tab and s And that's it! You now have Apify datasets set up as a Source, and you can use Airbyte to transfer your datasets to one of the available destinations. To learn more about how to setup a Connection, visit [Airbyte's documentation](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) + +## Trigger a sync automatically after an Actor run + +Instead of syncing on a schedule, you can start an Airbyte sync as soon as an Actor run finishes. Use an Apify [webhook](/integrations/webhooks) to call the Airbyte API and refresh the connection whenever new data is scraped. + +### Prerequisites + +- An Airbyte connection that uses your Apify Dataset as a source. +- Airbyte API access: an access token and the **connection ID** (you can copy it from the connection's URL in Airbyte). The exact endpoint and authentication depend on whether you use Airbyte Cloud or a self-managed instance, so check the [Airbyte API reference](https://reference.airbyte.com/reference/createjob) for the current details. + +### Set up the webhook + +1. In [Apify Console](https://console.apify.com), open the Actor and go to the **Integrations** tab. +1. Under **Connect with Apify**, click **HTTP webhook**. +1. Configure the webhook: + - **Event types**: select `Run succeeded` (`ACTOR.RUN.SUCCEEDED`). + - **URL**: the Airbyte API endpoint that starts a sync, for example `https://api.airbyte.com/v1/jobs`. +1. Set the **Headers template** to authenticate with your Airbyte token: + + ```json + { + "Authorization": "Bearer YOUR_AIRBYTE_TOKEN", + "Content-Type": "application/json" + } + ``` + +1. Set the **Payload template** to start a sync for your connection: + + ```json + { + "connectionId": "YOUR_CONNECTION_ID", + "jobType": "sync" + } + ``` + +1. Click **Save**, then **Test** to confirm that Airbyte starts a sync. + +Every successful Actor run now triggers Airbyte to move the freshly scraped data to your destination, with no manual step in between. diff --git a/sources/platform/integrations/programming/github.md b/sources/platform/integrations/programming/github.md index 90b3d62a01..8daf566ff8 100644 --- a/sources/platform/integrations/programming/github.md +++ b/sources/platform/integrations/programming/github.md @@ -50,7 +50,7 @@ For private repositories, configure a [deployment key](/actors/development/deplo ## Build automatically on every push -After you link an Actor to a GitHub repository, add a webhook in GitHub to trigger a new build on every push: +By default, a linked Actor is rebuilt only when you trigger a build manually. To rebuild it automatically whenever you push to the repository, add a webhook in GitHub that calls the Actor's **Build Actor** API endpoint: 1. In Apify Console, open the Actor's **API** dropdown and select **API endpoints**. Copy the **Build Actor** endpoint URL. It has this format: From c3584e9692995f5e6bb415609b4dc598ca25bbeb Mon Sep 17 00:00:00 2001 From: Marcel Rebro Date: Tue, 28 Jul 2026 11:38:13 +0200 Subject: [PATCH 2/4] docs: apply review-docs fixes to Integrations enrichments Fix markdownlint bullet style, list punctuation, and passive voice flagged by the review-docs standards checks. Co-Authored-By: Claude Opus 4.8 (1M context) --- sources/platform/integrations/data-and-storage/airbyte.md | 8 ++++---- sources/platform/integrations/programming/github.md | 2 +- 2 files changed, 5 insertions(+), 5 deletions(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index 52b2e3a0b1..d6fc5d8df2 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -46,16 +46,16 @@ Instead of syncing on a schedule, you can start an Airbyte sync as soon as an Ac ### Prerequisites -- An Airbyte connection that uses your Apify Dataset as a source. -- Airbyte API access: an access token and the **connection ID** (you can copy it from the connection's URL in Airbyte). The exact endpoint and authentication depend on whether you use Airbyte Cloud or a self-managed instance, so check the [Airbyte API reference](https://reference.airbyte.com/reference/createjob) for the current details. +* An Airbyte connection that uses your Apify Dataset as a source. +* Airbyte API access: an access token and the **connection ID** (you can copy it from the connection's URL in Airbyte). The exact endpoint and authentication depend on whether you use Airbyte Cloud or a self-managed instance, so check the [Airbyte API reference](https://reference.airbyte.com/reference/createjob) for the current details. ### Set up the webhook 1. In [Apify Console](https://console.apify.com), open the Actor and go to the **Integrations** tab. 1. Under **Connect with Apify**, click **HTTP webhook**. 1. Configure the webhook: - - **Event types**: select `Run succeeded` (`ACTOR.RUN.SUCCEEDED`). - - **URL**: the Airbyte API endpoint that starts a sync, for example `https://api.airbyte.com/v1/jobs`. + * **Event types**: `Run succeeded` (`ACTOR.RUN.SUCCEEDED`) + * **URL**: the Airbyte API endpoint that starts a sync, for example `https://api.airbyte.com/v1/jobs` 1. Set the **Headers template** to authenticate with your Airbyte token: ```json diff --git a/sources/platform/integrations/programming/github.md b/sources/platform/integrations/programming/github.md index 8daf566ff8..6007a0ab42 100644 --- a/sources/platform/integrations/programming/github.md +++ b/sources/platform/integrations/programming/github.md @@ -50,7 +50,7 @@ For private repositories, configure a [deployment key](/actors/development/deplo ## Build automatically on every push -By default, a linked Actor is rebuilt only when you trigger a build manually. To rebuild it automatically whenever you push to the repository, add a webhook in GitHub that calls the Actor's **Build Actor** API endpoint: +By default, a linked Actor rebuilds only when you trigger a build manually. To rebuild it automatically whenever you push to the repository, add a webhook in GitHub that calls the Actor's **Build Actor** API endpoint: 1. In Apify Console, open the Actor's **API** dropdown and select **API endpoints**. Copy the **Build Actor** endpoint URL. It has this format: From 1e3340c90da8ffbae2d403674521743ce84515f1 Mon Sep 17 00:00:00 2001 From: Marcel Rebro Date: Tue, 28 Jul 2026 11:47:17 +0200 Subject: [PATCH 3/4] docs: restructure Airbyte integration page Move requirements into a page-level Prerequisites section near the top, reorder into a source -> connection -> auto-sync flow, and fold the auto-sync requirements into a lead-in so prerequisites no longer sit below the whole setup. Tighten prose and fix terminology. Co-Authored-By: Claude Opus 4.8 (1M context) --- .../integrations/data-and-storage/airbyte.md | 41 +++++++++---------- 1 file changed, 19 insertions(+), 22 deletions(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index d6fc5d8df2..196fb0b4fb 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -7,49 +7,46 @@ slug: /integrations/airbyte import ThirdPartyDisclaimer from '@site/sources/_partials/_third-party-integration.mdx'; -Airbyte is an open-source data integration platform that allows you to move your data between different sources and destinations using pre-built connectors, which are maintained either by Airbyte itself or by its community. -One of these connectors is the Apify Dataset connector, which makes it simple to move data from Apify datasets to any supported destination. +[Airbyte](https://airbyte.com) is an open-source data integration platform that moves data between sources and destinations using pre-built connectors, maintained by Airbyte or its community. The Apify Dataset connector lets you move data from your Apify datasets to any Airbyte-supported destination. -To use Airbyte's Apify connector you need to: - -* Have an Apify account. -* Have an Airbyte account. +This guide shows you how to set up Apify datasets as a source in Airbyte and, optionally, trigger a sync automatically after every Actor run. -## Set up Apify connector in Airbyte +## Prerequisites + +* An [Apify account](https://console.apify.com). +* An [Airbyte account](https://airbyte.com). + +## Set up the Apify connector in Airbyte -Once you have all the necessary accounts set up, you need to set up the Apify connector. -To do so, you will need to navigate to **Sources** tab in Airbyte and select **Apify Dataset** +In Airbyte, open the **Sources** tab and select **Apify Dataset**. ![Airbyte sources tab](../images/airbyte-sources.png) -You will need to provide a **dataset ID** and your Apify API Token. You can find both of these in [Apify Console](https://console.apify.com). +Enter your **dataset ID** and **Apify API token**. You can find both in [Apify Console](https://console.apify.com). ![Airbyte source setup](../images/airbyte-source-setup.png) -To find your **dataset ID**, you need to navigate to the **Storage** tab in Apify Console. Copy it and paste it in Airbyte. +To find your **dataset ID**, open the **Storage** tab in Apify Console and copy the ID of the dataset you want to use. -![Datasets in app](../images/datasets-app.png) +![Datasets in Apify Console](../images/datasets-app.png) -To find your Apify API token, you need to navigate to the **Settings** tab and select **API & Integrations**. Copy it and paste it in the relevant field in Airbyte. +To find your **Apify API token**, open **Settings > API & Integrations** in Apify Console and copy the token. -![Integrations token](../images/apify-integrations-token.png) +![API & Integrations token in Apify Console](../images/apify-integrations-token.png) -And that's it! You now have Apify datasets set up as a Source, and you can use Airbyte to transfer your datasets to one of the available destinations. +Your Apify datasets are now available as a source. You can use Airbyte to transfer them to any supported destination. -To learn more about how to setup a Connection, visit [Airbyte's documentation](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) +## Set up a connection + +A connection links your Apify Dataset source to a destination and controls how and when data syncs. To create one, follow [Set up a connection](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) in the Airbyte documentation. ## Trigger a sync automatically after an Actor run Instead of syncing on a schedule, you can start an Airbyte sync as soon as an Actor run finishes. Use an Apify [webhook](/integrations/webhooks) to call the Airbyte API and refresh the connection whenever new data is scraped. -### Prerequisites - -* An Airbyte connection that uses your Apify Dataset as a source. -* Airbyte API access: an access token and the **connection ID** (you can copy it from the connection's URL in Airbyte). The exact endpoint and authentication depend on whether you use Airbyte Cloud or a self-managed instance, so check the [Airbyte API reference](https://reference.airbyte.com/reference/createjob) for the current details. - -### Set up the webhook +To set this up, you need an Airbyte connection that uses your Apify Dataset as a source, plus Airbyte API access: an access token and the **connection ID** (copy it from the connection's URL in Airbyte). The exact endpoint and authentication depend on whether you use Airbyte Cloud or a self-managed instance, so check the [Airbyte API reference](https://reference.airbyte.com/reference/createjob) for the current details. 1. In [Apify Console](https://console.apify.com), open the Actor and go to the **Integrations** tab. 1. Under **Connect with Apify**, click **HTTP webhook**. From e1911d229138f1f0be16a45d378460f98b577e85 Mon Sep 17 00:00:00 2001 From: Marcel Rebro Date: Tue, 28 Jul 2026 11:56:33 +0200 Subject: [PATCH 4/4] docs: clarify Airbyte source vs connection headings Rename the two setup headings so they describe distinct steps: setting up the Apify Dataset source, then connecting that source to a destination. Add a short explainer of what an Airbyte connection is. Co-Authored-By: Claude Opus 4.8 (1M context) --- sources/platform/integrations/data-and-storage/airbyte.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/sources/platform/integrations/data-and-storage/airbyte.md b/sources/platform/integrations/data-and-storage/airbyte.md index 196fb0b4fb..07450e1720 100644 --- a/sources/platform/integrations/data-and-storage/airbyte.md +++ b/sources/platform/integrations/data-and-storage/airbyte.md @@ -18,7 +18,7 @@ This guide shows you how to set up Apify datasets as a source in Airbyte and, op * An [Apify account](https://console.apify.com). * An [Airbyte account](https://airbyte.com). -## Set up the Apify connector in Airbyte +## Set up the Apify Dataset source in Airbyte In Airbyte, open the **Sources** tab and select **Apify Dataset**. @@ -36,11 +36,11 @@ To find your **Apify API token**, open **Settings > API & Integrations** in Apif ![API & Integrations token in Apify Console](../images/apify-integrations-token.png) -Your Apify datasets are now available as a source. You can use Airbyte to transfer them to any supported destination. +Your Apify dataset is now available as a source. Next, connect it to a destination so Airbyte knows where to move the data. -## Set up a connection +## Connect the source to a destination -A connection links your Apify Dataset source to a destination and controls how and when data syncs. To create one, follow [Set up a connection](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) in the Airbyte documentation. +Setting up the source only tells Airbyte where your data comes from. To actually move it, create a _connection_: an Airbyte pipeline that links your Apify Dataset source to a destination and controls how and when the data syncs. To set one up, follow [Set up a connection](https://docs.airbyte.com/using-airbyte/getting-started/set-up-a-connection) in the Airbyte documentation. ## Trigger a sync automatically after an Actor run