Use the dbt Cloud integration
By using the dbt Cloud integration, you can create and run dbt transformations during syncs in Airbyte Cloud. This allows you to transform raw data into a format that is suitable for analysis and reporting, including cleaning and enriching the data.
Normalizing data may cause an increase in your destination's compute cost. This cost will vary depending on the amount of data that is normalized and is not related to Airbyte credit usage.
Step 1: Generate a service token
Generate a service token for your dbt Cloud transformation.
- To use the dbt Cloud integration, you must use a paid version of dbt Cloud.
- The service token must have Member, Job Admin, or Account Admin permissions.
Step 2: Set up the dbt Cloud integration in Airbyte Cloud
To set up the dbt Cloud integration in Airbyte Cloud:
In the Airbyte UI, click Settings.
Click dbt Cloud integration.
Paste the service token from Step 1 and click Save changes.
Click Connections and select the connection you want to add a dbt transformation to.
Go to the Transformation tab and click + Add transformation.
Select the transformation from the dropdown and click Save changes. The transformation will run during the subsequent syncs until you remove it.
You can have multiple transformations per connection.
- To remove a transformation, click X on the transformation and click Save changes.