Jobs in dbt Cloud
These are the available job types in dbt Cloud:
- Deploy jobs — To create and set up triggers for building production data assets
- Continuous integration (CI) jobs — To create and set up triggers for checking code changes
- Merge jobs — To create and set up triggers for merged pull requests
Below is a comparison table that describes the behaviors of the different job types:
Deploy jobs | CI jobs | Merge jobs | |
---|---|---|---|
Purpose | Builds production data assets. | Builds and tests new code before merging changes into production. | Build merged changes into production or update state for deferral. |
Trigger types | Triggered by a schedule or by API. | Triggered by a commit to a PR or by API. | Triggered by a successful merge into the environment's branch or by API. |
Destination | Builds into a production database and schema. | Builds into a staging database and ephemeral schema, lived for the lifetime of the PR. | Builds into a production database and schema. |
Execution mode | Runs execute sequentially, so as to not have collisions on the underlying DAG. | Runs execute in parallel to promote team velocity. | Runs execute sequentially, so as to not have collisions on the underlying DAG. |
Efficiency run savings | Detects over-scheduled jobs and cancels unnecessary runs to avoid queue clog. | Cancels existing runs when a newer commit is pushed to avoid redundant work. | N/A |
State comparison | Only sometimes needs to detect state. | Almost always needs to compare state against the production environment to build on modified code and its dependents. | Almost always needs to compare state against the production environment to build on modified code and its dependents. |
Job run duration | Limit is 24 hours. | Limit is 24 hours. | Limit is 24 hours. |
0