v0.14.0 dbt_shopify_source

PR #93 includes the following changes:

Breaking Changes

• Updated for connector changes released on January 6, 2025. See the release notes for more details. Added the following columns to the stg_shopify__* staging tables:

  • inventory_item:
    • duplicate_sku_count
    • harmonized_system_code
    • inventory_history_url
    • legacy_resource_id
    • measurement_id
    • measurement_weight_value
    • measurement_weight_unit
    • is_tracked_editable_locked
    • tracked_editable_reason
    • unit_cost_amount
    • unit_cost_currency_code
  • inventory_level:
    • inventory_level_id
    • can_deactivate
    • created_at
    • deactivation_alert
  • product_variant:
    • is_available_for_sale
    • display_name
    • legacy_resource_id
    • has_components_required
    • sellable_online_quantity
  • product_image:
    • media_id
    • status
    • url

• For backward compatibility, the following columns were coalesced to combine values from the old column name with the new column name, with the resulting column retaining the new name:

  • inventory_item:
    • The deprecated cost column is coalesced with the new column unit_cost_amount as unit_cost_amount.
  • product_image:
    • The deprecated src column is coalesced with the new column url as url.

• Marked the following columns as deprecated in the documentation. These columns will return null values following the connector update, and customers should expect this behavior until the columns are fully removed in a future release.

  • inventory_level:
    • available_quantity
  • product_variant:
    • fulfillment_service
    • grams
    • inventory_management
    • requires_shipping
    • weight
    • weight_unit
    • option_*
  • product_image:
    • position
    • created_at
    • updated_at
    • variant_ids

Under the Hood

• Updated shopify_*_data seed data and get_*_columns macros to include new columns for the following tables:
  • inventory_item
  • inventory_level
  • product_image
  • product_variant
• Standardized boolean casting by updating get_*_columns to use dbt.type_boolean() for consistency.

Full Changelog: v0.13.0...v0.14.0

v0.13.0 dbt_shopify_source

PR #91 includes the following changes:

Breaking Changes

• Adds enable/disable config for the metadata staging model using the shopify_using_metafield variable (default true).
• Adds enable/disable config for the abandoned_checkout staging models using the shopify_using_abandoned_checkout variable (default true):
  • stg_shopify__abandoned_checkout
  • stg_shopify__abandoned_checkout_discount_code
  • stg_shopify__abandoned_checkout_shipping_line
• For more information on how to enable/disable these tables, refer to the README. This will be a breaking change if you choose to disable these tables.

Under the Hood

• Updates the index calculation in stg_shopify__abandoned_checkout_discount_code by removing the conditional logic for null scenarios now that a disable config has been added to the model.

Full Changelog: v0.12.1...v0.13.0

v0.12.1 dbt_shopify_source

🪲 Bug Fixes 🪛

• Added support for a new delayed fulfillment event status from Shopify. delayed has been added to the accepted_values test on stg_shopify__fulfillment_event (PR #84).
• Added product_id to the unique combination_of_columns test for the stg_shopify__product_image model (PR #86).

Contributors

• @ryan-brainforge (PR #86)
• @shreveasaurus (PR #84)

Full Changelog: v0.12.0...v0.12.1

v0.12.0 dbt_shopify_source

PR #79 introduces the following changes:

🚨 Breaking Changes 🚨

• To reduce storage, updated default materialization of staging models from tables to views.
  • Note that stg_shopify__metafield will still be materialized as a table for downstream use.

⚠️ Running a --full-refresh will be required if you have previously run these staging models as tables and get the following error:

Trying to create view <model path> but it currently exists as a table. Either drop <model path> manually, or run dbt with `--full-refresh` and dbt will drop it for you.

Under the Hood

• Updated the maintainer PR template to the current format.
• Added integration testing pipeline for Databricks SQL Warehouse.

PR #81 introduces the following changes:

🪲 Bug Fixes 🪛

• Removed the index filter in stg_shopify__order_discount_code, as we were erroneously filtering out multiple discounts for an order since index is meant to pair with order_id as the unique identifier for this source.
• Added index as a field in stg_shopify__order_discount_code, as it is part of the primary key.

📝 Documentation Updates 📝

• Added index documentation to our src_shopify.yml and stg_shopify.yml.
• Updated the unique_combination_of_columns test on stg_shopify__order_discount_code to correctly check on index with order_id and source_relation rather than code.

🔧 Under the Hood 🔩

• Updated the pull request templates.

Full Changelog: v0.11.0...v0.12.0

v0.11.0 dbt_shopify_source

PR #78 introduces the following changes:

🚨 Breaking Changes 🚨

• Added source_relation to the partition_by clauses that determine the is_most_recent_record in the stg_shopify__metafield table.
• Added source_relation to the partition_by clauses that determines the index in the stg_shopify__abandoned_checkout_discount_code table.
• If the user is leveraging the union feature, this could change data values.

🐛 Bug Fixes 🪛

• Updated partition logic in stg_shopify__metafield and stg_shopify__abandoned_checkout_discount_code to account for null table Redshift errors when handling null field cases.

🚘 Under The Hood 🚘

• Included auto-releaser GitHub Actions workflow to automate future releases.
• Added additional casting in seed dependencies for above models integration_tests/dbt_project.yml to ensure local testing passed on null cases.

Full Changelog: v0.10.0...v0.11.0

v0.10.0 dbt_shopify_source

🚨 Breaking Changes 🚨

• This release will be a breaking change due to the removal of below dependencies.

Dependency Updates

• Removes the dependency on dbt-expectations and updates the dbt-date dependency to the latest version. (PR #75)

Full Changelog: v0.9.0...v0.10.0

v0.9.0 dbt_shopify_source

Breaking Changes

• In June 2023 the Shopify connector received an update which upgraded the connector to be compatible with the new 2023-04 Shopify API. As a result, the following fields have been removed as they were deprecated in the API upgrade: (PR #70)

model	field removed
stg_shopify__customer	lifetime_duration
stg_shopify__order_line	fulfillment_service
stg_shopify__order_line	destination_location_* fields
stg_shopify__order_line	origin_location_* fields
stg_shopify__order	total_price_usd
stg_shopify__order	processing_method

Under the Hood

• Removed databricks from the shopify_database configuration in the src_shopify.yml to allow Databricks Unity catalog users to define a unity Catalog as a database. (PR #70)

Documentation Updates

• Documentation provided in the README for how to connect sources when leveraging the union schema/database feature. (PR #70)

Full Changelog: v0.8.3...v0.9.0

v0.8.3 dbt_shopify_source

Happy World Refrigeration Day 🧊 ! Did you know Albert Einstein co-invented a refrigerator?

Hopefully you can track more successfully refrigerator orders to your company with the latest updates to the dbt_shopify_source package.

Bug Fixes 🐛 🪛

PR #69 includes the following fixes:

• Lower casing metafield_reference field in stg_shopify__metafield to fix metafield table breakages upstream when the key field has different casing for otherwise identical strings.
• Lower casing owner_resource field in stg_shopify__metafield to ensure identical value fields with different casing are then correctly pivoted together upstream in the shopify transformation package get_metafields macro.

Under the Hood:

• Incorporated the new fivetran_utils.drop_schemas_automation macro into the end of each Buildkite integration test job. (PR #65)
• Updated the pull request templates. (PR #65)

Contributors

• @ZCrookston & @FridayPush (Issue #64)

v0.8.2 dbt_shopify_source

Bug Fixes

PR #59 introduces the following changes:

• The fivetan_utils.union_data macro has been expanded to handle checking if a source table exists. Previously in the Shopify source package, this check happened outside of the macro and depended on the user having a defined shopify source. If the package anticipates a table that you do not have in any schema or database, it will return a completely empty table (ie limit 0) that will work seamlessly with downstream transformations.
  • A compilation message will be raised when a staging model is completely empty. This compiler warning can be turned off by the end user by setting the fivetran__remove_empty_table_warnings variable to True (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).
• A uniqueness test has been placed on the order_line_id, index, and source_relation columns in stg_shopify__tax_line, as it was previously missing a uniqueness test.

Contributors

• @dfagnan (Issue #57)

v0.8.1...v0.8.2

v0.8.1 dbt_shopify_source

Happy Thursday!

Bug Fixes

• Addresses Issue #54, in which the deprecated discount_id field was used instead of code in stg_shopify__abandoned_checkout_discount__code (PR #56).

Full Changelog: v0.8.0...v0.8.1