Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update variable declarations #59

Open
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

fivetran-avinash
Copy link
Contributor

@fivetran-avinash fivetran-avinash commented Jan 3, 2025

PR Overview

This PR will address the following Issue/Feature: Internal Height ticket

This PR will result in the following new package version: 0.11.1

Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:

Macro Updates

  • Introduced a local version of the fill_pass_through_columns macro that directly calls the variables within our staging models. This removes the existing string-to-variable conversion and leads to cleaner parsing.
  • This new macro is applied to all staging models with passthrough column functionality, and replaces the existing fill_pass_through_columns macro.
    • stg_netsuite and stg_netsuite2 models impacted include: accounts, classes, consolidated_exchange_rates, customers, departments, items, locations, subsidiaries, transaction_lines, transactions, and vendors.
  • Similar changes are being made on a simultaneous release to the persist_pass_through_columns macro in the dbt_netsuite package. See the release notes for more details.
  • The process for adding passthrough columns remains unchanged. Consult the README for more details.

PR Checklist

Basic Validation

Please acknowledge that you have successfully performed the following commands locally:

  • dbt run –full-refresh && dbt test
  • dbt run (if incremental models are present) && dbt test

Before marking this PR as "ready for review" the following have been applied:

  • The appropriate issue has been linked, tagged, and properly assigned
  • All necessary documentation and version upgrades have been applied
  • docs were regenerated (unless this PR does not include any code or yml updates)
  • BuildKite integration tests are passing
  • Detailed validation steps have been provided below

Detailed Validation

Please share any and all of your validation steps:

Ran on multiple variations of passthrough columns (with name, with alias, with multiple passthrough columns, with no passthrough columns).

If you had to summarize this PR in an emoji, which would it be?

🚲

@fivetran-avinash fivetran-avinash self-assigned this Jan 6, 2025
@fivetran-avinash fivetran-avinash marked this pull request as ready for review January 6, 2025 21:50
Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @fivetran-avinash a few questions and comments before approval.

[PR #59](https://github.com/fivetran/dbt_netsuite_source/pull/59) includes the following updates:

## Macro Updates
- Introduced a local version of the `fill_pass_through_columns` macro that directly calls the variables within our staging models. This removes the existing string-to-variable conversion and leads to cleaner parsing.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also include a note here that this should result in no changes to the macro functionality and no changes on the user end are required.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added.

@@ -41,7 +41,7 @@ final as (
_fivetran_deleted

--The below macro adds the fields defined within your accounts_pass_through_columns variable into the staging model
{{ fivetran_utils.fill_pass_through_columns('accounts_pass_through_columns') }}
{{ netsuite_source.fill_pass_through_columns(var('accounts_pass_through_columns')) }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we also add a default value for these just in case?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a default [] value to each of the new macro calls.

Copy link
Contributor Author

@fivetran-avinash fivetran-avinash left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-joemarkiewicz This is ready for re-review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants