Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Onboarding with multiple partition columns errors out. #125

Open
harsha-pasala opened this issue Dec 2, 2024 · 0 comments
Open

Onboarding with multiple partition columns errors out. #125

harsha-pasala opened this issue Dec 2, 2024 · 0 comments
Assignees
@harsha-pasala
Labels
bug Something isn't working
Milestone
v0.0.9

Comments

@harsha-pasala
Copy link

Currently, adding more than one partition column to the bronze_partition_columns in the onboarding file would onboard this as a single element array with all the partition columns concatenated as comma separated string, which causes the pipeline to fail.

For instance, adding email and firstname as partition columns would register successfully in the spec table but the DLT pipeline fails to infer the partition clause, causing it to fail:

image

image

image
@ravi-databricks ravi-databricks added the bug Something isn't working label Dec 2, 2024
@ravi-databricks ravi-databricks added this to the v0.0.9 milestone Dec 2, 2024
harsha-pasala added a commit to harsha-pasala/dlt-meta that referenced this issue Dec 4, 2024
@harsha-pasala
Fix Issue databrickslabs#125: Support for multiple partition columns …
4dac68d 
…in bronze, bronze quarantine, and silver layers.
@harsha-pasala harsha-pasala mentioned this issue Dec 4, 2024
Merged
ravi-databricks added a commit that referenced this issue Dec 4, 2024
@ravi-databricks
Merge pull request #129 from harsha-pasala/issue_125
82e5978 
Fix Issue #125: Support for multiple partition columns in bronze, bronze quarantine, and silver layers.
harsha-pasala added a commit to harsha-pasala/dlt-meta that referenced this issue Dec 5, 2024
@harsha-pasala
Issue databrickslabs#125: Refactor and fix linting issues.
9b7fca4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@harsha-pasala harsha-pasala

Labels
bug Something isn't working
Projects
None yet
Milestone
v0.0.9
Development

When branches are created from issues, their pull requests are automatically linked.

issue_125 databrickslabs/dlt-meta
2 participants
@ravi-databricks @harsha-pasala