Skip to content

Releases: microsoft/FabricBQSync

v2.0.7

07 Jan 23:13
a7fcb6b
Compare
Choose a tag to compare
Merge pull request #103 from microsoft/v3

v2.0.7

v2.0.6

07 Jan 22:24
8057248
Compare
Choose a tag to compare

Installer error fix

v2.0.5

07 Jan 16:57
d09ec12
Compare
Choose a tag to compare

v2.0.5

  • Data Maintenance (see docs)
    -- Scheduled maintenance support
    -- Lakehouse Delta Inventory
  • Integration Tests
  • Documentation Updates
  • Misc. Fixes and Updates

v2.0.4

24 Dec 20:35
cabf29d
Compare
Choose a tag to compare

Version 2 Changes

Performance improvements and new runtime optimization options (ex: approximate_source_row_counts)
Configuration updates (Reorganized/regroup for simplicity and clarity)
Unified logging framework & telemetry
Table pattern-match filters for discovery
Source predicate without source_query
Fabric-side partitioning (override BQ partitioning schema)
Column-mapping (rename and data-type conversion)
BQ Spark Connector optimization parameters (recommendations)
Improved reporting/exception handling in Installer
Automated version upgrade utility
Migration to .toml/Build Modernization
Publish to PyPi (https://pypi.org/project/FabricSync/)

Version 1.1.0

10 Dec 11:55
58f97ad
Compare
Choose a tag to compare
  • Improve performance & overall TCO with support for BigQuery Standard API for Metadata Sync operations.
  • Improved exception handling and status reporting to standard out
  • Added support for source_query tracking in sync telemetry tables

Version 1.0.0

30 Oct 18:24
ed888f7
Compare
Choose a tag to compare

Version 1.0.0 Features

  • Multi-Project/Multi-Dataset sync support
  • Table & Partition expiration based on BigQuery configuration
  • Synching support for Views & Materialized Views
  • Support for handling tables with required partition filters
  • BigQuery connector configuration for alternative billing and materialization targets
  • Ability to rename BigQuery tables and map to specific Lakehouse
  • Complex-type (STRUCT/ARRAY) handling/flattening
  • Support for Delta schema evolution for evolving BigQuery table/view schemas
  • Support for Delta table options for Lakehouse performance/optimization
  • Automatic Lakehouse table maintenance on synced tables
  • Detailed process telemetry that tracks data movement and pairs with native Delta Time Travel capabilities