Releases: microsoft/FabricBQSync
Releases · microsoft/FabricBQSync
v2.0.7
v2.0.6
Installer error fix
v2.0.5
v2.0.5
- Data Maintenance (see docs)
-- Scheduled maintenance support
-- Lakehouse Delta Inventory - Integration Tests
- Documentation Updates
- Misc. Fixes and Updates
v2.0.4
Version 2 Changes
Performance improvements and new runtime optimization options (ex: approximate_source_row_counts)
Configuration updates (Reorganized/regroup for simplicity and clarity)
Unified logging framework & telemetry
Table pattern-match filters for discovery
Source predicate without source_query
Fabric-side partitioning (override BQ partitioning schema)
Column-mapping (rename and data-type conversion)
BQ Spark Connector optimization parameters (recommendations)
Improved reporting/exception handling in Installer
Automated version upgrade utility
Migration to .toml/Build Modernization
Publish to PyPi (https://pypi.org/project/FabricSync/)
Version 1.1.0
- Improve performance & overall TCO with support for BigQuery Standard API for Metadata Sync operations.
- Improved exception handling and status reporting to standard out
- Added support for source_query tracking in sync telemetry tables
Version 1.0.0
Version 1.0.0 Features
- Multi-Project/Multi-Dataset sync support
- Table & Partition expiration based on BigQuery configuration
- Synching support for Views & Materialized Views
- Support for handling tables with required partition filters
- BigQuery connector configuration for alternative billing and materialization targets
- Ability to rename BigQuery tables and map to specific Lakehouse
- Complex-type (STRUCT/ARRAY) handling/flattening
- Support for Delta schema evolution for evolving BigQuery table/view schemas
- Support for Delta table options for Lakehouse performance/optimization
- Automatic Lakehouse table maintenance on synced tables
- Detailed process telemetry that tracks data movement and pairs with native Delta Time Travel capabilities