Changelog

What's Changed

Minor features

• Add SCD2 GroupBy helper CTRL-206 by @nikhil-zlai in #1869

Bug fixes

• [codex] Add GroupBy upload status endpoint by @nikhil-zlai in #1860
• refactor(cli): centralize shared root options by @tchow-zlai in #1875

Full Changelog: v1.12.2...v1.13.0

What's Changed

Bug fixes

• Docs cleanup by @sean-zlai in #1845
• Per-environment compile via teams..py by @david-zlai in #1858
• Wire Crucible Spark and Flink UI links by @tchow-zlai in #1859
• Fix nested JoinSource mutation dependencies by @nikhil-zlai in #1867
• fix(spark): stabilize GroupByTest "group by from chaining gb" by @bagipriyank in #1863
• Bump commons-configuration2 to 2.15.0 to clear grype GHSA-337m-mw94-2v6g by @kumar-zlai in #1868
• cloud_aws: bundle patched delta-spark + delta-storage into the assembly by @kumar-zlai in #1865
• docs: Add integration testing section to devnotes by @tchow-zlai in #1836

Full Changelog: v1.12.1...v1.12.2

What's Changed

Bug fixes

• Make schedule-all schedule all confs and not just the diffs by @david-zlai in #1831
• [crucible] Render Spark UI URL via gateway /spark/{ns}/{id} rewrite by @tchow-zlai in #1852
• fix(flink-eks): pin Flink and aws-cli images by digest/version by @kumar-zlai in #1856
• Enable JoinSource chaining across joins by @varant-zlai in #1853

Full Changelog: v1.11.0...v1.12.1

What's Changed

Bug fixes

• Make schedule-all schedule all confs and not just the diffs by @david-zlai in #1831
• [crucible] Render Spark UI URL via gateway /spark/{ns}/{id} rewrite by @tchow-zlai in #1852
• fix(flink-eks): pin Flink and aws-cli images by digest/version by @kumar-zlai in #1856
• Enable JoinSource chaining across joins by @varant-zlai in #1853

Full Changelog: v1.11.0...v1.12.0

What's Changed

Minor features

• Add groupBy schema fetcher API by @nikhil-zlai in #1835
• [crucible][azure] Enable Chronon runs on Azure Crucible by @nikhil-zlai in #1810
• feat(stats): drift fetching by @cristian-zlai in #1843
• Add generic compare-tables CLI subcommand by @nikhil-zlai in #1538
• feat(cli): zipline compare-tables for adhoc table comparison via EMR Serverless by @kumar-zlai in #1846

Bug fixes

• feat(flink): Support HTTPS + HTTP Basic Auth for Schema Registry in SchemaRegistrySerDe by @DucNgn in #1829
• Add Hub backfill concurrency option by @nikhil-zlai in #1839
• Use delta log/snapshot explicitly to pull partition off stats if available by @BenMagyar in #1830
• Merge into fails on on delta tables with deletion vectors by @BenMagyar in #1832
• patch(emr-serverless): add custom emr image with swappable delta-spark jar by @kumar-zlai in #1838
• patch(emr-serverless): bundle patched delta-spark jar + bootstrap script by @kumar-zlai in #1847
• patch(cloud_aws): refresh UC jars off upstream + add client/hadoop bundles by @kumar-zlai in #1848
• Use select in fetcher path to support transformed keys by @BenMagyar in #1809

New Contributors

• @DucNgn made their first contribution in #1829

Full Changelog: v1.10.7...v1.11.0

What's Changed

Bug fixes

• Show batch/online mode labels in clear-downstream CLI by @kumar-zlai in #1816
• Remove KvPartitions and KvPartitionsStore CTRL-165 by @kumar-zlai in #1799
• Improve CI caching for Mill builds by @nikhil-zlai in #1840
• Only compute null rate for ts/ds cols by @BenMagyar in #1841
• Alt: dedup imported configs by id() instead of AST by @tchow-zlai in #1821

Full Changelog: v1.10.6...v1.10.7

What's Changed

Bug fixes

• Make row_ids optional by @david-zlai in #1820
• docs: Document EVAL_URL teams.py prerequisite for zipline hub eval by @tchow-zlai in #1798
• Add msk iam jar + streaming GB example by @piyush-zlai in #1813
• fix(metrics): flush OTel exporter after GroupByUpload null-count gauges by @tchow-zlai in #1774

Full Changelog: v1.10.5...v1.10.6

What's Changed

Minor features

• Add support for Dynamo globally replicated tables by @piyush-zlai in #1807

Bug fixes

• feat: specify nodeSelector when triggering Flink apps on EKS by @felipesai in #1790
• fix: vertx metrics to otlp and resource attributes by @sai-bojja-ck in #1815
• Make azure auth token acquire a warning message if unable by @david-zlai in #1822
• Register Spark StorageStatus with Kryo by @nikhil-zlai in #1825
• feat: Add Flink Application Mode deployment for Dataproc by @JoeTime17 in #1782

Other changes

• Revert "chore(spark): silence Inbox NotSerializableException noise from StorageStatus" by @nikhil-zlai in #1828

New Contributors

• @sai-bojja-ck made their first contribution in #1815

Full Changelog: v1.10.4...v1.10.5

What's Changed

Minor features

• CLI: Add zipline config by @sean-zlai in #1814

Bug fixes

• feat: allow jvm to persist after Driver finishes by @cristian-zlai in #1803
• chore(spark): silence Inbox NotSerializableException noise from StorageStatus by @tchow-zlai in #1811
• test: integration tests for eval by @cristian-zlai in #1789
• refactor: support python 3.10 by @cristian-zlai in #1812
• Revert "Allow mixed types to be compiled in different folder types" by @david-zlai in #1818

Full Changelog: v1.10.3...v1.10.4

What's Changed

Bug fixes

• Allow mixed types to be compiled in different folder types by @david-zlai in #1801

Full Changelog: v1.10.2...v1.10.3