Changelog

What's Changed

Bug fixes

• handle ts projection and filter in flink by @BenMagyar in #2039
• Push readiness checks onto the driver for Joins by @BenMagyar in #2020
• reduce memory overhead for driver readiness checks by @BenMagyar in #2042
• Fix hourly GroupBy online (Ion) upload for sub-daily partitions by @nikhil-zlai in #2041
• avoid sharing logging codecs across threads by @BenMagyar in #2040
• Bound sensor retries to one partition interval; trim sensor resources by @nikhil-zlai in #2044
• Route NVMe canary output through Polaris by @tchow-zlai in #2048
• Normalize Iceberg timestamp partitions for readiness by @tchow-zlai in #2045
• Flink K8s submitter job crash / restart fixes by @piyush-zlai in #2047
• fix: load step details for Flink cleanup by @tchow-zlai in #2050

Full Changelog: v1.18.0...v1.18.1

What's Changed

Minor features

• Flink URLs Through Hub by @chewy-zlai in #1986

Bug fixes

• Don't collapse a missing GroupByServingInfo into an opaque 500 by @nikhil-zlai in #2012
• cast date onto grid for cli commands by @BenMagyar in #2014
• We only need to read stats for the partition we are writing against by @BenMagyar in #1937
• Namespace should be substituted in key filter by @BenMagyar in #2016
• mixGridtoken produce unsafe sem hash by @BenMagyar in #2027
• feat: make fetcher thread pool configurable and add KV read timeout by @cceasy in #1874
• Bump logback to 1.5.38 to fix GHSA-jhq6-gfmj-v8fx grype failures by @tchow-zlai in #2015
• Add NVMe stress integration test by @tchow-zlai in #2035
• Defer join key compilation failures until derivation by @nikhil-zlai in #2030
• Fix stale version stamps in released jar manifests by @nikhil-zlai in #2007

Full Changelog: v1.17.7...v1.18.0

What's Changed

Bug fixes

• Add aws_databricks join + wire up aws canary adhoc CI tests by @piyush-zlai in #2004
• Fix sparse readiness partition boundary by @tchow-zlai in #2009
• Handle Dataproc cluster DELETING/UNRECOGNIZED/ERROR_DUE_TO_UPDATE states by @david-zlai in #2010

Full Changelog: v1.17.4...v1.17.7

What's Changed

Bug fixes

• Add aws_databricks join + wire up aws canary adhoc CI tests by @piyush-zlai in #2004
• Fix sparse readiness partition boundary by @tchow-zlai in #2009
• Handle Dataproc cluster DELETING/UNRECOGNIZED/ERROR_DUE_TO_UPDATE states by @david-zlai in #2010

Full Changelog: v1.17.4...v1.17.6

What's Changed

Bug fixes

• Add aws_databricks join + wire up aws canary adhoc CI tests by @piyush-zlai in #2004
• Fix sparse readiness partition boundary by @tchow-zlai in #2009
• Handle Dataproc cluster DELETING/UNRECOGNIZED/ERROR_DUE_TO_UPDATE states by @david-zlai in #2010

Full Changelog: v1.17.4...v1.17.5

What's Changed

Minor features

• Add keyFilter to GroupBy to shrink batch uploads by @nikhil-zlai in #1991

Bug fixes

• Bump logback to 1.5.33 to fix GHSA-p47f-322f-whfh by @piyush-zlai in #1997
• Update Flink K8s submitter to suspend rather than delete jobs by @piyush-zlai in #1996
• Fix Flink Java 17 compatibility: add JDK to image, replace SAM lambdas by @piyush-zlai in #1999
• Make schedule-all a full sync of config-declared schedules by @nikhil-zlai in #1998
• Qualify sensor node names by dependency grid to stop cross-conf clobbering by @nikhil-zlai in #2001
• let readiness checks act as sparse data arrival checks like ds by @BenMagyar in #2005

Full Changelog: v1.17.3...v1.17.4

What's Changed

Bug fixes

• Support daily partitions with sub-daily offsets by @BenMagyar in #1990
• Allow for defaults over partition interval, offset and schedule by @BenMagyar in #1992

Full Changelog: v1.17.2...v1.17.3

What's Changed

Bug fixes

• Cut down Flink logging for warn / errors by @piyush-zlai in #1989
• Sense the newest data-bearing partition for timestamp partition columns by @nikhil-zlai in #1995

Full Changelog: v1.17.0...v1.17.2

What's Changed

Bug fixes

• Cut down Flink logging for warn / errors by @piyush-zlai in #1989
• Sense the newest data-bearing partition for timestamp partition columns by @nikhil-zlai in #1995

Full Changelog: v1.17.0...v1.17.1

What's Changed

Bug fixes

• Cut down Flink logging for warn / errors by @piyush-zlai in #1989
• Sense the newest data-bearing partition for timestamp partition columns by @nikhil-zlai in #1995

Full Changelog: v1.17.0...v1.17.1+july3

What's Changed

Bug fixes

• Cut down Flink logging for warn / errors by @piyush-zlai in #1989
• Sense the newest data-bearing partition for timestamp partition columns by @nikhil-zlai in #1995

Full Changelog: v1.17.0...v1.17.1-july3

What's Changed

Minor features

• Support sub-daily partition intervals by @nikhil-zlai in #1914
• Add conf-level workflow concurrency API by @nikhil-zlai in #1965
• Update zipline hub clear-downstream for API changes by @sean-zlai in #1968

Bug fixes

• Bump jackson-databind to 2.18.8 to clear grype CVE-2026-545xx advisories by @tchow-zlai in #1964
• fix(cloud_gcp): add logback.xml to suppress gRPC Bearer token leaks by @JoeTime17 in #1959
• JoinParts are not being reused in the monolith join by @BenMagyar in #1954
• Handle daily catalog partitions returned as timestamps by @nikhil-zlai in #1966
• Fix planner bug where we don't handle null Query objs in JoinSrc by @piyush-zlai in #1969
• Add user-activities src + GB for Crucible canary by @piyush-zlai in #1971
• Update schedule lifecycle integration expectations by @tchow-zlai in #1974
• Decouple Flink k8s checkpoint check from url by @piyush-zlai in #1975
• add new spark.chronon.kv_upload.batch_table_gc_age_days opt by @BenMagyar in #1984

Full Changelog: v1.16.2...v1.17.0

What's Changed

Bug fixes

• Support pinning the reader schema for a topic by @BenMagyar in #1944
• fix(gcp_cloud): resolve GCP_LOCATION for bulkPut job from env vars by @sai-muppiri-ck in #1947
• feat(aws): configure Flink (eks) pod labels via FLINK_EKS_POD_LABELS env var by @neeraj-lalji-depop in #1942
• Order join planning dependencies source-first by @tchow-zlai in #1953
• Honor KV upload timeout config by @nikhil-zlai in #1949
• Scope orchestration threadpool metrics by @nikhil-zlai in #1951
• CTRL-247: crucible env to new warehouse + artifacts buckets + shared-domain hub URL by @kumar-zlai in #1955
• docs: Clear & Rerun page CTRL-163 by @kumar-zlai in #1936
• Validate end-ds is on/after start-ds in hub CLI by @david-zlai in #1957
• Avoid DPP plan explosion in final join writes by @nikhil-zlai in #1952
• Drop online-flag gate from groupBy schema fetch by @nikhil-zlai in #1932
• Fix grype in cloud_azure around jline by @piyush-zlai in #1962

New Contributors

• @neeraj-lalji-depop made their first contribution in #1942

Full Changelog: v1.16.1...v1.16.2

What's Changed

Bug fixes

• Upgrade mill to 1.1.6 (and JDK 17 launcher) by @david-zlai in #1912
• Add an adds opens for java time for E2E tests by @piyush-zlai in #1940
• fix(cloud_gcp): pin bulkPut export job to GCP_LOCATION by @sai-muppiri-ck in #1938
• Flesh out docs on entity source behavior with Debezium rails by @piyush-zlai in #1934
• Retry when Dataproc cluster runs into an error state by @david-zlai in #1930
• Lower rate of hotpath logging in KV impls by @piyush-zlai in #1941
• Log iceberg partition row counts in postJobActions by @david-zlai in #1921

New Contributors

• @sai-muppiri-ck made their first contribution in #1938

Full Changelog: v1.16.0...v1.16.1

What's Changed

Minor features

• Add Debezium CDC Serde support by @piyush-zlai in #1906
• Extend Flink job code to support EntitySrc + add IT by @piyush-zlai in #1918

Bug fixes

• Expose partitions and timeout_ms on dyndb ion writer as conf by @BenMagyar in #1909
• deps: bump netty to 4.1.135.Final to fix Grype CVE failures by @piyush-zlai in #1920
• Fix groupBy schema fetch to read from batch serving info by @nikhil-zlai in #1891
• docker/spark: unified cross-cloud spark image CTRL-236 by @kumar-zlai in #1919
• canary: split aws_databricks bucket overrides into teams.canary.py CTRL-229 by @kumar-zlai in #1923
• fix(service): deduplicate OTLP resource attributes to prevent Microme… by @RickyDepop in #1915
• Increase timeout for backfill no data integration test by @david-zlai in #1924
• ci: mirror jar publishes to s3://zipline-artifacts-aws CTRL-236 by @kumar-zlai in #1926
• docker/spark: bake fs.s3a.aws.credentials.provider into image CTRL-236 by @kumar-zlai in #1928
• fix(ci): use github context vars instead of git rev-parse in push-jars CTRL-236 by @kumar-zlai in #1929
• canary: drop renewCredential opt-out for aws_databricks K8sSubmitter CTRL-236 by @kumar-zlai in #1931
• Increase number of warmup requests for BigTable by @david-zlai in #1925

Full Changelog: v1.15.2...v1.16.0

What's Changed

Minor features

• feat(k8s): tag Flink pods and metrics with the GroupBy name by @RickyDepop in #1888

Bug fixes

• Delete CrucibleSubmitter and CrucibleClient by @tchow-zlai in #1901
• Bump io.vertx:vertx-* from 4.5.24 to 4.5.27 by @tchow-zlai in #1902
• patch(emr-serverless): bake UC jars into custom image to enable credential renewal CTRL-223 by @kumar-zlai in #1898
• canary: test_id scoping + UC cleanup for aws_databricks UC backfill tests CTRL-217 by @kumar-zlai in #1899
• test_hub_backfill_uc: widen DS to 02-01..02-05 + fix UC cleanup default schema CTRL-217 by @kumar-zlai in #1904
• fix(spark): stabilize HeterogeneousPartitionColumnsTest by @bagipriyank in #1886

New Contributors

• @RickyDepop made their first contribution in #1888

Full Changelog: v1.15.1...v1.15.2

What's Changed

Bug fixes

• Preserve named JoinSource joins during normalization by @nikhil-zlai in #1894
• Add PR tests for zipline admin init and zipline compile by @david-zlai in #1887
• canary: add aws_databricks/demo UC + Delta hub-backfill integration test by @kumar-zlai in #1897
• Fail empty GroupBy uploads with a single shared zero-row guard by @tchow-zlai in #1900

Full Changelog: v1.15.0...v1.15.1

What's Changed

Bug fixes

• Add more docs around our metrics setup by @piyush-zlai in #1883
• test(aws_databricks): new join for team by @cristian-zlai in #1876
• Make temporal boundaries strict everywhere by @nikhil-zlai in #1884
• Fix imported config attribution during compile by @tchow-zlai in #1885
• Respect end cutoff in input readiness checks by @nikhil-zlai in #1890

Full Changelog: v1.14.1...v1.15.0

What's Changed

Bug fixes

• refactor(cli): deprecate repo root alias by @tchow-zlai in #1877
• Handle Enum types in Avro conversion by @BenMagyar in #1879
• Extract stats for clustered iceberg tables by @BenMagyar in #1870

Full Changelog: v1.13.0...v1.14.1

What's Changed

Bug fixes

• refactor(cli): deprecate repo root alias by @tchow-zlai in #1877
• Handle Enum types in Avro conversion by @BenMagyar in #1879
• Extract stats for clustered iceberg tables by @BenMagyar in #1870

Full Changelog: v1.13.0...v1.14.0