Changelog

What's Changed

Minor features

• Flink Proxy Links and Local Testing of Unified Domain by @chewy-zlai in #1157
• Guard backfills and schedule deploys against competing version claims by @nikhil-zlai in #1200

Bug fixes

• Use engine labels for Crucible placement by @tchow-zlai in #1184
• Update homepage roundtable banner by @varant-zlai in #1188
• Remove NVMe-specific Spark storage configuration by @tchow-zlai in #1192
• Exclude Ping Requests From Audit Logs by @chewy-zlai in #1195
• Use submitted Spark configuration for resource sizing by @tchow-zlai in #1194
• Decouple SAML audience from issuer to fix SSO logins broken by the better-auth 1.6.23 bump by @sean-zlai in #1196
• UI: Show error message for failed logins due to configuration by @sean-zlai in #1198
• Promote only tested commits to main-passing-tests by @nikhil-zlai in #1174

Full Changelog: v1.17.7...v1.18.0

What's Changed

Bug fixes

• Thread Kubernetes placement through Crucible submissions by @tchow-zlai in #1159
• Derive compute placement from workflow mode by @tchow-zlai in #1181
• Resolve dependencies to producer nodes by table + partition grid by @nikhil-zlai in #1180
• Use engine labels for Crucible placement by @tchow-zlai in #1182
• Disable Crucible Azure integration tests by @tchow-zlai in #1183

Full Changelog: v1.17.6...v1.17.7

What's Changed

Bug fixes

• Sync infrastructure repo into the release flow by @tchow-zlai in #1179

Full Changelog: v1.17.5...v1.17.6

What's Changed

Bug fixes

• Add crucible aws adhoc tests to platform CI by @piyush-zlai in #1172
• Ignore test_hub_run_adhoc.py in AWS 'prod' integration tests by @piyush-zlai in #1177
• Disable Azure integration tests in canary workflow by @tchow-zlai in #1178

Full Changelog: v1.17.4...v1.17.5

What's Changed

Minor features

• Schedule lifecycle: config declares which schedules exist by @nikhil-zlai in #1171

Bug fixes

• Fix wedged jobs after streaming job cancel by @piyush-zlai in #1167
• Fix Flink UI blank page when Hub is mounted at a sub-path by @piyush-zlai in #1168
• Support self-referential staging queries in eval by @nikhil-zlai in #1169
• Add support in LokiLogStore for flink logs by @piyush-zlai in #1170

Full Changelog: v1.17.3...v1.17.4

What's Changed

Bug fixes

• Tolerate missing engine CRDs in KubernetesCrucibleJobStore by @nikhil-zlai in #1162

Full Changelog: v1.17.2...v1.17.3

What's Changed

Bug fixes

• Attempt fix for initializeNodeExecutionData by @david-zlai in #1164

Full Changelog: v1.17.1...v1.17.2

What's Changed

Bug fixes

• Add Crucible Azure deployment workflow by @tchow-zlai in #1158

Full Changelog: v1.17.0...v1.17.1

What's Changed

Minor features

• UI: Auth improvements by @sean-zlai in #1133
• Improve Crucible Flink support to be closer to existing EKS / AKS flows by @piyush-zlai in #1127
• Loki: add crucible-aws log profiles for AWS Crucible UI by @tchow-zlai in #1125
• UI: Add "Run Backfill" / "Adhoc" actions, "Clear downstream", graph chart maximize / scale to fit, and other improvements by @sean-zlai in #1131
• UI: Fetcher by @sean-zlai in #991
• Apply conf workflow concurrency defaults by @nikhil-zlai in #1141

Bug fixes

• Bump jackson-databind to 2.18.8 to clear grype CVE-2026-545xx advisories by @tchow-zlai in #1135
• Restore platform compile after Chronon API updates by @nikhil-zlai in #1138
• Guard AWS EMR validation behind compute mode by @tchow-zlai in #1136
• Fix sub-daily workflow scheduling status by @nikhil-zlai in #1128
• Wire up Flink urls + checkpoint health checks in the Crucible flow by @piyush-zlai in #1139
• Unify Crucible submitter path across clouds by @tchow-zlai in #1140
• Fix multiworkflow continuous node bug causing initializeNodeExecutionData error by @piyush-zlai in #1144
• Add Databricks Unity Catalog support to demo-scripts by @piyush-zlai in #1145
• CI: Bump mill JVM heap for cloud_azure assembly to avoid OOM by @david-zlai in #1146
• CTRL-249: forward-auth bridge for browser → Hub gateway by @kumar-zlai in #1150
• Update Aws & Azure verticles to use new K8sFlink health check + internal job id rails by @piyush-zlai in #1151
• UI: Improve status performance (sub-daily, large DAGs) by @sean-zlai in #1152
• Auth: Add AUTH_ALLOWED_PRINCIPALS allowlist to gate user provisioning and login by email/domain by @sean-zlai in #1147
• Scope Crucible submit idempotency lookups by @tchow-zlai in #1154
• CTRL-249: reshape gateway UI URLs to /engines//jobs//ui by @kumar-zlai in #1155

Full Changelog: v1.16.2...v1.17.0

What's Changed

Bug fixes

• CTRL-227: backfill end_time on pre-fix failed/upstreamFailed steps by @kumar-zlai in #1111
• CTRL-242: skip test_hub_backfill_uc.py on canary-aws by @kumar-zlai in #1120
• CTRL-243: restore Spark History Server URL on JobTrackingInfo.sparkUrl by @kumar-zlai in #1124
• UI: Impove performance of large DAGs, highlight execution lineage, and other improvements by @sean-zlai in #1126
• CTRL-248: Update Crucible AWS workflow CLUSTER_NAME → crucible-eks by @kumar-zlai in #1129
• CTRL-245: Mount Crucible gateway proxy routes in Hub for live SparkUI by @kumar-zlai in #1132

Full Changelog: v1.16.1...v1.16.2

What's Changed

Bug fixes

• Add hostname for production logs by @david-zlai in #1113
• Bump JDK to 17 for mill 1.1.6 upgrade by @david-zlai in #1095
• fix(build): pin eval & orchestration thriftJava to --release 17 by @david-zlai in #1115
• CTRL-242: route AWS hub through CrucibleSubmitter via thin wrapper by @kumar-zlai in #1116
• CTRL-243: delete platform/k8s module (follow-up to CTRL-242) by @kumar-zlai in #1117
• Auth: Fix SAML redirect and device flow (zipline auth login) behind proxy (CloudFront, API Gateway, etc) by @sean-zlai in #1118
• UI: Update deps / fix security vulns by @sean-zlai in #1119

Full Changelog: v1.16.0...v1.16.1

What's Changed

Minor features

• UI: Monitor overview by @sean-zlai in #1090

Bug fixes

• Remove version check to unblock but leave the logic and logs by @david-zlai in #1089
• K8sSubmitter: point jobUrl at Spark History Server URL by @tchow-zlai in #1098
• k8s: K8sSubmitter cloud-URI conf-path + AWS verticle defaults CTRL-231 CTRL-232 by @kumar-zlai in #1099
• Stamp end_time on terminal steps registered via batchRegisterSteps CTRL-227 by @kumar-zlai in #1096
• k8s: strip trailing/leading non-alphanumeric after sanitizeLabel truncation CTRL-235 by @kumar-zlai in #1100
• crucible-integration-test: target new crucible-aws Hub URL + auth CTRL-228 by @kumar-zlai in #1101
• k8s: K8sSubmitter loads chronon jar from S3 instead of baked image CTRL-236 by @kumar-zlai in #1102
• ci: add update_crucible_aws workflow CTRL-236 by @kumar-zlai in #1103
• ci: route crucible_integration_test through compiled_canary/ CTRL-229 by @kumar-zlai in #1104
• fix(ci): trigger update_crucible_aws on Update Canary completion CTRL-236 by @kumar-zlai in #1106
• fix(eval): concurrency issues for request catalog by @cristian-zlai in #1085
• CTRL-217: run crucible-aws integration tests after deploy by @kumar-zlai in #1109
• demo-scripts: add dim_listings CDC pipeline for Chronon EntitySource (AWS) by @piyush-zlai in #1088

Full Changelog: v1.15.2...v1.16.0

What's Changed

Bug fixes

• Add /healthz endpoint / check for frontend container by @sean-zlai in #1079
• AWS K8sSubmitter + delete Crucible verticles broken by chronon#1901 by @tchow-zlai in #1084
• ci: keep CI eval service warm (minScale=1) to stop /eval cold-start 503s by @tchow-zlai in #1083
• Exclude jackson-dataformat-yaml in k8s excludeJackson to unbreak AWS hub by @tchow-zlai in #1086
• crucible_integration_test: add AWS twin running UC backfill suite (CTRL-217) by @kumar-zlai in #1081
• fix(eval): support group by derivations with ts by @cristian-zlai in #1092
• fix(eval): ADD JAR dependency fetch in local Spark mode by @cristian-zlai in #1091

Full Changelog: v1.15.1...v1.15.2

What's Changed

Bug fixes

• update_canary: remove Crucible integration test jobs by @kumar-zlai in #1080
• fix(eval): Enable Hive Support for all by @cristian-zlai in #1078

Full Changelog: v1.15.0...v1.15.1

What's Changed

Minor features

• UI: Cancel streaming job by @sean-zlai in #1066
• Add Scala Crucible gateway module CTRL-215 by @nikhil-zlai in #1074

Bug fixes

• UI: Improve display (decimal versions, multi-line sensor name, etc) by @sean-zlai in #1060
• bug(eval): enable hive in eval spark session by @cristian-zlai in #1069
• UI: Fix null crash in NodeExecutionDrawer when step deselects (reading runId) by @sean-zlai in #1075

Full Changelog: v1.14.1...v1.15.0

What's Changed

Bug fixes

• feat(eval): setups, get remote urls and add locally by @cristian-zlai in #1042
• fix: Make dotenv prod dependency

Full Changelog: v1.14.0...v1.14.1

What's Changed

Minor features

• Add an API endpoint to cancel adhoc streaming jobs by @piyush-zlai in #1055

Bug fixes

• Fix zipline auth login flow by @sean-zlai in #1065

Full Changelog: v1.13.0...v1.14.0

Full Changelog: v1.12.2...v1.13.0

What's Changed

Minor features

• VSCode: Add environment state / selection by @sean-zlai in #1045

Bug fixes

• fix(orchestration): prevent overlapping workflow execution cycles by @tchow-zlai in #1051
• UI: Update deps by @sean-zlai in #1048
• UI: Multiline entity labels (folder/namespace as secondary line) by @sean-zlai in #1047
• fix: extend streaming uniqueness constraint + add retry tracing CTRL-197 by @kumar-zlai in #1053
• UI: Strip SvelteKit Link headers (fix nginx 502 error) by @sean-zlai in #1057
• Resolve conf placeholders from the Hub process env, not just team env by @kumar-zlai in #1056
• Bump commons-configuration2 to 2.15.0 to clear grype GHSA-337m-mw94-2v6g by @kumar-zlai in #1058
• UI: Support master as default branch on features view by @sean-zlai in #1059
• Revert migration 0015: drop streaming uniqueness over retry states by @kumar-zlai in #1061

Full Changelog: v1.12.1...v1.12.2

What's Changed

Bug fixes

• UI: Fix workflow logs when ran more than 24 hours ago (for log providers requiring start/end such as CloudWatch) by @sean-zlai in #1040
• Site: New blog posts and site improvements by @sean-zlai in #1029
• fix(eval): preserve backtick info end-to-end in table rewrite by @tchow-zlai in #988
• UI: Move schedule columns to be more visible by @sean-zlai in #1044

Full Changelog: v1.12.0...v1.12.1