github.com/datazip-inc/olake

What's Changed

• feat(discover): tiered schema sampling with partial results on timeout by @vikaxsh in #1274
• chore: staging -> master v0.11.2 by @mihir-datazip in #1276

Full Changelog: v0.11.1...v0.11.2

What's Changed

• fix(ci): read AI review settings from secrets, rename environment to ai-code-review by @vikaxsh in #1260
• fix: keep microsecond precision for timestamp in legacy writer by @faridkotia in #1233
• fix(iceberg): pin parquet-jackson to 1.18.1 to clear shaded jackson-databind CVEs by @vaibhav-datazip in #1271
• chore: staging -> master v0.11.1 by @vaibhav-datazip in #1269

New Contributors

• @faridkotia made their first contribution in #1233

Full Changelog: v0.11.0...v0.11.1

What's Changed

• feat: source type in telemetry sync completed event and more config conditions by @vaibhav-datazip in #1202
• fix(postgres): make publication validation case-sensitive by @roshankumar0036singh in #1217
• fix: pull MinIO images from quay.io (Docker Hub repos deleted) by @shubham19may in #1232
• feat: Support Horizon catalog by @sahitya-datazip in #1198
• chore(make): self-contained destination compose, s3 source shares its MinIO by @mihir-datazip in #1186
• ci: add maintainer-approved AI code review with OpenCodeReview by @vikaxsh in #1236
• chore(iceberg): rename Java writer package from io.debezium to io.olake by @vikaxsh in #1248
• fix: pull MinIO images from olakego mirror (quay.io removed them too) by @shubham19may in #1255
• feat(iceberg): add v3 deletion vector support by @vikaxsh in #1162
• chore: staging -> master v0.11.0 by @vikaxsh in #1258

New Contributors

• @roshankumar0036singh made their first contribution in #1217

Full Changelog: v0.10.1...v0.11.0

What's Changed

• feat: optional schema discovery and stream validation during sync by @cotishq in #1039
• fix(iceberg): preserve OLake metadata columns by @copacabanaservice01 in #1179
• fix: trivy grpc failure by @vaibhav-datazip in #1221
• chore(iceberg): drop unused io.minio:minio test dependency by @mihir-datazip in #1222
• fix: deduplication in Arrow CDC when insert+update in same sync by @sahitya-datazip in #1195

New Contributors

• @cotishq made their first contribution in #1039
• @copacabanaservice01 made their first contribution in #1179

Full Changelog: v0.10.0...v0.10.1

What's Changed

• chore(ci): add composite actions to dependabot scans by @Kaileshwar16 in #1141
• chore(deps): bump version.grpc from 1.69.0 to 1.83.1 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1092
• chore(deps): bump actions/setup-java from 3 to 5 by @dependabot[bot] in #1146
• chore(deps): bump org.postgresql:postgresql from 42.7.7 to 42.7.13 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1147
• chore(deps): bump DerJuulsn/todo-issue from 1.1.4 to 2.0.0 by @dependabot[bot] in #1148
• chore(deps): bump version.jackson from 2.22.1 to 2.22.2 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1150
• chore(deps): bump aws-actions/configure-aws-credentials from 4 to 6 by @dependabot[bot] in #1152
• feat: introducing pos deletes in olake (interoperabilty v0) by @hash-data in #1064
• chore(deps): bump software.amazon.awssdk:bom from 2.51.3 to 2.54.2 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1151
• chore(deps): bump actions/github-script from 6 to 9 by @dependabot[bot] in #1153
• chore(deps-dev): bump org.apache.maven.plugins:maven-failsafe-plugin from 3.5.2 to 3.5.6 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1156
• chore(deps): bump org.apache.httpcomponents.client5:httpclient5 from 5.6.3 to 5.6.4 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1157
• FIX: enforce CDC initial wait time defaults for MySQL and Postgres by @kaizakin in #1029
• chore: fix trivy vulnerability by @vishalm0509 in #1181
• fix: map Iceberg REST auth type by @sahitya-datazip in #1182
• feat(mysql): support CDC without binlog_row_metadata=FULL by @vikaxsh in #1194
• chore: Staging -> master v0.10.0 by @vikaxsh in #1201

New Contributors

• @Kaileshwar16 made their first contribution in #1141
• @kaizakin made their first contribution in #1029

Full Changelog: v0.9.5...v0.10.0

What's Changed

• feat: add telemetry for error events by @vaibhav-datazip in #1117
• feat: add ui props file parsing for telemetry by @vaibhav-datazip in #1144
• feat: implement 2PC support in parquet writer by @siiddhantt in #959
• fix: exit code for check fail by @vaibhav-datazip in #1164

⚠️ Exactly once delivery for Parquet Destination is currently in beta. Feel free to contact the team over slack or create a GitHub issue, if you encounter any problem.

Full Changelog: v0.9.4...v0.9.5

What's Changed

• fix: auto selected cursor field by @vikaxsh in #1108
• chore(deps): bump software.amazon.awssdk:bom from 2.49.6 to 2.51.3 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1100
• chore(deps-dev): bump org.apache.maven.plugins:maven-enforcer-plugin from 3.5.0 to 3.6.3 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1099
• chore(deps-dev): bump org.apache.maven.plugins:maven-surefire-plugin from 3.5.2 to 3.5.6 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1097
• chore(deps): bump actions/upload-artifact from 4 to 7 by @dependabot[bot] in #1093
• chore(deps-dev): bump org.apache.maven.plugins:maven-shade-plugin from 3.2.1 to 3.6.2 in /destination/iceberg/olake-iceberg-java-writer by @dependabot[bot] in #1094
• chore(deps): bump golang.org/x/mod to v0.40.0 by @vikaxsh in #1134
• chore: added-regex by @saksham-datazip in #1136
• chore: staging -> master v0.9.4 by @vikaxsh in #1138

Full Changelog: v0.9.3...v0.9.4

What's Changed

• chore: bump go version 1.25.12 -> 1.25.13 by @mihir-datazip in #1115
• fix(mysql): correct unsigned mediumint values over CDC by @mihir-datazip in #1074
• ci: skip documentation check for dependabot PRs by @vikaxsh in #1125
• feat: s3 xml support by @sahitya-datazip in #1085
• chore(deps): bump actions/checkout from 3 to 7 by @dependabot[bot] in #1089
• fix(IT): add wait in s3 tests before pushing files within same second by @mihir-datazip in #1130
• chore(deps): bump actions/download-artifact from 4 to 8 by @dependabot[bot] in #1090

New Contributors

• @dependabot[bot] made their first contribution in #1089

Full Changelog: v0.9.2...v0.9.3

What's Changed

• feat(tests): run integration tests against the real driver docker images by @mihir-datazip in #1037
• chore(s3-driver): abstract out aws to generic s3 object store by @mihir-datazip in #1018
• fix(iceberg): bump httpclient5 to 5.6.3 to fix CVE-2026-54399 by @vikaxsh in #1113
• fix: issue with flush last batch by @hash-data in #1112
• fix(mongodb): support inline TLS certificates for UI/Docker deployments by @krishanu7 in #1082
• chore: staging -> master v0.9.2 by @mihir-datazip in #1114

New Contributors

• @krishanu7 made their first contribution in #1082

Full Changelog: v0.9.1...v0.9.2

What's Changed

• feat: emit bytes read stats in telemetry by @vaibhav-datazip in #1047
• refactor: de-couple Integration Test module from codebase by @mihir-datazip in #1033
• feat(iceberg): add gcp_project_id for BigLake request routing header by @vikaxsh in #1056
• chore: remove common lib dependency in IT and olake module by @mihir-datazip in #1053
• fix: s3 driver parquet parser data types by @mihir-datazip in #1020
• feat(ci): add Java dependency CVE scanning with Trivy by @vikaxsh in #1038
• chore: fix pom formatting by @vikaxsh in #1065
• fix(lint): enable lint for all modules in olake by @mihir-datazip in #1060
• fix(docker): keep the JVM trust store in sync with the OS on Temurin by @vikaxsh in #1078
• fix(postgres): pick the slot LSN source by recovery state so CDC works on a read-replica by @erikcw in #1070
• feat: configure Iceberg Destination fields by @sahitya-datazip in #1057
• chore: gitignore local Claude Code tooling state by @shubham19may in #1083
• chore: remove default values in rest_auth_type for Iceberg Catalogs by @sahitya-datazip in #1087
• chore: added size based batching by @saksham-datazip in #1086
• chore: staging -> master v0.9.1 by @vaibhav-datazip in #1088

New Contributors

• @erikcw made their first contribution in #1070

Full Changelog: v0.9.0...v0.9.1

What's Changed

• feat: log OLake version on startup by @sahitya-datazip in #1030
• chore: docker optimizations for integration tests by @mihir-datazip in #1024
• feat(iceberg): upgrade Apache Iceberg from 1.7.2 to 1.10.2 by @vikaxsh in #1026
• chore: add make targets for test databases, dev builds and integration tests by @mihir-datazip in #1021
• feat: track source bytes read in stats by @vaibhav-datazip in #1011
• fix: Preserve record order during concurrent filtering by @sahitya-datazip in #1035
• feat: rolling writer in s3 destination by @mihir-datazip in #1012
• fix(test): restore iproute2/lsof in base image so iceberg port reclaim works by @vikaxsh in #1042
• chore: staging -> master v0.9.0 by @vikaxsh in #1041

New Contributors

• @sahitya-datazip made their first contribution in #1030
• @mihir-datazip made their first contribution in #1024

Full Changelog: v0.8.2...v0.9.0

What's Changed

• fix: cdc insert failure during gcp by @vaibhav-datazip in #1025
• fix(iceberg): use resolved destination column names for partition by @vikaxsh in #1028
• feat: 2pc kafka by @saksham-datazip in #979
• chore: staging -> master v0.8.2 by @vaibhav-datazip in #1027

Full Changelog: v0.8.1...v0.8.2

What's Changed

• fix: guard nil shutdown in DropStreams to prevent clear-destination panic by @vikaxsh in #1022
• chore: hotfix staging -> master v0.8.1 by @vikaxsh in #1023

Full Changelog: v0.8.0...v0.8.1

What's Changed

• feat(iceberg): single JVM per process instead of per stream-chunk by @vikaxsh in #962
• refactor(chunking): refactor MySQL helpers for unit testing by @vimla01 in #975
• chore: added-placeholder by @saksham-datazip in #999
• fix: discover fails for streams with "." in schema or table name by @vaibhav-datazip in #1015
• chore: staging -> master v0.8.0 by @vikaxsh in #1017

⚠️ Known Issues:

• Full-load syncs (without CDC or incremental mode) and Clear Destination may fail when using the Parquet destination.
• Iceberg table creation could fail on uppercase or special-character partition columns when use_source_column_names is disabled.

Full Changelog: v0.7.8...v0.8.0

What's Changed

• fix(postgres): lsn mismatch validation when slot already matches metadata-committed LSN by @vaibhav-datazip in #998
• fix: bump golang.org/x/net to v0.55.0 to fix trivy-go CI failures by @vaibhav-datazip in #1004
• feat: add bulk read path for backfill and incremental sync DB2 by @vishalm0509 in #990

⚠️ Changes (#990)
timestamp datatype is synced to the destination in UTC (earlier Local).
decfloat is stored in the destination as String (earlier Float64)

• chore: release olake version v0.7.8 by @vishalm0509 in #1009

Full Changelog: v0.7.7...v0.7.8

What's Changed

• docs: Update the README with Fusion by @nayanj98 in #948
• docs: Update the README by @hash-data in #989
• feat: add support for capture instance management on read replica by @vishalm0509 in #991
• feat: add configurable source vs destination column naming strategy by @vikaxsh in #978
• feat: kafka driver change by @saksham-datazip in #958
• chore: staging -> master v0.7.7 by @vikaxsh in #992

Full Changelog: v0.7.6...v0.7.7