NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
Go modules
Go modules, #2032 by repository stars
Latest stable
v1.6.6
Last release 17 days ago
05 Nov 2026
Ships fairly regularly
a new release about every 3 weeks
Nearly every release is documented
notes for 58 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
5 years old
515 releases · first in 2022
Drag across the ruler to compare, or tap a release to open it.
Add SAP HANA database connector (HANA Cloud and SSH tunnel supported).
primary_key, then the Postgres replica identity index, then the table primary key, then a unique index on NOT NULL columns (_id for MongoDB). Fail before any read when streams have no key, and name all of them in one error.parallel_scan source option to read a Postgres table with parallel ctid ranges on the Arrow lane.insert_concurrency target option for ADBC and native ClickHouse targets.proxy_url.filter() function, for example filter(array, "value > 1").pgx driver instead of lib/pq for Postgres. Reads use the binary protocol and take less CPU.big.Rat) and the row path (rows pass between goroutines in chunks)..arrow files).use_adbc does not change the read.claude-sonnet-5-5, gemini-3.8-flash).mcp-go to v1.5.0 for the current MCP protocol.dbase and firebolt).{incremental_where_cond} or {incremental_value} placeholder. Before, each chunk read the same rows.TABLE_ALREADY_EXISTS on ClickHouse Cloud).proxy_url tunnels for Postgres (verify-full), MySQL, SQL Server and ClickHouse.pgx) for empty binary values and for integer or text values in bool columns.role), and Snowflake one-line PEM keys from a secret manager.client_charset, keep NVARCHAR2/NCLOB text on non-Unicode databases, and fix LOB column length for sqlldr.UNIQUEIDENTIFIER values.tar.gz asset, bind the HTTP import listener early, and let DuckDB read an HTTP import batch more than once (MotherDuck).short and byte native types (map to smallint).true/false for 1/0.d/w/M suffixes, use step-based chunk size, and remove boundary duplicates.{model.*} variables in sling build model hooks, and run KILL and similar statements with Exec on ClickHouse.break or goto: send the skipped status.SLING_TASK_CONFIG for large configs: read it from a file path (E2BIG on Linux).Env, state store and shared replication state.Datastream.Collect, and a 0-row file write for small streams.explode and alias docs.Your coding agent can read these notes before it upgrades. Set up the MCP server →
External secret manager references: Connections, env blocks and expressions can use secret references (op://, ref+awssecrets://, ref+vault://, ref+sli
env blocks and expressions can use secret references (op://, ref+awssecrets://, ref+vault://, ref+sling://, and more). Supported providers include 1Password, AWS Secrets Manager and SSM, Azure Key Vault, GCP Secret Manager, Vault/OpenBao, Doppler, Infisical, Bitwarden, Akeyless, Keeper, Conjur, Delinea, Kubernetes, SOPS, HTTP JSON, file and exec. Configure them in the new secret_providers block of env.yaml. A project env.yaml can declare its own providers. Use from: to merge a full JSON/YAML secret into a connection. Sling redacts secret values in log output.secret() function: New expression function that resolves a secret reference, e.g. secret("op://vault/item/field").+pre / pre+ (also for post, pre_merge, post_merge) to prepend or append to the default hooks.ssh_host_key, ssh_known_hosts and ~/.ssh/known_hosts. Sling warns by default and rejects in strict mode (ssh_strict_host_key). New ssh_ciphers and ssh_kex_algorithms properties.transforms: transforms accepts one stage map ({col: expr}). Invalid shapes now give an error that lists the valid shapes.merge_insert performance: The NOT IN key set now includes only keys that are also in the source, so merges into large targets scan less data.delete_missing: soft row return: Sling now clears _sling_deleted_at when a soft-deleted row comes back in the source.delete_missing disable values: none, false and off now disable the option, instead of an error.DATETIME/VARCHAR columns. date_parse also accepts values that are already datetimes.replace_accents race: Fixed panics and hangs when many goroutines use replace_accents. Also fixed related channel races in batches and merged dataflows.SLING_USE_ADBC, Sling commits the open transaction before the ADBC import, so an MSSQL truncate does not lock the load.INSERT now quote column names such as default, key and rows.sling conns test on unresolved type: The test now fails when Sling cannot resolve the connection type (e.g. a missing secret reference).lib/pq does not support, which prevented a connection panic.New database connectors: Firebolt, OpenSearch, DynamoDB (scan, batch write and delete_missing), LanceDB (with the DuckDB lance extension) and dBase .d
delete_missing), LanceDB (with the DuckDB lance extension) and dBase .dbf files (read-only).databricks-volume file connection for Unity Catalog Volumes. New copy_method: zerobus on databricks connections for direct Delta ingestion through Arrow Flight.copy_format: copy_format (arrow | csv) replaces copy_method / DUCKDB_USE_ARROW. Arrow is now the default, and Sling falls back to CSV when the arrow extension does not load.insert, update, update_insert and delete_insert. Cloudflare R2 is now a supported Iceberg storage.sling serve sessions close cached connections after 10 minutes of inactivity, so expired credentials get refreshed.env.yaml editing: sling conns set/unset now edit env.yaml line by line and keep comments, formatting and key order. Literal secret values are allowed. Writes stop when env.yaml does not fully parse.gc_bucket: Fixed the multiple credential options provided error with Application Default Credentials.ISODate, ObjectId) and Extended JSON ($date, $oid, $numberLong, etc.).-d option. An interrupt during a BCP load no longer drops the _tmp table under bcp.hugeint/ubigint map to decimal, timestamp_s/ms/ns are recognized and ±infinity values decode correctly. checksum_decimal now truncates in DuckDB, DuckLake, LanceDB and MotherDuck.limit option is respected.http_port in the native connection string.gosnowflake to v1.19.1. Sling no longer disables AWS IMDS, so EC2 instance-profile credentials work.%20 instead of +.sling setup / assist: Fixed terminal detection when stdin is /dev/null. The error now points to --non-interactive.Nothing published for this version
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
Build execution status sync: Platform status reporting for build runs and per-model progress (BuildStatus / BuildModelStatus), including model log fet
Build execution status sync: Platform status reporting for build runs and per-model progress (BuildStatus / BuildModelStatus), including model log fetch via ExecBuildModels.
UUID column typing: column_typing.uuid.as_text maps UUID columns to varchar(36) instead of unbounded text.
Databricks merge_update: Uses MERGE INTO ... WHEN MATCHED THEN UPDATE instead of UPDATE ... FROM.
Assist report composition: Compose redacted issue reports from collected parts without a local log snapshot; guard contact-form URL size under Cloudflare limits.
MCP compact dataset output: Shared pipe-delimited compact helpers for discover / query / file-list assistant payloads.
sling build subcommands: Split into run, compile, and list (replacing flag-based --compile / --list). Adds --path and --recursive for discovering sling_build.yml in subdirectories.
Build pipeline / hook command: and env:: build: steps support command: run|test|compile|list (with test: true as an alias) and an env: overlay applied for the step.
MSSQL uniqueidentifier transforms: Auto parse_ms_uuid no longer drops or corrupts user-defined staged transforms.
DuckDB process death: Clearer mid-query death errors (including OOM-killer hint) and reconnect after the process exits.
Unsupported API auth types: Return an explicit error for unknown authentication types instead of failing unclearly.
Incremental where parentheses: incremental_where_cond syntax wraps conditions in parentheses.
Parallel build logs: Per-model log buffers so parallel worker output is attributed to the correct model.
Replication state locking: NewReplicationState owns the mutex so concurrent stream state updates are safe.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
Critical fix for DuckDB OOM issue.
SQL Server named instances: host\instance and host/instance are parsed into host + instance. Warns when port 1433 is set alongside an instance name (t
SQL Server named instances: host\instance and host/instance are parsed into host + instance. Warns when port 1433 is set alongside an instance name (the driver ignores the instance), and surfaces a clearer error when SQL Server Browser (UDP 1434) cannot resolve the instance.
DuckDB max_line_size override: Connection property max_line_size now overrides DuckDB read_csv line limits across temp-file, named-pipe, and HTTP import paths.
DuckDB large text/XML columns: read_csv max_line_size is raised to 256 MB for text-class columns (not only binary), so large text/ntext/xml/varchar(max)/clob values no longer fail at the 2 MB default (fixes #787). CSV error hints now suggest copy_method: arrow_http only for DuckDB-class connections.
ADBC 3-part table names: Ingestion now targets the catalog/database in database.schema.table instead of the connection default database (fixes #785).
Parquet TIME and UUID columns: Parquet writes with time/timez/uuid columns no longer panic from an Arrow builder type mismatch.
Multi-file reader hangs and duplicate listings: Remote file bodies are opened lazily and prefetched with a bounded worker pool (issue #789), instead of holding one idle connection per file. Duplicate listing paths (e.g. Google Drive) are skipped.
Missing merge primary key: Merge config generation no longer nil-dereferences when a specified primary key column is absent; it returns a clear error instead.
Timestamp timezone through Arrow: Source timezone is preserved through Arrow conversion (e.g. Snowflake TIMESTAMP_TZ). Zone-labeled datetime stays TIMESTAMP instead of being promoted to TIMESTAMPTZ. Iceberg appends stamp timestamps as UTC so they match Iceberg timestamptz.
DuckDB producer/consumer hangs: Import cancels the producer when the consumer stops, aborts Arrow/CSV flushes on cancelled streams, and kills stalled DuckDB queries after 60 minutes (SLING_DUCKDB_STALL_TIMEOUT; 0 disables).
CDC snapshot logs: Per-stream CDC snapshot output is attributed to the correct stream instead of mixing into the group log.
MySQL/MariaDB CDC timestamps: TIMESTAMP keeps its offset (timestamptz) and DATETIME stays datetime, so CDC rows match the snapshot path instead of writing TIMESTAMP_NTZ to targets.
ADBC auto-setup: Automatically downloads the ADBC driver manager (conda-forge) when missing, and auto-installs drivers via the dbc CLI when a driver p
SLING_DISABLE_DBC_AUTO_INSTALL). Windows discovery for adbc_driver_manager.dll is included.Redshift AWS credential chain: Falls back to the default AWS credential chain (env vars, shared profiles, IAM roles) when Redshift/S3 credentials are not explicitly configured, with clearer errors and redacted credential logging.
Soft-merge delete guard NULL-safe: CDC soft-merge _sling_synced_op != 'D' guards now use COALESCE across dialects so pre-CDC target rows with NULL _sling_synced_op are no longer skipped (including Redshift).
ADBC connection keys and auth: Corrected driver property keys (e.g. Snowflake/Trino uri), added Snowflake PAT and key-pair (JWT) auth, fixed BigQuery auth_type handling, and improved adbc_uri overrides per database type.
ADBC library load diagnostics: Load failures (outdated libstdc++/glibc, wrong arch, ADBC_DRIVER_MANAGER_LIB) now return actionable remediation steps, including an LD_PRELOAD hint on Linux when needed.
Column select vs SQL expressions: * inside SQL/JSONPath expressions (e.g. concat('a*', id), '$[*].amount') is no longer treated as a column glob; unmatched globs warn instead of silently no-oping.
DuckDB Arrow / concurrency: Upgraded DuckDB, fixed copy_method → arrow_http when DUCKDB_USE_ARROW is set, improved Arrow stream error handling, and fall back to CSV when Arrow is unavailable due to a locked instance.
Bool vs int cast to string: Boolean→string casting no longer uses integer comparisons/CAST that break on PostgreSQL/Redshift; integers targeting string columns use a plain varchar cast.
Incremental state time format: time.Time state values are stored as RFC3339 so watermarks round-trip correctly with cast.ToTime (avoids full re-pulls).
GCS auth collision: Resolved multiple-credential-option errors with newer Google API clients; added GC_KEY_BODY, GC_KEY_FILE, KEYFILE, and GC_CRED_API_KEY aliases.
Three-part object names (`database.schema.table`): Table names can now be qualified with a database/catalog for dialects that support it (Snowflake, D
Three-part object names (database.schema.table): Table names can now be qualified with a database/catalog for dialects that support it (Snowflake, Databricks, Trino, BigQuery, DuckDB/DuckLake/MotherDuck, Fabric, SQL Server, Azure, Azure DWH). The database qualifier now flows into metadata queries (columns, primary keys, indexes, DDL), Snowflake internal-stage creation, and temp tables, which inherit the target's database. Dialects that don't support it now reject 3-part names with a clear error instead of silently misbehaving.
Oracle read performance (prefetch_rows): New connection property to control the number of rows fetched per network round-trip, defaulting to 100 instead of go-ora's 25. Large table reads are significantly faster; lower it (e.g. 25) for tables with large BLOB/CLOB columns to reduce memory usage.
ScyllaDB improvements: Column metadata is now read from system_schema.columns (instead of select * limit 1), with proper native CQL → Sling type mapping, keyspace/table/view introspection, truncate/add column/drop column support, CQL-safe DROP TABLE generation, NetworkTopologyStrategy for keyspace creation, and json mapped to text.
Upsert-by-insert for key-value stores: incremental and backfill modes with a primary key now work with direct writes for ScyllaDB, MongoDB, and Azure Table, where INSERT is already an upsert-by-PK — no more falling back to a temp table or erroring out.
Go 1.26: Toolchain and dependencies bumped to Go 1.26.0.
ClickHouse pending mutations block table drops: DropTable now kills in-flight mutations referencing the table before dropping it, avoiding failures when a previous delete/update mutation is still running.
ClickHouse long loads fail with "bad connection" at commit: Large ClickHouse loads that held a single transaction open for the whole run would fail when the connection was reaped underneath mid-commit. Loads now commit on a wall-clock cadence (batch_max_duration, default 5 minutes for ClickHouse), and ClickHouse connections use a bounded max lifetime/idle time so the pool retires stale connections cleanly.
S3 transfers truncated on large/slow objects: Removed the client-wide 300s HTTP timeout, which capped the entire request including body reads. Connect/handshake/header phases remain bounded by transport timeouts; a whole-request deadline can still be opted into via HTTP_TIMEOUT.
SQL Server merge double-casting: The MERGE template now uses casted field variants (set_fields_casted, src_insert_fields_casted), since src is a derived table where the cast has already been applied — previously the cast was applied twice.
SQL Server integer-to-string cast: Integers targeting a string column are now cast with a plain cast(... as varchar); only actual boolean columns get the 1/0 → 'true'/'false' conversion. Previously integer columns were incorrectly rendered as true/false.
Nested format variables missing during pre-render: Nested maps (source.type, target.type, stream.table, …) are now built before target-object pre-rendering and refreshed afterwards, so JMESPath lookups resolve in all cases.
Wildcard streams not matching explicit stream config: Wildcard expansion now matches explicit stream entries on schema.table first, so a 2-part stream definition still matches when the table renders with a database qualifier.
Command/SSH hook output bypassing log sinks: command hook output (both local and SSH) is now routed through env.Println instead of writing straight to os.Stdout/os.Stderr, so it is properly captured by log sinks. Partial trailing lines are flushed at the end.
ScyllaDB connector: New scylladb database connection type for basic import/export, including connection template, default port (9042), and NoSQL type
ScyllaDB connector: New scylladb database connection type for basic import/export, including connection template, default port (9042), and NoSQL type registration.
MariaDB CDC reader: Dedicated binlog reader for MariaDB (separate from MySQL) handling the 4-column SHOW BINLOG STATUS DDL, the MariaDB GTID scheme, and transaction-boundary reads when resuming by file/offset.
CDC change_feed option: Reference a pre-provisioned, DBA-managed server-side CDC object instead of relying on the engine default — a PostgreSQL publication, a SQL Server capture instance, or an Oracle GoldenGate stream. Takes precedence over engine-specific properties (e.g. gg_stream).
Composite unique keys: Nested unique key groups (e.g. unique: [[a, b]]) are now preserved as composite unique indexes in generated DDL instead of being flattened into separate single-column constraints.
Redshift IAM role & profile auth: Added AWS_ROLE_ARN and AWS_PROFILE support for S3 authentication during Redshift COPY/UNLOAD, alongside the existing access-key/session-token paths. AWS_ROLE_ARN=default uses the cluster's attached default IAM role.
Pipeline execution state & CLI args: Pipeline runtime state now exposes execution-level fields (ID, start time, status, errors), and CLI arguments are surfaced via SLING_CLI_ARGS_MAP with dashed keys normalized to underscores and list values (primary-key, select, streams) preserved as structured data.
on_failure: defer in hook group loops: Deferred step failures no longer abort the group mid-loop. They are collected across all loop iterations (concurrent and sequential) and surfaced only after every iteration completes; hard failures still abort immediately.
CDC replay_from in shared-reader groups: replay_from was silently ignored when multiple streams shared a CDC reader — the group computed its start position from each stream's already-advanced position. Stream positions are now rewound before the shared start position is computed, matching single-stream semantics.
MariaDB CDC table filtering (#775): Wildcard-expanded stream names retained their identifier quoting (e.g. `sf`.`fakturs`), so no binlog rows event ever matched the filter set and runs reported "read 0 CDC events". Table names are now normalized (quotes stripped, lower-cased) before filtering.
Replication runtime state race: ReplicationConfig.RuntimeState now locks state access to prevent race conditions from concurrent callers.
Deprecated `queues:` warning: Downgraded the deprecated top-level queues: spec-field warning to debug (queues are auto-detected).
skip_lines source option: New skip_lines source option to skip a fixed number of leading lines (e.g. preamble rows) before the header is parsed.sql: queries are now re-rendered after start-hooks run, so {store.*}, {state.*}, and {execution.*} variables resolve at query time (also exposed in the format map).ActiveDirectoryServicePrincipalAccessToken support — connect and BCP-import using a pre-fetched Azure AD access token (delivered via the security-token protocol, not the DSN).redshift-serverless.amazonaws.com now automatically use the Redshift connector.primary: [[user_id, brand_id]]), flattened to behave identically to the flat form.primary_key declared on an API spec now deduplicates records at the extraction layer (first-seen wins), preventing duplicate-key violations on merge.DELETE/UPDATE statements in merge, delete-insert, and change-capture templates.decimal cast (type only, no precision) no longer locks the sample-inferred precision, which could silently saturate/overflow later rows on strict engines like StarRocks.columns: are no longer reverted to string/decimal mid-stream when a value fails to cast.CHARACTERSET AL32UTF8 to the sqlldr control template to correctly load multi-byte UTF-8 data.http_timeout: The raised http_timeout is now applied on every session (not only when the httpfs extension is registered), with a http_timeout connection property to override it.Describe (e.g. a missing table) now surfaces the real underlying error instead of returning an empty result.Authenticate no longer dereferences a nil authenticator, and unsupported authentication types now return a clear error.queues: warning: Downgraded the deprecated top-level queues: spec-field warning to debug (queues are auto-detected).See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
Column reordering and renames in `select`: The select clause now supports reordering and renaming columns inline. Combined with stricter handling of s
Column reordering and renames in select: The select clause now supports reordering and renaming columns inline. Combined with stricter handling of select exclusions and excluded PKs, this gives finer control over output schemas without needing downstream transforms.
Oracle LOB / binary fidelity to Snowflake: End-to-end row-level fidelity for Oracle LONG, LONG RAW, and large BLOB columns when replicating to Snowflake. Snowflake COPY VIA STAGE now casts hex-encoded binary to BINARY with explicit sizing up to 64MB, Snowflake parquet file formats set binary_as_text = false, DuckDB staging decodes hex-encoded binary to BLOB for parquet, DuckDB read_csv max_line_size is raised for large hex blobs, and BinaryToHex conversion is optimized from O(n²) to O(n). Type inference is refined to preserve native binary types and apply explicit lengths.
null_if function: New function for normalizing values to null when they match a target — useful for cleaning sentinel values out of API responses and CSV inputs.
JSON-RPC error detection in endpoints: API endpoints now recognize JSON-RPC error envelopes and surface them through the standard rule/retry pipeline instead of treating them as successful payloads.
Idle DB-connection reaping in sling lsp: The language server now reaps idle database connections instead of holding them open for the lifetime of the editor session.
FileType.Exts method: New helper returns all valid extensions for a FileType, enabling correct detection of multi-extension formats (e.g. .xlsm now recognized as Excel file).
Inline iterate.over preserved on dynamic API endpoints: Inner iterate.over is now preserved across dynamic endpoint expansion, and the over field's JSON tag is corrected so YAML/JSON specs round-trip correctly.
BigQuery errors masked by context.Canceled: BigQuery job-wait logic is consolidated into waitForJob, which re-fetches job status with a detached context if job.Wait returns context.Canceled. Real BigQuery API errors now surface from LoadFromReader, CopyFromGCS, and CopyToGCS instead of being hidden behind a generic cancellation error.
GCS path format in importViaGoogleStorage: Corrected the GCS URI format used when importing via Google Storage, fixing failures on BigQuery loads that route through GCS.
Auth-sequence responses skipped default rules: Default retry/fail rules are now applied to authentication-sequence responses in dbio/api. Previously these responses bypassed the rule pipeline, producing unclear errors on auth failures. Rule application is also guarded for idempotency to prevent stacking on re-compilation.
Endpoint rule stacking on re-compilation: Added an idempotency guard to checkResponse so endpoint rules aren't duplicated when specs are re-compiled, and ensured mutations to setup/teardown call requests/responses persist by indexing directly into slices.
CDC metadata column validation: Added support for retrieving and validating CDC metadata columns after the initial snapshot, with additional debug logging on CDC operations to make troubleshooting easier.
Temp-table double-drop: Skip dropping a temp table that has already been marked as dropped, and make the temp-table cleanup key unique to avoid collisions between concurrent tasks.
Queue-only API endpoints: New queue_only flag on API spec endpoints. Such endpoints drain synchronously to populate downstream queues and emit no reco
Queue-only API endpoints: New queue_only flag on API spec endpoints. Such endpoints drain synchronously to populate downstream queues and emit no records of their own, and are hidden from broad enumeration (sling conns discover, wildcard replication expansion) while remaining addressable by name. queue_only is also honored as a defaults value in the spec.
Inline iterate lists/objects for dynamic API endpoints: Dynamic endpoints now accept native YAML arrays and objects in iterate (in addition to JSON literals and JMESPath strings). Nested YAML maps are normalized to map[string]any for consistent template/JMESPath use.
sling conns exec output formats and --limit: sling conns exec now supports --output csv|json|arrow with streaming (Arrow IPC / CSV go straight to stdout, logs to stderr) and a --limit flag (default 100, 0 = unlimited). The limit is pushed down via the dialect's limit_sql template so the database truncates server-side. sling conns discover also gains CSV output.
CDC nil target options on shared-reader path: CDC's shared-reader write path bypassed TaskExecution.Execute() and left target options (ColumnCasing, AddNewColumns, AdjustColumnType) nil. Now calls Config.SetDefault() on the cloned config so system-wide defaults apply.
Dataflow.Pause timeout on slow stream starts: Pause now waits up to a configurable timeout (SLING_PAUSE_TIMEOUT, default 30s) and returns false if any stream can't pause in time or the dataflow context is canceled, instead of using a short random timer.
MySQL LoadDataLocal missing batches: Reader handler is now registered per batch in MySQL's LoadDataLocal, ensuring every batch is loaded instead of only the first.
DuckDB Describe errors no longer masked: SELECT/WITH queries fail fast on Describe errors in DuckDB instead of swallowing the error and returning misleading results.
Nil reader panic in ConsumeCsvReaderChl: Guards against a nil reader to prevent panics.
Spurious HTTP-URL check in GenerateInsertStatement: Removed an unnecessary check that could misclassify insert targets.
chunk() function return type: The pipeline chunk() function now returns *ChunkResult instead of a bare channel for consistent downstream consumption.
Cleaner error/messages: Clearer row-count-mismatch error in WriteToDb/writeToDbDirectly, simplified pause error handling on those same paths, corrected DuckDB pipeline path and sling command output message, clarified the sling run CLI description.
CDC shared-reader replication: New CDCGroupRunner orchestrates multi-stream CDC replications through a shared reader, with phased prepare/read-into-ca
CDCGroupRunner orchestrates multi-stream CDC replications through a shared reader, with phased prepare/read-into-cache/write-and-commit execution and bounded-parallel writes.HookQuery: Automatically retries query hooks against dead database connections instead of failing the run.NewArrowWriter options: Arrow writer accepts additional options for finer control over output, with quieter logging in InferColumnTypes.sling agent service commands: Manage the Sling agent as a system service on Windows, macOS, and Linux (install/uninstall/start/stop).sling project CLI subcommands: New commands for managing project executions, files, and connections — including filters, output formatting, create/update/delete on jobs and files, and confirmation prompts on destructive actions.file:// SQL support: MCP server can now execute queries from saved SQL files.NewSingleRequest to prevent concurrent map iteration and write panics during API calls.Nothing published for this version
CDC support for PostgreSQL, SQL Server, Oracle, and MongoDB: Change Data Capture now works with PostgreSQL (logical replication), SQL Server, Oracle,
ReadChanges now captures the current position before streaming so catch-up runs terminate without waiting for new events.adjust_column_type for CDC: CDC replications now default adjust_column_type to true, automatically widening target columns (varchar length, decimal precision) when the source schema changes.adjust_column_type precision expansion: The adjust_column_type option now detects and expands varchar length and decimal precision/scale when the source columns grow wider, avoiding truncation or precision loss.description parameter for SQL query actions: MCP database.query and worksheet logging now accept an optional description field for improved context and observability.SID option could conflict with service_name, causing connection failures.SQL Server BCP with Entra ID authentication: BCP bulk loading now supports Entra ID token-based auth and Azure CLI integration for passwordless authen
full-refresh mode with CDC options, clearing state before running an initial snapshot.length() function supports scalar types: The length() function now safely handles integers, floats, booleans, and dates by converting to string representation, allowing use in wildcard transforms with ternary guards.sling project jobs run --wait flag: New --wait / -w flag polls execution status every 5 seconds until the job reaches a terminal state, then reports rows, bytes, and duration.char(400000), preventing excessive memory allocation during Oracle bulk imports.tinyint in metadata queries across MariaDB, MySQL, and StarRocks templates.path package with filepath across the codebase for correct behavior on Windows.SaveToken to proceed even when running in agent mode.OAuth2 authorization code flow with configurable redirect URL and port: The authorization code flow now supports a configured redirect_uri, using its
redirect_uri, using its host, port, and callback path instead of always binding to a random local port.CLIENT_SECRET and client certificate properties are now properly passed through for Microsoft Fabric ABFS and Azure file system authentication.column_typing: column_typing string max_length rules now apply to non-database sources (CSV/files), enabling auto-inference of varchar() precision when loading into databases like Oracle.GetSchemata table retrieval: Fixed schema value not being cast to string, which caused table listing to fail when discovering BigQuery schemas.CommandContext) and surfaces actionable SQL*Loader-700 / out-of-memory errors instead of generic failures.defer dbConn.Close() calls in ClearTableForChunkLoadWithRange and ProcessChunks to prevent connection leaks during chunked replication.nil error being passed to g.Error when update_key is missing for stream chunking.`--home-dir` flag: New flag across sling run and all sling conns subcommands (list, test, set, unset, exec, discover) to specify a custom sling home d
--home-dir flag: New flag across sling run and all sling conns subcommands (list, test, set, unset, exec, discover) to specify a custom sling home directory. Sets SLING_HOME_DIR and reloads connections accordingly.
Column merge with defaults (+ prefix): Stream-level columns: entries prefixed with + now merge with defaults.columns instead of replacing them. Use +column_name: ~ to unset a default. Without +, legacy replace behavior is preserved.
Pipeline store variables in replications: {store.xxx} variables set in pipeline steps are now accessible in inline replication where: and sql: fields.
API spec range_step support: Added range_step to the endpoint context map, enabling three-part range expressions for backfill.
API spec state variable rendering in jmespath / jq: State variables (e.g. {state.endpoint_name}) are now resolved inside jmespath and jq response record expressions.
SLING_LOGGING env from replication: Moved SLING_LOGGING env handling from per-task to replication-level so it takes effect before stream execution and properly reinitializes the logger.
Direct insert incremental state: writeToDbDirectly now calls SyncColumns() and SyncStats() so incremental state (e.g. datetime update keys) is correctly captured after direct insert writes.
Auth token refresh on retry: API retry logic now refreshes HTTP request headers from conn.State.Auth.Headers before resending, fixing stale token issues after server-side token rotation (both single-request and mid-pagination scenarios).
Windows path handling: CleanWindowsPath applied to local file locations in ParseLocation, API spec file:// paths, env file paths, and SLING_HOME_DIR.
Oracle chunking with custom SQL: Fixed AS table alias syntax for Oracle (which doesn't support AS for subquery aliases).
Fix critical issue with API Spec state parsing when using setup
setupADBC DuckDB — new ADBC connector with Docker testing
ISODate() in filters.env.sling file support for per-project connection definitionsworking_dir parameter on connection, pipeline, and replication actions.env.sling from working directory_sling_synced_op = 'D' instead of _sling_deleted_at; snapshot rows marked with 'S'merge_change_capture_soft templates across all 14 databasesgodbc v0.0.5, purego v0.10.0New change-capture replication mode
change-capture replication modechange_capture and change_capture_soft (soft delete)WHERE clause support added to chunk query functions0000-01-01core/env package (env.ExecID)SLING_LOG_DIR env vars)SLING_PROXY environment variable (or proxy_url per-connection property) for proxy configurationStreamRowsContext column mapping streamlined; sync issue fixedtoFloat methodNewStreamProcessor clarifiedGenerateDDLInferColumnTypes preserves explicit types for empty datasetsCritical fix for AzureSQL and Fabric merge_strategy templates
merge_strategy templatesPreserve foreign keys, indexes, column comments, default values, and auto-increment attributes when replicating between databases
insert, update, update_insert, and delete_insert merge strategiesjq Expressionsjq source option for JSON-based data streamsjq() transform function for column-level transformationsDiscover methodcurrent_database() for catalog filteringEnhanced delete_missing with configurable source and target WHERE clauses
delete_missing with configurable source and target WHERE clausesEscapeBackslash option for MySQL LOAD DATA operationsDB2 Database Support - Initial support for IBM DB2 with connection templates and full test suite
definition-only Mode - Create table/file definitions without transferring data (parquet/arrow only for files)_sling_synced_at Column - Enable with SLING_SYNCED_AT_COLUMN=true for timestamp tracking_sling_synced_op Column - Tracks operation type: I (insert), U (update), D (soft delete)slugify Function - Convert strings to URL-friendly slugsdelete_missing with transforms - Fixed errors in PK-only queries when transforms presentunixodbc and odbcinstNew ODBCConn type for generic ODBC database connections
Added CastBoolColumnForSelect method to cast boolean columns when target expects integer or string
Database Templates: Unified quoting/unquoting methods across connections; added YAML-based type mappings (deprecating TSV)
Removed deprecated --config CLI flag: Cleanup of legacy options
Endpoint-specific authentication: Refactored API authentication to allow individual endpoints to define and manage their own authentication, including
Dynamic field to Endpoint for generated state indicationRuleTypeSkip to skip records and RuleTypeBreak to stop processing requests for current iterationcontextMap for improved state management across endpointsAggregationTypeFlatten to AggregationTypeCollect for clearer semanticsCastColumnForSelect functionpre.*, post.*)hasRange method and improved incremental mode warningsRunStateVariables to Env in EnvFile structure for improved clarityEnv and Variables maps with backward compatibilityLocalConnections map with connection dataNewSession method to create SSH sessions with proper error handlingLocalConnections and transforms to prevent race conditionsrenderEndpointTemplatePipeline handling in Context method of PipelineStepExecutionfilepath import in database_ducklake.goduckURI variable in filesystem operationsafter fieldcast_as tests{fields} placeholder with select parameterSee https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
See https://github.com/slingdata-io/sling-cli/ for more details.
MongoDB collection listing enhancements
Fix Arrow Decimal truncation issue.
MongoDB ObjectID Support - Added proper ObjectID filtering capabilities for MongoDB connections with automatic hex string conversion
FetchSpec function for loading API specificationsstatement_timeout parameter supportNew Database Support: Added Arrow Flight SQL (FlightSQL) connection type
starting_after and ending_before parametersImprove Staged Transforms reliability and performance
Nothing published for this version
Added Exasol connector: New database type with comprehensive bulk import functionality, CSV handling, and timestamp formatting
Transform with new TransformLegacy for backward compatibilityParseStageTransforms functionrecord.field_name syntaxdecode (source) and encode (target) handlingg.DebugLow to g.Debug across codebase for better performancelength(records) to length(response.records)CastToString to CastToStringCSV for proper CSV formattingExasol Database Integration: Added comprehensive support for Exasol database
_SLING_LOADED_AT logging during column operationssimpleaggregatefunction and fixedstring typesNativeTypeToGeneral to use switch statement for better performanceSLING_LOADED_ATChanged FileSelect from pointer to slice for consistency across codebase to fix critical bug.
FileSelect from pointer to slice for consistency across codebase to fix critical bug.Enhanced Chunking Functionality:
Enhanced Chunking Functionality:
Replication Improvements:
Database Improvements:
File System Updates:
New Test Suites:
Logging & Environment:
SLING_LOGGING=NO_COLOR supportenv.IsThreadChildBuild & Development:
Iceberg Support: Enhanced Iceberg connection with AWS config and improved database handling
iceberg_glue target and enhanced Glue connection capabilitiesadjustCol flag for DuckDB and related typesflarco/g dependency to v0.1.154mark3labs/mcp-go to v0.33.0SLING_KEEP_TEMP environment variableCritical fix for a bug when creating DuckLake secrets
NEW: Complete Databricks database integration
Upgrade to AWS SDK for Go v2: The AWS SDK has been upgraded to v2, which brings in a more modern, modular architecture. This required substantial code
Upgrade to AWS SDK for Go v2: The AWS SDK has been upgraded to v2, which brings in a more modern, modular architecture. This required substantial code updates, including adding context to all AWS API calls for better cancellation and timeout control, and improving error handling.
New Connector and Format Support:
iceberg-go library. This allows Sling to interact with Iceberg tables for data replication tasks.DuckLake has been introduced as a new database type, extending the capabilities of DuckDB.Enhancements to Existing Connectors:
PURGE option when dropping tables.role in the PostgreSQL connection URL for more granular access control.BIT column transformations has been added.1.1.3 to 1.3.0.General Improvements and Fixes:
SLING_TIMEOUT has been added to replication and pipeline runs.TableExists method has been added to the connection interface to check for table existence before performing operations.CSV Schema Handling: Fixed potential out-of-bounds errors and addressed schema inconsistencies
connect_time property to connection methodsgithub.com/flarco/g from v0.1.143 → v0.1.146github.com/spf13/cast from v1.6.0 → v1.7.1Fix critical bug with sling agent
sling agentImproved error handling for incremental mode (Commit c9dadd0).
c9dadd0).cd31e26).GetSchemata (Commit 4d5c9b5).GetCount (Commit 4666114).1d1d1d9).4244c34).id property to each (Commit 87024b5).pipeline.json schema (Commit 87274d9, 4bcfb66).2b986d0), which was later reverted (Commit db7b294).7f70b19).82fa1a5) and column number mismatches (Commit b201e68).private_key property (Commits baff658, 2f4b7a3 - merged from PR #553 by GeoffTearle).0b004c3).TrimSQLComments function (Commit bf0c02b).d40d044).nvarchar length factor for temporary tables on SQL Server to provide a buffer, addressing issue #554 (Commit 7f8f3ed).6d43d8a).731ff55).75e8000).bcp (Bulk Copy Program) executable in tests (Commit 4369307).Improved API specs and documentation
Added --trace flag to set logging level to TRACE (not for production use)
--trace flag to set logging level to TRACE (not for production use)--endpoints flag for testing specific API connection endpointsSLING_TIMEOUT environment variableCloseAll()a5b4635).b8d610c, 3b10488).904fa6a).c29b280).NullIf configuration (Commit 27a8f9a).nil df (DataFrame) in task execution (Commit ae645d6).nil values in the state map for dbio (Commit 9f2e78b).6e7d4c4).dc76593).bc05b3a).4e21dcf).aa62c31).GetNativeType (Commit 1fa88fe).2eeaada).34f1486).Added support for Azure SQL Database and Azure Data Warehouse in multiple code paths
TypeDbAzure and TypeDbAzureDWH alongside SQL Serverhttps://www.googleapis.com/auth/bigquery"did not find update_key: %s"GetFormatMap() method
_) to dot (.) as separatorgithub.com/flarco/g from v0.1.136 to v0.1.138github.com/sijms/go-ora/v2 from v2.8.22 to v2.8.24SQL Server BCP Import Improvements
SQL Server BCP Import Improvements
emptyRep placeholderDuckDB File Writing Enhancements
JSON Processing
Data Type Casting
Configuration and Pipeline Updates
Added support for AWS_SESSION_TOKEN in Redshift connections
AWS_SESSION_TOKEN in Redshift connectionsdbio.TypeFileS3 from a switch case in WriteDataflowViaDuckDBOne column per quarter.