github.com/warpstreamlabs/bento

1.21.0 - 2026-08-21

Added

• Optional Keys method for caches enabling consumers of cache resources to enumerate keys, caches that do not support key listing yield ErrKeyListingNotSupported @ecordell
• memory, file, aws_s3 and gcp_cloud_storage caches support Keys @ecordell
• bucket field on aws_s3 output supports bloblang interpolation @jem-davies
• Cache operation exists which checks caches for keys @lublak
• extract_tracing_map and new_root_span_with_link on the gcp_pubsub input & inject_tracing_map on the gcp_pubsub output @jesperanzasolo
• transaction_isolation_level field to kafka & kafka_franz components @mbuckley2000
• send_ack field on nats input enables/disables sending acknowledgement back to nats' input subject reply address @ahart97
• Optional ListableCache interface for caches that support key listing - with implementations for memory, file, aws_s3 & gcp_cloud_storage
• broker_read_max_bytes to kafka_franz input and broker_write_max_bytes & max_buffered_bytes options to kafka_franz output @jem-davies

Fixed

• parse_big_decimal rejects scales above 16383 to avoid unbounded big-integer work @aratz-lasa
• stale buffer example path in internal/impl README @youdie006
• fsevent preserves file create events when watching new subdirs @mattfaltyn
• aws_s3_stream handles files smaller than S3's minimum multipart size @triddell

Security

• Breaking: Addressed GO-2026-5048 by replacing github.com/hamba/avro/v2 with github.com/iskorotkov/avro/v2, temporarily disabling go install github.com/warpstreamlabs/bento/cmd/bento@<version> due to replace directive usage.
• bump Go version to 1.26.6 to fix various CVEs in the standard library @jem-davies

New Contributors

• @jesperanzasolo made their first contribution in #923
• @mbuckley2000 made their first contribution in #933
• @youdie006 made their first contribution in #959
• @ahart97 made their first contribution in #899
• @mattfaltyn made their first contribution in #962

Full Changelog: v1.20.0...v1.21.0

Added

• Optional Keys method for caches enabling consumers of cache resources to enumerate keys, caches that do not support key listing yield ErrKeyListingNotSupported @ecordell
• memory, file, aws_s3 and gcp_cloud_storage caches support Keys @ecordell
• bucket field on aws_s3 output supports bloblang interpolation @jem-davies
• Cache operation exists which checks caches for keys @lublak
• extract_tracing_map and new_root_span_with_link on the gcp_pubsub input & inject_tracing_map on the gcp_pubsub output @jesperanzasolo
• transaction_isolation_level field to kafka & kafka_franz components @mbuckley2000
• send_ack field on nats input enables/disables sending acknowledgement back to nats' input subject reply address @ahart97
• Optional ListableCache interface for caches that support key listing - with implementations for memory, file, aws_s3 & gcp_cloud_storage
• broker_read_max_bytes to kafka_franz input and broker_write_max_bytes & max_buffered_bytes options to kafka_franz output @jem-davies

Fixed

• parse_big_decimal rejects scales above 16383 to avoid unbounded big-integer work @aratz-lasa
• stale buffer example path in internal/impl README @youdie006
• fsevent preserves file create events when watching new subdirs @mattfaltyn
• aws_s3_stream handles files smaller than S3's minimum multipart size @triddell

Security

• Breaking: Addressed GO-2026-5048 by replacing github.com/hamba/avro/v2 with github.com/iskorotkov/avro/v2, temporarily disabling go install github.com/warpstreamlabs/bento/cmd/bento@<version> due to replace directive usage.
• bump Go version to 1.26.6 to fix various CVEs in the standard library @jem-davies

1.20.0 - 2026-07-27

Added

• parse_big_decimal bloblang method for Kafka Connect / Debezium decimal decoding @aratz-lasa
• aws_bedrock_invoke processor for invoking Amazon Bedrock models @louisdvs & @gregfurman

Fixed

• Fixed keyless records in the kafka_franz components being routed to a single partition @jem-davies
• batchErr mutex locking in the elasticsearch_v2 output @jem-davies
• updated various dependencies to address CVEs

New Contributors

• @louisdvs made their first contribution in #934

Full Changelog: v1.19.0...v1.20.0

Added

• parse_big_decimal bloblang method for Kafka Connect / Debezium decimal decoding @aratz-lasa
• aws_bedrock_invoke processor for invoking Amazon Bedrock models @louisdvs & @gregfurman

Fixed

• Fixed keyless records in the kafka_franz components being routed to a single partition @jem-davies
• batchErr mutex locking in the elasticsearch_v2 output @jem-davies
• updated various dependencies to address CVEs

1.19.0 - 2026-07-10

Added

• grpc_client input component @jem-davies
• sync_response added to nats input NATS @henrikschristensen
• endpoint config option added to gcp_bigquery output @Shareed2k
• RLE_DICTIONARY support to parquet default encoding @georgeTobia
• elasticsearch processor @Omar1H1
• json_number_type config option added to aws_dynamodb output enables JSON numbers to be either stored as dynamoDB Strings / Numbers @cthorner
• negotiate config options added to http components to enable SPNEGO auth @lublak
• timestamp field added to gcp_bigtable enabling setting timestamps @gregfurman
• restart_backoff fields added to read_until input enable setting a backoff policy for when the child input restarts @aramperes

Fixed

• aws_dynamodb output no longer drops successfully-built messages when another message in the batch fails request construction @cthorner
• aws_kinesis assign msgChan after succesful connection @richardartoul
• aws_kinesis input fixed a nil pointer panic when ListShards returned an error @richardartoul
• aws_kinesis input fixed ListShards pagination error @gregfurman
• omit_if_empty config option added to aws_dynamodb enabling the correction of previously documented behaviour that missing paths are omitted rather than written as null @cthorner
• aws_kinesis input fixed shard consumer busy-loop and excess timer allocations noticible at high shard counts @richardartoul
• schema_registry_decode & schema_registry_encode fixed for schema's whose subject contained a / @PitchBlack07

Changed

• aws_kinesis input simplified EFO architecture to align with Amazon's Kinesis Client @matus-tomlein

New Contributors

• @georgeTobia made their first contribution in #773
• @istairbn made their first contribution in #869
• @Shareed2k made their first contribution in #887
• @matus-tomlein made their first contribution in #819
• @PitchBlack07 made their first contribution in #858
• @Omar1H1 made their first contribution in #886
• @cthorner made their first contribution in #909
• @aramperes made their first contribution in #883

Full Changelog: v1.18.1...v1.19.0

Added

• grpc_client input component @jem-davies
• sync_response added to nats input NATS @henrikschristensen
• endpoint config option added to gcp_bigquery output @Shareed2k
• RLE_DICTIONARY support to parquet default encoding @georgeTobia
• elasticsearch processor @Omar1H1
• json_number_type config option added to aws_dynamodb output enables JSON numbers to be either stored as dynamoDB Strings / Numbers @cthorner
• negotiate config options added to http components to enable SPNEGO auth @lublak
• timestamp field added to gcp_bigtable enabling setting timestamps @gregfurman
• restart_backoff fields added to read_until input enable setting a backoff policy for when the child input restarts @aramperes

Fixed

• aws_dynamodb output no longer drops successfully-built messages when another message in the batch fails request construction @cthorner
• aws_kinesis assign msgChan after succesful connection @richardartoul
• aws_kinesis input fixed a nil pointer panic when ListShards returned an error @richardartoul
• aws_kinesis input fixed ListShards pagination error @gregfurman
• omit_if_empty config option added to aws_dynamodb enabling the correction of previously documented behaviour that missing paths are omitted rather than written as null @cthorner
• aws_kinesis input fixed shard consumer busy-loop and excess timer allocations noticible at high shard counts @richardartoul
• schema_registry_decode & schema_registry_encode fixed for schema's whose subject contained a / @PitchBlack07

Changed

• aws_kinesis input simplified EFO architecture to align with Amazon's Kinesis Client @matus-tomlein

1.18.1 - 2026-06-06

Fixed

• avro scanner call Scan() before Read() @istairbn
• protobuf processor buf schema registry poller goroutine leak @jem-davies

Changed

• upgrade to Go version 1.26.4 @jem-davies
• upgrade otlp dependency @jem-davies

Full Changelog: v1.18.0...v1.18.1

Fixed

• avro scanner call Scan() before Read() @istairbn
• protobuf processor buf schema registry poller goroutine leak @jem-davies

Changed

• upgrade to Go version 1.26.4 @jem-davies
• upgrade otlp dependency @jem-davies

1.18.0 - 2026-05-25

Added

• template processor enabling use of Go template syntax for message transformations @lublak
• fsevent input creates messages for file-system events with metadata pertaining to event @henrikschristensen
• duckdb_append output inserts rows into a DuckDB database using the Appender API @iamramtin
• digest_auth fields on http components enabling digest authentication @lublak
• oauth2 fields on kafka & kafka_franz enabling oauth2 authentication @vsl86 & @jem-davies
• emit_unpopulated field to protobuf processor enabling emitting unpopulated fields with their default JSON values @matta-dev
• Environment variable "BENTO_CONFIG" is checked for Bento Configuration @jem-davies
• checksum_algorithm field added to aws_s3 when set Bento computes the checksum for s3 to check @seanbarzilay

Fixed

• file processor delete operation fixed for windows @henrikschristensen
• goroutine leak in SQL components @adrianhaj
• nil-check added to sql_raw output @adrianhaj
• kafka_franz input to attach logger regardless of consumer group being set @gregfurman

Changed

• updated to Go version 1.26 @gregfurman & @jem-davies
• upgrade sarama to 1.47.0 (kafka component library) @gitphill
• upgrade golang/x/net for CVE @jem-davies
• removed reference to deprecated 'Optional' field in cuegen @aebrahim
• kafka_franz franz-go logs to surface at ERROR/WARN/INFO/DEBUG instead of ERROR/WARN/DEBUG/TRACE @gregfurman

New Contributors

• @vsl86 made their first contribution in #758
• @matta-dev made their first contribution in #844
• @aebrahim made their first contribution in #857
• @seanbarzilay made their first contribution in #817

Full Changelog: v1.17.0...v1.18.0

Added

• template processor enabling use of Go template syntax for message transformations @lublak
• fsevent input creates messages for file-system events with metadata pertaining to event @henrikschristensen
• duckdb_append output inserts rows into a DuckDB database using the Appender API @iamramtin
• digest_auth fields on http components enabling digest authentication @lublak
• oauth2 fields on kafka & kafka_franz enabling oauth2 authentication @vsl86 & @jem-davies
• emit_unpopulated field to protobuf processor enabling emitting unpopulated fields with their default JSON values @matta-dev
• Environment variable "BENTO_CONFIG" is checked for Bento Configuration @jem-davies
• checksum_algorithm field added to aws_s3 when set Bento computes the checksum for s3 to check @seanbarzilay

Fixed

• file processor delete operation fixed for windows @henrikschristensen
• goroutine leak in SQL components @adrianhaj
• nil-check added to sql_raw output @adrianhaj
• kafka_franz input to attach logger regardless of consumer group being set @gregfurman

Changed

• updated to Go version 1.26 @gregfurman & @jem-davies
• upgrade sarama to 1.47.0 (kafka component library) @gitphill
• upgrade golang/x/net for CVE @jem-davies
• removed reference to deprecated 'Optional' field in cuegen @aebrahim
• kafka_franz franz-go logs to surface at ERROR/WARN/INFO/DEBUG instead of ERROR/WARN/DEBUG/TRACE @gregfurman

What's Changed

1.17.0 - 2026-04-15

Added

• sanitize_namespace_names field to schema_registry_decode processor @jem-davies
• api_key to elasticsearch_v2 output adding the option to use a elasticsearch API key to connect @alexthemayers
• extract_tracing_map and new_root_span_with_link fields to the kafka_franz input @danielavelez12
• kafka_timestamp_ms metadata fields to both kafka_franz and kafka @dnson & @sonnydinhgc
• new file processor @henrikschristensen

Changed

• upgrade OTEL dependencies for CVE @gitphill
• upgrade go-jose/v4 to v4.1.4 for CVE @gergo-papp
• upgrade lambda distribution & update docs @jem-davies

New Contributors

• @msamadony made their first contribution in #774
• @henrikschristensen made their first contribution in #690
• @gergo-papp made their first contribution in #804
• @comigor made their first contribution in #806
• @dnson made their first contribution in #808
• @danielavelez12 made their first contribution in #803
• @alexthemayers made their first contribution in #812

Full Changelog: v1.16.2...v1.17.0

Added

• sanitize_namespace_names field to schema_registry_decode processor @jem-davies
• api_key to elasticsearch_v2 output adding the option to use a elasticsearch API key to connect @alexthemayers
• extract_tracing_map and new_root_span_with_link fields to the kafka_franz input @danielavelez12
• kafka_timestamp_ms metadata fields to both kafka_franz and kafka @dnson & @sonnydinhgc
• new file processor @henrikschristensen

Changed

• upgrade OTEL dependencies for CVE @gitphill
• upgrade go-jose/v4 to v4.1.4 for CVE
• upgrade lambda distribution & update docs @jem-davies

1.16.2 - 2026-03-31

Fixed

• aws_kinesis input busy loop when batching.period is set @jem-davies
• various dependency updates for CVEs

Full Changelog: v1.16.1...v1.16.2

Fixed

• aws_kinesis input busy loop when batching.period is set @jem-davies
• various dependency updates for CVEs

1.16.1 - 2026-03-19

Fixed

• add handling for authentication errors in SQL output components @adrianhaj

Full Changelog: v1.16.0...v1.16.1

Fixed

• add handling for authentication errors in SQL output components @adrianhaj

Added

• datadog_logs output component @gregfurman

1.16.0 - 2026-03-18

Added

• headers field added to websocket output enables setting custom headers to the websocket handshake @DackJempsey
• enhanced_fan_out configuration options for aws_kinesis input @jbeemster & @matus-tomlein
• aws_s3_stream output streams data to S3 using multipart uploads @triddell
• duckdb driver option added to sql components; @sapk & @James-Gilbert-
• debug field added to kafka input; enabling will forward sarama's internal logs to Bento's logger @gitphill
• error_source_label, error_source_path, error_source_type bloblang functions @gregfurman
• payload field added to http processor & http_client output; alternative to using the message as the payload @lublak
• python processor; WASM-based Python processor @gregfurman

Changed

• Modernize Go syntax with go fix; included 'modernize' linter in CI @gregfurman & @jem-davies
• Enabled use of # BENTO LINT DISABLE token in component example documentation @iamramtin

New Contributors

• @DackJempsey made their first contribution in #740

Full Changelog: v1.15.2...v1.16.0

Added

• headers field added to websocket output enables setting custom headers to the websocket handshake @DackJempsey
• enhanced_fan_out configuration options for aws_kinesis input @jbeemster & @matus-tomlein
• aws_s3_stream output streams data to S3 using multipart uploads @triddell
• duckdb driver option added to sql components; @sapk & @James-Gilbert-
• debug field added to kafka input; enabling will forward sarama's internal logs to Bento's logger @gitphill
• error_source_label, error_source_path, error_source_type bloblang functions @gregfurman
• payload field added to http processor & http_client output; alternative to using the message as the payload @lublak
• python processor; WASM-based Python processor @gregfurman

Changed

• Modernize Go syntax with go fix; included 'modernize' linter in CI @gregfurman & @jem-davies
• Enabled use of # BENTO LINT DISABLE token in component example documentation @iamramtin

1.15.2 - 2026-03-11

Added

• datadog_logs output component @gregfurman

Full Changelog: v1.15.1...v1.15.2

Added

• datadog_logs output component @gregfurman

Added

• gcp_bigtable output component @gregfurman