airbyte-cdk

Adding more tooling to cover source-stripe events stream

Raise error on passing unsupported value formats as query parameters

Vector DB CDK: Refactor embedders, File based CDK: Handle 422 errors properly in document file type parser

Vector DB CDK: Refactor embedders, File based CDK: Handle 422 errors properly in document file type parser

Update airbyte-protocol

Improve integration tests tooling

low-code: cache requests sent for parent streams File-based CDK: Add support for automatic primary key for document file type format File-based CDK: Add support for remote parsing of document file type format via API Vector DB CDK: Fix bug with embedding tokens with special meaning like <|endoftext|>

no-op to verify pypi publish flow

Allow for connectors to continue syncing when a stream fails

File-based CDK: hide source-defined primary key; users can define primary keys in the connection's configuration

Source Integration tests: decoupling entrypoint wrapper from pytest

First iteration of integration tests tooling (http mocker and response builder)

concurrent-cdk: factory method initializes concurrent source with default number of max tasks

Vector DB CDK: Add omit_raw_text flag

concurrent cdk: read multiple streams concurrently

low-code: fix injection of page token if first request

Fix of generate the error message using _try_get_error based on list of errors

Vector DB CDK: Remove CDC records, File CDK: Update unstructured parser

low-code: fix debug logging when using --debug flag

Increase maximum_attempts_to_acquire to avoid crashing in acquire_call

File CDK: Improve stream config appearance

Concurrent CDK: fix futures pruning

Fix spec schema generation for File CDK and Vector DB CDK and allow skipping invalid files in document file parser

Concurrent CDK: Increase connection pool size to allow for 20 max workers

Concurrent CDK: Improve handling of future to avoid memory leak and improve performances

Add call rate functionality

Fix class SessionTokenAuthenticator for CLASS_TYPES_REGISTRY mapper

File CDK: Improve file type detection in document file type parser

Concurrent CDK: incremental (missing state conversion). Outside of concurrent specific work, this includes the following changes:

• Checkpointing state was acting on the number of records per slice. This has been changed to consider the number of records per syncs
• Source.read_state and Source._emit_legacy_state_format are now classmethods to allow for developers to have access to the state before instantiating the source

File CDK: Add pptx support

make parameter as not required for default backoff handler

use in-memory cache if no file path is provided

File CDK: Add unstructured parser

Update source-declarative-manifest base image to update Linux alpine and Python

Add max time for backoff handler

File CDK: Add CustomFileBasedException for custom errors

low-code: Allow connector developers to specify the type of an added field

concurrent cdk: fail fast if a partition raises an exception

File CDK: Avoid listing all files for check command

Vector DB CDK: Expose stream identifier logic, add field remapping to processing | File CDK: Emit analytics message for used streams

Add filters for base64 encode and decode in Jinja Interpolation

Few bug fixes for concurrent cdk

Add ability to wrap HTTP errors with specific status codes occurred during access token refresh into AirbyteTracedException

Enable debug logging when running availability check

Enable debug logging when running availability check

File CDK: Allow configuring number of tested files for schema inference and parsability check

Vector DB CDK: Fix OpenAI compatible embedder when used without api key

Vector DB CDK: Improve batching process

Introduce experimental ThreadBasedConcurrentStream

Fix initialize of token_expiry_is_time_of_expiration field

Add new token_expiry_is_time_of_expiration property for AbstractOauth2Authenticator for indicate that token's expiry_in is a time of expiration

Coerce read_records to iterable in http availabilty strategy

Add functionality enabling Page Number/Offset to be set on the first request

Fix parsing of UUID fields in avro files

Vector DB CDK: Fix OpenAI embedder batch size

Add configurable OpenAI embedder to cdk and add cloud environment helper