airbyte-cdk

low-code: Make refresh token in oauth authenticator optional

Unfreeze requests version and test new pipeline

low-code: use jinja sandbox and restrict some methods

pin the version of the requests library

Support parsing non UTC dates and Connector Builder set slice descriptor

low-code: fix add field transformation when running from the connector builder

Emit stream status messages

low-code: remove now_local() macro because it's too unpredictable

low-code: alias stream_interval and stream_partition to stream_slice in jinja context

Connector builder scrubs secrets from raw request and response

low-code: Add title, description, and examples for all fields in the manifest schema

low-code: simplify session token authenticator interface

low-code: fix typo in ManifestDeclarativeSource

Emit slice log messages when running the connector builder

set slice and pages limit when reading from the connector builder module

Low-Code CDK: Enable use of SingleUseRefreshTokenAuthenticator

low-code: fix duplicate stream slicer update

Low-Code CDK: make RecordFilter.filter_records as generator

Enable oauth flow for low-code connectors

Remove unexpected error swallowing on abstract source's check method

connector builder: send stacktrace when error on read

Add connector builder module for handling Connector Builder server requests

CDK's read command handler supports Connector Builder list_streams requests

Fix reset pagination issue on test reads

• Low-code CDK: Override refresh_access_token logic DeclarativeOAuthAuthenticator

Releasing using the new release flow. No change to the CDK per se

OAuth: retry refresh access token requests

Low-Code CDK: duration macro added

support python3.8

Publishing Docker image for source-declarative-manifest

Breaking changes: We have promoted the low-code CDK to Beta. This release contains a number of breaking changes intended to improve the overall usability of the language by reorganizing certain concepts, renaming, reducing some field duplication, and removal of fields that are seldom used.

The changes are:

• Deprecated the concept of Stream Slicers in favor of two individual concepts: Incremental Syncs, and Partition Routers:
  • Stream will define an incremental_sync field which is responsible for defining how the connector should support incremental syncs using a cursor field. DatetimeStreamSlicer has been renamed to DatetimeBasedCursor and can be used for this field.
  • Retrievers will now define a partition_router field. The remaining slicers are now called SubstreamPartitionRouter and ListPartitionRouter, both of which can be used here as they already have been.
  • The CartesianProductStreamSlicer because partition_router can accept a list of values and will generate that same cartesian product by default.
• $options have been renamed to $parameters
• Changed the notation for component references to the JSON schema notation ($ref: "#/definitions/requester")
• DefaultPaginator no longer has a url_base field. Moving forward, paginators will derive the url_base from the HttpRequester. There are some unique cases for connectors that implement a custom Retriever.
• primary_key and name no longer need to be defined on Retrievers or Requesters. They will be derived from the stream’s definition
• Streams no longer define a stream_cursor_field and will derive it from the incremental_sync component. checkpoint_interval has also been deprecated
• DpathExtractor field_pointer has been renamed to field_path
• RequestOption can no longer be used with with inject_into set to path. There is now a dedicated RequestPath component moving forward.

Low-Code CDK: fix signature _parse_records_and_emit_request_and_responses

Low-Code: improve day_delta macro and MinMaxDatetime component

Make HttpAvailabilityStrategy default for HttpStreams

Low-Code CDK: make DatetimeStreamSlicer.step as InterpolatedString

Low-Code: SubstreamSlicer.parent_key - dpath support added

Fix issue when trying to log stream slices that are non-JSON-serializable

Use dpath.util.values method to parse response with nested lists

Use dpath.util.values method to parse response with nested lists

Limiting the number of HTTP requests during a test read

Surface the resolved manifest in the CDK

Add AvailabilityStrategy concept and use check_availability within CheckStream

Add missing package in previous patch release

Handle edge cases for CheckStream - checking connection to empty stream, and checking connection to substream with no parent records

Low-Code: Refactor low-code to use Pydantic model based manifest parsing and component creation

Low-code: Make documentation_url in the Spec be optional

Low-Code: Handle forward references in manifest

Allow for CustomRequester to be defined within declarative manifests

Adding cursor_granularity to the declarative API of DatetimeStreamSlicer

Add utility class to infer schemas from real records

Do not eagerly refresh access token in SingleUseRefreshTokenOauth2Authenticator #20923

Fix the naming of OAuthAuthenticator

Include declarative_component_schema.yaml in the publish to PyPi

Start validating low-code manifests using the declarative_component_schema.yaml file

Reverts additions from versions 0.13.0 and 0.13.3.

Low-code: Add token_expiry_date_format to OAuth Authenticator. Resolve ref schema

Fixed StopIteration exception for empty streams while check_availability runs.