gcp-bigquery-client

Fix

• Fix BigQuery job_statistics.reservation_id serde to use snake_case. Thanks @benjaminran PR #120

Added

• Add interval to field type. Thanks @Groennbeck PR #117

What's Changed

• chore: add TableValuedFunction routine type by @thevaibhav-dixit in #109
• make ResultSet more general by @imor in #97
• add insert_all_gzipped endpoint by @idobenamram in #110
• add f64 type and repeated field mode support in AppendRows API by @imor in #112
• Reduce dependency (axum) by @hirofumi in #115
• Limit request size to under 10 MB for AppendRows API by @imor in #114

New Contributors

• @thevaibhav-dixit made their first contribution in #109
• @idobenamram made their first contribution in #110
• @hirofumi made their first contribution in #115

Full Changelog: 0.23.0...0.25.0

Added

• Limit request size to under 10 MB for AppendRows API. Thanks @imor - PR #514.
• Added f64 type and repeated field mode support in AppendRows API. Thanks @imor - PR #512.
• Reduce dependency (axum). Thanks @hirofumi - PR #115.

Added

• Added insert_all_gzipped method, see this PR for more details. Thanks @idobenamram.

Changed

• Added missing routine type TableValuedFunction as specified in the reference. It also fixes the data type of creation_time and last_modified_time to String type (see https://cloud.google.com/bigquery/docs/reference/rest/v2/routines). Thanks @thevaibhav-dixit.

• Added a new method ResultSet::new_from_get_query_results_response which creates a ResultSet from a GetQueryResultsResponse. Thanks @imor.

• Breaking changes:

  • Return type of JobApi::query changed from Result<ResultSet, BQError> to Result<QueryResponse, BQError>.
  • ResultSet::new renamed to ResultSet::new_from_query_response.

• Rationale for the breaking changes:

  JobApi::query now returns Result<QueryResponse, BQError> instead of Result<ResultSet, BQError>. A ResultSet wraps over a QueryResponse but callers didn't have acces to that internal object. To allow callers access to the internal object, JobApi::query now returns the internal object itself. This means older code which expected a ResultSet will break.

• Upgrading to the new version:

  To fix broken code, you'll have to call ResultSet::from_query_response function. For example, if your code looked like this:

  let mut result_set = client
        .job()
        .query(
            project_id,
            query_request,
        )
        .await?;
  

  It should be updated to:

  let query_response = client
        .job()
        .query(
            project_id,
            query_request,
        )
        .await?;
    let mut result_set = ResultSet::new_from_query_response(query_response);
  

  Another reason for the change was making it consistent with JobApi::get_query_results which already returned an unwrapped object which callers needed to manually wrap inside a ResultSet by calling ResultSet::new method.

What's Changed

• Add support for bigquery AppendRows storage write API by @imor in #95
• Add GZIP support by @Deniskore in #90
• Fix error about invalid certificate when calling append_rows api by @imor in #107
• Re-export hyper_rustls from yup by @DoumanAsh in #85
• pub use yup_oauth2; by @serprex in #86
• yup-oauth2 10 by @serprex in #89
• yup-oauth2 11 by @serprex in #92
• Fix clippy warnings produced with Rust 1.78.0 by @imor in #94
• tonic 0.12, prost 0.13 by @serprex in #104

New Contributors

• @DoumanAsh made their first contribution in #85
• @serprex made their first contribution in #86
• @imor made their first contribution in #94
• @Deniskore made their first contribution in #90

Full Changelog: 0.18.1...0.23.0

Fix

• Fix a root certificate issue following a breaking change in Tonic (by @imor).
• Remove dependency on protoc. The generated code is now included in the repository (by @lquerel).

Maintenance

• Bump versions of thiserror, hyper-util, tokio, serde, serde_json, tonic, tonic-build.

Added

• Add partial support for BigQuery Storage Write API (by @imor).
  • append_rows
  • get_write_stream
• Add GZIP support for insert_all (by @Deniskore). The gzip feature is included by default. See https://github.com/lquerel/gcp-bigquery-client/issues/74 for more information.

Breaking changes:

• Client::from_authenticator is now async.
• ClientBuilder::build_from_authenticator is now async.

Maintenance

• Bump version of yup_oauth2 to v11 (by @serpex). gcp-bigquery-client can now be used with ring or aws-lc-rs as a TLS backend.
• Fix Clippy warnings produced with Rust 1.78.0 (by @imor).

Maintenance

• Re-export yup_oauth2 as suggested by @serpex.

Maintenance

• Re-export hyper_rustls from yup (Thanks to @DoumanAsh)
• Bump versions of all dependencies to their most recent versions (including hyper and yup-oauth2)

What's Changed

• Apply the same fix as #54 to query_all by @LawnGnome in #64
• Feature/paginate through all jobs list by @Shirlo in #63
• Fix tabledata.list return type by @enricozb in #67
• add table_data_list_response module by @enricozb in #69
• add #[serde(default)] to NestedResponseError:status by @henriiik in #79
• Allow building Client from Authenticator by @henriiik in #77

New Contributors

• @LawnGnome made their first contribution in #64
• @Shirlo made their first contribution in #63
• @enricozb made their first contribution in #67
• @henriiik made their first contribution in #79

Full Changelog: 0.17.0...0.18.1

Improvement

• Add support to bigquery-emulator (Thanks to @henriiik)
• Add support to use the ClientBuilder to build a Client with an Authenticator (Thanks to @henriiik)

Fix

• Fix build issue with hyper-rustls (Thanks to @OmriSteiner and @nate-kelley-buster)

Fix

• Fix tabledata.list return type (Thank you @enricozb)

Improvement

• Feature/paginate through all jobs list #63 (Thank you @Shirlo)

Fix

• Apply the same fix as #54 to query_all #64 (Thank you @LawnGnome)

Add support for JSON column types

Improvement

• Add support for JSON column types. Thanks to Michael Gibson (@mchlgibs) for this contribution.

Improvement

• Add get_serde and get_serde_by_name methods to read columns for any types that implements serde::de:DeserializeOwned. Thanks to @andyquinterom for this contribution.

Improvement

• Update hyper-rustls version.

Improvement

• Fix Rows are not present when job not completed yet (Thanks @alu).

Improvement

• Add format_options field to QueryRequest (Thanks @JichaoS).

Improvement

• Update FieldType enum to Geography field type (Thanks @kiibo382).

Improvement

• Two new methods in the job API query_all_with_location and query_all_with_job_reference (Thanks @MikhailMS).

Improvement

• Example to run with bigquery-emulator (Thanks @marcoleni).

Improvement

• Application default credentials auth & authorized user auth (#46) (Thanks @kiibo382).

Fix

• Installed flow auth - execute the authorization code flow before returning (#45) (Thanks @kiibo382).
• Avoid panic when schema doesn't exist (#44) (Thanks @lee-hen).

Improvement

• Better error management in Client::from_service_account_key_file (Thanks @burmecia).

Improvement

• Abstraction of the Authenticator (Thanks @kiibo382).
• InstalledFlowAuthenticator support (Thanks @kiibo382).
• Support for BigQuery emulator (Thanks @Marcoleni)
• Bump yup-oauth2 crate version.
• Bump time crate version (security issue).

Fix

• Process list - Change numeric_id type from u64 to string (Thanks @kiibo382)

Improvement

• Make Client cloneable (Thanks @lee-hen).
• Bump yup-oauth2 crate version.
• Bump time crate version (security issue).
• Change Job.query_all method signature to return a stream to support more use cases (Thanks LiHRaM).

Improvement

• Add query_all method to support result pagination (Thanks to @LiHRaM).

Fix

• Fix dependencies issues (Thanks to @MathiasKindberg).
• Fix view creation (Thanks to @jeffreybolle).

Improvement

• Replace Chrome by Time.

Fix

• Fix QueryParameter type declaration (Thanks to @newapplesho).

Fix

• Fix 2 issues in the job API (Thanks to @nixxholas).

Added

• 2 features native-tls and rust-tls to respectively use OpenSSL or Rust TLS.
• Add methods is_empty, len, clear to TableDataInsertAllRequest.
• Add method add_rows to TableDataInsertAllRequest (thanks @nixxholas).
• Bump version for yup-oauth2 v6 (thanks @JamesHinshelwood).
• Implement Default trait for most of the structures in the model sub-directory.
• Implement Clone trait for most of the structures in the model sub-directory.
• Implement Display trait for ErrorProto and TableDataInsertAllResponseInsertErrors.

Fix

• Fix ResultSet.get_i64 not working with some valid integer notation (e.g. 123.45E4) (Thanks to @komi1230).

Fix

• Fix Workload identify serialization issue (Thanks to @komi1230).

Added

• Workload identify support (Thanks to @komi1230).

Warning: this version is incompatible with the previous version.

Added

• Added dataset.delete_if_exists.
• Added table.delete_if_exists.
• Added new setters for dataset and table structs.

Changed

• Removed redundant parameters in dataset.create.
• Removed redundant paramaters in table.create.
• Improved BQError::ResponseError.
• Improved the example.