google-cloud-bigquery

Features

• add progress bar to QueryJob.to_dataframe and to_arrow (#352) (dc78edd)
• allow routine references (#378) (f9480dc)

Bug Fixes

• dbapi: allow rows to be fetched from scripts (#387) (b899ad1), closes #377

Performance Improvements

• avoid extra API calls from to_dataframe if all rows are cached (#384) (c52b317)
• cache first page of jobs.getQueryResults rows (#374) (86f6a51)
• use getQueryResults from DB-API (#375) (30de15f)

Dependencies

• expand pyarrow dependencies to include version 2 (#368) (cd9febd)

11-05-2020 09:27 PST

Internal / Testing Changes

• update google.cloud.bigquery.__version__

Features

• add method api_repr for table list item (#299) (07c70f0)
• add support for listing arima, automl, boosted tree, DNN, and matrix factorization models (#328) (502a092)
• add timeout paramter to load_table_from_file and it dependent methods (#327) (b0dd892)
• add to_api_repr method to Model (#326) (fb401bd)
• allow client options to be set in magics context (#322) (5178b55)

Bug Fixes

• make TimePartitioning repr evaluable (#110) (20f473b), closes #109
• use version.py instead of pkg_resources.get_distribution (#307) (b8f502b)

Performance Improvements

• add size parameter for load table from dataframe and json methods (#280) (3be78b7)

Documentation

• update clustering field docstrings (#286) (5ea1ece), closes #285
• update snippets samples to support version 2.0 (#309) (61634be)

Dependencies

• add protobuf dependency (#306) (cebb5e0), closes #305
• require pyarrow for pandas support (#314) (801e4c0), closes #265

Features

• add constants for MONTH and YEAR time partitioning types (#283) (9090e1c)

Bug Fixes

• remove unnecessary dependency on libcst (#308) (c055930)

Performance Improvements

• remove redundant array deepcopy (#26) (b54f867)

Documentation

• samples: add create_table_clustered code snippet (#291) (d1eb8b3)

09-30-2020 14:51 PDT

Implementation Changes

• Transition the library to microgenerator. (#278) This is a breaking change that drops support for Python 2.7 and 3.5 and brings a few other changes. See migration guide for more info.

Internal / Testing Changes

• Update protoc-generated comments (via synth). (#270)
• Add CI secrets manager (via synth). (#271)

1.28.3 (2022-12-14)

Bug Fixes

• Fix invalid version specification of pyarrow (#1403) (4812d82)

1.28.2 (2022-06-07)

Bug Fixes

• deps: require protobuf<4.0.0 on v1 branch (#1271) (3dbeb72)

1.28.1 (2022-04-04)

Bug Fixes

• deps: require google-api-core >= 1.31.5, >= 2.3.2 on v1 release (#1166) (34d9bec)

Features

• add custom cell magic parser to handle complex --params values (#213) (dcfbac2)
• add instrumentation to list methods (#239) (fa9f9ca)
• add opentelemetry tracing (#215) (a04996c)
• expose require_partition_filter for hive_partition (#257) (aa1613c)

Bug Fixes

• fix dependency issue in fastavro (#241) (2874abf)
• update minimum dependency versions (#263) (1be66ce)
• validate job_config.source_format in load_table_from_dataframe (#262) (6160fee)

Documentation

• recommend insert_rows_json to avoid call to tables.get (#258) (ae647eb)

Bug Fixes

• rationalize platform constraints for 'pyarrow' extra (#235) (c9a0567)

Documentation

• Migrated code samples from https://github.com/GoogleCloudPlatform/python-docs-samples

Bug Fixes

• RowIterator.to_arrow() error when BQ Storage client cannot be created (#181) (7afa3d7)

Dependencies

• Updated version constraints on grmp dependency in anticipation of 1.0.0 release (#189)

Features

• use BigQuery Storage client by default (#55) (e75ff82), closes #91
• bigquery: add eq method for class PartitionRange and RangePartitioning (#162) (0d2a88d)
• bigquery: expose date_as_object parameter to users (#150) (a2d5ce9)
• bigquery: expose date_as_object parameter to users (#150) (cbd831e)

Bug Fixes

• dry run queries with DB API cursor (#128) (bc33a67)
• omit NaN values when uploading from insert_rows_from_dataframe (#170) (f9f2f45)

Documentation

• bigquery: add client thread-safety documentation (#132) (fce76b3)
• bigquery: add docstring for conflict exception (#171) (9c3409b)
• bigquery: consistent use of optional keyword (#153) (79d8c61)
• bigquery: fix the broken docs (#139) (3235255)

1.25.0 (2026-10-01)

Features

• declare Python3.15 support (8775794)

02-03-2020 01:38 PST

Implementation Changes

• Fix inserting missing repeated fields. (#10196)
• Deprecate client.dataset() in favor of DatasetReference. (#7753)
• Use faster to_arrow + to_pandas in to_dataframe() when pyarrow is available. (#10027)
• Write pandas datetime[ns] columns to BigQuery TIMESTAMP columns. (#10028)

New Features

• Check rows argument type in insert_rows(). (#10174)
• Check json_rows arg type in insert_rows_json(). (#10162)
• Make RowIterator.to_dataframe_iterable() method public. (#10017)
• Add retry parameter to public methods where missing. (#10026)
• Add timeout parameter to Client and Job public methods. (#10002)
• Add timeout parameter to QueryJob.done() method. (#9875)
• Add create_bqstorage_client parameter to to_dataframe() and to_arrow() methods. (#9573)

Dependencies

• Fix minimum versions of google-cloud-core and google-resumable-media dependencies. (#10016)

Documentation

• Fix a comment typo in job.py. (#10209)
• Update code samples of load table file and load table URI. (#10175)
• Uncomment Client constructor and imports in samples. (#10058)
• Remove unused query code sample. (#10024)
• Update code samples to use strings for table and dataset IDs. (#9974)

Internal / Testing Changes

• Bump copyright year to 2020, tweak docstring formatting (via synth). #10225
• Add tests for concatenating categorical columns. (#10180)
• Adjust test assertions to the new default timeout. (#10222)
• Use Python 3.6 for the nox blacken session (via synth). (#10012)

12-16-2019 09:39 PST

Implementation Changes

• Add iamMember entity type to allowed access classes. (#9973)
• Fix typo in import error message (pandas -> pyarrow). (#9955)

Dependencies

• Add six as an explicit dependency. (#9979)

Documentation

• Add sample to read from query destination table. (#9964)

12-11-2019 13:31 PST

New Features

• Add close() method to client for releasing open sockets. (#9894)
• Add support of use_avro_logical_types for extract jobs. (#9642)
• Add support for hive partitioning options configuration. (#9626)
• Add description for routine entities. (#9785)

Documentation

• Update code samples to use strings for table and dataset IDs. (#9495)

Internal / Testing Changes

• Run unit tests with Python 3.8. (#9880)
• Import Mapping from collections.abc not from collections. (#9826)

11-13-2019 12:23 PST

Implementation Changes

• Preserve job config passed to Client methods. (#9735)
• Use pyarrow fallback for improved schema detection. (#9321)
• Add TypeError if wrong job_config type is passed to client job methods. (#9506)
• Fix arrow deprecation warning. (#9504)

New Features

• Add --destination_table parameter to IPython magic. (#9599)
• Allow passing schema as a sequence of dicts. (#9550)
• Implement defaultEncryptionConfiguration on datasets. (#9489)
• Add range partitioning to tables, load jobs, and query jobs. (#9477)

Dependencies

• Pin google-resumable-media to includ 0.5.x. (#9572)

Documentation

• Fix link anchors in external config docstrings. (#9627)
• Add python 2 sunset banner to documentation. (#9036)
• Add table create sample using integer range partitioning. (#9478)
• Document how to achieve higher write limit and add tests. (#9574)
• Add code sample for scripting. (#9537)
• Rewrite docs in Google style, part 2. (#9481)
• Use multi-regional key path for CMEK in snippets. (#9523)

Internal / Testing Changes

• Fix undelete table system test to use milliseconds in snapshot decorator. (#9649)
• Format code with latest version of black. (#9556)
• Remove duplicate test dependencies. (#9503)

10-16-2019 10:33 PDT

New Features

• add ability to pass in a table ID instead of a query to the %%bigquery magic (#9170)
• add support for custom QueryJobConfig in BigQuery.cursor.execute method (#9278)
• store QueryJob to destination var on error in %%bigquery magic (#9245)
• add script statistics to job resource (#9428)
• add support for sheets ranges (#9416)
• add support for listing jobs by parent job (#9225)
• expose customer managed encryption key for ML models (#9302)
• add Dataset.default_partition_expiration_ms and Table.require_partition_filter properties (#9464)

Dependencies

• restrict version range of google-resumable-media (#9243)

Documentation

• document how to load data as JSON string (#9231)
• standardize comments and formatting in existing code samples (#9212)
• rewrite docstrings in Google style (#9326)
• fix incorrect links to REST API in reference docs (#9436)

Internal / Testing Changes

• add code samples to lint check (#9277)
• update code samples to use strings for table and dataset IDs (#9136)
• simplify scripting system test to reduce flakiness (#9458)

09-13-2019 11:22 PDT

Implementation Changes

• Change default endpoint to bigquery.googleapis.com (#9213)
• Change the default value of Cursor instances' arraysize attribute to None (#9199)
• Deprecate automatic schema conversion. (#9176)
• Fix list_rows() max results with BQ storage client (#9178)

New Features

• Add Model.encryption_config. (via synth) (#9214)
• Add Client.insert_rows_from_dataframe() method (#9162)
• Add support for array parameters to Cursor.execute(). (#9189)
• Add support for project IDs with org prefix to Table.from_string() factory. (#9161)
• Add --max_results option to Jupyter magics (#9169)
• Autofetch table schema on load if not provided. (#9108)
• Add max_results parameter to QueryJob.result(). (#9167)

Documentation

• Fix doc link. (#9200)

Internal / Testing Changes

• Revert "Disable failing snippets test (#9156)." (#9220)

09-03-2019 14:33 PDT

Implementation Changes

• Raise when unexpected fields are present in the LoadJobConfig.schema when calling load_table_from_dataframe. (#9096)
• Determine the schema in load_table_from_dataframe based on dtypes. (#9049)
• Raise helpful error when loading table from dataframe with STRUCT columns. (#9053)
• Fix schema recognition of struct field types. (#9001)
• Fix deserializing None in QueryJob for queries with parameters. (#9029)

New Features

• Include indexes in table written by load_table_from_dataframe, only if fields corresponding to indexes are present in LoadJobConfig.schema. (#9084)
• Add client_options to constructor. (#8999)
• Add --dry_run option to %%bigquery magic. (#9067)
• Add load_table_from_json() method to create a table from a list of dictionaries. (#9076)
• Allow subset of schema to be passed into load_table_from_dataframe. (#9064)
• Add support for unsetting LoadJobConfig.schema. (#9077)
• Add support to Dataset for project IDs containing an org prefix. (#8877)
• Add enum with SQL type names allowed to be used in SchemaField. (#9040)

Documentation

• Fix the reference URL for Client.create_dataset(). (#9149)
• Update code samples to use strings for table names instead of client.dataset(). (#9032)
• Remove compatability badges from READMEs. (#9035)
• Fix Pandas DataFrame load example under Python 2.7. (#9022)

Internal / Testing Changes

• Disable failing snippets test for copying CMEK-protected tables. (#9156)
• Fix BigQuery client unit test assertions (#9112)
• Replace avro with arrow schemas in test_table.py (#9056)

08-08-2019 12:28 PDT

New Features

• Add bqstorage_client param to QueryJob.to_arrow() (#8693)
• Include SQL query and job ID in exception messages. (#8748)
• Allow using TableListItem to construct a Table object. (#8738)
• Add StandardSqlDataTypes enum to BigQuery (#8782)
• Add to_standard_sql() method to SchemaField (#8880)
• Add debug logging statements to track when BQ Storage API is used. (#8838)
• Hide error traceback in BigQuery cell magic (#8808)
• Allow choice of compression when loading from dataframe (#8938)
• Additional clustering metrics for BQML K-means models (via synth). (#8945)

Documentation

• Add compatibility check badges to READMEs. (#8288)
• Link to googleapis.dev documentation in READMEs. (#8705)
• Remove redundant service account key code sample. (#8891)

Internal / Testing Changes

• Fix several pytest "skip if" markers (#8694)
• Update tests to support conversion of NaN as NULL in pyarrow 0.14.*. (#8785)
• Mock external calls in one of BigQuery unit tests (#8727)
• Set IPython user agent when running queries with IPython cell magic (#8713)
• Use configurable bucket name for GCS samples data in systems tests. (#8783)
• Move maybe_fail_import() to top level test utils (#8840)
• Set BQ Storage client user-agent when in Jupyter cell (#8734)

07-12-2019 07:56 PDT

New Features

• Support faster Arrow data format in to_dataframe when using BigQuery Storage API. (#8551)
• Add to_arrow to get a pyarrow.Table from query results. (#8609)

Dependencies

• Exclude bad 0.14.0 pyarrow release. (#8551)

07-01-2019 10:22 PDT

New Features

• Add Routines API. (#8491)
• Add more stats to Models API, such as optimization_strategy (via synth). (#8344)

Documentation

• Add docs job to publish to googleapis.dev. (#8464)
• Add sample demonstrating how to create a job. (#8422)
• Use autodetected location in code samples. (#8340, #8341)

Internal / Testing Changes

• Refactor to_dataframe to deterministicly update progress bar. (#8303)

06-14-2019 10:10 PDT

Implementation Changes

• Fix bug where load_table_from_dataframe could not append to REQUIRED fields. (#8230)

New Features

• Add page_size parameter to QueryJob.result. (#8206)

06-04-2019 11:11 PDT

New Features

• Add maximum_bytes_billed argument and context.default_query_job_config property to magics. (#8179)

Dependencies

• Don't pin google-api-core in libs using google-cloud-core. (#8213)

05-31-2019 10:22 PDT

New Features

• Use job_config.schema for data type conversion if specified in load_table_from_dataframe. (#8105)

Internal / Testing Changes

• Adds private _connection object to magics context. (#8192)
• Fix coverage in 'types.py' (via synth). (#8146)

05-21-2019 11:16 PDT

Implementation Changes

• Don't raise error when encountering unknown fields in Models API. (#8083)

Documentation

• Use alabaster theme everwhere. (#8021)

Internal / Testing Changes

• Add empty lines (via synth). (#8049)

05-16-2019 11:25 PDT

Implementation Changes

• Remove duplicates from index on pandas DataFrames returned by to_dataframe(). (#7953)
• Prevent error when time partitioning is populated with empty dict (#7904)
• Preserve order in to_dataframe with BQ Storage from queries containing ORDER BY (#7793)
• Respect progress_bar_type in to_dataframe when used with BQ Storage API (#7697)
• Refactor QueryJob.query to read from resource dictionary (#7763)
• Close the to_dataframe progress bar when finished. (#7757)
• Ensure that KeyboardInterrupt during to_dataframeno longer hangs. (#7698)
• Raise ValueError when BQ Storage is required but missing (#7726)
• Make total_rows available on RowIterator before iteration (#7622)
• Avoid masking auth errors in to_dataframe with BQ Storage API (#7674)

New Features

• Add support for passing client_info. (#7849 and (#7806)
• Phase 1 for storing schemas for later use. (#7761)
• Add destination and related properties to LoadJob. (#7710)
• Add clustering_fields property to TableListItem (#7692)
• Add created and expires properties to TableListItem (#7684)

Dependencies

• Pin google-cloud-core >= 1.0.0, < 2.0dev. (#7993)
• Add [all] extras to install all extra dependencies (#7610)

Documentation

• Move table and dataset snippets to samples/ directory (#7683)

Internal / Testing Changes

• Blacken unit tests. (#7960)
• Cleanup client tests with method to create minimal table resource (#7802)

04-05-2019 08:16 PDT

Dependencies

• Add dependency on protobuf. (#7668)

04-04-2019 09:19 PDT

Internal / Testing Changes

• Increment version number in setup.py.

03-06-2019 15:20 PST

Implementation Changes

• Harden 'ArrayQueryParameter.from_api_repr' against missing 'parameterValue'. (#7311)
• Allow nested records w/ null values. (#7297)

New Features

• Add exists_ok and not_found_ok options to ignore errors when creating/deleting datasets/tables. (#7491)
• Accept a string in Table and Dataset constructors. (#7483)

Documentation

• Update docstring of RowIterator's to_dataframe (#7306)
• Updated client library documentation URLs. (#7307)

Internal / Testing Changes

• Fix lint. (#7383)

1.9.0 (2026-10-01)

Features

• declare Python3.15 support (8775794)
• update API sources and regenerate (#18513) (7d7adca)

12-17-2018 17:53 PST

Documentation

• Document Python 2 deprecation (#6910)
• Normalize docs for 'page_size' / 'max_results' / 'page_token' (#6842)

12-10-2018 12:39 PST

Implementation Changes

• Add option to use BQ Storage API with to_dataframe (#6854)
• Fix exception type in comment (#6847)
• Add to_bqstorage to convert from Table[Reference] google-cloud-bigquery-storage reference (#6840)
• Import iam.policy from google.api_core. (#6741)
• Add avro logical type control for load jobs. (#6827)
• Allow setting partition expiration to 'None'. (#6823)
• Add retry argument to _AsyncJob.result. (#6302)

Dependencies

• Update dependency to google-cloud-core (#6835)

Documentation

• Add avro load samples (#6832)

Internal / Testing Changes

• Blacken libraries (#6794)
• Fix copy/paste typos in noxfile comments (#6831)

11-05-2018 16:41 PST

Implementation Changes

• Add destination table properties to LoadJobConfig. (#6202)
• Allow strings or references in create_dataset and create_table (#6199)
• Fix swallowed error message (#6168)

New Features

• Add --params option to %%bigquery magic (#6277)
• Expose to_api_repr method for jobs. (#6176)
• Allow string in addition to DatasetReference / TableReference in Client methods. (#6164)
• Add keyword arguments to job config constructors for setting properties (#6397)

Documentation

• Update README service links in quickstart guides. (#6322)
• Move usage guides to their own docs. (#6238)
• Normalize use of support level badges (#6159)

Internal / Testing Changes

• Deprecation cleanups (#6304)
• Use _get_sub_prop helper so missing load stats don't raise. (#6269)
• Use new Nox (#6175)
• Harden snippets against transient GCS errors. (#6184)

1.6.0 (2026-10-01)

Features

• declare Python3.15 support (8775794)

Implementation Changes

• Retry '502 Bad Gateway' errors by default. (#5930)
• Avoid pulling entire result set into memory when constructing dataframe. (#5870)
• Add support for retrying unstructured 429 / 500 / 502 responses. (#6011)
• Populate the jobReference from the API response. (#6044)

Documentation

• Prepare documentation for repo split (#5955)
• Fix leakage of bigquery/spanner sections into sidebar menu. (#5986)

Internal / Testing Changes

• Test pandas support under Python 3.7. (#5857)
• Nox: use inplace installs (#5865)
• Update system test to use test data in bigquery-public-data. (#5965)

1.5.0 (2026-10-01)

Features

• declare Python3.15 support (8775794)

Implementation Changes

• Add 'internalError' to retryable error reasons. (#5599)
• Don't raise exception if viewing CREATE VIEW DDL results (#5602)

New Features

• Add Orc source format support and samples (#5500)
• Move 'DEFAULT_RETRY' (w/ its predicate) to a new public 'retry' module. (#5552)
• Allow listing rows on an empty table. (#5584)

Documentation

• Add load_table_from_dataframe() to usage docs and changelog and dedents snippets in usage page (#5501)
• Add samples for query external data sources (GCS & Sheets) (#5491)
• Add BigQuery authorized view samples (#5515)
• Update docs to show pyarrow as the only dependency of load_table_from_dataframe() (#5582)

Internal / Testing Changes

• Add missing explict coverage for '_helpers' (#5550)
• Skip update_table and update_dataset tests until etag issue is resolved. (#5590)

New Features

• NUMERIC type support (#5331)
• Add timeline and top-level slot-millis to query statistics. (#5312)
• Add additional statistics to query plan stages. (#5307)
• Add client.load_table_from_dataframe() (#5387)

Documentation

• Use autosummary to split up API reference docs (#5340)
• Fix typo in Client docstrings (#5342)

Internal / Testing Changes

• Prune systests identified as reduntant to snippets. (#5365)
• Modify system tests to use prerelease versions of grpcio (#5304)
• Improve system test performance (#5319)

Implementation Changes

• Switch list_partitions helper to a direct metatable read (#5273)
• Fix typo in Encoding.ISO_8859_1 enum value (#5211)

New Features

• Add UnknownJob type for redacted jobs. (#5281)
• Add project parameter to list_datasets and list_jobs (#5217)
• Add from_string factory methods to Dataset and Table (#5255)
• Add column based time partitioning (#5267)

Documentation

• Standardize docstrings for constants (#5289)
• Fix docstring / impl of ExtractJob.destination_uri_file_counts. (#5245)

Internal / Testing Changes

• Add testing support for Python 3.7; remove testing support for Python 3.4. (#5295)

New Features

• Add client.get_service_account_email (#5203)

Documentation

• Update samples and standardize region tags (#5195)

Internal / Testing Changes

• Fix trove classifier to be Production/Stable
• Don't suppress 'dots' output on test (#5202)