github.com/databricks/terraform-provider-databricks

• Added experimental databricks_sql_table resource to manage tables in the Unity Catalog (#2213).
• Added databricks_pipelines data source (#2202).
• Added missing permissions to databricks_grants resource (#2260).
• Added support for running databricks_cluster init scripts from workspace files (#2251).
• Added suppress diff for run_if in databricks_job (#2229).
• Fixed delete permission error for manually removed databricks_job (#2225).
• Documented fleet selector in the databricks_node_type data source (#2261).
• Documented example for databricks_job tags (#2235).
• Documented more Azure Databricks workspaces creation (#2228, #2248).
• Removed note about Azure KeyVault-based databricks_secret_scope and service principals (#2231).
• Migrated databricks_cluster_policy to Go SDK (#2250).
• Updated databricks_sql_endpoint docs for Azure DBSQL Serverless GA (#2249, #2254).
• Updated policy definition in databricks_aws_crossaccount_policy data source (#2262).
• Bumped databricks-sdk-go from 0.7.0 to 0.8.0 (#2259).

• Add exporter support for databricks_sql_alert (#2207).
• Add support for notifications in databricks_pipeline resource (#2218).
• Add suppress diff for path argument of databricks_directory resource when it ends with / (#2204).
• Exporter: don't export storage when databricks_pipeline was created with default value (#2203).
• Exporter: phase 1 of support for Account-level exports (#2205).
• Fixed regression in databricks_group data not to require workspace admin privileges (#2210).
• Suppress diff for edition attribute in databricks_pipeline (#2219).

• Explicitly include SCIM attributes for databricks_group, databricks_user, databricks_user_role, databricks_group_role, databricks_group_member, databricks_group_instance_profile, databricks_user data, databricks_group data, and databricks_entitlement resources (#2200).
• Added SQL File task to databricks_job resource (#2199).
• Fix diff detection for databricks_share resource (#2197).
• Guide to deploy Databricks on Azure with PrivateLink - Standard deployment (#2066).
• Remove CREATE_VIEW from databricks_grants doc (#2198).

Updated dependency versions:

• Bump github.com/databricks/databricks-sdk-go from 0.6.0 to 0.7.0 (#2195).
• Bump golang.org/x/mod from 0.9.0 to 0.10.0 (#2192).

• Allow rotating token block in databricks_mws_workspaces resource by only changing comment field (#2114).
• Exclude roles in SCIM API list calls to reduce load on Databricks SCIM service (#2181).
• Fixed databricks_service_principals data source issue with empty filter (#2185).
• Update Go SDK to v0.6.0 (#2186).

• Added caching of SCIM Me API call to databricks_current_user data source and databricks_permissions resource. (#2170).
• Added example for automatically rotating a token (#2135).
• Added run_if condition in databricks_job resource (#2125).
• Added File Arrival trigger to databricks_job resource (#2142).
• Added source parameter for spark_python_task in databricks_job (#2157).
• Automatically add CAN_MANAGE permission on databricks_sql_endpoint for calling user (#2168).
• Deprecated enable_serverless_compute on databricks_sql_global_config resource (#2139).
• Document enable_serverless_compute API changes in databricks_sql_endpoint resource (#2137).
• Fix edge cases for databricks_permissions resource (#2158).
• Migrate databricks_cluster_policy data source to Go SDK (#2155).
• Update the description of ip_addresses parameter in databricks_ip_access_list docs (#2116).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.25.0 to 2.26.1 (#2140).
• Bump github.com/zclconf/go-cty from 1.13.0 to 1.13.1 (#2124).

• Added databricks_sql_alert resource (#2047).
• Added experimental GCP support for more resources (#2088, #2091, #2090, #2089, #2080).
• Added suppress diff to default_data_access_config_id in databricks_metastore (#2111).
• Export initialize_file_system for ADLS Gen2 mounts (#2107).
• Enforce formatting on pull requests (#2099).
• Added MatchRegexp match type for partial matches (#2102).
• Skip model serving integration test on GCP (#2098).
• More doc fixes (#2108, #2106).

Updated dependency versions:

• Bump github.com/databricks/databricks-sdk-go from 0.4.0 to 0.5.0 (#2096, #2112).
• Bump github.com/hashicorp/hcl/v2 from 2.16.1 to 2.16.2 (#2097).

1.12.0

• Added databricks_model_serving resource (#2054).
• Added Unity Catalog on GCP support (#2000).
• Deprecate schedule block in databricks_sql_query resource (#2078).
• Fixed InitScripts Type to work with GCS and ABFS in databricks_cluster resource (#2067).
• Added more testing for databricks_tables data source (#2075).
• Added more testing for databricks_schemas data source (#2074).
• Migrated databricks_node_type data source to Go SDK (#2070).
• Migrated databricks_schemas data to Go SDK (#2065).
• Migrated databricks_tables data source to SDK (#2068).
• Migrated databricks_views data source to Go SDK (#2073).
• Migrated databricks_git_credential to Go SDK (#2069).
• Migrated databricks_shares data source to Go SDK (#2072).

Updated dependency versions:

• Bump github.com/databricks/databricks-sdk-go from v0.3.3 to v0.4.0 (#2086).
• Bump golang.org/x/mod from 0.8.0 to 0.9.0 (#2076).

1.11.1

• Databricks on Azure with PrivateLink - Simplified deployment (#1977).
• Deterministic diff for databricks_permissions (#2059).

1.11.0

• Added force_delete_home_dir and force_delete_repos attributes to databricks_user and databricks_service_principal resources (#2032).
• Added docs for continuous block in the databricks_job resource (#2048).
• Exporter: databricks_permissions for databricks_notebook & databricks_directory (#1908).
• Improve error messages for databricks_permissions (#2055).
• Make reflect resource utility friendly with Go SDK (#2051).

Updated dependency versions:

• Bump github.com/stretchr/testify from 1.8.1 to 1.8.2 (#2049).

1.10.1

• Migrated databricks_catalogs data to Go SDK (#2038).
• Migrated databricks_current_user data source to Go SDK (#2037).
• Migrated databricks_workspace_conf to Go SDK (#2035).
• Added new feature (#2015).
• Minor documentation improvements (#2039).

Updated dependency versions:

• Bump github.com/databricks/databricks-sdk-go from v0.3.2 to v0.3.3 (#2044).
• Bump github.com/zclconf/go-cty from 1.12.1 to 1.13.0 (#2043).

1.10.0

• Migrated client and configuration layer to github.com/databricks/databricks-sdk-go (#1848).
• Added new attribute to databricks_job resource (#1988).
• Added history_data_sharing_status, partition and status fields to databricks_share (#2013).
• Added start_version and cdf_enabled support for databricks_share (#2007).
• Fixed databricks_share update logic (#2022).
• Updated GCP guide with new permissions required to deploy databricks_mws_networks (#1999).
• Minor doc changes to address #1916, #1937, #2010 (#2012).
• Various documentation improvements (#1981, #1998, #2002, #2016, #2019).
• Integration testing improvements (#1935, #2024).

Updated dependency versions:

• Removed unused github.com/Azure/go-autorest/autorest and github.com/mitchellh/go-homedir (#2026).
• Bump Go from 1.18 to 1.19 (#2029).
• Bump CodeQL to v2 (#2027).
• Bump github.com/golang-jwt/jwt/v4 from 4.4.3 to 4.5.0 (#2030).
• Bump github.com/hashicorp/hcl/v2 from 2.15.0 to 2.16.1 (#1971, #1997).
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.24.1 to 2.25.0 (#2031).
• Bump golang.org/x/mod from 0.7.0 to 0.8.0 (#1996).
• Bump golang.org/x/net from 0.6.0 to 0.7.0 (#2028).
• Bump google.golang.org/api from 0.108.0 to 0.110.0 (#1984, #1995).

1.9.2

• Added file library type to databricks_pipeline resource (#1975).
• Added new node type selector to databricks_node_type data source (#1957).
• Removed check for creation of Azure Key Vault-based databricks_secret_scope using Service Principals (#1965).
• Reworked Graviton selection logic in databricks_node_type data source (#1974).
• Don't consider GPU-based nodes in databricks_node_type data source until explicitly requested (#1978).

Documentation:

• Added SQL example for databricks_job documentation (#1967).
• Added description to max_clusters_per_user in databricks_cluster_policy (#1959).
• Clarify SQL warehouse types for sql_task in databricks_job (#1964).
• Moved tags to default_tags in AWS provider examples (#1969).
• Added documentation around webhooks_notifications for databricks_job (#1968).
• Removed deprecated params from bucket doc examples (#1970).

1.9.1

• Added max_clusters_per_user to databricks_cluster_policy resource (#1955).
• Added support for cluster_mount_infos in databricks_cluster (#1945).
• Added parent attribute to databricks_sql_query and databricks_sql_dashboard (#1949).
• Added support for iam_role_arn in databricks_instance_profile (#1943).
• Use zone_id = "auto" for databricks_mount on S3 (#1932).
• Fixed databricks_cluster resource missing library definitions issues (#1925).
• Remove computed annotation for aws_attributes (#1933).

Updated dependency versions:

• Bump github.com/Azure/go-autorest/autorest/adal from 0.9.21 to 0.9.22 (#1953).
• Bump github.com/Azure/go-autorest/autorest/azure/auth (#1952).
• Bump google.golang.org/api from 0.106.0 to 0.107.0 (#1929).
• Bump google.golang.org/api from 0.107.0 to 0.108.0 (#1954).

1.9.0

• Added databricks_mws_credentials data source (#1909).
• Fixed incorrect diff for num_clusters and min_num_clusters for stopped databricks_sql_endpoint (#1927).
• Fixed privilege_assignment in databricks_sql_permissions (#1872).
• Documentation improvements (#1921, #1923).

Updated dependency versions:

• Bump github.com/hashicorp/go-retryablehttp from 0.7.1 to 0.7.2 (#1913).
• Bump google.golang.org/api from 0.105.0 to 0.106.0 (#1914).

1.8.0

• Added support for GCP (Public Preview) with state upgraders for databricks_mws_workspaces (#1871, #1886, #1748, #1879).
• Added documentation for databricks_permission_assignment (#1880).
• Added azure_attributes to clusters in databricks_pipeline resource (#1854).
• Added databricks_instance_pool data source (#1907).
• Added databricks_provider resource for Delta Sharing (#1572).
• Added acceptance tests for databricks_cluster data and databricks_sql_endpoint data (#1882).
• Added search by name for databricks_cluster data source (#1901).
• Added support for sparse checkouts in the databricks_repo (#1869).
• Added config_reference attribute to databricks_secret for easier reference from Spark configuration (#1898).
• Added datarbicks_directory data source (#1902).
• Extended databricks_catalog resource to support Delta Sharing Catalog (#1887).
• Improved databricks_metastore_assignment resource (#1900).
• Improved databricks_grants error messages (#1888).
• Improved databricks_group documentation (#1816).
• Improved data_security_mode documentation for databricks_cluster (#1830).
• Replace the incorrect id attribute with the correct sp_id in service principal data source docs example (#1873).
• Use NVMe disk size for selection in the databricks_node_type data source (#1856).
• Allowed to override resource ID for specific data source (#1885).

Experimental Resource Exporter

• Added command-line flag to export all users and service principals (#1893).
• Added emit for secret scopes from Spark Conf and Env Vars (#1897).
• Fixed issue with exporting of resources with simple name (#1891).
• Generate references that are matching only to a prefix (#1890).
• Updated list of supported services and associated resources (#1894).
• Use databricks_group_role instead of deprecated databricks_group_instance_profile (#1905).
• Use dbfs_path as reference for init scripts in clusters (#1892).
• Logging improvements (#1895).

Updated dependency versions:

• Bump google.golang.org/api from 0.104.0 to 0.105.0 (#1863).

1.7.0

• Added support for Unity Catalog on GCP through gcp_service_account_key (#1836).
• Added support for Jupyter (.ipynb) files in databricks_notebook resource (#1801).
• Added databricks_cluster_policy data source (#1792).
• Added catalog parameter to dbt_task in databricks_job resource (#1774).
• Added home and repos attributes to databricks_user and databricks_service_principal (#1791).
• Added storage_root parameter in databricks_catalog and databricks_schema resources (#1784).
• Added exporting of databricks_service_principal resource (#1811).
• Added notebook source parameter for databricks_jobs data (#1837).
• Added support for init scripts on ADLS in databricks_cluster and related resources (#1845).
• Added definiton attribute to databricks_cluster_policy data (#1834).
• Added validation for preview account API paths (#1795).
• Made lifetime_seconds & comment optional for databricks_obo_token (#1844).
• Force replace when changing display_name of databricks_service_principal (#1783).
• We can now export admin and users groups as databricks_group data, not resource (#1721).
• We can now export predefined databricks_cluster_policy as data sources (#1815).
• We can now export databricks_sql_global_config resource (#1806).
• Fixed reference to databricks_cluster_policy in databricks_job during export (#1813).
• We can now explicitly normalize variable names during export (#1835).
• We can now fail fast in import.sh when can't import resource (#1814).
• Fixed multidomain databricks_user in exporter (#1722).
• Fixed missing attributes from databricks_job data source (#1798).
• Suppressed network diff for GCP workspaces with Databricks-managed VPC (#1847).
• Improved export of DBSQL objects (#1788).
• Documented webhook_notifications for databricks_job resource (#1842).
• Clarified databricks_job, databricks_mws_*, databricks_cluster docs (#1796).

Updated dependency versions:

• Bump github.com/golang-jwt/jwt/v4 from 4.4.2 to 4.4.3 (#1817).
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.24.0 to 2.24.1 (#1761).
• Bump golang.org/x/mod from 0.6.0 to 0.7.0 (#1760).
• Bump google.golang.org/api from 0.102.0 to 0.104.0 (#1758, #1839).

1.6.5

• Added query_plan attribute to databricks_sql_visualization (#1752).
• Fixed member_id reference of nested groups and databricks_group_member for exporter (#1723).
• Fixed auto-purged cluster behaviour for databricks_library (#1745).
• Use Jobs API 2.1 with name filter for databricks_job data source (#1744).

1.6.4

• Reverted PRO as default warehouse_type in databricks_sql_endpoint (#1741).
• Moved testing of clusters, instance pools, and SQL Warehouses to internally configured test environment variables (#1739).

Updated dependency versions:

• Bump google.golang.org/api from 0.101.0 to 0.102.0 (#1736).

1.6.3

• Added warehouse_type parameter to databricks_sql_endpoint to support PRO SKU (#1728).
• Correct exporting of the computed attributes for databricks_cluster (#1711).
• Escape database name in databricks_sql_permissions resource (#1730).

• Added runtime_engine to databricks_cluster (#1686).
• Added validation for path in databricks_repo (#1702).
• Added auto-detection of AWS CodeCommit URLs in databricks_repo (#1704).
• Restricting access to S3 bucket by custom tag on the IAM identity according to security email in databricks_aws_bucket_policy data resource (#1694).
• Update Azure Unity Catalog guide to use azurerm_databricks_access_connector (#1685).
• Clarify that databricks_mws_permission_assignment should be used for assigning account-level users/groups (#1706).
• Other documentation fixes (#1696, #1692).

Updated dependency versions:

• Bump github.com/stretchr/testify from 1.8.0 to 1.8.1 (#1689).
• Bump github.com/zclconf/go-cty from 1.11.1 to 1.12.0 (#1714).
• Bump golang.org/x/mod from 0.5.1 to 0.6.0 (#1690).
• Bump google.golang.org/api from 0.99.0 to 0.101.0 (#1713, #1691).

• Added CAN_VIEW permissions for databricks_sql_dashboard and databricks_sql_query (#1682).
• Added webhook_notifications support to databricks_job (#1674).
• Allow updating private_access_settings_id for databricks_mws_workspaces (#1668).
• Changed databricks_pipeline edition default value from advanced to ADVANCED (#1683).
• Fixed reference to display_name_contains in docs example (#1677).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.23.0 to 2.24.0 (#1671).
• Bump github.com/zclconf/go-cty from 1.11.0 to 1.11.1 (#1672).
• Bump google.golang.org/api from 0.98.0 to 0.99.0 (#1673).

• Added databricks_share resource, databricks_shares data source, and databricks_share data source (#1664).
• Documentation updates (#1666, #1669).

• Added enable_serverless_compute in the documentation for the databricks_sql_global_config (#1655).
• Update databricks_grants with new permissions model (#1657).
• Exporter now adds the force flag to users and groups (#1661).

Updated dependency versions:

• Bump google.golang.org/api from 0.97.0 to 0.98.0 (#1652).

• Added databricks_job data resource (#1509).
• Fixed handling of references in databricks_permissions resource exporter (#1631).
• Fixed stripping of CAN_MANAGE permission from caller of databricks_sql_query resource (#1644).
• Fixed provider debug mode (#1560).

Documentation improvements:

• Expanded documentation for databricks_sql_visualization resource (#1630).

Updated dependency versions:

• Bump github.com/hashicorp/hcl/v2 from 2.14.0 to 2.14.1 (#1634).
• Bump google.golang.org/api from 0.96.0 to 0.97.0 (#1633).

• Added autoscale mode configuration to databricks_pipeline resource (#1600).
• Fixed gcp_availability field in databricks_insance_pool resource (#1610).
• Fixed secret field name in databricks_mlflow_webhook resource (#1625).
• Further improvements of exporter (#1602).

Documentation improvements:

• Updates for databricks_table and databricks_mws_vpc_endpoint (#1616).
• Document http_timeout_seconds from common/client.go (#1599).
• Expand parameter documentation for databricks_sql_query resource (#1603).
• Updated Unity Catalog docs (#1605, #1626, #1620).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.21.0 to 2.23.0 (#1597, #1611).
• Bump google.golang.org/api from 0.94.0 to 0.96.0 (#1598, #1612).

• Added force_destroy flag to databricks_schema & databricks_catalog (#1578).
• Added databricks_entitlements resource (#1583).
• Added databricks_group_role resource (#1575).
• Added databricks_recipient resource for Delta Sharing (#1571).
• Added dbt_task field to databricks_job (#1537).
• Fixed drift in storage for databricks_pipeline (#1574).
• Fixed databricks_mws_private_access_settings defaults (#1567).
• Fixed databricks_user creation with force on account (#1577).
• Fixed databricks_permissions for calling user to CAN_MANAGE on databricks_cluster (#1579).

Documentation improvements:

• Added sql_task configuration block in databricks_job resource (#1589).
• Added supported languages in Unity Shared clusters (#1587).
• Removed "Public Preview" marker from Unity Catalog resources docs (#1570).
• Fixed instance pool docs (#1581).

Updated dependency versions:

• Bump github.com/hashicorp/hcl/v2 from 2.13.0 to 2.14.0 (#1582).
• Bump google.golang.org/api from 0.93.0 to 0.94.0 (#1569).

• Use resize API to scale databricks_cluster while it's running (#1541).
• Updated to latest Unity Catalog privileges model (#1556).
• Added cluster policy support for databricks_pipeline (#1554).
• Fixed databricks_node_type by skipping nodes that aren't available in subscription/region (#1534).
• Fixed sending of active flag in the databricks_user (#1536).
• Fixed Azure CLI tests on Go 1.19 (#1538).
• Various doc updates (#1553, #1552, #1544, #1543).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.20.0 to 2.21.0 (#1540).
• Bump github.com/zclconf/go-cty from 1.10.0 to 1.11.0 (#1558).
• Bump google.golang.org/api from 0.90.0 to 0.93.0 (#1525, #1545).
• Bump gopkg.in/ini.v1 from 1.66.6 to 1.67.0 (#1526).

• Added databricks_mws_permission_assignment resource (#1491).
• Added databricks_mws_workspaces data resource (#1497).
• Added exporter for databricks_pipeline and databricks_job (#1484).
• Fixed databricks_permissions for calling user to CAN_MANAGE on databricks_mlflow_model (#1507).
• Fixed phantom cluster blocks in databricks_pipeline (#1508).
• Improve test coverage of multitask databricks_job and databricks_pipeline (#1493).
• Minor stability improvements (#1505, #1487, #1496, #1503).

Updated dependency versions:

• Bump github.com/Azure/go-autorest/autorest from 0.11.27 to 0.11.28 (#1513).
• Bump github.com/Azure/go-autorest/autorest/adal from 0.9.20 to 0.9.21 (#1512).
• Bump github.com/Azure/go-autorest/autorest/azure/cli from 0.4.5 to 0.4.6 (#1515).
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.19.0 to 2.20.0 (#1516).
• Bump google.golang.org/api from 0.87.0 to 0.90.0 (#1499, #1514).

• Added databricks_sql_warehouses data resource to list all warehouses in a workspace with a name filter (#1460).
• Added databricks_sql_warehouse data resource to list SQL warehouse attributes based on single id (#1460).
• Added databricks_cluster data resource to list cluster attributes based on single id (#1460).
• Added Azure Managed Identity documentation examples (#1471).
• Added more attributes to databricks_cluster (#1459).
• Added more attributes to databricks_instance_pool (#1463).
• Added feature request GitHub issue template (#1482).
• Added tf:optional tag to simplify the code (#1395).
• Fixed databricks_pipeline incorrect generation of cluster blocks (#1416).
• Fixed databricks_table update for column block (#1468).
• Fixed reads for any_file and anonymous_function in databricks_sql_permissions (#1477).
• Tuned integration tests for databricks_mws_* (#1483).
• Removed integration tests for databricks_azure_adls_gen1_mount (#1461).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.18.0 to 2.19.0 (#1475).
• Bump google.golang.org/api from 0.86.0 to 0.87.0 (#1476).

• Added metastore to databricks_grants (#1447).
• Added update support for databricks_mws_log_delivery (#1439).
• Fixed name generation for exported databricks_notebook (#1435).
• Fixed databricks_job recreation on changed docker_image URL (#1437).
• Fixed replace databricks_mws_networks on vpc_endpoints change (#1453).
• Fixed diff suppress in databricks_external_location on skip_validation (#1421).
• Switched to SQL warehouses API for databricks_sql_endpoint (#1414).
• Improve docs for databricks_permissions and databricks_obo_token (#1462).
• Improve docs for abfs block in databricks_mount (#1446).
• Improve dev docs for tf:"suppress_diff", tf:"force_new" and tf:"sensitive" tags (#1465).
• Moved couple of acceptance tests out of preview (#1433).
• Migrated to Go 1.18: interface{} -> any (#1466).

Updated dependency versions:

• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.17.0 to 2.18.0 (#1450).

• Added better handling of missing objects during import (#1417).
• Fix problem in the databricks_node_type data source (#1400).
• Fix update for databricks_storage_credential resource (#1403).
• Improve databricks_job resource (#1428).
• Upgraded UC API from 2.0 to 2.1 (#1418).
• Sanitized host provider field prior to auth flow (#1385).
• Use delta_sharing_scope instead of delta_sharing_enabled (#1398).
• Added instructions to create missing .terraform.lock.hcl (#1397).
• Clarified databricks_permissions doc for service principals (#1426).
• Clarified databricks_cluster autotermination_minutes default value (#1419).
• Fully moved codebase from databrickslabs to databricks namespace (#1429).
• Various integration testing improvements (#1425, #1427, #1420).

Updated dependency versions:

• Bump Go from 1.16.x to 1.18.x (#1413).
• Bump github.com/golang-jwt/jwt/v4 from 4.4.1 to 4.4.2 (#1407).
• Bump github.com/hashicorp/hcl/v2 from 2.12.0 to 2.13.0 (#1406).
• Bump github.com/stretchr/testify from 1.7.3 to 1.8.0 (#1387, #1408, #1422).
• Bump google.golang.org/api from 0.84.0 to 0.86.0 (#1386, #1423).