Release Highlights

This is a Bug Fix (non-scheduled) release to address the Known Issues in v0.9.1.

User Experience

• Improvements to Nav Bar UX
• Improvements to filtering for Related Glossary Entities and Tags (migrated to using keyword filters and fixed longstanding urn-related bug)
• Enable providing an Ownership Type for Glossary Terms, Nodes, and Domains
• Allow adding links without a full domain to entity (community requested)

Actions

• Adding new Entity Change Events for DataProcessInstanceRunEvent and AssertionRunEvent

Access Management

• Added new Metadata Privilege called "Manage Children" which permits creating and deleting Glossary Terms and Glossary Nodes inside a particular Node.

Fixes

• Properly escape schema field urns with URN-encoded characters
• Fix around the visibility of deleting a Term Group with children
• Properly show personal access token duration beyond 1 month during creation

What's Changed

• feat(change-event): add change events for DataProcessInstanceRunEvent by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6320
• Worked on the Usage column & Lineage Drawer by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6290
• refactor(bootstrap data): Adding assertions data to bootstrap by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6324
• fix(ui) Disable deleting Term Groups with children by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6332
• feat(ingestion): business-glossary - Add values and relatedTerms support by @mohdsiddique in https://github.com/datahub-project/datahub/pull/6148
• fix(ui): two small ux fixes by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6335
• feat(ingest): add new ingestion source PowerBI Report Server by @alcoccoque in https://github.com/datahub-project/datahub/pull/5369
• feat(ingest): drop plugin support for airflow 1.x by @hsheth2 in https://github.com/datahub-project/datahub/pull/6331
• fix(ingest): fix invalid schema field urns with empty field path by @mayurinehate in https://github.com/datahub-project/datahub/pull/6338
• fix(perf): trim down unnecessary fields from container and domain GraphQl queries by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6337
• fix(adv search): fixing typo in es utils by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6348
• docs(ingest): clarify that redshift-usage doesn't support column-level usage by @hsheth2 in https://github.com/datahub-project/datahub/pull/6347
• Fix the date issue on Create Access token Modal by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6342
• Enable Owner Type for Glossary Node + Domain by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6334
• fix(ui) Fix filters in embedded list search component by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6350
• docs: add Razer as DataHub adopter by @lvxhnat in https://github.com/datahub-project/datahub/pull/6353
• Allow links without top level domain by @djordje-mijatovic in https://github.com/datahub-project/datahub/pull/6317
• feat(ingest): support reserved keywords in model codegen by @hsheth2 in https://github.com/datahub-project/datahub/pull/6351
• docs(act) update Act on Metadata landing page by @maggiehays in https://github.com/datahub-project/datahub/pull/6288
• feat(build): refactor cypress tests, add some tests for invite users, domain creation by @anshbansal in https://github.com/datahub-project/datahub/pull/6259
• fix(ingest): fix log line interpolation by @hsheth2 in https://github.com/datahub-project/datahub/pull/6349
• fix(schema-history): remove unnecessary margin on version selector by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6359
• feat(ingest): upgrade feast by @cburroughs in https://github.com/datahub-project/datahub/pull/6186
• fix(apache-ranger): compile ranger plugin for java 8 by @mohdsiddique in https://github.com/datahub-project/datahub/pull/6355
• feat(privileges) Create privileges to allow for managing children of entities by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6346
• fix(ui) Handle encoded schemaField urns on the frontend by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6321
• refactor(ui): Refactor the Glossary Related Entities, Tag Profiles to use search filters instead of query API. by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6352
• fix(ingest): only log vars if requested by @hsheth2 in https://github.com/datahub-project/datahub/pull/6362
• Install openjdk in base ingestion image by @frsann in https://github.com/datahub-project/datahub/pull/6365
• docs(logos) add Hurb and Razer logos to docs site by @maggiehays in https://github.com/datahub-project/datahub/pull/6363
• fix(ingest): bigquery - Sending lineage aspects as patch by @treff7es in https://github.com/datahub-project/datahub/pull/6313

New Contributors

• @alcoccoque made their first contribution in https://github.com/datahub-project/datahub/pull/5369
• @lvxhnat made their first contribution in https://github.com/datahub-project/datahub/pull/6353
• @cburroughs made their first contribution in https://github.com/datahub-project/datahub/pull/6186

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.9.1...v0.9.2

Release Highlights

Known Issues

• In embedded search experiences (Glossary Terms, Domains, Lineage), filters can become "locked" in place once selected. This is addressed in v0.9.2

User Experience

• Column-level Impact Analysis is here! You can now see the full end-to-end list of column dependencies; watch the demo here <p align="center"> <img width="70%" src="https://user-images.githubusercontent.com/15873986/199131362-5984ccdb-b951-4a36-ae49-15475bee2e06.png"/> </p>

• When creating a Glossary Term from the UI, you can now add the description in the same step <p align="center"> <img width="70%" src="https://user-images.githubusercontent.com/15873986/199131376-be59e2b2-f890-4421-8bf6-85d75ad87eba.png"/> </p>

• We now support adding Domains to Glossary Terms <p align="center"> <img width="70%" src="https://user-images.githubusercontent.com/15873986/199131391-4e1480ad-c6ef-4eca-ba7a-094ed54810b9.png"/> </p>

• You can now preview Entity Names and Types in browser tabs <p align="center"> <img width="70%" src="https://user-images.githubusercontent.com/15873986/199131404-4d9aea5b-8bfb-4d39-b18a-32e71d615bd5.png"/> </p>

• Login with SSO button on the login page.

Bug Fixes

• Assertions Tab functionality is restored
• SSO: Continuous login loop bug reported when the session cookie size exceed 4096 characters has been address.
• Ingestion scheduler for > 30 ingestion sources is now fixed. Previously there was a bug causing certain ingestion to become unscheduled.

Metadata Ingestion

• New Ingestion Source: Databricks Unity Catalog - check out the docs here
• Tableau: Column-level lineage and Stateful Ingestion are now supported
• LookML: Improved column-level lineage
• BigQuery: we have promoted bigqery-beta to bigquery
• Snowflake: Stateful Ingestion now supports deleting Containers

DataHub Docs Site

We continue to push improved feature guides to the DataHub docs site, including:

• Sync Status
• DataHub Roles
• Dataset Usage and Query History
• DataHub Access Policies
• Managed DataHub Metadata Tests

What's Changed

• feat(ui): looker, lookml - add banner to cross-link ingestion by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6111
• feat(ingest): infer aspect name from type in get_aspect by @hsheth2 in https://github.com/datahub-project/datahub/pull/6033
• feat(ingestion): Tableau stateful ingestion by @amanda-her in https://github.com/datahub-project/datahub/pull/6094
• feat(ingest): include raw s3 paths if s3 source by @hsheth2 in https://github.com/datahub-project/datahub/pull/6168
• feat(secrets) Allow creating secrets with multiline values in the UI by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6169
• feat(ingest/tableau): support dashboard tags by @hsheth2 in https://github.com/datahub-project/datahub/pull/6185
• feat(ingest): bigquery-beta - Parsing view ddl definition for lineage by @treff7es in https://github.com/datahub-project/datahub/pull/6187
• fix(ingest) - bigquery-beta - Using table ref instead of table id by @treff7es in https://github.com/datahub-project/datahub/pull/6193
• docs(roles): update roles docs to new doc format by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6175
• docs(posts): add posts feature guide by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6184
• feat(ingest): include instance in container dataPlatform when provided by @hsheth2 in https://github.com/datahub-project/datahub/pull/6083
• feat(telemetry): add telemetry events to the settings page by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6198
• Worked to update the ingestion type while editing by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6156
• fix(ingest): add lower bound for ujson dep version by @hsheth2 in https://github.com/datahub-project/datahub/pull/6189
• feat(ingest/tableau): emit status aspects + streamline stateful ingestion by @hsheth2 in https://github.com/datahub-project/datahub/pull/6188
• feat(ingest): support self-signed certs in Tableau by @hsheth2 in https://github.com/datahub-project/datahub/pull/6172
• fix(ingest): report warning/error counts correctly by @hsheth2 in https://github.com/datahub-project/datahub/pull/6128
• fix(ingest): Closeable as a context manager by @hsheth2 in https://github.com/datahub-project/datahub/pull/6067
• feat(ingestion-ui) Add new form for the bigquery-beta connector by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6200
• feat(ingest): add platform instance to tableau by @alaponin in https://github.com/datahub-project/datahub/pull/5978
• feat(release): bump CLI version to 0.9.0 by @szalai1 in https://github.com/datahub-project/datahub/pull/6195
• fix(frontend): fix UI message in create group modal by @liyuhui666 in https://github.com/datahub-project/datahub/pull/6205
• docs: dataset usage and query history feature guide by @treff7es in https://github.com/datahub-project/datahub/pull/5900
• fix(glossary) Improve business glossary loading performance by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6208
• feat(ingest): replace base85's pickle with json by @hsheth2 in https://github.com/datahub-project/datahub/pull/6178
• docs: add sync status feature guide by @hsheth2 in https://github.com/datahub-project/datahub/pull/5897
• feat(frontend): add custom ssl truststore settings by @alexey-kravtsov in https://github.com/datahub-project/datahub/pull/6090
• docs(spark): add configuration instructions for databricks by @mayurinehate in https://github.com/datahub-project/datahub/pull/6206
• fix(ingest): use corpGroup instead of corpgroup by @hsheth2 in https://github.com/datahub-project/datahub/pull/6202
• build: upgrade gradle wrapper by @hsheth2 in https://github.com/datahub-project/datahub/pull/6203
• fix(ingest): catch errors when profiling for sample values by @mayurinehate in https://github.com/datahub-project/datahub/pull/6194
• fix(ingest): only restrict GE version for hive by @hsheth2 in https://github.com/datahub-project/datahub/pull/6170
• feat(ingest/GE): enable debug logs to stdout when DATAHUB_DEBUG env var is set by @mayurinehate in https://github.com/datahub-project/datahub/pull/6192
• feat(ingest): allow selfsigned certificate in s3 source by @mayurinehate in https://github.com/datahub-project/datahub/pull/6179
• build(ingest): remove markupsafe dep and bump pytest-docker by @hsheth2 in https://github.com/datahub-project/datahub/pull/6201
• docs(access policies): Creating Proper Access Policies Guide by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6001
• feat(ingest): support deletion of containers in snowflake stateful in… by @mayurinehate in https://github.com/datahub-project/datahub/pull/6180
• fix(glossary) Improve performance when getting root glossary terms by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6214
• fix(ui) Fix bigquery and redshift forms for lineage fields by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6215
• fix(ui) Properly display column-level lineage with v2 field paths by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6217
• fix(ingest): bigquery-beta - Add stacktrace to bigquery schema ingest logs by @treff7es in https://github.com/datahub-project/datahub/pull/6226
• tests(embedded search): adding domain & container tests by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6221
• fix(docs): fix pdl link for mxe docs by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6230
• feat(telemetry): add telemetry events to the glossary, domains, and managed ingestion pages by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6216
• fix(ingest): bigquery-beta - Adding python 3.8 fix for memory footprint util by @treff7es in https://github.com/datahub-project/datahub/pull/6228
• docs(quickstart): enable slack community link by @jx2lee in https://github.com/datahub-project/datahub/pull/6209
• fix(build): allow image tag via env, fix requirements by @anshbansal in https://github.com/datahub-project/datahub/pull/6237
• fix(ingest): remove back-ticks from table name when creating urn by @mayurinehate in https://github.com/datahub-project/datahub/pull/6236
• feat(ingest): bigquery-beta - Add option to lowercase urns by @treff7es in https://github.com/datahub-project/datahub/pull/6240
• fix(ingest): presto-on-hive - Adding db name to the presto on hive urn by @treff7es in https://github.com/datahub-project/datahub/pull/6024
• Worked on the CSS issue of Add Owners Modal by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6223
• fix(ingest): stateful-ingestion - keep dataset urn case in checkpoints by @treff7es in https://github.com/datahub-project/datahub/pull/6244
• Create Tag Modal Issue: Clear the input value on press. by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6212
• feat(build): add cypress tests for glossary and deprecation by @anshbansal in https://github.com/datahub-project/datahub/pull/6249
• feat(ingest): hive-on-presto - Add option to properly filter hive schemas by @treff7es in https://github.com/datahub-project/datahub/pull/6247
• fix(ingest):lookml - better column-level lineage, hive urn generation… by @shirshanka in https://github.com/datahub-project/datahub/pull/6254
• fix(ingestion scheduler): Fix bug where ingestion is unscheduled for > 30 ingestion sources. by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6256
• fix(oidc): Avoid storing Pac4j profile in cookie by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6260
• docs(browse): add documentation on browse feature by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5941
• feat(ui-ingestion) Add test connection button to bigquery-beta form by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6248
• docs(logo) update thoughtworks logo by @maggiehays in https://github.com/datahub-project/datahub/pull/6266
• feat(metrics): add metrics around search caching by @RyanHolstien in https://github.com/datahub-project/datahub/pull/6255
• feat(ui): display entity names in browser tab titles by @ngamanda in https://github.com/datahub-project/datahub/pull/6225
• fix(oidc): change default oidc username claim to be email by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6220
• fix(ui): repair display name of MongoDB source by @wirelessr in https://github.com/datahub-project/datahub/pull/6270
• feat(ui) Display 'View in Github' if externalUrl is link to GitHub by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6253
• fix(ingest): looker - deps, column level lineage fixes by @shirshanka in https://github.com/datahub-project/datahub/pull/6271
• Adding Domain to Glossary Terms by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6135
• test(neo4j): Improve test performance by @david-leifker in https://github.com/datahub-project/datahub/pull/6142
• Dynamic width of the pop-overs by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6238
• feat(ingest/kakfa-connect): support generic connectors by @BoyuanZhangDE in https://github.com/datahub-project/datahub/pull/6173
• fix(ingestion): passing disable_ssl_verification param value to DatahubRestEmitter by @AdamDz in https://github.com/datahub-project/datahub/pull/6241
• feat(ingest): allow for deleting aspects in cli with -p tag by @Anirudh181001 in https://github.com/datahub-project/datahub/pull/6190
• fix(quickstart): support for user-level sockets, arch option for forcing quickstart architecture by @shirshanka in https://github.com/datahub-project/datahub/pull/6279
• fix(posts): render link posts dynamically and fix margin by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6234
• docs(lookml): add docs for multi-project lookml ingestion by @shirshanka in https://github.com/datahub-project/datahub/pull/6284
• fix(ui) Fix two lineage visualization bugs by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6278
• feat(ingest): bigquery - Promoting bigquery-beta to bigquery source by @treff7es in https://github.com/datahub-project/datahub/pull/6222
• fix(adv search): two advanced search fixes by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6252
• feat(lineage) Add column-level impact analysis feature by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6272
• feat(docs): Adding Managed DataHub Metadata Tests Guide by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6219
• fix: only add failure report on exception and process view and table by @abelstam12 in https://github.com/datahub-project/datahub/pull/6242
• refractor(ingest): update field name for snowflake column lineage by @mayurinehate in https://github.com/datahub-project/datahub/pull/6263
• docs(getting started) Update Getting Started landing page by @maggiehays in https://github.com/datahub-project/datahub/pull/6282
• docs(adopter) adding ClassDojo logo to website by @maggiehays in https://github.com/datahub-project/datahub/pull/6293
• feat(ingest): add support for column level lineage in tableau by @mayurinehate in https://github.com/datahub-project/datahub/pull/6264
• fix(ingest/dbt): lowercase external urns + cleanup config by @hsheth2 in https://github.com/datahub-project/datahub/pull/6289
• fix(ingest/tableau): add extra debug info for lineage failure by @hsheth2 in https://github.com/datahub-project/datahub/pull/6285
• fix(assertion tab): fixing up regression in assertion resolver by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6296
• feat: make platform for spark lineage inferred and configurable by @danielli-ziprecruiter in https://github.com/datahub-project/datahub/pull/6251
• refactor(docs): Minor docs refactoring by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6300
• fix(roles): move search button to right side of screen by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6306
• feat(ingest/mssql): add type mappings for BIT and SQL_VARIANT by @hsheth2 in https://github.com/datahub-project/datahub/pull/6304
• feat(ingest): add fallthrough support to KeyValuePattern by @hsheth2 in https://github.com/datahub-project/datahub/pull/6302
• feat(ui) Allow a user to type in a custom value in ingestion Secret Fields by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6301
• feat(ui) Add documentation to term/node creation modal by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6294
• fix(spark-lineage): Rename table.platform to table.hive_platform_alias by @treff7es in https://github.com/datahub-project/datahub/pull/6311
• fix(docs): fix custom transformer example interface by @DSchmidtDev in https://github.com/datahub-project/datahub/pull/6309
• feat(ui) Display inputFields in column-lineage visualization by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6303
• ci: Up to date actions addressing warnings in builds. by @kevinneville in https://github.com/datahub-project/datahub/pull/6308
• feat(ingest): unity-catalog - Unity catalog source by @treff7es in https://github.com/datahub-project/datahub/pull/6292
• fix(logs): fix logged variable on looker sdk error by @mayurinehate in https://github.com/datahub-project/datahub/pull/6319
• feat(ui) Update bigquery UI ingestion source to be the same as bigquery-beta by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6283

New Contributors

• @alaponin made their first contribution in https://github.com/datahub-project/datahub/pull/5978
• @jx2lee made their first contribution in https://github.com/datahub-project/datahub/pull/6209
• @wirelessr made their first contribution in https://github.com/datahub-project/datahub/pull/6270
• @AdamDz made their first contribution in https://github.com/datahub-project/datahub/pull/6241
• @Anirudh181001 made their first contribution in https://github.com/datahub-project/datahub/pull/6190
• @abelstam12 made their first contribution in https://github.com/datahub-project/datahub/pull/6242
• @danielli-ziprecruiter made their first contribution in https://github.com/datahub-project/datahub/pull/6251

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.9.0...v0.9.1

Release Highlights

Known Issues

Assertions Tab UX bug

This release introduced a bug in the assertions tab causing assertion results to be hidden. This will be addressed in the subsequent release.

Release Notes

We’re excited to announce the release of DataHub v0.9.0!

This minor release includes an upgrade to Java 11 and surfacing Column-Level Lineage support within the DataHub UI.

Here are some additional highlights:

User Experience

• Column-Level Lineage is now surfaced within the DataHub UI!
• Advanced Search now supports searching by Column-level details (i.e. name, description, tag, etc.), as well as complex AND/OR statements. For example:
  • Show results that match any filters
  • Show results that match all filters
  • Owner is either of Shannon or Mark
  • Oner is not Shannon nor Mark
  • Try it in demo here
• You can now add invite users and assign them to a default DataHub Role
• Improvements to site performance during the Browse experience

Developer Experience

• DataHub has been upgraded to Java 11!
• Improved tracking of GraphQL errors for bug resolution
• CorpUser and CorpGroup are now available via the Python SDK

Metadata Ingestion

• Automatically extract Column-Level Lineage from Snowflake & Looker sources
• dbt Meta Mapping is now supported at the Column Level - this means you can automatically extract Tags and Glossary Terms from your dbt model and surface them in DataHub

What's Changed

• fix(ingest): bigquery-beta - Getting datasets with biquery client by @treff7es in https://github.com/datahub-project/datahub/pull/6039
• feat(roles): add ability to invite users into a role by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6015
• refactor(java11) - convert most modules to java 11 by @leifker in https://github.com/datahub-project/datahub/pull/5836
• docs(readme): Fixing broken article link by @davrax in https://github.com/datahub-project/datahub/pull/6042
• refactor(ingest): streamline pydantic configs by @hsheth2 in https://github.com/datahub-project/datahub/pull/6011
• docs(ingest): add example of dbt column_meta_mapping by @hsheth2 in https://github.com/datahub-project/datahub/pull/6038
• refactor(ingest): use aspect map in transformers by @hsheth2 in https://github.com/datahub-project/datahub/pull/6040
• feat(ui): Adding placeholder entity for DataPlatform by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6045
• feat(ingest): implement compression for CheckpointState by @alexey-kravtsov in https://github.com/datahub-project/datahub/pull/6007
• feat(advanced-search): adding select value modal by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6026
• fix(ingest): bigquery-beta - Additional fixes for Bigquery beta by @treff7es in https://github.com/datahub-project/datahub/pull/6051
• feat(advanced search): adding advanced search filter component & prereqs for it by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6055
• docs(ingest): add path spec examples for s3 by @mayurinehate in https://github.com/datahub-project/datahub/pull/6050
• fix(deps): metadata-io - remove parquet dependency by @shirshanka in https://github.com/datahub-project/datahub/pull/6046
• fix(ingestion): Tableau test case execution fix by @mohdsiddique in https://github.com/datahub-project/datahub/pull/6005
• feat(ingest): list referenced env variables in recipe by @hsheth2 in https://github.com/datahub-project/datahub/pull/6043
• fix(ingest): compat with mypy 0.981 by @hsheth2 in https://github.com/datahub-project/datahub/pull/6056
• fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false by @GyuhoonK in https://github.com/datahub-project/datahub/pull/5974
• docs(approval workflows): adding approval workflow docs by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5896
• feat(retention): disable applying retention on bootstrap by @anshbansal in https://github.com/datahub-project/datahub/pull/6066
• fix(ingest): correct tableau browse paths by @hsheth2 in https://github.com/datahub-project/datahub/pull/6064
• fix(ingest): bigquery-beta - handling complex types properly by @treff7es in https://github.com/datahub-project/datahub/pull/6062
• docs: create SECURITY.md by @laulpogan in https://github.com/datahub-project/datahub/pull/6069
• fix(containers): show soft deleted status of containers by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6072
• docs(ingest): clarify bigquery-beta multiproject setup by @hsheth2 in https://github.com/datahub-project/datahub/pull/6071
• chore(setup): change defaults for partitions by @anshbansal in https://github.com/datahub-project/datahub/pull/6074
• refactor(browse): Improving Browse Feature Performance by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6073
• feat(ingest): add column-level lineage support for snowflake by @mayurinehate in https://github.com/datahub-project/datahub/pull/6034
• feat(ingest): looker - support for simple column level lineage by @shirshanka in https://github.com/datahub-project/datahub/pull/6084
• fix(elastic-setup) Fixing env var logic by @pedro93 in https://github.com/datahub-project/datahub/pull/6079
• Revert "chore(setup): change defaults for partitions (#6074)" by @pedro93 in https://github.com/datahub-project/datahub/pull/6086
• fix(mae-consumer): fix regression on base64 encoding by @codesorcery in https://github.com/datahub-project/datahub/pull/6061
• fix(elasticsearch) Analytics indices creation on AWS ES by @tomas-kubin in https://github.com/datahub-project/datahub/pull/5502
• docs(ingest): note that Athena doesn't support lineage by @hsheth2 in https://github.com/datahub-project/datahub/pull/6081
• fix(ingest): alias for mssql-odbc source by @hsheth2 in https://github.com/datahub-project/datahub/pull/6080
• fix(ingest): presto-on-hive - Setting display name properly by @treff7es in https://github.com/datahub-project/datahub/pull/6065
• fix(schema filter): fix schema infinite rerender by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6082
• feat(monitoring): track graphql errors in metrics by @szalai1 in https://github.com/datahub-project/datahub/pull/6087
• feat(advanced search): Add component to show all advanced search filters & add new filter by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6058
• fix(ingest): bump lkml version by @hsheth2 in https://github.com/datahub-project/datahub/pull/6091
• fix(ingest): lookml - extract column correctly by @shirshanka in https://github.com/datahub-project/datahub/pull/6093
• feat(retention): change default policy, add API to apply retention by @anshbansal in https://github.com/datahub-project/datahub/pull/6088
• fix(lineage): fix missed casing in lineage registry by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6078
• fix(ingest): bigquery-beta - Lowering a bit memory footprint of bigquery usage by @treff7es in https://github.com/datahub-project/datahub/pull/6095
• feat(ingest): remove hardcoded env variable default for cli version by @shirshanka in https://github.com/datahub-project/datahub/pull/6075
• docs: add information about mapping ports for datahub-gms by @shirshanka in https://github.com/datahub-project/datahub/pull/6092
• chore(deps): upgrade graphql-java deps to 19.0 by @shirshanka in https://github.com/datahub-project/datahub/pull/6099
• chore(deps): upgrade neo4j to 4.4.x by @shirshanka in https://github.com/datahub-project/datahub/pull/6101
• feat(docs): Improve documentation about Search by @szalai1 in https://github.com/datahub-project/datahub/pull/5889
• feat(ingest): add async option to ingest proposal endpoint by @RyanHolstien in https://github.com/datahub-project/datahub/pull/6097
• chore(deps): upgrade opentelemetry dependencies by @shirshanka in https://github.com/datahub-project/datahub/pull/6100
• refactor(recommendations): Bump default max recommendations count for Platforms by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/6113
• feat(ingest): add Sandbox support by @rgudic in https://github.com/datahub-project/datahub/pull/6105
• fix(mae): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS by @szalai1 in https://github.com/datahub-project/datahub/pull/6114
• feat(advanced-search): Complete Advanced Search: backend changes & tying UI together by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6068
• feat(search): improved search snippet FE logic by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6109
• feat(ingest): add CorpUser and CorpGroup to the Python SDK by @ttaubermarshall-stripe in https://github.com/datahub-project/datahub/pull/5930
• fix(ingest): hide deprecated path_spec option from config by @hsheth2 in https://github.com/datahub-project/datahub/pull/5944
• feat(posts): add posts feature to DataHub by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6110
• fix(ingest): remove unused mysql golden file by @hsheth2 in https://github.com/datahub-project/datahub/pull/6106
• fix(ingestion): fix percent change computation in stale_entity_removal by @rslanka in https://github.com/datahub-project/datahub/pull/6121
• refactor(ingest): use pydantic utilities for NamingPattern by @hsheth2 in https://github.com/datahub-project/datahub/pull/6013
• fix(ingest): presto-on-hive - not failing on Hive type parsing error by @treff7es in https://github.com/datahub-project/datahub/pull/6118
• fix(ingest): ignore usage and operation for snowflake datasets withou… by @mayurinehate in https://github.com/datahub-project/datahub/pull/6112
• refactor(ingest): remove typing workarounds by @hsheth2 in https://github.com/datahub-project/datahub/pull/6108
• Added information about AUTH_OIDC_EXTRACT_GROUPS_ENABLED by @PrashantKhadke in https://github.com/datahub-project/datahub/pull/6120
• feat(lineage): show fully qualified task name in lineage UI by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6126
• docs(tableau): adding a ingestion video by @shirshanka in https://github.com/datahub-project/datahub/pull/6124
• Sending "getting started" direct to quickstart by @laulpogan in https://github.com/datahub-project/datahub/pull/6125
• build: Update JNA for M1 Mac by @david-leifker in https://github.com/datahub-project/datahub/pull/6116
• fix(ingest): bigquery-beta - fix for missing key error if dataset list was empty by @treff7es in https://github.com/datahub-project/datahub/pull/6133
• fix(ingest): file - add configurability for counting all elements bef… by @shirshanka in https://github.com/datahub-project/datahub/pull/6136
• Worked on the feature to update group title by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/6047
• fix(ingest): add trino package max version restriction by @hsheth2 in https://github.com/datahub-project/datahub/pull/6137
• test(KafkaEmitter): Enable ability to run test locally by @david-leifker in https://github.com/datahub-project/datahub/pull/6123
• fix(ingest): add column name quoting for approximate count distinct by @hsheth2 in https://github.com/datahub-project/datahub/pull/6107
• fix(ingestion): add fallback to trino by @IceS2 in https://github.com/datahub-project/datahub/pull/6044
• perf(search): temporarily disable fetching input fields for search results by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6139
• feat(lineage) Add Column-Level to Lineage Visualization by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6138
• feat(tracking): add telemetry for frontend events by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6129
• docs(approvals): update approval permission docs by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6143
• fix(ingest): fetch workbook tags in workbooks graphql query by @mayurinehate in https://github.com/datahub-project/datahub/pull/6102
• fix(lineage) Fix possible null pointer exception in UpstreamLineagesMapper by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6147
• fix(ingest): bigquery-beta - Eliminate the need for data.read permission for table schema by @treff7es in https://github.com/datahub-project/datahub/pull/6146
• fix(lineage) Fix batching to ES for impact analysis by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/6149
• feat(ingest/lookml): add support for local/remote dependencies by @hsheth2 in https://github.com/datahub-project/datahub/pull/6150
• fix(auth): fix login endpoint to respect session expiration env var by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/6151
• fix(impact analysis): fixing filtering on impact analysis + cypress tests by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6152
• docs(favicon): add docs for customizing favicon by @gabe-lyons in https://github.com/datahub-project/datahub/pull/6155
• fix(ingest): bigquery-beta - ensure that status aspect is emitted for… by @shirshanka in https://github.com/datahub-project/datahub/pull/6154
• fix(ingest): bigquery - Fix syntax error in get_all_schema_tables_query by @hieunt-itfoss in https://github.com/datahub-project/datahub/pull/6159
• fix(ingest): allow snowflake profiling to work with geography type by @mayurinehate in https://github.com/datahub-project/datahub/pull/6162
• feat(ingest): support enabled flag for airflow config by @hsheth2 in https://github.com/datahub-project/datahub/pull/6089
• refactor(ingest): Tableau cleanup by @hsheth2 in https://github.com/datahub-project/datahub/pull/6131
• fix(ingest): bigquery-beta - turning sql parsing off in lineage extraction by @treff7es in https://github.com/datahub-project/datahub/pull/6163
• fix(ingest): allow hiding some fields from the schema by @hsheth2 in https://github.com/datahub-project/datahub/pull/6077

New Contributors

• @davrax made their first contribution in https://github.com/datahub-project/datahub/pull/6042
• @laulpogan made their first contribution in https://github.com/datahub-project/datahub/pull/6069
• @tomas-kubin made their first contribution in https://github.com/datahub-project/datahub/pull/5502
• @rgudic made their first contribution in https://github.com/datahub-project/datahub/pull/6105
• @ttaubermarshall-stripe made their first contribution in https://github.com/datahub-project/datahub/pull/5930
• @PrashantKhadke made their first contribution in https://github.com/datahub-project/datahub/pull/6120
• @david-leifker made their first contribution in https://github.com/datahub-project/datahub/pull/6116
• @IceS2 made their first contribution in https://github.com/datahub-project/datahub/pull/6044

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.8.45...v0.9.0