PyPI · #4184 most downloaded on PyPI

elementary-data

0.26.0933K downloads/moelementary-data/elementary ↗New releases in your daily digest, changelog included.

Data monitoring and lineage

Last release 24 days ago
10 Sep 2026
Ships fairly regularly
a new release about every 5 weeks
Nearly every release is documented
notes for 59 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
5 years old
98 releases · first in 2022

Release timeline

98 releases since 2022

20222023202420252026

20222026

One column per quarter.

Releases

0.26.010 Sept 2026
feat(status): add REUSED to Status enum for dbt State v1.11+ by @zerafachris in #2316
What's Changed

feat(status): add REUSED to Status enum for dbt State v1.11+ by @zerafachris in #2316

Add missing fields to DbtInvocationSchema by @vyagubov in #2327

fix: truncate large test result samples to prevent oversized alert payloads (#2044) by @zerafachris in #2302

fix: normalize non-standard fractional-second precision when parsing timestamps (#2221) by @zerafachris in #2303

fix: interpret naive detected_at as UTC when rendering alert timestamps by @hiromi-dev in #2305

Report FE bugfixes by @haritamar in #2345

Support dbt 2.0 / Fusion in the edr CLI by @haritamar in #2333

docs: correct --profiles-dir help text by @EladBarkay in #2344

New Contributors

@zerafachris made their first contribution in #2316

@hiromi-dev made their first contribution in #2305

@EladBarkay made their first contribution in #2344

Full Changelog: v0.25.1...v0.26.0

0.25.18 Jul 2026

Replace sed with ruamel.yaml for packages.yml version bumps by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2148

What's Changed

Replace sed with ruamel.yaml for packages.yml version bumps by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2148
Add Dependency Review GitHub Action by @haritamar in https://github.com/elementary-data/elementary/pull/2282
Create SECURITY.md by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2288

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.25.0...v0.25.1

Open source →

Additional notes

What's Changed

Replace sed with ruamel.yaml for packages.yml version bumps by @devin-ai-integration[bot] in #2148
Add Dependency Review GitHub Action by @haritamar in #2282
Create SECURITY.md by @ofek1weiss in #2288

Full Changelog: v0.25.0...v0.25.1

Open source →

0.24.12 Jun 2026

fix: skip alerts with unknown Status instead of crashing by @Darkandz in https://github.com/elementary-data/elementary/pull/2235

What's Changed

fix: skip alerts with unknown Status instead of crashing by @Darkandz in https://github.com/elementary-data/elementary/pull/2235
Support custom paths for internal dbt project via env vars by @michael-myaskovsky in https://github.com/elementary-data/elementary/pull/2248

New Contributors

@Darkandz made their first contribution in https://github.com/elementary-data/elementary/pull/2235

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.24.0...v0.24.1

Open source →

Additional notes

What's Changed

fix: skip alerts with unknown Status instead of crashing by @Darkandz in #2235
Support custom paths for internal dbt project via env vars by @michael-myaskovsky in #2248

New Contributors

@Darkandz made their first contribution in #2235

Full Changelog: v0.24.0...v0.24.1

Open source →

0.24.028 May 2026Security

security: pin lxml >=6.1.0 to fix CVE-2026-41066 by @MikaKerman in https://github.com/elementary-data/elementary/pull/2218

What's Changed

security: fix 7 high/critical Dependabot alerts by @MikaKerman in https://github.com/elementary-data/elementary/pull/2216
security: pin lxml >=6.1.0 to fix CVE-2026-41066 by @MikaKerman in https://github.com/elementary-data/elementary/pull/2218
CORE-780: pin urllib3 to 2.7.0 for Dependabot high alerts by @NoyaArie in https://github.com/elementary-data/elementary/pull/2229
fix: pin idna>=3.15 to address medium Dependabot alert (SSRF via malformed Unicode) by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2239
Use native Slack Table Block for test results sample rendering by @quickcoffee in https://github.com/elementary-data/elementary/pull/2227
APP-1123: add skip_test_result_rows to skip test_result_rows query in get_test_results macro by @MikaKerman in https://github.com/elementary-data/elementary/pull/2230
fix: add explicit sqlserver__ dispatches in elementary_cli (CORE-877) by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2241
chore: update dbt-data-reliability to v0.24.0 (CORE-877) by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2242
chore: add report bundle 1.0.33 (CORE-877) by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2243

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.23.4...v0.24.0

Open source →

Additional notes

What's Changed

security: fix 7 high/critical Dependabot alerts by @MikaKerman in #2216
security: pin lxml >=6.1.0 to fix CVE-2026-41066 by @MikaKerman in #2218
CORE-780: pin urllib3 to 2.7.0 for Dependabot high alerts by @NoyaArie in #2229
fix: pin idna>=3.15 to address medium Dependabot alert (SSRF via malformed Unicode) by @devin-ai-integration[bot] in #2239
Use native Slack Table Block for test results sample rendering by @quickcoffee in #2227
APP-1123: add skip_test_result_rows to skip test_result_rows query in get_test_results macro by @MikaKerman in #2230
fix: add explicit sqlserver__ dispatches in elementary_cli (CORE-877) by @elazarlachkar in #2241
chore: update dbt-data-reliability to v0.24.0 (CORE-877) by @elazarlachkar in #2242
chore: add report bundle 1.0.33 (CORE-877) by @elazarlachkar in #2243

Full Changelog: v0.23.4...v0.24.0

Open source →

0.23.215 Apr 2026

Truncate oversized Teams webhook payloads to prevent HTTP 413 errors by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pu

What's Changed

Truncate oversized Teams webhook payloads to prevent HTTP 413 errors by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2160
Teams webhook message too large exception by @GuyEshdat in https://github.com/elementary-data/elementary/pull/2164
fix: allow null materialization in ModelAlertDataSchema for ClickHouse compatibility by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2180
ci: add typos config to suppress false positives on Vertica SVG gradient IDs by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2181
chore: change dbt package version to 0.23.1 by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2187

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.23.1...v0.23.2

Open source →

Additional notes

What's Changed

Truncate oversized Teams webhook payloads to prevent HTTP 413 errors by @devin-ai-integration[bot] in #2160
Teams webhook message too large exception by @GuyEshdat in #2164
fix: allow null materialization in ModelAlertDataSchema for ClickHouse compatibility by @devin-ai-integration[bot] in #2180
ci: add typos config to suppress false positives on Vertica SVG gradient IDs by @devin-ai-integration[bot] in #2181
chore: change dbt package version to 0.23.1 by @devin-ai-integration[bot] in #2187

Full Changelog: v0.23.1...v0.23.2

Open source →

0.23.012 Mar 2026Deprecated

fix: replace deprecated datetime.utcnow() with datetime.now(tz=timezone.utc) by @themavik in https://github.com/elementary-data/elementary/pull/2111

What's Changed

fix: remove return from finally block to prevent exception swallowing by @themavik in https://github.com/elementary-data/elementary/pull/2109
fix: handle string-type exposure owner in ExposureSchema validation by @themavik in https://github.com/elementary-data/elementary/pull/2110
fix: replace deprecated datetime.utcnow() with datetime.now(tz=timezone.utc) by @themavik in https://github.com/elementary-data/elementary/pull/2111
fix(CORE-355): handle abbreviated timezone offsets in convert_partial_iso_format_to_full_iso_format by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2116
fix: apply toyaml filter to all secret-backed credential fields in profiles template by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2124
fix: wire --config-dir CLI flag to Config initialization by @themavik in https://github.com/elementary-data/elementary/pull/2121
fix: add ref() macro override for dbt-core 1.11 compatibility by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2137
Add optional --ssl-ca-bundle flag for SSL certificate configuration by @szaffarano in https://github.com/elementary-data/elementary/pull/1802
feat: add DuckDB, Trino, Dremio & Spark support to CI and CLI by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2135
feat: add Microsoft Fabric and SQL Server support to elementary CLI by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2140
feat: add Vertica adapter support by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2141
feat: add dbt-fabricspark support to elementary CLI by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2142
fix: swap latest_run_time and latest_run_time_utc in _parse_test_db_row by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2144
fix: only filter by invocations_rank_index when no invocation_id is specified by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2143

New Contributors

@themavik made their first contribution in https://github.com/elementary-data/elementary/pull/2109
@szaffarano made their first contribution in https://github.com/elementary-data/elementary/pull/1802

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.22.0...v0.23.0

Open source →

Additional notes

What's Changed

fix: remove return from finally block to prevent exception swallowing by @themavik in #2109
fix: handle string-type exposure owner in ExposureSchema validation by @themavik in #2110
fix: replace deprecated datetime.utcnow() with datetime.now(tz=timezone.utc) by @themavik in #2111
fix(CORE-355): handle abbreviated timezone offsets in convert_partial_iso_format_to_full_iso_format by @devin-ai-integration[bot] in #2116
fix: apply toyaml filter to all secret-backed credential fields in profiles template by @devin-ai-integration[bot] in #2124
fix: wire --config-dir CLI flag to Config initialization by @themavik in #2121
fix: add ref() macro override for dbt-core 1.11 compatibility by @devin-ai-integration[bot] in #2137
Add optional --ssl-ca-bundle flag for SSL certificate configuration by @szaffarano in #1802
feat: add DuckDB, Trino, Dremio & Spark support to CI and CLI by @devin-ai-integration[bot] in #2135
feat: add Microsoft Fabric and SQL Server support to elementary CLI by @devin-ai-integration[bot] in #2140
feat: add Vertica adapter support by @devin-ai-integration[bot] in #2141
feat: add dbt-fabricspark support to elementary CLI by @devin-ai-integration[bot] in #2142
fix: swap latest_run_time and latest_run_time_utc in _parse_test_db_row by @devin-ai-integration[bot] in #2144
fix: only filter by invocations_rank_index when no invocation_id is specified by @devin-ai-integration[bot] in #2143

New Contributors

@themavik made their first contribution in #2109
@szaffarano made their first contribution in #1802

Full Changelog: v0.22.0...v0.23.0

0.22.029 Jan 2026

Replace numpy with math by @vyagubov in https://github.com/elementary-data/elementary/pull/2074

What's Changed

Replace numpy with math by @vyagubov in https://github.com/elementary-data/elementary/pull/2074
Python 3.13 support by @vyagubov in https://github.com/elementary-data/elementary/pull/2078
update dbt package reference by @haritamar in https://github.com/elementary-data/elementary/pull/2080
New contributors update! 🎉 by @Maayan-s in https://github.com/elementary-data/elementary/pull/2083
Add orchestrator jobs data to alerts by @quickcoffee in https://github.com/elementary-data/elementary/pull/1997
Include Seeds and Snapshots w/o Tests in Dashboard by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2087
Update schema.py by @yu-iskw in https://github.com/elementary-data/elementary/pull/2086
feat: quiet-logs flag by @michrzan in https://github.com/elementary-data/elementary/pull/2072
Make default Config() Initialization respect target_path in default config file by @ryanquincypaul in https://github.com/elementary-data/elementary/pull/2093
Update the version constrains of google-cloud-storage by @yu-iskw in https://github.com/elementary-data/elementary/pull/2079
Remove python 3.9 by @vyagubov in https://github.com/elementary-data/elementary/pull/2081
fix: add ClickHouse-specific UPDATE syntax for alert status updates by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2090
Replace click.MultiCommand with click.Group by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2096
Re-enable ClickHouse in CLI tests by @devin-ai-integration[bot] in https://github.com/elementary-data/elementary/pull/2095
dbt version bump by @arbiv in https://github.com/elementary-data/elementary/pull/2098
Update report index.html by @arbiv in https://github.com/elementary-data/elementary/pull/2099

New Contributors

@vyagubov made their first contribution in https://github.com/elementary-data/elementary/pull/2074
@michrzan made their first contribution in https://github.com/elementary-data/elementary/pull/2072
@ryanquincypaul made their first contribution in https://github.com/elementary-data/elementary/pull/2093

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.20.1...v0.22.0

Open source →

0.20.17 Dec 2025Deprecated

Remove deprecated test recommendations macro by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2057

What's Changed

Added more detailed exception for teams webhook failure by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2031
bugfix to disable_samples flag + update package ref by @haritamar in https://github.com/elementary-data/elementary/pull/2039
Correctly shorten versioned model names by @Ryosuke839 in https://github.com/elementary-data/elementary/pull/2043
fix: handle support for partial success introduce in dbt 1.9 with microbatching by @nicor88 in https://github.com/elementary-data/elementary/pull/2041
SlackWebMessagingIntegration: support reply_broadcast option by @MikaKerman in https://github.com/elementary-data/elementary/pull/2054
SlackWebMessagingIntegration: accept additional keyword args in from_token by @MikaKerman in https://github.com/elementary-data/elementary/pull/2055
Fix BigQuery scan for test result rows by @tlangton3 in https://github.com/elementary-data/elementary/pull/1940
Create html email formatter by @MikaKerman in https://github.com/elementary-data/elementary/pull/2051
Remove deprecated test recommendations macro by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2057
Fix namespace of macro call by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2061
unfurl_links=False for avoiding preview in slack messages by @GuyEshdat in https://github.com/elementary-data/elementary/pull/2064
Fix: Properly quote database and schema identifiers for SQL compatibility by @mschmidoev in https://github.com/elementary-data/elementary/pull/1987
Readme rebranded and up to date by @NoyaOffer in https://github.com/elementary-data/elementary/pull/2065
Change stale workflow configuration by @arbiv in https://github.com/elementary-data/elementary/pull/2045
limit postgres version in CI by @haritamar in https://github.com/elementary-data/elementary/pull/2040
Using community Athena pacakge in CI by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2066
Upgrade dbt package to 0.21.0 by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2067
Updated report index.html by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2068

New Contributors

@Ryosuke839 made their first contribution in https://github.com/elementary-data/elementary/pull/2043
@nicor88 made their first contribution in https://github.com/elementary-data/elementary/pull/2041
@tlangton3 made their first contribution in https://github.com/elementary-data/elementary/pull/1940
@mschmidoev made their first contribution in https://github.com/elementary-data/elementary/pull/1987

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.20.0...v0.20.1

Open source →

0.20.09 Oct 2025Deprecated

removed usage of deprecated -m flag in dbt by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2000

What's Changed

fix test dwh write dbt profies by @NoyaArie in https://github.com/elementary-data/elementary/pull/1999
removed usage of deprecated -m flag in dbt by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2000
disable group registration when tracking is disabled by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2001
update dbt package revision by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2003
Handle empty result in clickhouse by @ofek1weiss in https://github.com/elementary-data/elementary/pull/2002
require approval only for fork PRs by @haritamar in https://github.com/elementary-data/elementary/pull/2004
Handle invalid characters when uploading CI artifact by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2005
Update README.md with new contributors by @Maayan-s in https://github.com/elementary-data/elementary/pull/2009
only check fork on PR events by @haritamar in https://github.com/elementary-data/elementary/pull/2011
Update DBT package version by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2012
Ele 5089 use row number instead of rank by @NoyaArie in https://github.com/elementary-data/elementary/pull/2015
Updated DBT pacakge revision by @elazarlachkar in https://github.com/elementary-data/elementary/pull/2017
Add attribution block to alert messages in data monitoring by @MikaKerman in https://github.com/elementary-data/elementary/pull/2016
Ele 4724 dbt fusion support by @haritamar in https://github.com/elementary-data/elementary/pull/1961
Ele 5122 cli stop using deprecated tests by @haritamar in https://github.com/elementary-data/elementary/pull/2022
update the CLI to use the new package version by @haritamar in https://github.com/elementary-data/elementary/pull/2024
attempt to remove dbt-databricks restriction by @haritamar in https://github.com/elementary-data/elementary/pull/2025
update report version by @haritamar in https://github.com/elementary-data/elementary/pull/2026
release/v0.20.0 by @github-actions[bot] in https://github.com/elementary-data/elementary/pull/2027
package-lock: remove name to avoid breaking old dbt versions by @haritamar in https://github.com/elementary-data/elementary/pull/2028
Feature: make the number of columns that are formatted as a table in Teams alerts a cli flag so that users have more control over the formatting in Teams by @FrankTub in https://github.com/elementary-data/elementary/pull/1958

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.19.5...v0.20.0

Open source →

0.19.531 Aug 2025

Slack join channel recursion fix by @MikaKerman in https://github.com/elementary-data/elementary/pull/1984

What's Changed

Slack join channel recursion fix by @MikaKerman in https://github.com/elementary-data/elementary/pull/1984
changed dbt package version to a commit with dremio types mapping. ne… by @GuyEshdat in https://github.com/elementary-data/elementary/pull/1985
Enhance SlackWebMessagingIntegration to include a timeout feature for… by @MikaKerman in https://github.com/elementary-data/elementary/pull/1990
use sets for alert filters by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1994
Ele 4942 dimension anomalies visualization by @NoyaArie in https://github.com/elementary-data/elementary/pull/1992
release/v0.19.5 by @github-actions[bot] in https://github.com/elementary-data/elementary/pull/1998

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.19.4...v0.19.5

Open source →

0.19.411 Aug 2025

Fix float("inf") and float("nan") JSON serialization breaking reports by @ClementSicard in https://github.com/elementary-data/elementary/pull/1964

What's Changed

Fix float("inf") and float("nan") JSON serialization breaking reports by @ClementSicard in https://github.com/elementary-data/elementary/pull/1964
Ele 4832 full source name in freshness alerts by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1971
upgrade the elementary dbt package to v0.19.2

New Contributors

@ClementSicard made their first contribution in https://github.com/elementary-data/elementary/pull/1964

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.19.3...v0.19.4

Open source →

0.18.213 May 2025

subscribers in the grouped alerts by @MikaKerman in https://github.com/elementary-data/elementary/pull/1893

What's Changed

subscribers in the grouped alerts by @MikaKerman in https://github.com/elementary-data/elementary/pull/1893
clickhouse cli integration by @michael-myaskovsky in https://github.com/elementary-data/elementary/pull/1892
Add FileSystemMessagingIntegration and related tests by @MikaKerman in https://github.com/elementary-data/elementary/pull/1904
Adds --s3-acl option to the cli to be able to set S3 report permissions. by @Lawiss in https://github.com/elementary-data/elementary/pull/1887
Fixed setup of internal dbt project used by Elementary by @abhipalsingh in https://github.com/elementary-data/elementary/pull/1867
Add function for disable_elementary_logo_print by @nickozilla in https://github.com/elementary-data/elementary/pull/1903
update report to 1.0.26 by @michael-myaskovsky in https://github.com/elementary-data/elementary/pull/1909

New Contributors

@michael-myaskovsky made their first contribution in https://github.com/elementary-data/elementary/pull/1892
@Lawiss made their first contribution in https://github.com/elementary-data/elementary/pull/1887
@abhipalsingh made their first contribution in https://github.com/elementary-data/elementary/pull/1867
@nickozilla made their first contribution in https://github.com/elementary-data/elementary/pull/1903

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.18.1...v0.18.2

Open source →

0.16.216 Feb 2025

Hierarchical Structure: Introduced a new side tree layout with groups and views for better navigation.

What's Changed

Report Improvements

Navigation

Hierarchical Structure: Introduced a new side tree layout with groups and views for better navigation.

Lineage Visualization

Ephemeral Model Dependencies: Ephemeral models remain excluded from the lineage graph, but their dependencies are now directly associated with downstream models. This ensures accurate data flow representation.
Seed Support: Seeds are now included in the lineage visualization.
Enhanced Exposure Logic: The presence of any dependency includes the relevant exposures.

General Report Enhancements

Optimized Report Size: Reduced overall report size.
Complete Test Overview: Reports now feature all tests, including those not yet executed, ensuring full visibility.
Snapshot Support: Snapshots are now part of the report.

Alerts Enhancements

Alert Grouping & Thresholds: Alerts are now grouped when they exceed the configured threshold, reducing notification noise.
Modular Alert System: A modular system for constructing alert messages has been introduced, enhancing flexibility and consistency.
Microsoft Teams Adaptive Cards: Alerts sent to Microsoft Teams now use the Adaptive Cards format, providing rich and interactive notifications.
- This update enables users to use Power Automate Workflows to send alerts.
Channel Override Fallback: Alerts now default to a fallback channel if the specified channel is unavailable, ensuring critical notifications are not missed.
Seed Alerts: Model Alerts has been expanded to include seeds.
By @kokorin in #1673

General Enhancements

Development & Infrastructure

DBT Package Lock Files: Introduced lock files for the internal DBT project.

Operational & Debugging Improvements

Error Logging Enhancements: The CLI's DbtRunner now saves error logs, making debugging easier.
Version Check Toggle: Added an option to disable Elementary’s automatic version check, reducing unnecessary network requests.
By @slaupster in #1674
Google Cloud Storage Client Update: Modified GCS client to use client.bucket instead of client.get_bucket, aligning with updated access requirements.
By @jcarpenter12 in #1739

New Contributors

A huge thank you to our first-time contributors:

@slaupster made their first contribution in https://github.com/elementary-data/elementary/pull/1674
@kokorin made their first contribution in https://github.com/elementary-data/elementary/pull/1673
@jcarpenter12 made their first contribution in https://github.com/elementary-data/elementary/pull/1739

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.16.1...v0.16.2

Open source →

0.16.05 Aug 2024Breaking

Fix breaking change dbt 1.3.0. by @elongl in https://github.com/elementary-data/elementary/pull/1578

What's Changed

SlimDbtRunner fixes for dbt 18 by @haritamar in https://github.com/elementary-data/elementary/pull/1528
Set --project-dir as working directory. by @elongl in https://github.com/elementary-data/elementary/pull/1532
Added project name to summary by @ellakz in https://github.com/elementary-data/elementary/pull/1506
Removed --env limits to "dev" or "prod" by @willbowditch in https://github.com/elementary-data/elementary/pull/1373
Structure sidebar by package and artifact type. by @elongl in https://github.com/elementary-data/elementary/pull/1553
Excluding test results with 'meta.elementary.include=false'. by @elongl in https://github.com/elementary-data/elementary/pull/1562
Fix breaking change dbt 1.3.0. by @elongl in https://github.com/elementary-data/elementary/pull/1578
Added api dbt runner by @haritamar in https://github.com/elementary-data/elementary/pull/1577
Support configuration of dbt runner method. by @elongl in https://github.com/elementary-data/elementary/pull/1629
Added timezone to alert detected_at by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1631
Set CWD for API dbt runner. by @elongl in https://github.com/elementary-data/elementary/pull/1633
Fixed report memory usage by @haritamar in https://github.com/elementary-data/elementary/pull/1634
Removed usage of deprecated 'pkg_resources' package. by @elongl in https://github.com/elementary-data/elementary/pull/1637
Print out dbt's exception. by @elongl in https://github.com/elementary-data/elementary/pull/1640
Add created_at to elementary_exposures. by @elongl in https://github.com/elementary-data/elementary/pull/1642
Fixed elementary_unique_id of source freshness test results by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1647
handle list of None owners by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1656

New Contributors

@hamzamazhar made their first contribution in https://github.com/elementary-data/elementary/pull/1530
@willbowditch made their first contribution in https://github.com/elementary-data/elementary/pull/1373
@okabak123 made their first contribution in https://github.com/elementary-data/elementary/pull/1565

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.15.1...v0.16.0

Open source →

0.15.02 May 2024

Ele 2601 override primary model singular tests by @NoyaArie in https://github.com/elementary-data/elementary/pull/1439

What's Changed

Ele 2601 override primary model singular tests by @NoyaArie in https://github.com/elementary-data/elementary/pull/1439
Added singular tests to groups API. by @elongl in https://github.com/elementary-data/elementary/pull/1372
ELE-2617 - Fix disable samples for alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1443
docs-roni-changes by @ronisaban2024 in https://github.com/elementary-data/elementary/pull/1445
Update README.md by @Maayan-s in https://github.com/elementary-data/elementary/pull/1446
Update README.md by @Maayan-s in https://github.com/elementary-data/elementary/pull/1448
Ele 2626 support singular tests in test results runs by @NoyaArie in https://github.com/elementary-data/elementary/pull/1449
Ele 2626 support singular tests in test results runs - fix ci by @NoyaArie in https://github.com/elementary-data/elementary/pull/1454
Ele 2677 add normalized path to tests by @NoyaArie in https://github.com/elementary-data/elementary/pull/1458
fix: Fixed update_sent_alerts macro by @svdimchenko in https://github.com/elementary-data/elementary/pull/1451
Test athena update alerts v2 by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1463
Remove poetry.lock from repo by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1464
ELE-2722 - support popuate_data argument to control alerts data population by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1466
Add @svdimchenko, @ronisaban2024, @dongchris, @sanromeo, @AvivZikelDY… by @Maayan-s in https://github.com/elementary-data/elementary/pull/1465
ELE-2725 - remove unused elementary database and schema from data monitoring alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1467
Ele 2648 change result tows by @noaKurman in https://github.com/elementary-data/elementary/pull/1468
ELE-2726 - support days back for alerts population - default is 1 by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1470
roni-docs-update2 by @ronisaban2024 in https://github.com/elementary-data/elementary/pull/1475
Ele 2785 remove retry package by @NoyaArie in https://github.com/elementary-data/elementary/pull/1478
dbt_runner: add retry command to dbt runner by @haritamar in https://github.com/elementary-data/elementary/pull/1331
ELE-2918 - add user_select and static_select to Slack message builder by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1486
ELE-2790 - Remove unused code of test management by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1481
Updated dbt package. by @elongl in https://github.com/elementary-data/elementary/pull/1487
ELE-2918 - Add actions block to Slack message builder by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1488
Refactor Slack integration and Slack Alert message builder to make them editable easily by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1490
remove test subtype from most alerts by @ellakz in https://github.com/elementary-data/elementary/pull/1485
ELE-489 Support dbt-trino connector by @Tomme in https://github.com/elementary-data/elementary/pull/1378
Filter exposures with no upstream tables in lineage. by @elongl in https://github.com/elementary-data/elementary/pull/1501
Filter loops in exposures. by @elongl in https://github.com/elementary-data/elementary/pull/1502
Empty lists are excluded. by @elongl in https://github.com/elementary-data/elementary/pull/1503
Added test run execution time to report json by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1500
added last and median exec times to test runs by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1504
ELE-2933: Column anomalies group_by - CLI by @dapollak in https://github.com/elementary-data/elementary/pull/1499
release/0.15.0 by @dapollak in https://github.com/elementary-data/elementary/pull/1507
release/v0.15.0 by @dapollak in https://github.com/elementary-data/elementary/pull/1509

New Contributors

@ronisaban2024 made their first contribution in https://github.com/elementary-data/elementary/pull/1445
@svdimchenko made their first contribution in https://github.com/elementary-data/elementary/pull/1451
@Tomme made their first contribution in https://github.com/elementary-data/elementary/pull/1378

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.14.1...v0.15.0

Open source →

0.14.129 Feb 2024

fix header block max length bug by @ellakz in https://github.com/elementary-data/elementary/pull/1417

What's Changed

fix header block max length bug by @ellakz in https://github.com/elementary-data/elementary/pull/1417
Ele 2515 add original path to tests fetcher by @NoyaArie in https://github.com/elementary-data/elementary/pull/1416
Handle sent_at column at alerts_v2 contains timezone by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1422
ELE-2569 - fix source freshness alerts created_at and updated_at are None by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1431
support pydantic 2 in elementary by @ellakz in https://github.com/elementary-data/elementary/pull/1426
fix file path when uploading to Azure Blob Storage by @SamirS97 in https://github.com/elementary-data/elementary/pull/1423

New Contributors

@SamirS97 made their first contribution in https://github.com/elementary-data/elementary/pull/1423

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.14.0...v0.14.1

Open source →

0.14.014 Feb 2024

New intro and quickstart by @Maayan-s in https://github.com/elementary-data/elementary/pull/1265

What's Changed

New intro and quickstart by @Maayan-s in https://github.com/elementary-data/elementary/pull/1265
Docs refactor by @Maayan-s in https://github.com/elementary-data/elementary/pull/1291
Ele 1916 document anomaly exclude filter by @Maayan-s in https://github.com/elementary-data/elementary/pull/1301
Integration contribution guide by @ellakz in https://github.com/elementary-data/elementary/pull/1275
create list_conversations method without sleep in slack client by @ellakz in https://github.com/elementary-data/elementary/pull/1335
Ele 2193 extract selector filter by @NoyaArie in https://github.com/elementary-data/elementary/pull/1334
ELE-2218: BigQuery query history permissions - Docs by @dapollak in https://github.com/elementary-data/elementary/pull/1336
ELE-2241 - add tags to report test results by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1340
Ele 2237 new filter schema by @NoyaArie in https://github.com/elementary-data/elementary/pull/1341
Created 'depends_on_columns'. by @elongl in https://github.com/elementary-data/elementary/pull/1327
Ensure backwards compatability for depends_on_columns by @erikzaadi in https://github.com/elementary-data/elementary/pull/1343
Ele 2234 support same property and filter for alerts by @NoyaArie in https://github.com/elementary-data/elementary/pull/1344
Root dir of BI integration in sidebar is the name of the BI integration as opposed to 'exposures' by @elongl in https://github.com/elementary-data/elementary/pull/1347
Ele 2285 add alert rules to docs by @ellakz in https://github.com/elementary-data/elementary/pull/1348
ELE-2263 - support multi filters at cli command by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1345
fixed ignore_small_changes docs example by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1358
Passing 'sub_type' to lineage nodes. by @elongl in https://github.com/elementary-data/elementary/pull/1361
explicit exec info by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1359
added test_results_sample to faq by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1362
added average to column metrics docs by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1364
Changed Slack link to global one by @Maayan-s in https://github.com/elementary-data/elementary/pull/1365
Corrected the JOIN condition in 'enriched_exposures' model. by @elongl in https://github.com/elementary-data/elementary/pull/1366
Initializing the root dir of the sidebar only for exposures. by @elongl in https://github.com/elementary-data/elementary/pull/1367
Add AWS Session token argument to 'send-report'. by @elongl in https://github.com/elementary-data/elementary/pull/1369
Moved skipped test results from warning to skipped status in summary report. by @elongl in https://github.com/elementary-data/elementary/pull/1371
Fix dbt deps logic in CLI by @haritamar in https://github.com/elementary-data/elementary/pull/1370
Added @jonboulle, @artem-garmash and @nicor88 to contributors! 🎉 by @Maayan-s in https://github.com/elementary-data/elementary/pull/1315
Added '--rows-per-insert' to 'upload-source-freshness' operation and changed default to 25. by @elongl in https://github.com/elementary-data/elementary/pull/1379
ELE-2329 - New alerts table by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1380
ELE-2390 - better logic separation for DataMonitoringAlerts flow by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1384
Alerts: Replace icon with color and make header informative by @ellakz in https://github.com/elementary-data/elementary/pull/1382
ELE-2398 - move sort_alerts from API to data monitoring alerts flow by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1387
ELE-2410 - split send_alerts flow to multiple steps by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1390
Ele 2417 fix permissions and security docs by @haritamar in https://github.com/elementary-data/elementary/pull/1391
Fix permissions docs by @haritamar in https://github.com/elementary-data/elementary/pull/1393
Support test_results_description as None for test alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1396
Handle None message for model alerts (skipped models) by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1399
Docs by @haritamar in https://github.com/elementary-data/elementary/pull/1400
Prevent failing on missing full path by @erikzaadi in https://github.com/elementary-data/elementary/pull/1402
Ensure empty full path is properly handled by @erikzaadi in https://github.com/elementary-data/elementary/pull/1403
Ensure that enriched exposures still works if cli views have not been synced by @erikzaadi in https://github.com/elementary-data/elementary/pull/1406
Introduce the possibility to send elementary alerts to Microsoft Teams using an incoming webhook in Teams by @FrankTub in https://github.com/elementary-data/elementary/pull/1397
Ele 238 teams integration (by Frank Tubbing) by @ellakz in https://github.com/elementary-data/elementary/pull/1401
teams docs by @ellakz in https://github.com/elementary-data/elementary/pull/1407
add new contributors by @ellakz in https://github.com/elementary-data/elementary/pull/1409
ELE-2501 - Remove long columns from alerts_v2 population by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1408
fix broken links and more stuff by @ellakz in https://github.com/elementary-data/elementary/pull/1410
Fix alerts_v2 for redshift - handle columns exceeding limit by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1411

New Contributors

@diegoquintanav made their first contribution in https://github.com/elementary-data/elementary/pull/1333
@FrankTub made their first contribution in https://github.com/elementary-data/elementary/pull/1397

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.13.2...v0.14.0

Open source →

0.12.129 Nov 2023

Ele 1707 add source freshness as test part 2 by @NoyaArie in https://github.com/elementary-data/elementary/pull/1208

What's Changed

Ele 1707 add source freshness as test part 2 by @NoyaArie in https://github.com/elementary-data/elementary/pull/1208
Added @LePeti and @belle-crisp to contributors! 🎉 by @Maayan-s in https://github.com/elementary-data/elementary/pull/1252
Ele 1965 source freshness alert time diff format by @NoyaArie in https://github.com/elementary-data/elementary/pull/1268
Ensure raw_queries doesn't fail exposures fetcher by @erikzaadi in https://github.com/elementary-data/elementary/pull/1267
ELE-36: Athena integration by @artem-garmash in https://github.com/elementary-data/elementary/pull/1251
ELE-1790: Renaming, Detection Delay Docs by @dapollak in https://github.com/elementary-data/elementary/pull/1197
Ele 1818 add report link for source freshness alert by @NoyaArie in https://github.com/elementary-data/elementary/pull/1276
decoupled alerts from Slack by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1266
ELE-2039 support multiple integrations at data monitoring alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1292
validate report selector only when attachment is sent by @ellakz in https://github.com/elementary-data/elementary/pull/1297
ELE-2072 support timeout param for GCS client by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1300
Ele 2079 fix pending source freshness alert schema by @NoyaArie in https://github.com/elementary-data/elementary/pull/1302
Allow specifying region_name for Boto3 by @jonboulle in https://github.com/elementary-data/elementary/pull/1287
contribution: Jonboulle nell add aws region by @dapollak in https://github.com/elementary-data/elementary/pull/1295
update OSS report bundle by @haritamar in https://github.com/elementary-data/elementary/pull/1304
release/v0.12.1 by @github-actions in https://github.com/elementary-data/elementary/pull/1305

New Contributors

@artem-garmash made their first contribution in https://github.com/elementary-data/elementary/pull/1251
@jonboulle made their first contribution in https://github.com/elementary-data/elementary/pull/1287

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.12.0...v0.12.1

Open source →

0.12.026 Oct 2023

Fix command in troubleshooting.mdx by @kovaacs in https://github.com/elementary-data/elementary/pull/1121

What's Changed

Fix command in troubleshooting.mdx by @kovaacs in https://github.com/elementary-data/elementary/pull/1121
Ele 1707 add source freshness as test part 1 by @NoyaArie in https://github.com/elementary-data/elementary/pull/1202
Ele 1804 source freshness result description calculate by @NoyaArie in https://github.com/elementary-data/elementary/pull/1188
Ele-1869 add last run missing fields to report models by @NoyaArie in https://github.com/elementary-data/elementary/pull/1212
Ele-1865 add materialization and patch_path to the report models by @NoyaArie in https://github.com/elementary-data/elementary/pull/1213
test_recommendations: small bugfix by @haritamar in https://github.com/elementary-data/elementary/pull/1214
Fix typo by @LePeti in https://github.com/elementary-data/elementary/pull/1216
Move enriched_exposures and elementary_exposures from dbt package by @erikzaadi in https://github.com/elementary-data/elementary/pull/1218
fix getting owner alerts from normalized alert directly by @belle-crisp in https://github.com/elementary-data/elementary/pull/1231
don't use dbt ls for statuses and resource types filter by @ellakz in https://github.com/elementary-data/elementary/pull/1233
Depends on macro: use enriched_exposures if needed by @erikzaadi in https://github.com/elementary-data/elementary/pull/1236
validate selectors for alerts and report by @ellakz in https://github.com/elementary-data/elementary/pull/1234
Renamed 'dbt_columns' to 'information_schema_columns'. by @elongl in https://github.com/elementary-data/elementary/pull/1223
Ele-1907 rename dbt_account_id env var by @NoyaArie in https://github.com/elementary-data/elementary/pull/1239
sidebar: support exposures by @haritamar in https://github.com/elementary-data/elementary/pull/1240
groups: fix for exposures - path should be the path in the BI by @haritamar in https://github.com/elementary-data/elementary/pull/1243
Backward compatibility for missing raw_queries by @erikzaadi in https://github.com/elementary-data/elementary/pull/1242
get_resources_columns: bugfix - handle backwards by @haritamar in https://github.com/elementary-data/elementary/pull/1246
release/v0.12.0 by @github-actions in https://github.com/elementary-data/elementary/pull/1247

New Contributors

@LePeti made their first contribution in https://github.com/elementary-data/elementary/pull/1216
@belle-crisp made their first contribution in https://github.com/elementary-data/elementary/pull/1231

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.11.0...v0.12.0

Open source →

0.11.03 Oct 2023

Added timestamp columns. by @elongl in https://github.com/elementary-data/elementary/pull/1119

What's Changed

Added timestamp columns. by @elongl in https://github.com/elementary-data/elementary/pull/1119
Contribution guide - CLI by @haritamar in https://github.com/elementary-data/elementary/pull/1129
Refactor context manager nesting by @kovaacs in https://github.com/elementary-data/elementary/pull/1122
Ele 1625 add link to test runs in alerts by @NoyaArie in https://github.com/elementary-data/elementary/pull/1126
change copy of alert links by @NoyaArie in https://github.com/elementary-data/elementary/pull/1132
Alert links updates by @NoyaArie in https://github.com/elementary-data/elementary/pull/1137
Fixing Dependencies in DbtRunner for Uninstalled Packages by @Arun-kc in https://github.com/elementary-data/elementary/pull/1050
Ele 1434 dbtrunner install dbt packages if needed by @elongl in https://github.com/elementary-data/elementary/pull/1139
alerts bugfix - ensure channel in alerts_config works in grouped mode by @haritamar in https://github.com/elementary-data/elementary/pull/1051
Further document custom slack channels by @JavierLopezT in https://github.com/elementary-data/elementary/pull/1145
Ele 1484 source freshness invocation by @NoyaArie in https://github.com/elementary-data/elementary/pull/1165
Added 'schema_changes_from_baseline' to the test recommendations model. by @elongl in https://github.com/elementary-data/elementary/pull/1178
Ele 1706 add to freshness result criteria by @NoyaArie in https://github.com/elementary-data/elementary/pull/1175
Ele 1803 add test description for dbt sources by @NoyaArie in https://github.com/elementary-data/elementary/pull/1181
Add docs a for exposure generic tests by @erikzaadi in https://github.com/elementary-data/elementary/pull/1154
ele 1820 alter cli to read from new unified exposures view by @erikzaadi in https://github.com/elementary-data/elementary/pull/1191

New Contributors

@Adamgo23 made their first contribution in https://github.com/elementary-data/elementary/pull/1060
@pbadeer made their first contribution in https://github.com/elementary-data/elementary/pull/1116
@JavierLopezT made their first contribution in https://github.com/elementary-data/elementary/pull/1145
@erikzaadi made their first contribution in https://github.com/elementary-data/elementary/pull/1154
@dapollak made their first contribution in https://github.com/elementary-data/elementary/pull/1169

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.10.0...v0.11.0

Open source →

0.10.022 Aug 2023

ELE-1436 add databricks catalog to CI by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1041

What's Changed

ELE-1436 add databricks catalog to CI by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/1041
Fix an invalid BigQuery query. by @elongl in https://github.com/elementary-data/elementary/pull/1045
Allow defining a different packages dir by env var by @haritamar in https://github.com/elementary-data/elementary/pull/1052
ele-1184 report bug - special characters are wrongly parsed by @NoyaArie in https://github.com/elementary-data/elementary/pull/1049
Ele 638 azure blob storage and elementary data cli by @ellakz in https://github.com/elementary-data/elementary/pull/1047
Azure Blob Storage Integration for send-report by @Arun-kc in https://github.com/elementary-data/elementary/pull/1037
Changed oldest maintained dbt version. by @elongl in https://github.com/elementary-data/elementary/pull/1068
Set default value for option. by @elongl in https://github.com/elementary-data/elementary/pull/1071
Added 'runtime error' to the default monitored statuses. by @elongl in https://github.com/elementary-data/elementary/pull/1080
Using Poetry instead of setuptools. by @elongl in https://github.com/elementary-data/elementary/pull/1077
Not passing a long CLI arg to macro. by @elongl in https://github.com/elementary-data/elementary/pull/1085
Typo fixes by @kovaacs in https://github.com/elementary-data/elementary/pull/1089
Kovaacs typo fixes by @elongl in https://github.com/elementary-data/elementary/pull/1090
Added a typos checker. by @elongl in https://github.com/elementary-data/elementary/pull/1091
Added models and macros for tests recommendation. by @elongl in https://github.com/elementary-data/elementary/pull/1076
Using a where_expression instead of sub-wheres. by @elongl in https://github.com/elementary-data/elementary/pull/1094

New Contributors

@Arun-kc made their first contribution in https://github.com/elementary-data/elementary/pull/1037
@kovaacs made their first contribution in https://github.com/elementary-data/elementary/pull/1089

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.9.2...v0.10.0

Open source →

Additional notes

title: "Elementary 0.10.0" sidebarTitle: "0.10.0"

August 24, 2023: v0.10.0 Python, v0.10.0 dbt package

🔥 What's New?

We now officially support Spark and Databricks Unity Catalog!
- Huge thanks to Rom Shitrit for working with us on Spark, it was a pleasure!
- Thanks so much Chinnu for making the Databricks Catalog support contribution, much appreciated!
- These integrations are very new so there may be some hiccups, please contact us in #support if you notice anything funny 🙏🏼
Elementary reports can now be uploaded to Azure Blob! ☁️
- Thanks Dharit Sura for opening this issue and huge kudos to Arun K C for taking this on and making it happen! 💪🏼
New selector filters for alerts
- We added 2 new filters to edr monitor, resource_type and status!
- This means it is now possible to run edr monitor separately for warnings and failures, and send them to different slack channels!
- Thanks Josh Elston-Green for requesting this, and also Pascal Moreau for opening the issue on Github
- See the docs for more details
Test your alerts in "dev" mode
- You can now run alerts that ignore your custom channels and suppression settings. This is intended for testing alerts in dev that you don't want everyone to panic about. Just try edr monitor --override-dbt-project-config
- Thanks Snir Israeli for opening this feature request!

Other Changes ✨

As of this version we will no longer support dbt versions prior to 1.3
- This means you shouldn't upgrade Elementary to 0.10.0 if you're using an older version of dbt 🙅🏽‍♀️
- Older versions of Elementary are not affected by this

Bugfixes 🐛

Table name missing in some generic tests
- Fixed by Ronan OBERT's contribution 🙌
Fixed a bunch of typos in the docs
- Thanks to Marcell Kovács for noticing and fixing! We also added a typo checker, so you can except our docs to be typo free going forward ✅
Fixed some character encoding issues in the report
- Thanks Assaf Haim, Christopher Ekfeldt, Ilya Michlin and everyone else who raised this

0.9.231 Jul 2023Deprecated

Also reading deprecated test param. by @elongl in https://github.com/elementary-data/elementary/pull/1024

What's Changed

Ele 323 filter alerts by status by @ellakz in https://github.com/elementary-data/elementary/pull/988
Invoking DbtRunner.deps() on edr run-operation upload-source-freshness by @elongl in https://github.com/elementary-data/elementary/pull/1019
Added selector to DbtRunner. by @elongl in https://github.com/elementary-data/elementary/pull/1023
Also reading deprecated test param. by @elongl in https://github.com/elementary-data/elementary/pull/1024
Ele 287 override flag by @ellakz in https://github.com/elementary-data/elementary/pull/1017
Containerized docs. by @elongl in https://github.com/elementary-data/elementary/pull/1030
Fix docker build pip version (causing package installation issues) by @noaKurman in https://github.com/elementary-data/elementary/pull/1031
Running dbt deps earlier in edr's logic. by @elongl in https://github.com/elementary-data/elementary/pull/1038

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.9.1...v0.9.2

Open source →

0.9.120 Jul 2023

Ele 1068 supperssion in cli by @ellakz in https://github.com/elementary-data/elementary/pull/1013

What's Changed

Ele 1068 supperssion in cli by @ellakz in https://github.com/elementary-data/elementary/pull/1013
release/v0.9.1 by @github-actions in https://github.com/elementary-data/elementary/pull/1014

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.9.0...v0.9.1

Open source →

Additional notes

title: "Elementary 0.9.1" sidebarTitle: "0.9.1"

July 20, 2023: v0.9.1 Python, v0.9.0 dbt package

🔥 What's new?

New Seasonality Options: hour_of_day and hour_of_week 🌞🌙
- Thanks to the brilliant contribution from Moss Pauly, you now have two new seasonality options: hour_of_day and hour_of_week.
- These options will help in making the anomaly detection tests more accurate for datasets with strong seasonality impact.
- Check out the docs
Data for calculating Quality Score 📊
- We made the following changes to help calculating data sets quality score (refer to this great article for more info):
  - We've added two new columns, elementary_test_results.failed_row_count and dbt_tests.quality_dimension. This data enables you to gain deeper insights into data quality and better track your data pipeline's health.
  - We automatically fill these fields for common test (dbt, dbt_utils, and dbt_expectations), if you would like them to work for other test, or overwrite the default ones, you will need to fill the test's meta with:
    - quality_dimension - Name of the quality dimension this test measures.
    - failed_row_count_calc - An SQL expression to calculate the amount of failed rows from the test (count(*), sum(n_records), etc).
  - Thank you Saurabh Jha for working with us on this!
  - This feature is still experimental, and is not reflected in the report nor the alerts.
Alert Suppression in CLI 🚦
- Now, you can suppress alerts in the Command Line Interface (CLI) using the --suppression-interval flag.
- This feature gives you more control over your alerts and helps you manage notifications effectively.
- Check out the docs

💫 More changes

Order Slack messages by test run time ⏰
- We've added a new option to order Slack messages by test run time. This makes it easier to track test results and prioritize action items - Thanks Willi Mueller for suggesting!
Set SQL expression as timestamp_column
- You can now set an SQL expression as the timestamp column, offering more flexibility in handling time-based data. Fantastic idea from Sham Sreedharan, and solves use cases raised by Shay Misgav, Renee Cooper, Steve Luk and FABIEN RYCKOORT.
Support for dbt where Parameter
- Thanks Taha Bel Khayate for surfacing.

🐛 Bugfix 🐛

We've resolved a pesky bug that caused dbt_columns to malfunction in specific access configurations when using BigQuery.
Table anomalies tests fix - Reported by Scott Anderson !
New dimension values will no linger cause dimension anomalies test to fail - Thanks Jason Deng for reporting!

Open source →

0.8.319 Jul 2023

Added 'capture_output' flags to 'DbtRunner.run' and 'DbtRunner.test'. by @elongl in https://github.com/elementary-data/elementary/pull/943

What's Changed

Added 'capture_output' flags to 'DbtRunner.run' and 'DbtRunner.test'. by @elongl in https://github.com/elementary-data/elementary/pull/943
Ele 966 add exposure data by @NoyaArie in https://github.com/elementary-data/elementary/pull/941
Schema changes are applied to table materialized models. by @elongl in https://github.com/elementary-data/elementary/pull/964
Ele 1194 add vars to dbt runner by @elongl in https://github.com/elementary-data/elementary/pull/970
Added tests to the Elementary models. by @elongl in https://github.com/elementary-data/elementary/pull/972
Not failing the sync if tables don't exist. by @elongl in https://github.com/elementary-data/elementary/pull/977
ELE-1261 test management get tests should handle a list of owners by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/987
[ELE-517] Order slack messages by test run time ASC by @ellakz in https://github.com/elementary-data/elementary/pull/989
MyPy support in OSS by @haritamar in https://github.com/elementary-data/elementary/pull/990
ELE-1343 dbt package 0.8.4 by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1000
release v0.8.3 by @ofek1weiss in https://github.com/elementary-data/elementary/pull/1002

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.8.2...v0.8.3

Open source →

0.8.221 Jun 2023

Upgraded 'packaging' requirement. by @elongl in https://github.com/elementary-data/elementary/pull/912

What's Changed

Upgraded 'packaging' requirement. by @elongl in https://github.com/elementary-data/elementary/pull/912
Ele 1042 distinct job name id in filter by @NoyaArie in https://github.com/elementary-data/elementary/pull/925
ELE-1108 config does not support update-bucket-website by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/942
Ele 983 generate job url and job run url by @NoyaArie in https://github.com/elementary-data/elementary/pull/952
Escaping HTML tags when passing 'elementaryData' object. by @elongl in https://github.com/elementary-data/elementary/pull/947

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.8.0...v0.8.2

Open source →

Additional notes

title: "Elementary 0.8.2" sidebarTitle: "0.8.2"

June 28, 2023: v0.8.2 Python, v0.8.2 dbt package

🔥 What's new?

Node info is now available on the lineage view ℹ️🔗
- When clicking on a node on the lineage you are now able to see the node's metadata (owners, tags and description) and job info (job id and name)!
- See how it looks in the attached image 👀
- Stay tuned - next version will also include exposure info 😱📺
We improved our table components for environments with long tables name 🌀
- We've added the ability to minimize the side bar and set a default width for some of the columns
- Thanks @Jon Simpson for bringing this up!

💫 More changes

Fixed a bug where alerts tag selectors did not work. Thanks @panapost and @Noam Moskowitz for bringing this up!
Fixed a bug where the report was being sent via Slack although it was hosted. Thanks @Javier López Tomás for noticing.
Handled a situation where the report failed to generate if there are html tags in any of the fields. Thanks @Pedro Gillet Soares for letting us know.
Added pg_catalog to redshift macros so they work with late binding views. Thank you kochalex for contributing! 🤩

Open source →

0.8.031 May 2023

Ele 381 add mypy to the cli repo - step 1 by @haritamar in https://github.com/elementary-data/elementary/pull/837

What's Changed

Ele 381 add mypy to the cli repo - step 1 by @haritamar in https://github.com/elementary-data/elementary/pull/837
Specify encoding style by @manulpatel in https://github.com/elementary-data/elementary/pull/869
Ele 801 support dbt 15 with dbtslimrunner by @haritamar in https://github.com/elementary-data/elementary/pull/898
ELE-957 remove env from report summary by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/901
ELE-978 support case where there are no short names to tests - test management by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/906
ELE-979 backward compatibility for sources owners - test management by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/907
Ele 826 orchestration integration by @NoyaArie in https://github.com/elementary-data/elementary/pull/900

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.10...v0.8.0

Open source →

Additional notes

title: "Elementary 0.8.0" sidebarTitle: "0.8.0"

June 1, 2023: v0.8.0 Python, v0.8.0 dbt package As this is a minor version bump, you need to run dbt run -s elementary

🔥 What's new?

🆕 Jobs info from Orchestrator 🆕
- Elementary now supports collecting metadata about your jobs from your orchestration tool!
- The goal is to provide context that is useful to triage and resolve data issues:
- As a first step, you could filter the lineage by job in the Elementary report.
  - More orchestrator related features are coming soon 😎
- Here is the guide for enabling jobs info collection..
You can now configure all test params in the project / model / test level 🤯
- Why is it useful?
  - It enables you to tailor the tests to the dataset and get higher level of accuracy!
  - You can leverage inheritance, configure at a higher level (like folder of models) and save the need to configure by test.
- Some examples:
  - You can set days_back: 90 to tests with time_bucket: period: week, and days_back: 7 to tests with time_bucket: period: hour .
  - You can set timestamp_column: updated_at in your dbt_project.yml if this is your convention, and override it for models where it's different.
  - You can set seasonality, time_bucket and timestamp_column at the source level, and it will apply for all the tests you add to tables of this source.
- We also upgraded our documentation of the tests configuration and how the tests work, to make it clearer 😇

💫 More changes

Added materialization field to models run results, thank you @Aril Mavinkere for contributing! 🤩
Removed env from report summary.

Open source →

0.7.1017 May 2023

Deploy Docs by @RoiTabach in https://github.com/elementary-data/elementary/pull/813

What's Changed

Deploy Docs by @RoiTabach in https://github.com/elementary-data/elementary/pull/813
Deploy Updated Docs by @RoiTabach in https://github.com/elementary-data/elementary/pull/825
Tests new docs by @Maayan-s in https://github.com/elementary-data/elementary/pull/832
Merge pull request #834 from elementary-data/release/v0.7.8 by @github-actions in https://github.com/elementary-data/elementary/pull/835
Update anomaly-sensitivity.mdx by @vishaalkk in https://github.com/elementary-data/elementary/pull/854
Merge pull request #862 from elementary-data/ele-857-add-indicative-logs-to-slack-message by @github-actions in https://github.com/elementary-data/elementary/pull/864
ELE-866 test management split tags and owners by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/865
ELE-866 test management split tags and owners by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/866
ELE-867 add meta to test management tests by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/867
ELE-869 test management return ids to resources by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/870
DbtCommandError prints dbt's error messages. by @elongl in https://github.com/elementary-data/elementary/pull/875
Prod by @elongl in https://github.com/elementary-data/elementary/pull/876
Changes to docs. by @elongl in https://github.com/elementary-data/elementary/pull/877
Printing Elementary's relation on 'edr'. by @elongl in https://github.com/elementary-data/elementary/pull/879
ELE-890 workaround for redshift run operation regression - update alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/880
ELE-894 add github action to test alerts updates by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/884
fix validate alerts workflow step by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/885
Update test-warehouse.yml by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/886
fix validate alerts workflow step by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/887
update report bundle by @NoyaArie in https://github.com/elementary-data/elementary/pull/888
release/v0.7.10 by @github-actions in https://github.com/elementary-data/elementary/pull/889

New Contributors

@NoyaArie made their first contribution in https://github.com/elementary-data/elementary/pull/888

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.9...v0.7.10

Open source →

Additional notes

title: "Elementary 0.7.10" sidebarTitle: "0.7.10"

May 17, 2023: v0.7.10 Python, v0.7.8 dbt package

🔥 What's new?

New artifacts model - dbt_columns 🆕
- Many users requested that we add this model with useful information about the columns in your project.
- We also plan to add features to the report and alerts based on this data. Stay tuned... :coming-soon:
- (This is not yet supported for Databricks, working on it)
New lineage filters - Tags and owners #️⃣👥
- You can now filter the lineage to see only the nodes that are relevant to a business department or a specific owner, and their upstream and downstream nodes.
- We also made some general improvements to the filters usability like adding search and clear all.
Test results sample size in the report can be changed 🔢
- The report is no longer limited to 5 results, you can change this by adding the var:
  - test_sample_row_count: 10
New flag - edr --version 🏁
- Thank you @Manul Patel for contributing this 🤩

💫 More changes

Alerts suppression interval is no longer limited to 24 hours.
Added indicative exceptions to Elementary tests.
time_bucket can now be configured in model and var levels as well.
Created workarounds to solve breaking changes in dbt 1.5.0 adapters:
Not rely on Databricks adapter to create temp tables - Thanks @Joseph Berni, @fitz and @Dharit Sura for reporting!
Run queries from run instead of run-operation due to bug in Redshift adapter - Thank you @Eugene Sobolev for reporting and investigating with us!

🐞 Bug fixes

Support dbt run results compiled sql with % on Redshift new adapter - Thanks @Fabien Traventhal for reporting!
Fixed ignored backfill_days in no timestamp tests - Thanks @leila and @Roland Baranovic for reporting!
Fixed alerts -group-by empty value - Thank you @Dimosthenis Schizas for contributing 🤩
Owners accept dict format - Thank you @Stephen Lloyd for reporting and @Manul Patel for contributing 🤩
Paginate upload of source freshness data for large results - Thank you @Fred for reporting and fixing 🤩
Thank you @winzee and @vinooganesh for helping keep our docs accurate and typos free 🎉e Melhuish](https://elementary-community.slack.com/team/U04KWBDTP4J)!

0.7.914 May 2023

Added a workflow to update label on user comments on issues. by @elongl in https://github.com/elementary-data/elementary/pull/840

What's Changed

Added a workflow to update label on user comments on issues. by @elongl in https://github.com/elementary-data/elementary/pull/840
Fixed test sample size to be determined only from the dbt package by @oravi in https://github.com/elementary-data/elementary/pull/839
Docs: add pointer from tutorial to doc on tests priorities by @RoiTabach in https://github.com/elementary-data/elementary/pull/812
Fixed group by when applied from code by @oravi in https://github.com/elementary-data/elementary/pull/848
Added --version option to Elementary cli by @manulpatel in https://github.com/elementary-data/elementary/pull/842
Modified owners validator to accept dict by @manulpatel in https://github.com/elementary-data/elementary/pull/847
Add description to get tests method of test management API by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/852
ELE-740 - paginate upload of source freshness data by @fredmny in https://github.com/elementary-data/elementary/pull/850
On test management get_tests macro we now include sources information by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/857
On test management get_tests macro we now return is_singular by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/858

New Contributors

@manulpatel made their first contribution in https://github.com/elementary-data/elementary/pull/842
@fredmny made their first contribution in https://github.com/elementary-data/elementary/pull/850

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.8...v0.7.9

Open source →

0.7.827 Apr 2023

Add a precision to "What happens on each test" by @winzee in https://github.com/elementary-data/elementary/pull/778

What's Changed

Add a precision to "What happens on each test" by @winzee in https://github.com/elementary-data/elementary/pull/778
Fixing Typo by @vinooganesh in https://github.com/elementary-data/elementary/pull/781
Merge pull request #801 from elementary-data/release/v0.7.7 by @github-actions in https://github.com/elementary-data/elementary/pull/802
Re-enable feedback buttons by @hanywang2 in https://github.com/elementary-data/elementary/pull/807
Prod by @elongl in https://github.com/elementary-data/elementary/pull/808
Docs for Seasonality by @RoiTabach in https://github.com/elementary-data/elementary/pull/789
ELE-673 slack summary remove attention required section by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/811
Added 'meta' to artifacts schema. by @elongl in https://github.com/elementary-data/elementary/pull/820
ELE-624 test configuration metadata API (for SaaS) by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/821
Fix for ELE-699, None default for --group-by by @RoiTabach in https://github.com/elementary-data/elementary/pull/823
total_seconds() instead of seconds by @RoiTabach in https://github.com/elementary-data/elementary/pull/815
ELE-653 fix formatting of alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/824
Change 'owner_email' to 'OwnerSchema' on 'ExposuresSchema'. by @elongl in https://github.com/elementary-data/elementary/pull/826
Add 'source_name' to 'get_sources'. by @elongl in https://github.com/elementary-data/elementary/pull/828
Added the 'label' field to 'ExposureSchema'. by @elongl in https://github.com/elementary-data/elementary/pull/829

New Contributors

@winzee made their first contribution in https://github.com/elementary-data/elementary/pull/778
@vinooganesh made their first contribution in https://github.com/elementary-data/elementary/pull/781

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.7...v0.7.8

Open source →

0.7.711 Apr 2023

Cloud docs by @Maayan-s in https://github.com/elementary-data/elementary/pull/763

What's Changed

Cloud docs by @Maayan-s in https://github.com/elementary-data/elementary/pull/763
fix issue in parsing of subscribers by @RoiTabach in https://github.com/elementary-data/elementary/pull/771
Filtering only Elementary models and not internal ones. by @elongl in https://github.com/elementary-data/elementary/pull/777
Added an 'all' extra. by @elongl in https://github.com/elementary-data/elementary/pull/776
Allowed using non dbt Hub package. by @elongl in https://github.com/elementary-data/elementary/pull/779
Add log rotation + dbt internal project log target by @noaKurman in https://github.com/elementary-data/elementary/pull/783
Added target path to upload_source_freshness by @oravi in https://github.com/elementary-data/elementary/pull/785
Updated the dbt artifact schemas. by @elongl in https://github.com/elementary-data/elementary/pull/787
indicative incompatibility error by @Maayan-s in https://github.com/elementary-data/elementary/pull/791
Commenting out a test that uses unmaintainable fixed data points. by @elongl in https://github.com/elementary-data/elementary/pull/800

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.6...v0.7.7

Open source →

Additional notes

title: "Elementary 0.7.7" sidebarTitle: "0.7.7"

April 12, 2023: v0.7.7 Python, v0.7.5 dbt package

🔥 What's new?

Seasonality and Anomaly direction 📈
- On this release we are introducing 2 new anomaly detection tests configurations. The goal is to improve the accuracy and unlock more detection use cases. 🎯💪
- We prepared a short video to explain 📽👇🏻
- seasonality: day_of_week 🗓
  - If enabled, daily values will be compared only to the same week day previous values.
  - This configuration would improve accuracy and detection of datasets that have different volume and metrics on weekends and different weekdays.
- anomaly_direction: [ both | spike | drop ] ↗️↘️
  - By default, elementary alerts on both spikes and drops of a metric. Using this configuration, you can limit anomaly tests to alert only on the wanted direction.
  - For example - If you want volume anomalies to fail only on drop in row count, and not on a spike, just add anomaly_direction: drop to the test config.

on-run-end performance improvements ⏳
- We fixed problems in artifacts caching, and implemented an incremental upload. This means that upon a change to models / tests / sources - elementary will now only update the changed resources.
- This should improve the performance of the hooks, and we have additional ideas and planned tasks around further improvements.
- Special thanks to @panapost for helping with this effort 🤩

🐞 Bug fixes

Added support to unsupported time buckets on Bigquery (week, month), and made buckets full and consistent to calendar times - Thank you @Kenneth Roos and @Julian Schulte for reporting!
Added log rotation to edr.log to prevent large log files that won't open - Thank you @Stéphane Burwash and @Grant Mehrer for reporting!
Fixed elementary tests custom names issue - Thank you @Fabien Traventhal for reporting!
Fixed subscribers parsing issue - Thank you @Muthu for reporting!
Added target-path to upload_source_freshness - Requested by @Ange Melhuish!

Open source →

0.7.623 Mar 2023

ELE-469 add flag to disable test results samples query by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/736

What's Changed

ELE-469 add flag to disable test results samples query by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/736
ELE-485 remove user DWH query for test result samples by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/738
Prod by @elongl in https://github.com/elementary-data/elementary/pull/741
Fixing incorrect group_by flag documentation for slack by @vishaalkk in https://github.com/elementary-data/elementary/pull/753
Add target_path flag option for edr files and logs by @noaKurman in https://github.com/elementary-data/elementary/pull/747
Fixed bug where bucket URL was none and report wasn't sent as an html by @oravi in https://github.com/elementary-data/elementary/pull/746
Added edr monitor debug to help our users debug their elementary prof… by @oravi in https://github.com/elementary-data/elementary/pull/765
Don't put "pass"ed test as warning, with a unit test by @RoiTabach in https://github.com/elementary-data/elementary/pull/767
Ele 527 high memory consumption when running edr by @oravi in https://github.com/elementary-data/elementary/pull/766
Fix config and target directory path docs by @will-warner in https://github.com/elementary-data/elementary/pull/773

New Contributors

@vishaalkk made their first contribution in https://github.com/elementary-data/elementary/pull/753
@noaKurman made their first contribution in https://github.com/elementary-data/elementary/pull/747
@will-warner made their first contribution in https://github.com/elementary-data/elementary/pull/773

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.5...v0.7.6

Open source →

Additional notes

title: "Elementary 0.7.6" sidebarTitle: "0.7.6"

March 27, 2023: v0.7.6 Python, v0.7.4 dbt package

🔥 What's new?

Custom test names are now supported! 🖌🎨
- For every dbt test, you can provide an indicative name and Elementary will show it!
- Here is an example:

tests:
  - accepted_values:
      values: ["ios", "android", "windows"]
      name: unexpected_operating_system

You can read more about the use cases from @Marta Massarotti and @Owen in the Github issue.
CLI improvements 💻😎
- Target path for all edr files
  - We added a new -target-path flag for all the outputs to make it easier to maintain and deploy Elementary.
  - Thanks @Gemma Down for the issue and use case!
- Added edr monitor debug command
  - This would help you debug connection and profile issues.

🐞 Bug fixes

Reduced high memory consumption of edr - Thanks @Jake Beresford for reporting and providing valuable context!
Improved Redshift upload artifacts performance and prevent concurrency issues - Thanks @Chintan Patel, @Hugo Vandernotte and @Fabien Traventhal for reporting!
Fixed upload source freshness issue - Thanks @Collin, @Idris, @Corentin Hembise and @Muthu for reporting!
Fixed bucket URL and html report are not sent in send-report - Thanks @Jack Welty for reporting!
Fix passed tests count as warnings in grouped alerts - Thanks @John Walsh for reporting!
Fixed cases and types issues in schema changes from baseline - Thanks @Mathias Reistad, @Luis Ventura, @Yiming and @manish ramrakhiani for reporting, and thank you Sadahiro Yoshikawa for contributing! 🤩
Special thanks to @Will Warner, @Vishal Kella and @Louis-Marius Gendreau for helping keep our docs correct and up to date! 🤩

📚 Reading list

We want to share some blog posts by community members -

@Alex Alves wrote about migrating to a new data warehouse and how Elementary could help
@Jonathan Talmi wrote about observability at Super, and specifically about how they utilize Elementary for alerts
Also shout out to @Stéphane Burwash for giving a talk about Elementary in a dbt meetup!

Open source →

0.7.51 Mar 2023

Update setup.py by @RoiTabach in https://github.com/elementary-data/elementary/pull/729

What's Changed

Update setup.py by @RoiTabach in https://github.com/elementary-data/elementary/pull/729
bump version for release by @RoiTabach in https://github.com/elementary-data/elementary/pull/730

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.4...v0.7.5

Open source →

Additional notes

title: "Elementary 0.7.5" sidebarTitle: "0.7.5"

March 6, 2023: v0.7.5 Python, v0.7.3 dbt package

🔥 What's new?

Grouped alert for test results by table 🤝🔔
- Feeling overwhelmed by alerts on each failed test?
- You can now add -group-by table to edr monitor and the table test results will be sent as one message.
- Docs are here ; Pic attached 📸
- This was requested by @Jake Beresford and @Ekaterina Khrushch
Add sum to column anomaly tests ➕
- You can now monitor anomalies on the sum of a numeric column.
- Thanks tc-chrisbui for the contribution! 🤩
Add where_expression to Python tests 🟰
- You can now filter the data you are testing in a Python test.
- Thank you Oskar Elvkull for the contribution! 🤩

💫 More changes

Added dbt 1.5.0 support. 😎

🐞 Bug fixes

Fixed a bug in dimension_anomalies without a timestamp_column - Thanks @Amihay Gonen and @Alvin M for reporting!
Fixed a bug with anomaly monitors running on the wrong data type (only in 0.7.2) - Thanks again @Amihay Gonen!
Fixed problems in the numbers presented in the dashboard 🔢
- Counting exposures as models - Thanks for reporting @Willi Mueller !
- Classifying tests as the wrong kind of test - - Thanks for reporting @Jan Santora!
Fixed dashboard header sometimes having an empty timestamp - @Mohamed Omran thanks for reporting!

Open source →

0.7.216 Feb 2023

Fix windows path format by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/686

What's Changed

Fix windows path format by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/686
results summary docs by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/684
Upate inner dbt project packages to use the latest elementary dbt package (Fix windows bug)

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.7.1...v0.7.2

Open source →

Additional notes

title: "Elementary 0.7.2" sidebarTitle: "0.7.2"

February 16, 2023: v0.7.2 Python, v0.7.1 dbt package

🔥 What's new?

Report Summary Slack Message 🆕🔔
- When you generate a new report and using send-report, you can also trigger a Slack notification summary of the report.
- This is useful for you and your team members to understand quickly if there is something in the new report you should address.
- Docs here, screen shot attached 📸
Dashboard graphs are now clickable #️⃣📊
- You can click on graphs and the dashboard, and you will be redirected to the relevant set of results.
- This means you can quickly navigate from the dashboard to a deep dive on the details.
Config changes reset anomaly detection tests 🔄
- When you change the configuration of an Elementary test, the metrics for the tests will be automatically re-calculated according to the new configuration.
- This improves the accuracy of the tests, so changes you make will affect immediately and not only after days of accumulating new data.

💫 More changes

Added a deployment guide for Gitlab CI. Thank you @Clinton Adams for your help! 🤩
Added Spark time related macros, thanks @Matias Stanislavsky for the help! 🤩
Changed lineage layout to reduce "spaghettiness" - Looking forward for your feedback on it @Gautier De Peyronnet! 🍝

🐞 Bug fixes

Fix the DBT_ORCHESTRATOR env var not being used - Thanks Andre Augusto for contributing! 🤩
Fixed long Windows paths error which failed deployment for several users.
Fixed Windows folder paths in the report appear empty - Thanks @Tasos Kouridis for reporting!
Changed macro names to prevent collision with other dbt packages - Thanks @Tiphaine Castel for reporting!

Open source →

0.7.014 Feb 2023

Ele 206 small hourly time buckets on the anomaly by @elongl in https://github.com/elementary-data/elementary/pull/619

What's Changed

Ele 206 small hourly time buckets on the anomaly by @elongl in https://github.com/elementary-data/elementary/pull/619
Not running Elementary's models if '--project-dir' provided. by @elongl in https://github.com/elementary-data/elementary/pull/638
Update redshift.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/651
Update databricks.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/650
Update snowflake.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/647
Update snowflake.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/646
Update bigquery.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/645
Update redshift.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/649
Lowercasing agate's columns by default. by @elongl in https://github.com/elementary-data/elementary/pull/643
DbtRunner.ls uses 'text' log format. by @elongl in https://github.com/elementary-data/elementary/pull/652
Wrote a guide for GitLab CI. by @elongl in https://github.com/elementary-data/elementary/pull/644
Update dashboard bundle by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/653
Writing all dbt and edr artifacts to same path. by @elongl in https://github.com/elementary-data/elementary/pull/659
rename api methods to fetcher by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/662
Deleted a redundant variable. by @elongl in https://github.com/elementary-data/elementary/pull/664
Conditionally using 'result_rows' if it's defined. by @elongl in https://github.com/elementary-data/elementary/pull/670
Ele 82 slack test results summary by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/626
change macro names by @Maayan-s in https://github.com/elementary-data/elementary/pull/672
update report bundle by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/673

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.10...v0.7.0

Open source →

0.6.107 Feb 2023

title: "Elementary 0.6.10" sidebarTitle: "0.6.10"

February 8, 2023: v0.6.10 Python, v0.6.13 dbt package

🔥 What's new?

Dashboard screen 📊👀
- We added a new dashboard screen to the UI!
- See a breakdown of your test results, tables health, monitored tables.
- Understand the high level status and the trends over time.
- You can also filter by tag / owner and get a dashboard view only of the tables that are relevant to you!
- You can play with it in the demo.
  - Already working on making the graphs clickable to enable drill down (in the next version) 💪
Major on-run-end performance improvement ⚡️
- We invested in reducing even more the impact of artifacts uploading on your runs.
- The improvement is achieved with caching we implemented, to only upload artifacts if there is a change from the last run.
- Note that this only works for dbt 1.4.0 and above (we made a contribution to dbt-core to support this).
dbt artifacts additions ➕
- New table dbt_seeds - A contribution by Franny Delaney, thank you so much 🤩
- thread_id was added to run results tables, and dbt_user env var was added to dbt_invocations - Thank you Elias Gryp and Ayal Alon for suggesting these!

🐞 Bug fixes

Fixed alerts duplications issue and email owners in Slack alerts - Thanks Josh Elston-Green for reporting both!
Fixed events tracking from the report are not disabled - Thanks Bendik Nesbo for reporting!
Fixed synonymous data types bug in schema changes from baseline test - Thanks Manish Ramrakhiani for reporting!
Fixed insert_rows failures on anomaly tests with small time buckets - Thanks Noam Moskowitz for reporting!
Fixed truncate param in CLI causing failures - Thank you Chintan Patel for contributing!
Fixes to our docs by Ed Bizarro and Oskar Elvkull - Thank you for contributing!

Open source →

0.6.96 Feb 2023

add a sentence about synonym dtypes by @RoiTabach in https://github.com/elementary-data/elementary/pull/609

What's Changed

add a sentence about synonym dtypes by @RoiTabach in https://github.com/elementary-data/elementary/pull/609
Not passing tracking data to report if tracking is disabled. by @elongl in https://github.com/elementary-data/elementary/pull/632
Simplified syntax. by @elongl in https://github.com/elementary-data/elementary/pull/635
ELE-217 alert deduping by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/608
Normalized alert always returns an owners list. by @elongl in https://github.com/elementary-data/elementary/pull/634

New Contributors

@RoiTabach made their first contribution in https://github.com/elementary-data/elementary/pull/609

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.8...v0.6.9

Open source →

0.6.826 Jan 2023

Postgres docs by @clad in https://github.com/elementary-data/elementary/pull/582

What's Changed

Postgres docs by @clad in https://github.com/elementary-data/elementary/pull/582
Update add-elementary-tests.mdx by @Hadarsagiv in https://github.com/elementary-data/elementary/pull/592
Update share-report-ui.mdx by @Deathfireofdoom in https://github.com/elementary-data/elementary/pull/597
Added a contribution guide. by @elongl in https://github.com/elementary-data/elementary/pull/596
verify that the dbt package is up-to-date in the internal project by @haritamar in https://github.com/elementary-data/elementary/pull/604
Fix event_freshness_anomalies examples by @edbizarro in https://github.com/elementary-data/elementary/pull/606
[Docs] Update question schema snippet path by @hanywang2 in https://github.com/elementary-data/elementary/pull/612
fix: remove truncate_if_on_run_end param by @Chintanvpatel in https://github.com/elementary-data/elementary/pull/614
fix malformed alert to slack method by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/618

New Contributors

@clad made their first contribution in https://github.com/elementary-data/elementary/pull/582
@Deathfireofdoom made their first contribution in https://github.com/elementary-data/elementary/pull/597
@edbizarro made their first contribution in https://github.com/elementary-data/elementary/pull/606
@Chintanvpatel made their first contribution in https://github.com/elementary-data/elementary/pull/614

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.7...v0.6.8

Open source →

0.6.719 Jan 2023

Fixed a bug in test runs order.

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.6...v0.6.7

Open source →

Additional notes

title: "Elementary 0.6.7" sidebarTitle: "0.6.7"

January 19, 2023: v0.6.7 Python, v0.6.11 dbt package

🔥 What's new?

Postgres integration 🆕
- Elementary now supports Postgres! Thank you Tasos Kouridis for this meaningful contribution!
- Docs here
Freshness anomalies monitoring improvements 🥬
- We have split our freshness anomalies test into two different tests to better handle two common different use cases:
  - freshness_anomalies - monitors anomalies in the frequency of updates. Imagine a table that is being updated hourly and then all of a sudden this table wasn't updated for 4 hours. Here you would probably use the updated_at/inserted_at column as an input for this test.
  - event_freshness_anomalies - monitors that the underlying data is up to date. Imagine an events table that is being updated hourly correctly but the events themselves are coming with a delay of 2 days from your production databases. Here, you would probably use the event_timestamp column as an input for this test.
- Docs here

💫 More changes

Added compatibility with dbt's upcoming release (1.4.0).
Following the breaking change we experienced in dbt 1.3.2, we've re-added the source freshness test support.
Added a few safety measures to make sure concurrent runs are always supported.
Thank you Emil Nilsson for adding the ability to choose a custom S3 endpoint to host the report when using edr cli (--s3-endpoint-url TEXT).
We updated the schema_changes_from_baseline test comparison to be case-insensitive. Thanks Manish Ramrakhiani for bringing this up!
Thank you Pratik Bothra, Clinton Adams and Benoit Turbang for helping us keep our documentation up to date and typos free 😊

🐞 Bug fixes

Resolved a race condition that sometimes caused a run failure (caused TestRunSchema.test_runs: None is not an allowed value error).
Fixed a bug where a test that always failed has the value 0% for ‘Fail Rate’. Thanks Jon Simpson for bringing this up!
Fixed a bug where where_expression was only implemented when a timestamp was defined. Thanks Ran Tibi for bringing this up!
Fixed UnicodeDecodeError error in Windows due to their default encoding.

As part of this version, we've invested in our testing infrastructure to ensure we're able to keep moving fast and providing valuable features! 💪⚡

Open source →

0.6.617 Jan 2023Breaking

Fix upcoming breaking changes in dbt 1.4.0 by @elongl in https://github.com/elementary-data/elementary/pull/566

What's Changed

Added edr run-operation upload-source-freshness by @elongl in https://github.com/elementary-data/elementary/pull/553
Add --s3-endpoint-url as option for sending report to S3 by @esenilsson & @elongl in https://github.com/elementary-data/elementary/pull/515, https://github.com/elementary-data/elementary/pull/516
fix fail rate bug by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/526
Update cli-commands.mdx by @esenilsson in https://github.com/elementary-data/elementary/pull/527
Always open files as utf-8 by @haritamar in https://github.com/elementary-data/elementary/pull/546
Fix upcoming breaking changes in dbt 1.4.0 by @elongl in https://github.com/elementary-data/elementary/pull/566
Fix test results configuration (report) by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/569
Fix duplicate rows bug by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/492
Postgres integration by @elongl in https://github.com/elementary-data/elementary/pull/562
Ele 184 revert dbt project dirs automatic by @elongl in https://github.com/elementary-data/elementary/pull/575

New Contributors

@esenilsson made their first contribution in https://github.com/elementary-data/elementary/pull/515
@Hadarsagiv made their first contribution in https://github.com/elementary-data/elementary/pull/540
@pratik60 made their first contribution in https://github.com/elementary-data/elementary/pull/550
@benoit-tropos-io made their first contribution in https://github.com/elementary-data/elementary/pull/570

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.5...v0.6.6

Open source →

0.6.53 Jan 2023

Using project directory to run the artifacts. by @elongl in https://github.com/elementary-data/elementary/pull/478

What's Changed

Using project directory to run the artifacts. by @elongl in https://github.com/elementary-data/elementary/pull/478
Suppress alerts by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/486
Alerts filters by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/498
Invocations filter by @IDoneShaveIt in https://github.com/elementary-data/elementary/pull/480
Changed the default days back to 'edr monitor' (alerts). by @elongl in https://github.com/elementary-data/elementary/pull/488

Full Changelog: https://github.com/elementary-data/elementary/compare/v0.6.3...v0.6.5

Open source →

Additional notes

title: "Elementary 0.6.5" sidebarTitle: "0.6.5"

January 10, 2023: v0.6.5 Python, v0.6.10 dbt package

🔥 What's new?

Alerts suppression 💤🔕
- Don't want to get multiple alerts if the same test keeps failing?
- You can now configure an alert_suppression_interval, this is a "snooze" period for alerts on the same issue.
- Docs here
Alerts filtering using selectors 🔘
- You can now configure edr to send only selected alerts, using tags, owners or models selectors.
- This enables you to send only the alerts you actually care about.
- Docs here
Generate report for a single invocation 1️⃣
- Use selectors to generate a pre-filtered report with the results you want to see.
- Try it: edr monitor report --select last_invocation
- Docs here
Granular time buckets in anomaly detection tests ⏳
- Now you can set time buckets that fit the updates cadence of your tables, to get better anomaly detection.
- The new config enables to bucket by hour | day | week and set the interval size as well.
  - Example: 6 hours buckets for volume test
```
tests:
  - elementary.volume_anomalies:
      timestamp_column: updated_at
      time_bucket:
        period: hour
        count: 6
```
- This was a very popular request here on Slack, special thanks to Rodrigo Loredo for your help with the implementation!

💫 More changes

Following the breaking change we experienced in dbt 1.3.2, we added dbt release candidates versions to our CI. This will enable us to prevent such incidents in the future.
We are evaluating a change in how we upload dbt artifacts to improve performance and unlock more use cases. For now you will see a warning message that will not impact your usage.

Open source →

elementary-data

Release timeline

Releases

What's Changed

New Contributors

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

What's Changed

What's Changed

New Contributors

What's Changed

What's Changed

What's Changed

Known Issues

New Contributors

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

What's Changed

Alerts

Report

What's Changed

Report Improvements

Navigation

Lineage Visualization

General Report Enhancements

Alerts Enhancements

General Enhancements

Development & Infrastructure

Operational & Debugging Improvements

New Contributors

What's Changed

What's Changed

New Contributors

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

What's Changed

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

title: "Elementary 0.10.0" sidebarTitle: "0.10.0"

🔥 What's New?