datafusion-tracing

Upgrade to DataFusion 54

Changed

• Update to Apache DataFusion 54.0.0
• Align InstrumentedExec with DataFusion 54's ExecutionPlan downcast API

chore: prepare 53.0.2 release

Fixed

• Close execution spans when streams finish instead of when execution plans are dropped, avoiding slow plan drops with synchronous OpenTelemetry span processors

chore: prepare 53.0.1 release

Added

• Add support for additional native DataFusion execution metrics, including output_bytes

Fixed

• Close rule phase spans correctly after fatal analyzer, logical optimizer, and physical optimizer rule errors

feat: Update to version 53.0.0

Changed

• Update to Apache DataFusion 53.0.0
• Update minimum supported Rust version to 1.88.0

fix: avoid recursive instrumentation using thread-local optimization …

Added

• Add tracing instrumentation for plan creation lifecycle via TracingQueryPlanner and rule instrumentation macros (instrument_rules_with_info_spans!). Phase spans now group individual rule executions for analyzer, logical optimizer, and physical optimizer, with automatic plan diff capture when rules modify plans
• Add transparent downcasting through InstrumentedExec by delegating as_any() to the inner plan. This allows code to inspect underlying execution node types without directly handling the instrumentation wrapper

Changed

• Update to Apache DataFusion 52.0.0
• Update OpenTelemetry dependencies to 0.31 and tracing-opentelemetry to 0.32
• Update Jaeger documentation to reference version 2.14.0

doc: Clarify InstrumentedExec visibility

Changed

• Update to Apache DataFusion 51.0.0
• Update minimum supported Rust version

Documentation

• Clarify InstrumentedExec visibility design decisions

fix: Update to version 50.0.2

Fixed

• Disable truncation indicator on plan preview output to prevent visual clutter

Documentation

• Clarify that instrument_rule should be placed last in the optimizer rules chain
• Add explanation of why InstrumentedExec is intentionally private

fix: Update to version 50.0.1

Fixed

• Downgrade comfy-table dependency to version 7.1 for broader compatibility

feat: Display dynamic filters in datafusion.node field

Added

• Display dynamic filters in the datafusion.node span field, providing visibility into filter pushdown during query execution

Changed

• Update to Apache DataFusion 50.0.0
• Switch to tpchgen-rs for generating TPC-H parquet test files

fix: Finalize recursive queries instrumentation support …

Fixed

• Finalize recursive query instrumentation support. WorkTableExec nodes can now be safely instrumented following upstream DataFusion changes (apache/datafusion#16469), enabling full tracing of all nodes in recursive query execution

Changed

• Update to Apache DataFusion 49.0.0

Fixed

• Backport partial support for recursive queries instrumentation to the 48.x line

Changed

• Update to Apache DataFusion 48.0.0

Fixed

• Add partial support for recursive queries instrumentation. Recursive queries now spawn a new span group for each recursive call via with_new_inner support on InstrumentedExec. Note: WorkTableExec nodes are not instrumented in this version due to DataFusion limitations

Documentation

• Clarify versioning scheme
• Fix documentation image links

Initial public release of DataFusion Tracing.

Added

• Tracing instrumentation for Apache DataFusion query execution plans
• Automatic span creation around execution steps via physical optimizer rule
• Native DataFusion metrics recording (execution time, output row count, etc.)
• Partial query result preview for debugging
• OpenTelemetry integration for distributed tracing
• Customizable InstrumentationOptions for controlling tracing behavior
• Support for custom span fields via add_custom_field
• Preview formatting utilities (pretty_format_compact_batch)
• Integration with Jaeger, DataDog, and other OpenTelemetry-compatible collectors