arrow-buffer

Releases

1. ▸▾23.0.019 Sept 2022Deprecated

   Deprecate RecordBatch::concat replace with concat\_batches \(\#2594\) \#2683 [arrow] (tustvold)

   Full Changelog

   Breaking changes:

   • Move JSON Test Format To integration-testing #2724 [arrow] (tustvold)
   • Split out arrow-buffer crate (#2594) #2693 [arrow] (tustvold)
   • Simplify DictionaryBuilder constructors (#2684) (#2054) #2685 [parquet] [arrow] (tustvold)
   • Deprecate RecordBatch::concat replace with concat_batches (#2594) #2683 [arrow] (tustvold)
   • Add overflow-checking variant for primitive arithmetic kernels and explicitly define overflow behavior #2643 [arrow] (viirya)
   • Update thrift v0.16 and vendor parquet-format (#2502) #2626 [parquet] (tustvold)
   • Update flight definitions including backwards-incompatible change to GetSchema #2586 [arrow] [arrow-flight] (liukun4515)

   Implemented enhancements:

   • Cleanup like and nlike utf8 kernels #2744 [arrow]
   • Speedup eq and neq kernels for utf8 arrays #2742 [arrow]
   • API for more ergonomic construction of RecordBatchOptions #2728 [arrow]
   • Automate updates to CHANGELOG-old.md #2726
   • Don't check the DivideByZero error for float modulus #2720 [arrow]
   • try_binary should not panic on unequaled array length. #2715 [arrow]
   • Add benchmark for bitwise operation #2714 [arrow]
   • Add overflow-checking variants of arithmetic scalar dyn kernels #2712 [arrow]
   • Add divide_opt kernel which produce null values on division by zero error #2709 [arrow]
   • Add DataType function to detect nested types #2704 [arrow]
   • Add support of sorting dictionary of other primitive types #2700 [arrow]
   • Sort indices of dictionary string values #2697 [arrow]
   • Support empty projection in RecordBatch::project #2690 [arrow]
   • Support sorting dictionary encoded primitive integer arrays #2679 [arrow]
   • Use BitIndexIterator in min_max_helper #2674 [arrow]
   • Support building comparator for dictionaries of primitive integer values #2672 [arrow]
   • Change max/min string macro to generic helper function min_max_helper #2657 [arrow]
   • Add overflow-checking variant of arithmetic scalar kernels #2651 [arrow]
   • Compare dictionary with binary array #2644 [arrow]
   • Add overflow-checking variant for primitive arithmetic kernels #2642 [arrow]
   • Use downcast_primitive_array in arithmetic kernels #2639 [arrow]
   • Support DictionaryArray in temporal kernels #2622 [arrow]
   • Inline Generated Thift Code Into Parquet Crate #2502 [parquet]

   Fixed bugs:

   • Escape contains patterns for utf8 like kernels #2745 [arrow]
   • Float Array should not panic on DivideByZero in the Divide kernel #2719 [arrow]
   • DictionaryBuilders can Create Invalid DictionaryArrays #2684 [parquet] [arrow]
   • arrow crate does not build with features = ["ffi"] and default_features = false. #2670 [arrow]
   • Invalid results with RowSelector having row_count of 0 #2669 [parquet]
   • clippy error: unresolved import crate::array::layout #2659 [arrow]
   • Cast the numeric without the CastOptions #2648 [arrow]
   • Explicitly define overflow behavior for primitive arithmetic kernels #2641 [arrow]
   • update the flight.proto and fix schema to SchemaResult #2571 [arrow] [arrow-flight]
   • Panic when first data page is skipped using ColumnChunkData::Sparse #2543 [parquet]
   • SchemaResult in IPC deviates from other implementations #2445 [arrow] [arrow-flight]

   Closed issues:

   • Implement collect for int values #2696 [arrow]

   Merged pull requests:

   • Speedup string equal/not equal to empty string, cleanup like/ilike kernels, fix escape bug #2743 [arrow] (Dandandan)
   • Partially flatten arrow-buffer #2737 [arrow] (tustvold)
   • Automate updates to CHANGELOG-old.md #2732 (iajoiner)
   • Update read parquet example in parquet/arrow home #2730 [parquet] (datapythonista)
   • Better construction of RecordBatchOptions #2729 [arrow] (askoa)
   • benchmark: bitwise operation #2718 [arrow] (liukun4515)
   • Update try_binary and checked_ops, and remove math_checked_op #2717 [arrow] (HaoYang670)
   • Support bitwise op in kernel: or,xor,not #2716 [arrow] (liukun4515)
   • Add overflow-checking variants of arithmetic scalar dyn kernels #2713 [arrow] (viirya)
   • Add divide_opt kernel which produce null values on division by zero error #2710 [arrow] (viirya)
   • Add DataType::is_nested() #2707 [arrow] (kfastov)
   • Update criterion requirement from 0.3 to 0.4 #2706 [parquet] [arrow] (dependabot[bot])
   • Support bitwise and operation in the kernel #2703 [arrow] (liukun4515)
   • Add support of sorting dictionary of other primitive arrays #2701 [arrow] (viirya)
   • Clarify docs of binary and string builders #2699 [arrow] (datapythonista)
   • Sort indices of dictionary string values #2698 [arrow] (viirya)
   • Add support for empty projection in RecordBatch::project #2691 [arrow] (Dandandan)
   • Temporarily disable Golang integration tests re-enable JS #2689 (tustvold)
   • Verify valid UTF-8 when converting byte array (#2205) #2686 [arrow] (tustvold)
   • Support sorting dictionary encoded primitive integer arrays #2680 [arrow] (viirya)
   • Skip RowSelectors with zero rows #2678 [parquet] (askoa)
   • Faster Null Path Selection in ArrayData Equality #2676 [arrow] (dhruv9vats)
   • Use BitIndexIterator in min_max_helper #2675 [arrow] (viirya)
   • Support building comparator for dictionaries of primitive integer values #2673 [arrow] (viirya)
   • json feature always requires base64 feature #2668 [parquet] (eagletmt)
   • Add try_unary, binary, try_binary kernels ~90% faster #2666 [arrow] (tustvold)
   • Use downcast_dictionary_array in unary_dyn #2663 [arrow] (tustvold)
   • optimize the numeric_cast_with_error #2661 [arrow] (liukun4515)
   • ffi feature also requires layout #2660 [arrow] (viirya)
   • Change max/min string macro to generic helper function min_max_helper #2658 [arrow] (viirya)
   • Fix flaky test test_fuzz_async_reader_selection #2656 [parquet] (thinkharderdev)
   • MINOR: Ignore flaky test test_fuzz_async_reader_selection #2655 [parquet] (viirya)
   • MutableBuffer::typed_data - shared ref access to the typed slice #2652 [arrow] (medwards)
   • Overflow-checking variant of arithmetic scalar kernels #2650 [arrow] (viirya)
   • support CastOption for casting numeric #2649 [arrow] (liukun4515)
   • Help LLVM vectorize comparison kernel ~50-80% faster #2646 [arrow] (tustvold)
   • Support comparison between dictionary array and binary array #2645 [arrow] (viirya)
   • Use downcast_primitive_array in arithmetic kernels #2640 [arrow] (viirya)
   • Fully qualifying parquet items #2638 (dingxiangfei2009)
   • Support DictionaryArray in temporal kernels #2623 [arrow] (viirya)
   • Comparable Row Format #2593 [arrow] (tustvold)
   • Fix bug in page skipping #2552 [parquet] (thinkharderdev)