PyPI · #86 most downloaded on PyPI

pyarrow

25.0.1333M downloads/moapache/arrow ↗New releases in your daily digest, changelog included.

Python library for Apache Arrow

Last release 1 months ago
10 Aug 2026
Ships fairly regularly
a new release about every 2 months
Nearly every release is documented
notes for 58 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
10 years old
65 releases · first in 2017

Release timeline

65 releases since 2017

2017201920212023

Releases

3.0.026 Jan 2021Deprecated
ARROW-10849 - [Python] Handle numpy deprecation warnings for builtin type aliases
New Features and Improvements

ARROW-1846 - [C++][Compute] Implement "any" reduction kernel for boolean data

ARROW-4193 - [Rust] Add support for decimal data type

ARROW-4544 - [Rust] JSON nested struct reader

ARROW-4804 - [Rust] Parse Date32 and Date64 in CSV reader

ARROW-4960 - [R] Build r-arrow conda package in crossbow

ARROW-4970 - [C++][Parquet] Implement parquet::FileMetaData::Equals

ARROW-5336 - [C++] Implement arrow::Concatenate for dictionary-encoded arrays with unequal dictionaries

ARROW-5350 - [Rust] Allow filtering on simple lists

ARROW-5394 - [C++][Benchmark] IsIn and IndexIn benchmark for integer and string types

ARROW-5679 - [Python][CI] Remove Python 3.5 support

ARROW-5950 - [Rust][DataFusion] Add logger

ARROW-6071 - [C++] Generic binary-to-binary casts

ARROW-6697 - [Rust] [DataFusion] Validate that all parquet partitions have the same schema

ARROW-6715 - [Website] Describe "non-free" component is needed for Plasma packages in install page

ARROW-6883 - [C++][Python] Allow writing dictionary deltas

ARROW-6995 - [Packaging][Crossbow] The windows conda artifacts are not uploaded to GitHub releases

ARROW-7531 - [C++] Reduce header inclusion cost slightly

ARROW-7800 - [Python] implement iter_batches() method for ParquetFile and ParquetReader

ARROW-7842 - [Rust][Parquet] Arrow list reader

ARROW-8113 - [C++] Lighter weight variant<>

ARROW-8199 - [C++] Add support for multi-column sort indices on Table

ARROW-8289 - [Rust] Parquet Arrow writer with nested support

ARROW-8423 - [Rust][Parquet] Serialize Arrow schema metadata

ARROW-8425 - [Rust][Parquet] Correct temporal IO

ARROW-8426 - [Rust][Parquet] - Add more support for converting Dicts

ARROW-8426 - [Rust][Parquet] Add support for writing dictionary types

ARROW-8853 - [Rust][Integration Testing] Enable Flight tests

ARROW-8876 - [C++] Implement casts from date types to Timestamp

ARROW-8883 - [Rust][Integration] Enable more tests

ARROW-9001 - [R] Box outputs as correct type in call_function

ARROW-9164 - [C++] Add embedded documentation to compute functions

ARROW-9187 - [R] Add bindings for arithmetic kernels

ARROW-9296 - [Rust][DataFusion] Address clippy errors clippy::unnecessary_unwrap, clippy::useless_format,

ARROW-9304 - [C++] Add "AppendEmpty" builder APIs for use inside StructBuilder::AppendNull

ARROW-9361 - [Rust] Move array types into their own modules

ARROW-9367 - [Python] Sorting on pyarrow data structures ?

ARROW-9400 - [Python] Do not depend on conda-forge static libraries in Windows wheel builds

ARROW-9475 - [Java] Clean up usages of BaseAllocator, use BufferAllocator in…

ARROW-9489 - [C++][string][string] )

ARROW-9555 - [Rust][DataFusion] Implement physical node for inner join

ARROW-9564 - [Packaging] Vendor r-arrow-feedstock conda-forge recipe

ARROW-9674 - [Rust] Make the parquet read and writers Send

ARROW-9704 - [Java] TestEndianness.testLittleEndian supports little- and big-endian platforms

ARROW-9707 - [Rust] [DataFusion] Re-implement threading model

ARROW-9709 - [Java] Test cases in arrow-vector takes care of endianness

ARROW-9728 - [Rust][Parquet] Nested definition & repetition for structs

ARROW-9747 - [Java][C++] Initial Support for 256-bit Decimals

ARROW-9771 - [Rust][DataFusion] treat predicates separated by AND separately in predicate pushdown

ARROW-9803 - [Go] Add initial support for s390x

ARROW-9804 - [FlightRPC] Flight auth redesign

ARROW-9828 - [Rust][DataFusion] Support filter pushdown optimisation for TableProvider implementations

ARROW-9861 - [Java] Support big-endian in DecimalVector

ARROW-9862 - [Java] Enable UnsafeDirectLittleEndian on a big-endian platform

ARROW-9911 - [Rust][DataFusion] SELECT <expression> with no FROM clause should produce a single row of output

ARROW-9945 - [C++][Dataset] Refactor Expression::Assume to return a Result

ARROW-9991 - [C++] Split kernels for strings/binary

ARROW-10002 - [Rust] Remove trait specialization from arrow crate

ARROW-10021 - [C++][Compute] Return top-n modes in mode kernel

ARROW-10032 - [Documentation] update C++ windows docs

ARROW-10079 - [Rust] Benchmark and improve count bits

ARROW-10095 - [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

ARROW-10097 - [C++] Persist SetLookupState in between usages of IsIn when filtering dataset batches

ARROW-10106 - [FlightRPC][Java] Expose onIsReady() callback

ARROW-10108 - [Rust] [Parquet] Fix compiler warning about unused return value

ARROW-10109 - [Rust] Add support to the C data interface for primitive types and utf8

ARROW-10110 - [Rust] Add support to consume C Data Interface

ARROW-10131 - [C++][Dataset][Python] Lazily parse parquet metadata

ARROW-10135 - [Rust][Parquet] Refactor file module to help adding sources

ARROW-10143 - [C++] Rewrite Array(Range)Equals

ARROW-10144 - [Flight] Add support for using the TLS_SNI extension

ARROW-10149 - [Rust] Add support to external release of un-owned buffers

ARROW-10163 - [Rust][DataFusion] Add DictionaryArray coercion support

ARROW-10168 - [Rust][Parquet] Schema roundtrip - use Arrow schema from Parquet metadata when available

ARROW-10173 - [Rust][DataFusion] Implement support for direct comparison to scalar values

ARROW-10180 - [C++][Doc] Update dependency management docs

ARROW-10182 - [C++] Add basic continuation support to Future

ARROW-10191 - [Rust][Parquet] Add roundtrip Arrow -> Parquet tests for all supported Arrow DataTypes

ARROW-10197 - [python][Gandiva] Execute expression on filtered data

ARROW-10203 - [Doc] Give guidance on big-endian support in the contributors docs

ARROW-10207 - [C++] Allow precomputing output string/list offsets in kernels

ARROW-10208 - [C++] Fix split string kernels on sliced input

ARROW-10216 - [Rust] Simd implementation for primitive min/max kernels

ARROW-10224 - [Python] Add support for Python 3.9 except macOS wheel and Windows wheel

ARROW-10225 - [Rust][Parquet] Fix null comparison in roundtrip

ARROW-10228 - [Julia] Contribute Julia implementation

ARROW-10236 - [Rust] Add can_cast_types to arrow cast kernel, use in DataFusion

ARROW-10241 - [C++][Compute] Add variance kernel benchmark

ARROW-10249 - [Rust] Support nested dictionaries inside list arrays

ARROW-10259 - [Rust] Add custom metadata to Field

ARROW-10261 - [Rust][Breaking] Change List datatype to Box<Field>

ARROW-10263 - [C++][Compute] Improve variance kernel numerical stability

ARROW-10268 - [Rust] Write out non-nested dictionaries in the IPC format

ARROW-10269 - [Rust] Update to 2020-11-14 nightly

ARROW-10277 - [C++] Support comparing scalars approximately

ARROW-10289 - [Rust] Read dictionaries in IPC streams

ARROW-10292 - [Rust][DataFusion] Simplify merge

ARROW-10295 - [Rust][DataFusion] Replace Rc<RefCell<>> by Box<> in accumulators.

ARROW-10300 - [Rust] Improve documentation for TPC-H benchmark

ARROW-10301 - [C++][Compute] Implement "all" reduction kernel for boolean data

ARROW-10302 - [Python] Don't double-package plasma-store-server

ARROW-10304 - [C++][Compute] Optimize variance kernel for integers

ARROW-10310 - [C++][Gandiva] Add single argument round() in Gandiva

ARROW-10311 - [Release] Update crossbow verification process

ARROW-10313 - [C++] Faster UTF8 validation for small strings

ARROW-10318 - [C++] Use pimpl idiom in CSV parser

ARROW-10319 - [Go][Flight] Add context to flight client auth handler

ARROW-10320 - [Rust][DataFusion] Migrated from batch iterators to batch streams.

ARROW-10322 - [C++][Dataset] Minimize Expression

ARROW-10323 - [Release][wheel] Add missing verification setup step

ARROW-10325 - [C++][Compute] Refine aggregate kernel registration

ARROW-10328 - [C++] Vendor fast_float number parsing library

ARROW-10330 - [Rust][DataFusion] Implement NULLIF() SQL function

ARROW-10331 - [Rust][DataFusion] Re-organize DataFusion errors

ARROW-10332 - [Rust] Allow CSV reader to iterate from start up to end

ARROW-10334 - [Rust][Parquet] NullArray roundtrip

ARROW-10336 - [Rust] Added FromIter and ToIter for string arrays

ARROW-10337 - [C++] More liberal parsing of ISO8601 timestamps with fractional seconds

ARROW-10338 - [Rust] Use const fn for applicable methods

ARROW-10340 - [Packaging][deb][RPM] Use Python 3.8 for pygit2

ARROW-10356 - [Rust][DataFusion] Add support for is_in

ARROW-10363 - [Python] Remove CMake bug workaround in manylinux

ARROW-10366 - [Rust][DataFusion] Do not buffer intermediate results in merge or HashAggregate

ARROW-10375 - [Rust] Removed PrimitiveArrayOps

ARROW-10378 - [Rust] Update take() kernel with support for LargeList.

ARROW-10381 - [Rust] Generalized Ordering for inter-array comparisons

ARROW-10382 - [Rust] Fix typos

ARROW-10383 - [Doc] fix typos

ARROW-10384 - [C++] Fix typos

ARROW-10385 - [C++][Gandiva] Add support for LLVM 11

ARROW-10389 - [Rust][DataFusion] Make the custom source implementation API more explicit

ARROW-10392 - [C++][Gandiva] Avoid string copy while evaluating IN expression

ARROW-10396 - [Rust][Parquet] Publically export SliceableCursor and FileSource

ARROW-10398 - [Rust][Parquet] Re-Export parquet::record::api::Field

ARROW-10400 - [C++] Propagate TLS client peer_identity when using mutual TLS

ARROW-10402 - [Rust] Refactor array equality

ARROW-10407 - [C++] Add BasicDecimal256 division Support

ARROW-10408 - [Java] Bump Avro to 1.10.0

ARROW-10410 - [Rust] Some refactorings

ARROW-10416 - [R] Support Tables in Flight

ARROW-10422 - [Rust] Removed unused trait BinaryArrayBuilder

ARROW-10424 - [Rust] Minor simplification to the generic impl PrimitiveArray

ARROW-10428 - [FlightRPC][Java] Add support for HTTP cookies

ARROW-10445 - [Rust] Added doubleEnded iterator to PrimitiveArrayIter

ARROW-10449 - [Rust] Make Dictionary::keys be an array

ARROW-10454 - [Rust][Datafusion] support creating ParquetExec from filelist and schema

ARROW-10455 - [Rust][CI] Fixed error in caching files

ARROW-10458 - [Rust][Datafusion] create_logical_plan should not require mutable reference

ARROW-10464 - [Rust][DataFusion] Add utility to convert TPC-H data from tbl to CSV and Parquet

ARROW-10466 - [Rust] [Website] Update implementation status page

ARROW-10467 - [FlightRPC][Java] Add the ability to pass arbitrary client headers.

ARROW-10468 - [C++][Compute] Provide KernelExecutor instead of FunctionExecutor

ARROW-10476 - [Rust] Allow string arrays to be built from Option<&str> or Option<String>

ARROW-10477 - [Rust] Add iterator support for Binary arrays.

ARROW-10478 - [Dev][Release] Correct Java versions to 3.0.0-SNAPSHOT

ARROW-10481 - [R] Bindings to add, remove, replace Table columns

ARROW-10483 - [C++] Move Executor into a separate header

ARROW-10484 - [C++] Make Future<> more generic

ARROW-10487 - [FlightRPC][C++] Header-based auth in clients

ARROW-10490 - [C++][GLib] Fix range-loop-analysis warnings

ARROW-10492 - [Java][JDBC] Allow users to config the mapping between SQL types and Arrow types

ARROW-10504 - [C++] Suppress UBSAN pointer-overflow warning in RapidJSON

ARROW-10510 - [Rust][DataFusion] Benchmark COUNT(DISTINCT) queries.

ARROW-10515 - [Julia][Doc] Update lists of supported languages to include Julia

ARROW-10522 - [R] Allow rename Table and RecordBatch columns with names()

ARROW-10526 - [FlightRPC][C++] Client cookie middleware

ARROW-10530 - [R] Optionally use distro package in linuxlibs.R

ARROW-10531 - [Rust][DataFusion] : Add schema and graphviz formatting for LogicalPlans and a PlanVisitor

ARROW-10539 - [Packaging][Python] Use GitHub Actions to build wheels for Windows

ARROW-10540 - [Rust] Extended filter kernel to all types and improved performance

ARROW-10541 - [C++] Add re2 library to core arrow / ARROW_WITH_RE2

ARROW-10542 - [C#][Flight] Add beginning on flight code for net core

ARROW-10543 - [Developer] Add a note about being patient after gitbox is enabled

ARROW-10552 - [Rust] Removed un-used Result

ARROW-10559 - [Rust][DataFusion] Split up logical_plan/mod.rs into sub modules

ARROW-10561 - [Rust] Simplified Buffer's write and write_bytes and fixed undefined behavior

ARROW-10562 - [Rust] Potential UB on unsafe code

ARROW-10566 - [C++] Allow validating ArrayData directly

ARROW-10567 - [C++] Add multiple perf runs options for higher precision reporting

ARROW-10572 - [Rust][DataFusion] Use aHash instead of FnvHashMap

ARROW-10574 - [Python][Parquet] Allow collections for 'in' / 'not in' filter (in addition to sets)

ARROW-10575 - [Rust] Rename union.rs to be cosistent with other arrays

ARROW-10581 - [Doc] IPC dictionary reference to relevant section

ARROW-10582 - [Rust][DataFusion] Implement "repartition" operator

ARROW-10584 - [Rust][DataFusion] Add SQL support for JOIN ON syntax

ARROW-10585 - [Rust][DataFusion] Add join support to DataFrame and LogicalPlan

ARROW-10586 - [Rust] [DataFusion] Add join support to query planner

ARROW-10589 - [Rust] Implement AVX-512 bit and operation

ARROW-10590 - [Rust] Remove Date32(Millisecond) from casts

ARROW-10591 - [Rust] Add support for StructArray to MutableArrayData

ARROW-10595 - [Rust] Simplify inner loop of min/max kernels for non-null case

ARROW-10596 - [Rust] Improve take benchmark

ARROW-10598 - [C++] Separate out bit-packing in internal::GenerateBitsUnrolled for better performance

ARROW-10604 - [GLib][Ruby] Add support for 256-bit decimal

ARROW-10607 - [C++][Parquet] Add parquet support for decimal256.

ARROW-10609 - [Rust] Optimize min/max of non null strings

ARROW-10628 - [Rust] flag clippy warnings as errors

ARROW-10633 - [Rust][DataFusion] Dependency version updates

ARROW-10634 - [C#][CI] Change the build version from 2.2 to 3.1 in CI

ARROW-10636 - [Rust][Parquet] Switch to Rust Stable by removing specialization in parquet

ARROW-10637 - [Rust] Added examples to some boolean kernels.

ARROW-10638 - [Rust] Improved tests of boolean kernel.

ARROW-10639 - [Rust] Added examples to is_null kernel and simplified signature.

ARROW-10644 - [Python] Consolidate path/filesystem handling in pyarrow.dataset and pyarrow.fs

ARROW-10646 - [C++][FlightRPC] Disable flaky Flight test on Windows

ARROW-10648 - [Java] Prepare Java codebase for source release without requiring any git tags to be created or pushed

ARROW-10651 - [C++] Fix alloc-dealloc-mismatch in S3-related factory

ARROW-10652 - [C++][Gandiva] Make gandiva cache size configurable

ARROW-10653 - [Rust] Update toolchain nightly

ARROW-10654 - [Rust] Specialize parsing of floats / bools in CSV Reader

ARROW-10660 - [Rust] Implement AVX-512 bit or operation

ARROW-10665 - [Rust] like/nlike utf8 scalar fast paths, bug fixes in like/nlike

ARROW-10666 - [Rust][DataFusion] Support nested SELECT statements.

ARROW-10669 - [C++][Compute] Support scalar arguments to Boolean compute functions

ARROW-10672 - [Rust][DataFusion] Made Limit be computed on the stream.

ARROW-10673 - [Rust][DataFusion] Made sort not collect on execute.

ARROW-10674 - [Rust] Fix BigDecimal to be little endian; Add IPC Reader/Writer for Decimal type to allow integration tests

ARROW-10677 - [Rust] Fix CSV Boolean parsing + add tests to demonstrate supported csv parsing

ARROW-10679 - [Rust][DataFusion] Implement CASE WHEN physical expression

ARROW-10680 - [Rust][DataFusion] Add partial support for TPC-H query 12

ARROW-10682 - [Rust] Improve sort kernel performance by enabling inlining of is_valid calls

ARROW-10685 - [Rust][DataFusion] Added support for Join on filter-pushdown optimizer.

ARROW-10688 - [Rust][DataFusion] Implement CASE WHEN logical plan

ARROW-10689 - [Rust][DataFusion] Add SQL support for CASE WHEN

ARROW-10693 - [Rust][DataFusion] Add support to left join

ARROW-10696 - [C++] Add SetBitRunReader

ARROW-10697 - [C++] Add notes about bitmap readers

ARROW-10703 - [Rust][DataFusion] Compute build-side of hash join once

ARROW-10704 - [Rust][DataFusion] Remove Nested from expression enum

ARROW-10708 - [Packaging][deb] Add support for Ubuntu 20.10

ARROW-10709 - [C++][Python] Allow PyReadableFile::Read() to call pyobj.read_buffer()

ARROW-10712 - [Rust][DataFusion] Add tests to TPC-H benchmarks

ARROW-10717 - [Rust][DataFusion] Add support for right join

ARROW-10720 - [C++] Add Rescale support for BasicDecimal256

ARROW-10721 - [C#][CI] Use .NET 3.1 by default

ARROW-10722 - [Rust][DataFusion] Reduce overhead of some data types in aggregations / joins, improve benchmarks

ARROW-10723 - [Packaging][deb][RPM] Enable Parquet encription

ARROW-10724 - [Dev Tools] Added labeler to PRs that need rebase.

ARROW-10725 - [Python][Compute] Expose sort options in Python bindings

ARROW-10728 - [Rust][DataFusion] Support USING in SQL

ARROW-10729 - [Rust][DataFusion] Add SQL support for JOIN using implicit syntax

ARROW-10732 - [Rust][DataFusion] Integrate DFSchema as a step towards supporting qualified column names

ARROW-10733 - [R] Improvements to Linux installation troubleshooting

ARROW-10740 - [Rust][DataFusion] Remove redundant clones found by clippy

ARROW-10741 - [Rust] Apply previously ignored clippy suggestions

ARROW-10742 - [Python] Check mask when creating array from numpy

ARROW-10745 - [Rust] Directly allocate padding bytes in filter context

ARROW-10747 - [Rust] : CSV reader optimization

ARROW-10750 - [Rust][DataFusion] Add SQL support for LEFT and RIGHT join

ARROW-10752 - [GLib] Add garrow_schema_has_metadata()

ARROW-10754 - [GLib] Add support for metadata to GArrowField

ARROW-10755 - [Rust][Parquet] Add support for writing boolean type

ARROW-10756 - [Rust][DataFusion] Fix reduntant clones

ARROW-10759 - [Rust][DataFusion] Implement string to date cast

ARROW-10763 - [Rust] Speed up take for primitive / boolean for non-null arrays

ARROW-10765 - [Rust] Optimize take string for non-null arrays

ARROW-10767 - [Rust] Speed up sum with nulls (non-simd)

ARROW-10770 - [Rust] JSON nested list reader

ARROW-10772 - [Rust] Speed up take by writing to buffer

ARROW-10775 - [Rust][DataFusion] Use ahash in join hashmap

ARROW-10776 - [C++] Allow STL iteration over concrete primitive arrays

ARROW-10781 - [Rust][DataFusion] add the 'Statistics' interface in data source

ARROW-10783 - [Rust][DataFusion] Implement Statistics for Parquet TableProvider

ARROW-10785 - [Rust] Optimize take string

ARROW-10786 - [Packaging][RPM] Drop support for CentOS 6

ARROW-10788 - [C++] Make S3 recursive tree walks parallel

ARROW-10789 - [Rust][DataFusion] Make TableProvider dynamically typed

ARROW-10790 - [C++] Improve ChunkedArray and Table sort_indices performance

ARROW-10792 - [Rust][CI] Modularize builds for faster build and smaller caches

ARROW-10795 - [Rust] Optimize specialization for datatypes

ARROW-10796 - [C++] Implement optimized RecordBatch sorting

ARROW-10800 - [Rust][Parquet] Provide access to the elements of parquet::record::{List, Map}

ARROW-10802 - [C++][NullType] in parquet column writer

ARROW-10808 - [Rust][DataFusion] Support nested expressions in aggregations.

ARROW-10809 - [C++] Use Datum for SortIndices() input

ARROW-10812 - [Rust] Make BooleanArray not a PrimitiveArray

ARROW-10813 - [Rust][DataFusion] Implement DFSchema

ARROW-10814 - [Packaging][deb] Remove support for Debian GNU/Linux Stretch

ARROW-10817 - [Rust][DataFusion] Implement TypedString and DATE coercion

ARROW-10820 - [Rust][DataFusion] Complete TPC-H Benchmark Queries

ARROW-10821 - [Rust][Datafusion] support negative expression

ARROW-10822 - [Rust][Datafusion] add simd feature flag to datafusion

ARROW-10824 - [Rust] Added partialEq to null array

ARROW-10825 - [Rust] Added support for NullArray to MutableArrayData

ARROW-10826 - [Rust] Add support for FixedSizeBinaryArray to MutableArrayData

ARROW-10827 - [Rust] Move concat from builders to a compute kernel and make it faster (2-6x)

ARROW-10828 - [Rust][DataFusion] Address / fix clippy lints

ARROW-10829 - [Rust][DataFusion] Implement Into<Schema> for DFSchema

ARROW-10832 - [Rust][Arrow] generate src/ipc/gen/* with latest snapshot flatc.

ARROW-10836 - [Rust] Extend take kernel to FixedSizeListArray

ARROW-10838 - [Rust][CI] Add arrow build targeting wasm32

ARROW-10839 - [Rust][Data Fusion] Implement BETWEEN operator

ARROW-10843 - [C++] Add support for temporal types in sort family kernels

ARROW-10845 - [Python][CI] Build with nightly numpy and pandas artifacts

ARROW-10849 - [Python] Handle numpy deprecation warnings for builtin type aliases

ARROW-10851 - [C++] Reduce size of generated code for sort kernels

ARROW-10857 - [Packaging] Follow PowerTools repository name change on CentOS 8

ARROW-10858 - [C++] Add missing Boost dependency with Visual C++

ARROW-10861 - [Python] Update minimal NumPy version to 1.16.6

ARROW-10864 - [Rust] Use standard ordering for floats

ARROW-10865 - [Rust] Easier to use Schema -> DFSchema conversion

ARROW-10867 - [C++] Workaround gcc internal compiler error

ARROW-10869 - [GLib] Add garrow_*_sort_indices() and related options

ARROW-10870 - [Julia][Doc] Include Julia in project documentation

ARROW-10871 - [Julia][CI] Setup Julia testing via Github Actions

ARROW-10873 - [C++] Apple Silicon is reported as arm64 in CMake

ARROW-10874 - [Rust][DataFusion] Add statistics for MemTable, change statistics struct

ARROW-10877 - [Rust] [DataFusion] Add benchmark based on kaggle movies

ARROW-10878 - [Rust] Simplify extend_from_slice

ARROW-10879 - [Packaging][deb] Restore Debian GNU/Linux Buster support

ARROW-10881 - [C++] Fix EXC_BAD_ACCESS in PutSpaced

ARROW-10885 - [Rust][DataFusion] Optimize hash join build vs probe order based on number of rows

ARROW-10887 - [Doc][C++] Document C++ IPC API

ARROW-10889 - [Rust][Proposal] Add guidelines about usage of unsafe

ARROW-10890 - [Rust] [DataFusion] JOIN support

ARROW-10891 - [Rust][DataFusion] Enable / fix clone_on_copy, map_clone, or_fun_call

ARROW-10893 - [Rust][DataFusion] More clippy lints

ARROW-10896 - [C++][CMake] Rename internal RE2 package name to "re2" from "RE2"

ARROW-10900 - [Rust][DataFusion] Resolve TableScan provider eagerly

ARROW-10904 - [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

ARROW-10905 - [Python] Add support for Python 3.9 windows wheels

ARROW-10908 - [Rust][DataFusion] Update relevant tpch-queries with BETWEEN

ARROW-10917 - [Doc] Update feature matrix for Rust

ARROW-10918 - [Doc][C++] Document supported Parquet features

ARROW-10927 - [Rust][Parquet] Add Decimal to ArrayBuilderReader

ARROW-10927 - [Rust][Parquet][REVERT]

ARROW-10927 - [Rust][Parquet] Add Decimal to ArrayBuilderReader

ARROW-10929 - [Rust] Change CI to use Stable Rust

ARROW-10933 - [Rust] Update readme files in regard to nightly rust

ARROW-10934 - [Python] Skip filesystem tests for in-memory fs for fsspec 0.8.5

ARROW-10938 - [Rust] upgrade dependency "flatbuffers" to 0.8

ARROW-10940 - [Rust] Extend sort kernel to ListArray

ARROW-10941 - [Doc] Document supported Parquet encryption features

ARROW-10944 - [Rust] Implement min/max aggregate kernels for BooleanArray

ARROW-10946 - [Rust] Simplified bit chunk iterator

ARROW-10947 - [Rust][DataFusion] Optimize UTF8 to Date32 Conversion

ARROW-10948 - [C++] Always use GTestConfig.cmake

ARROW-10949 - [Rust] Removed un-needed clone

ARROW-10951 - [Python][CI] Fix nightly pandas builds (pytest monkeypatch issue)

ARROW-10952 - [Rust] Add pre-commit hook

ARROW-10966 - [C++] Use FnOnce for ThreadPool's tasks instead of std::function

ARROW-10968 - [Rust][DataFusion] Don't build hash table for right side of join

ARROW-10969 - [Rust][DataFusion] Implement basic String ANSI SQL Functions

ARROW-10985 - [Rust] Update unsafe guidelines for adding JIRA references

ARROW-10986 - [Rust][DataFusion] Add average stats to TPC-H benchmarks

ARROW-10988 - [C++] Require CMake 3.5 or later

ARROW-10989 - [Rust] Iterate primitive buffers by slice

ARROW-10993 - [CI][macOS] Fix Python 3.9 installation by Homebrew

ARROW-10995 - [Rust][DataFusion] Limit ParquetExec concurrency when reading large number of files

ARROW-11004 - [FlightRPC][Python] Header-based auth in clients

ARROW-11005 - [Rust] Remove indirection from take kernel

ARROW-11008 - [Rust][DataFusion] Simplify count accumulator

ARROW-11009 - [C++] Allow changing default memory pool with an environment variable

ARROW-11010 - [Python] `np.float` deprecation warning in `_pandas_logical_type_map`

ARROW-11012 - [Rust][DataFusion] Make write_csv and write_parquet concurrent

ARROW-11015 - [CI][Gandiva] Move gandiva nightly build from travis to github action

ARROW-11018 - [Rust][DataFusion] Add support for column-level statistics, null count.

ARROW-11026 - [Rust] : Run tests without requiring environment variables

ARROW-11028 - [Rust] Make a few pattern matches more idiomatic

ARROW-11029 - [Rust][DataFusion] Add documentation for code that determines number of rows per operator

ARROW-11032 - [C++][FlightRPC] Benchmark unix socket RPC

ARROW-11033 - [Rust] Csv writing performance improvements

ARROW-11034 - [Rust] remove rustfmt ignore list, fix format

ARROW-11035 - [Rust] Improved performance of casting to utf8

ARROW-11037 - [Rust] Optimized creation of string array from iterator.

ARROW-11038 - [Rust] Removed unused trait and Result.

ARROW-11039 - [Rust] Performance improvement for utf-8 to float cast

ARROW-11040 - [Rust] Simplified builders

ARROW-11042 - [Rust][DataFusion] Increase default batch size

ARROW-11043 - [C++] Add "is_nan" kernel

ARROW-11046 - [Rust][DataFusion] Support count_distinct in DataFrame API

ARROW-11049 - [Python] Expose alternate memory pools

ARROW-11052 - [Rust][DataFusion] Implement metrics for HashJoinExec

ARROW-11053 - [Rust] [DataFusion] Optimize joins with dynamic capacity for output batches

ARROW-11054 - [Rust][DataFusion] Move to sqlparser 0.7.0

ARROW-11055 - [Rust][DataFusion] Support date_trunc function

ARROW-11058 - [Rust][DataFusion] Implement coalesce batches operator

ARROW-11063 - [Rust][Breaking] Validate null counts when building arrays

ARROW-11064 - [Rust][DataFusion] Speed up hash join on smaller batches

ARROW-11072 - [Rust][Parquet] Support reading decimal from physical int types

ARROW-11076 - [Rust][DataFusion] Refactor usage of right indices in hash join

ARROW-11079 - [R] Catch up on changelog since 2.0

ARROW-11080 - [C++][Dataset] Improvements to implicit casting

ARROW-11082 - [Rust] C data interface to largeUTF8

ARROW-11086 - [Rust] Extend take implementation to more index types

ARROW-11091 - [Rust][DataFusion] Fix new clippy linting errors

ARROW-11095 - [Python] access pyarrow.RecordBatch field() and column() by string name

ARROW-11096 - [Rust][Large] binary

ARROW-11097 - [Rust] Minor simplification of some tests.

ARROW-11099 - [Rust] Remove unsafe value_slice and raw_values methods from primitive and boolean arrays

ARROW-11100 - [Rust] Speed up numeric to string cast using lexical_core

ARROW-11101 - [Rust] rewrite pre-commit hook

ARROW-11104 - [GLib] Add append_null/append_nulls to GArrowArrayBuilder and use them

ARROW-11105 - [Rust] Migrated MutableBuffer::freeze to From<MutableBuffer> for Buffer

ARROW-11109 - [GLib] Add garrow_array_builder_append_empty_value() and values()

ARROW-11110 - [Rust][Datafusion] ExecutionContext.table should take immutable reference

ARROW-11111 - [GLib] Add GArrowFixedSizeBinaryArrayBuilder

ARROW-11121 - [Developer] Use pull_request_target for PR JIRA integration

ARROW-11122 - [Rust] Added FFI support for date and time.

ARROW-11124 - [Doc] Update status matrix for Decimal256

ARROW-11125 - [Rust] Logical equality for list arrays

ARROW-11126 - [Rust] Document and test ARROW-10656

ARROW-11127 - [C++] ifdef unused cpu_info on non-x86 platforms

ARROW-11129 - [Rust][DataFusion] Use tokio for loading parquet

ARROW-11130 - [Website][CentOS 8][RHEL 8] Enable all required repositories by default

ARROW-11131 - [Rust] Improve performance of boolean_equal

ARROW-11136 - [R] Bindings for is.nan

ARROW-11137 - [Rust][DataFusion] Clippy needless_range_loop,needless_lifetimes

ARROW-11138 - [Rust][DataFusion] Add ltrim, rtrim to built-in functions

ARROW-11139 - [GLib] Add support for extension type

ARROW-11155 - [C++][Packaging] Move gandiva crossbow jobs off of Travis-CI

ARROW-11158 - [Julia] Implement Decimal256 support for Julia

ARROW-11159 - [Developer] Consolidate pull request related jobs

ARROW-11165 - [Rust][DataFusion] Document Postgres as standard SQL dialect

ARROW-11168 - [Rust][Doc] Fix cargo doc warnings

ARROW-11169 - [Rust] Add a comment explaining where float total_order algorithm came from

ARROW-11175 - [R] Small docs fixes

ARROW-11176 - [R] Expose memory pool name and document setting it

ARROW-11187 - [Rust][Parquet] Fix Build error by Pin specific parquet-format-rs version

ARROW-11188 - [Rust] Support crypto functions from PostgreSQL dialect

ARROW-11193 - [Java][Documentation] Add Java ListVector Documentation

ARROW-11194 - [Rust] Enable packed_simd for aarch64

ARROW-11195 - [Rust] [DataFusion] Built-in table providers should expose relevant fields

ARROW-11196 - [GLib] Add support for mock, HDFS and S3 file systems with factory function

ARROW-11198 - [Packaging][Python] Ensure setuptools version during build supports markdown

ARROW-11200 - [Rust][DataFusion] Physical operators and expressions should have public accessor methods

ARROW-11201 - [Rust][DataFusion] create_batch_empty - support more types

ARROW-11203 - [Developer][Website] Enable JIRA and pull request integration

ARROW-11204 - [C++] Fix build failures with bundled gRPC and Protobuf

ARROW-11205 - [GLib][Dataset] Add GADFileFormat and its family

ARROW-11209 - [Rust] DF - Better error message on unsupported GROUP BY

ARROW-11210 - [CI] Restore workflows that had been blocked by INFRA

ARROW-11212 - [Packaging][Python] Use vcpkg as dependency source for manylinux and windows wheels

ARROW-11213 - [Packaging][Python] Dockerize wheel building on windows

ARROW-11215 - [CI] Use named volumes by default for caching in docker-compose

ARROW-11218 - [R] Make SubTreeFileSystem print method more informative

ARROW-11219 - [CI][Ruby][MinGW] Reduce CI time

ARROW-11221 - [Rust] DF Implement GROUP BY support for Float32/Float64

ARROW-11231 - [Packaging][deb][RPM] Add support for mimalloc

ARROW-11234 - [CI][Ruby][macOS] Reduce CI time

ARROW-11236 - Bump Jackson to 2.11.4

ARROW-11240 - [Packaging][R] Add mimalloc to R packaging

ARROW-11242 - [CI] Remove CMake 3.2 job

ARROW-11245 - [C++][Gandiva] Add support for LLVM 11.1

ARROW-11247 - [C++] Infer date32 columns in CSV

ARROW-11256 - [Packaging][Linux] Don't buffer packaging output

ARROW-11272 - [Release][wheel] Remove unsupported Python 3.5 and manylinux1

ARROW-11273 - [Release][deb] Remove unsupported Debian GNU/Linux stretch

ARROW-11278 - [Release][NodeJS] Don't touch ~/.bash_profile

ARROW-11280 - [Release][APT] Fix minimal build example check

ARROW-11281 - [C++] Remove needless runtime RapidJSON dependency

ARROW-11282 - [Packaging][deb] Add missing libgflags-dev dependency

ARROW-11285 - [Release][APT] Add support for Ubuntu Groovy

ARROW-11292 - [Release][JS] Use Node.JS LTS

ARROW-11293 - [C++] Don't require Boost and gflags with find_package(Arrow)

ARROW-11307 - [Release][Ubuntu][20.10] Add workaround for dependency issue

ARROW-11454 - [Website] [Rust] 3.0.0 Blog Post

PARQUET-1566 - [C++] Indicate if null count, distinct count are present in column statistics

Bug Fixes

ARROW-2616 - [Python] Cross-compiling Pyarrow

ARROW-6582 - [R] Arrow to R fails with embedded nuls in strings

ARROW-7363 - [Python] add combine_chunks method to ChunkedArray

ARROW-7909 - [Website] Add how to install on Red Hat Enterprise Linux

ARROW-8258 - [Rust] [Parquet] ArrowReader fails on some timestamp types

ARROW-9027 - [Python][Testing] Split parquet tests into multiple files + clean-up

ARROW-9479 - [JS] Fix Table.from for zero-item serialized tables, Table.empty for schemas containing compound types (List, FixedSizeList, Map)

ARROW-9636 - [Python] Update documentation about 'LZO' compression in parquet.write_table

ARROW-9690 - [Go] tests failing on s390x

ARROW-9776 - [R] read_feather causes segfault in R if file doesn't exist

ARROW-9897 - [C++][Gandiva] Added to_date function

ARROW-9897 - [C++][Gandiva] Revert - to_date function

ARROW-9898 - [C++][Gandiva] Fix linking issue with castINT/FLOAT functions

ARROW-9903 - [R] open_dataset freezes opening feather files on Windows

ARROW-9963 - [Python] Recognize datetime.timezone.utc as UTC on conversion python->pyarrow

ARROW-10039 - [Rust] Do not require memory alignment of buffers

ARROW-10042 - [Rust] Fix tests involving ArrayData/Buffer equality

ARROW-10080 - [R] Call gc() and try again in MemoryPool

ARROW-10122 - [Python] Fix to_pandas conversion with subset of columns and MultiIndex

ARROW-10145 - [C++][Dataset] Assert integer overflow in partitioning falls back to string

ARROW-10146 - [Python] Fix parquet FileMetadata.to_dict in case statistics is not set

ARROW-10174 - [Java] Fix reading/writing dict structs

ARROW-10177 - [CI][Gandiva] Nightly gandiva-jar-xenial fails

ARROW-10186 - [Rust] Tests fail when following instructions in README

ARROW-10247 - [C++][Dataset] Support writing datasets partitioned on dictionary columns

ARROW-10264 - [Python] Fix failing hdfs test

ARROW-10270 - [R] Fix CSV timestamp_parsers test on R-devel

ARROW-10283 - [Python] Define PY_SSIZE_T_CLEAN to deal with Python deprecation warning

ARROW-10293 - [Rust][DataFusion] Fixed benchmarks

ARROW-10294 - [Java] Resolve problems of DecimalVector APIs on ArrowBufs

ARROW-10298 - [Rust] Incorrect offset handling in iterator over dictionary keys

ARROW-10321 - [C++] Use check_cxx_source_compiles for AVX512 detect in

2.0.019 Oct 2020Deprecated

ARROW-10285 - [Python] Fix usage of deprecated num_children in pyarrow.orc submodule

Bug Fixes

ARROW-2367 - [Python] ListArray has trouble with sizes greater than kMaximumCapacity
ARROW-4189 - [Rust] Added coverage report.
ARROW-4917 - [C++] orc_ep fails in cpp-alpine docker
ARROW-5578 - [C++][Flight] Flight does not build out of the box on Alpine Linux
ARROW-7226 - [Python][Doc] Add note re: JSON format support
ARROW-7384 - [Website] Fix search indexing warning reported by Google
ARROW-7517 - [C++] Builder does not honour dictionary type provided during initialization
ARROW-7663 - [Python] Raise better error message when passing mixed-type (int/string) Pandas dataframe to pyarrow Table
ARROW-7903 - [Rust][DataFusion] Migrated to sqlparser 0.6.1
ARROW-7957 - [Python] Handle new FileSystem in ParquetDataset by automatically using new implementation
ARROW-8265 - [Rust] [DataFusion] Table API collect() should not require context
ARROW-8394 - [JS] Upgrade to TypeScript 4.0.2, fix typings for TS 3.9+
ARROW-8735 - [Rust][Parquet] Allow arm 32 to use soft hash implementation
ARROW-8749 - [C++] IpcFormatWriter writes dictionary batches with wrong ID
ARROW-8773 - [Python] Preserve nullability of fields in schema.empty_table()
ARROW-9028 - [R] Should be able to convert an empty table
ARROW-9096 - [Python] Pandas roundtrip with dtype="object" underlying numeric column index
ARROW-9177 - [C++][Parquet] Tracking issue for cross-implementation LZ4 Parquet compression compatibility
ARROW-9414 - [Packaging][deb][RPM] Enable S3
ARROW-9462 - [Go] The Indentation after the first Record in arrjson writer is incorrect
ARROW-9463 - [Go] Make arrjson Writer close idempotent
ARROW-9490 - [Python][C++] Bug in pa.array when input mixes int8 with float
ARROW-9495 - [C++] Equality assertions don't handle Inf / -Inf properly
ARROW-9520 - [Rust][DataFusion] Add support for aliased aggregate exprs
ARROW-9528 - [Python] Honor tzinfo when converting from datetime
ARROW-9532 - [Python][Doc] Use Python3_EXECUTABLE instead of PYTHON_EXECUTABLE for finding Python executable
ARROW-9535 - [Python] Remove symlink fixes from conda recipe
ARROW-9536 - [Java] Miss parameters in PlasmaOutOfMemoryException.java
ARROW-9541 - [C++] CMakeLists requires UTF8PROC_STATIC when building static library
ARROW-9544 - [R] Fix version argument of write_parquet()
ARROW-9546 - [Python] Clean up Pandas Metadata Conversion test
ARROW-9548 - [Go] Test output files are not removed correctly
ARROW-9549 - [Rust] Fixed version in dependency in parquet.
ARROW-9554 - [Java] FixedWidthInPlaceVectorSorter sometimes produces wrong result
ARROW-9556 - [Python][C++] Segfaults in UnionArray with null values
ARROW-9560 - [Packaging] Add required conda-forge.yml
ARROW-9569 - [CI][R] Fix rtools35 builds for msys2 key change
ARROW-9570 - [Doc] Clean up sphinx sidebar
ARROW-9573 - [Python][Dataset] Provide read_table(ignore_prefixes=)
ARROW-9574 - [R] Cleanups for CRAN 1.0.0 release
ARROW-9575 - [R] gcc-UBSAN failure on CRAN
ARROW-9577 - [C++] Ignore EBADF error in posix_madvise()
ARROW-9583 - [Rust] Fix offsets in result of arithmetic kernels
ARROW-9588 - [C++] Partially support building with clang in an MSVC setting
ARROW-9589 - [C++/R] Forward declare structs as structs
ARROW-9592 - [CI] Update homebrew before calling brew bundle
ARROW-9596 - [CI][Crossbow] Fix homebrew-cpp again, again
ARROW-9597 - [C++] AddAlias in compute::FunctionRegistry should be synchronized
ARROW-9598 - [C++][Parquet] Fix writing nullable structs
ARROW-9599 - [CI] Appveyor toolchain build fails because CMake detects different C and C++ compilers
ARROW-9600 - [Rust] pin proc macro
ARROW-9600 - [Rust][Arrow] pin older version of proc-macro2 during build
ARROW-9602 - [R] Improve cmake detection in Linux build
ARROW-9603 - [C++] Fix parquet write to not assume leaf-array validity bitmaps have the same values as parent structs
ARROW-9606 - [C++][Dataset] Support "a"_.In(<>).Assume(<compound>)
ARROW-9609 - [C++][Dataset] CsvFileFormat reads all virtual columns as null
ARROW-9621 - [Python] Skip test_move_file for in-memory fsspec filesystem
ARROW-9622 - [Java] Fixed UnsupportedOperationException in complexcopier with null value in unionvector inside st…
ARROW-9628 - [Rust] Disable artifact caching for Mac OSX builds
ARROW-9629 - [Python] Fix kartothek integration tests by fixing dependencies
ARROW-9631 - [Rust] Make arrow not depend on flight
ARROW-9631 - [Rust] flight should depend on arrow, not the other way around
ARROW-9642 - [C++] Let MakeBuilder refer DictionaryType's index_type for deciding the starting bit width of the indices
ARROW-9643 - [C++] Only register the SIMD variants when it's supported.
ARROW-9644 - [C++][Dataset] Don't apply ignore_prefixes to partition base_dir
ARROW-9652 - [Rust][DataFusion] Error message rather than panic for external csv tables with no column defs
ARROW-9653 - [Rust][DataFusion] Do not error in planner with SQL has multiple group by expressions
ARROW-9659 - [C++] Fix RecordBatchStreamReader when source is CudaBufferReader
ARROW-9660 - [C++] Revamp dictionary association in IPC
ARROW-9666 - [Python][wheel][Windows] Fix wheel build for Windows
ARROW-9670 - [C++][FlightRPC] don't hang if Close and Read called simultaneously
ARROW-9676 - [R] Error converting Table with nested structs
ARROW-9684 - [C++] Fix undefined behaviour on invalid IPC / Parquet input
ARROW-9692 - [Python] Fix distutils-related warning
ARROW-9693 - [CI][Docs] Nightly docs build fails
ARROW-9696 - [Rust][DataFusion] fix nested binary expressions
ARROW-9698 - [C++] Remove -DNDEBUG flag leak in .pc file
ARROW-9700 - [Python] fix create_library_symlinks for macos
ARROW-9712 - [Rust][DataFusion] Fix parquet error handling and general code improvements
ARROW-9714 - [Rust][DataFusion] Implement type coercion rule for limit and sort
ARROW-9716 - [Rust][DataFusion] Implement limit on concurrent threads in MergeExec
ARROW-9726 - [Rust][DataFusion] Do not create parquet reader thread until execute is called
ARROW-9727 - [C++] Fix crashes on invalid IPC input (OSS-Fuzz)
ARROW-9729 - [Java] Disable Error Prone when project is imported into …
ARROW-9733 - [Rust][DataFusion] Added support for COUNT/MIN/MAX on string columns
ARROW-9734 - [Rust][DataFusion] TableProvider.scan now returns partitions instead of iterators
ARROW-9741 - [Rust] [DataFusion] Incorrect count in TPC-H query 1 result set
ARROW-9743 - [R] Sanitize paths in open_dataset
ARROW-9744 - [Python] Fix build failure on aarch64
ARROW-9764 - [CI][Java] Fix wrong image name for push
ARROW-9768 - [Python] Check overflow in conversion of datetime objects to nanosecond timestamps
ARROW-9768 - [Rust][DataFusion] Rename PhysicalPlannerImpl to DefaultPhysicalPlanner
ARROW-9778 - [Rust][DataFusion] Implement Expr.nullable() and make consistent between logical and physical plans
ARROW-9783 - [Rust][DataFusion] Remove aggregate expression data type
ARROW-9785 - [Python] Fix excessively slow S3 options test
ARROW-9789 - [C++] Don't install jemalloc in parallel
ARROW-9790 - [Rust][Parquet] : Increase test coverage in arrow_reader.rs
ARROW-9790 - [Rust][Parquet] Fix PrimitiveArrayReader boundary conditions
ARROW-9793 - [Rust][DataFusion] Fixed unit tests
ARROW-9797 - [Rust] AMD64 Conda Integration Tests is failing for the Master branch
ARROW-9799 - [Rust] [DataFusion] Implementation of physical binary expression get_type method is incorrect
ARROW-9800 - [Rust][Parquet] Remove println! when writing column statistics
ARROW-9801 - DictionaryArray with non-unique values are silently corrupted when written to a Parquet file
ARROW-9809 - [Rust][DataFusion] Fixed type coercion, supertypes and type checking.
ARROW-9814 - [Python] Fix crash in test_parquet::test_read_partitioned_directory_s3fs
ARROW-9815 - [Rust][DataFusion] Remove the use of Arc/Mutex to protect plan time structures
ARROW-9815 - [Rust][DataFusion] Add a trait for looking up scalar functions by name
ARROW-9815 - [Rust][DataFusion] Fixed deadlock caused by accessing the scalar functions' registry.
ARROW-9816 - [C++] Escape quotes in config.h
ARROW-9827 - [C++][Dataset] Skip parsing RowGroup metadata statistics when there is no filter
ARROW-9831 - [Rust][DataFusion] Fixed compilation error
ARROW-9840 - [Python] fs documentation out of date with code (FileStats -> FileInfo)
ARROW-9846 - [Rust] Master branch broken build
ARROW-9851 - [C++] Disable AVX512 runtime paths with Valgrind
ARROW-9852 - [C++] Add more IPC fuzz regression files
ARROW-9852 - [C++] Validate dictionaries fully when combining deltas
ARROW-9855 - [R] Fix bad merge/Rcpp conflict
ARROW-9859 - [C++] Decode username and password in URIs
ARROW-9864 - [Python] Support pathlib.path in pq.write_to_dataset
ARROW-9874 - [C++] Add sink-owning version of IPC writers
ARROW-9876 - [C++] Faster ARM build on Travis-CI
ARROW-9877 - [C++] Fix homebrew-cpp build fail on AVX512
ARROW-9879 - [Python] Add support for numpy scalars to ChunkedArray.getitem
ARROW-9882 - [C++/Python] Update OSX build to conda-forge-ci-setup=3
ARROW-9883 - [R] Fix linuxlibs.R install script for R < 3.6
ARROW-9888 - [Rust][DataFusion] Allow ExecutionContext to be shared between threads (again)
ARROW-9889 - [Rust][DataFusion] Implement physical plan for EmptyRelation
ARROW-9906 - [C++] Keep S3 filesystem alive through open file objects
ARROW-9913 - [C++] Make outputs of Decimal128::FromString independent of the presence of one another.
ARROW-9920 - [Python] Validate input to pa.concat_arrays() to avoid segfault
ARROW-9922 - [Rust] Add StructArray::TryFrom (+40%)
ARROW-9924 - [C++][Dataset] Enable per-column parallelism for single ParquetFileFragment scans
ARROW-9931 - [C++] Fix undefined behaviour on invalid IPC input
ARROW-9932 - [R] Arrow 1.0.1 R package fails to install on R3.4 over linux
ARROW-9936 - [Python] Fix / test relative file paths in pyarrow.parquet
ARROW-9937 - [Rust][DataFusion] Improved aggregations
ARROW-9943 - [C++] Recursively apply Arrow metadata when reading from Parquet
ARROW-9946 - [R] Check sink argument class in ParquetFileWriter
ARROW-9953 - [R] Declare minimum version for bit64
ARROW-9962 - [Python] Fix conversion to_pandas with tz-aware index column and fixed offset timezones
ARROW-9968 - [C++] Fix UBSAN build
ARROW-9969 - [C++] Fix RecordBatchBuilder with dictionary types
ARROW-9970 - [Go] fix checkptr failure in sum methods
ARROW-9972 - [CI] Work around grpc-re2 clash on Homebrew
ARROW-9973 - [Java] JDBC DateConsumer does not allow dates before epoch
ARROW-9976 - [Python] ArrowCapacityError when doing Table.from_pandas with large dataframe
ARROW-9990 - [Rust][DataFusion] Fixed the NOT operator
ARROW-9993 - [Python] Tzinfo - string roundtrip fails on pytz.StaticTzInfo objects
ARROW-9994 - [C++][Python] Auto chunking nested array containing binary-like fields result malformed output
ARROW-9996 - [C++] Dictionary is unset when calling DictionaryArray.GetScalar for null values
ARROW-10003 - [C++] Create parent dir for any destination fs in CopyFiles
ARROW-10008 - [C++][Dataset] Fix filtering/row group statistics of dict columns
ARROW-10011 - [C++] Make FindRE2.cmake re-entrant
ARROW-10012 - [C++] Make MockFileSystem thread-safe
ARROW-10013 - [FlightRPC][C++] fix setting generic client options
ARROW-10017 - [Java] Fix LargeMemoryUtil long conversion
ARROW-10022 - [C++] Fix divide by zero and overflow error for scalar arithmetic benchmark
ARROW-10027 - [C++] Fix Take array kernel for NullType
ARROW-10034 - [Rust] Fix Rust build on master
ARROW-10041 - [Rust] Added check of data type to GenericString::from.
ARROW-10047 - [CI] Conda integration tests failing with cmake error
ARROW-10048 - [Rust] Fixed error in computing min/max with null entries.
ARROW-10049 - [C++/Python] Sync conda recipe with conda-forge
ARROW-10060 - [Rust][DataFusion] Fixed error on which Err were discarded in MergeExec.
ARROW-10062 - [Rust] Fix for null elems at key position in dictionary arrays
ARROW-10073 - [Python] Don't rely on dict item order in test_parquet_nested_storage
ARROW-10081 - [C++/Python] Fix bash syntax in drone.io conda builds
ARROW-10085 - [C++] Fix S3 region resolution on Windows
ARROW-10087 - [CI] Fix nightly docs job
ARROW-10098 - [R][Doc] Fix copy_files doc mismatch
ARROW-10104 - [Python] Separate tests into its own conda package
ARROW-10114 - [R] Segfault in to_dataframe_parallel with deeply nested structs
ARROW-10116 - [Python][Packaging] Fix gRPC linking error in macOS wheels builds
ARROW-10119 - [C++] Fix Parquet crashes on invalid input
ARROW-10121 - [C++] Fix emission of new dictionaries in IPC writer
ARROW-10124 - [C++] Don't restrict permissions when creating files
ARROW-10125 - [R] Int64 downcast check doesn't consider all chunks
ARROW-10130 - [C++][Dataset] Ensure ParquetFileFragment::SplitByRowGroup preserves the 'has_complete_metadata' status
ARROW-10136 - [Rust] : Fix null handling in StringArray and BinaryArray filtering, add BinaryArray::from_opt_vec
ARROW-10137 - [C++][R] Move nameof.h into R subproject
ARROW-10147 - [Python] Pandas metadata fails if index name not JSON-serializable
ARROW-10150 - [C++] Fix crashes on invalid Parquet file
ARROW-10169 - [Rust] Pretty print null PrimitiveTypes as empty strings
ARROW-10175 - [CI] Fix nightly HDFS integration tests (ensure to use legacy dataset)
ARROW-10176 - [C++] Avoid using unformattable types for test parameters
ARROW-10178 - [CI] Remove patch to fix Spark master build
ARROW-10179 - [Rust] Fixed error in labeler
ARROW-10181 - [Rust] Skip compiling one test on 32 bit ARM architecture
ARROW-10188 - [Rust][DataFusion] Fixed DataFusion examples.
ARROW-10189 - [Doc] Fixed typo in C-Data interface example
ARROW-10192 - [Python] Always decode inner dictionaries when converting array to Pandas
ARROW-10193 - [Python] Segfault when converting to fixed size binary array
ARROW-10200 - [CI][Java] Fix a job failure for s390x Java on TravisCI
ARROW-10204 - [Rust] Filter kernel should only count bits in valid range
ARROW-10214 - [Python] Allow printing undecodable schema metadata
ARROW-10226 - [Rust] [Parquet] Parquet reader reading wrong columns in some batches within a parquet file
ARROW-10230 - [JS][Doc] JavaScript documentation fails to build
ARROW-10232 - FixedSizeListArray is incorrectly written/read to/from parquet
ARROW-10234 - [C++][Gandiva] Fix logic of round() for floats/decimals in Gandiva
ARROW-10237 - [C++] Duplicate dict values cause corrupt parquet
ARROW-10238 - [C#] List<Struct> is broken
ARROW-10239 - [C++] Add missing zlib dependency to aws-sdk-cpp
ARROW-10244 - [Python] Document pyarrow.dataset.parquet_dataset
ARROW-10248 - [Python][Dataset] Always apply Python's default write properties
ARROW-10262 - [C++] Fix TypeClass for BinaryScalar and LargeBinaryScalar
ARROW-10271 - [Rust] Update dependencies
ARROW-10279 - [Release][Python] Fix verification script to align with the new macos wheel platform tags
ARROW-10280 - [Packaging][Python] Fix macOS wheel artifact patterns
ARROW-10281 - [Python] Fix warnings when running tests
ARROW-10284 - [Python] Correctly suppress warning about legacy filesystem on import
ARROW-10285 - [Python] Fix usage of deprecated num_children in pyarrow.orc submodule
ARROW-10286 - [C++][FlightRPC] Make CMake output less confusing
ARROW-10288 - [C++] Fix compilation errors on 32-bit x86
ARROW-10290 - [C++] List POP_BACK is not available in older CMake versions
ARROW-10296 - [R] Data saved as integer64 loaded as integer
ARROW-10517 - [Python] Unable to read/write Parquet datasets with fsspec on Azure Blob
ARROW-11062 - [Java] When writing to flight stream, Spark's mapPartitions is not working

New Features and Improvements

ARROW-983 - [C++] Implement InputStream and OutputStream classes for interacting with socket connections
ARROW-1509 - [Python] Write serialized object as a stream of encapsulated IPC messages
ARROW-1644 - [C++][Parquet] Read and write nested Parquet data with a mix of struct and list nesting levels
ARROW-1669 - [C++] Consider adding Abseil (Google C++11 standard library extensions) to toolchain
ARROW-1797 - [C++] Implement binary arithmetic kernels for numeric arrays
ARROW-2164 - [C++] Clean up unnecessary decimal module refs
ARROW-3080 - [Python] Unify Arrow to Python object conversion paths
ARROW-3757 - [R] R bindings for Flight RPC client
ARROW-3850 - [Python] Support MapType and StructType for enhanced PySpark integration
ARROW-3872 - [R] Add ad hoc test of feather compatibility
ARROW-4046 - [Python/CI] Exercise large memory tests
ARROW-4248 - [C++][Plasma] Build on Windows / Visual Studio
ARROW-4685 - [C++] Update Boost to 1.69 in manylinux1 docker image
ARROW-4927 - [Rust] Update top level README to describe current functionality
ARROW-4957 - [Rust] [DataFusion] Implement get_supertype correctly
ARROW-4965 - [Python] Timestamp array type detection should use tzname of datetime.datetime objects
ARROW-5034 - [C#] ArrowStreamWriter and ArrowFileWriter implement sync WriteRecordBatch
ARROW-5123 - [Rust] Parquet derive for simple structs
ARROW-6075 - [FlightRPC] Handle uncaught exceptions in middleware
ARROW-6281 - [Python] Produce chunked arrays for nested types in pyarrow.array
ARROW-6282 - [Format] Support lossy compression
ARROW-6437 - [R] Add AWS SDK to system dependencies for macOS and Windows
ARROW-6535 - [C++] Status::WithMessage should accept variadic parameters
ARROW-6537 - [R] : Pass column_types to CSV reader
ARROW-6972 - [C#] Support for StructArrays
ARROW-6982 - [R] Add bindings for compare and boolean kernels
ARROW-7136 - [Rust] Added caching to the docker image
ARROW-7218 - [Python] Conversion from boolean numpy scalars not working
ARROW-7302 - [C++] CSV: allow dictionary types in explicit column types
ARROW-7372 - [C++] Allow creating dictionary array from simple JSON
ARROW-7871 - [Python] Expose more compute kernels
ARROW-7960 - [C++] Add support fo reading additional types
ARROW-8001 - [R][Dataset] Bindings for dataset writing
ARROW-8002 - [C++][Dataset][R] Support partitioned dataset writing
ARROW-8048 - [Python] Run memory leak tests nightly as follow up to ARROW-4120
ARROW-8172 - [C++] ArrayFromJSON for dictionary arrays
ARROW-8205 - [Rust][DataFusion] Added check to uniqueness of column names.
ARROW-8253 - [Rust] [DataFusion] Improve ergonomics of registering UDFs
ARROW-8262 - [Rust] [DataFusion] Add example that uses LogicalPlanBuilder
ARROW-8296 - [C++][Dataset] Add IpcFileWriteOptions
ARROW-8355 - [Python] Remove hard pandas dependency from FeatherDataset and minimize pandas dependency in test_feather.py
ARROW-8359 - [C++/Python] Enable linux-aarch64 builds
ARROW-8383 - [Rust] Allow easier access to keys array of a dictionary array
ARROW-8402 - [Java] Support ValidateFull methods in Java
ARROW-8493 - [C++][Parquet] Start populating repeated ancestor defintion
ARROW-8494 - [C++][Parquet] Full support for reading mixed list and structs
ARROW-8581 - [C#] Accept and return DateTime from DateXXArray
ARROW-8601 - [Go][FOLLOWUP] Fix RAT violations related to Flight in Go
ARROW-8601 - [Go][Flight] Implementations Flight RPC server and client
ARROW-8618 - [C++] Clean up some redundant std::move()s
ARROW-8678 - [C++/Python][Parquet] Remove old writer code path
ARROW-8712 - [R] Expose strptime timestamp parsing in read_csv conversion options
ARROW-8774 - [Rust] [DataFusion] Improve threading model
ARROW-8810 - [R] Add documentation about Parquet format, appending to stream format
ARROW-8824 - [Rust] [DataFusion] Implement new SQL parser
ARROW-8828 - [Rust] Implement SQL tokenizer
ARROW-8829 - [Rust] Implement SQL parser
ARROW-9010 - [Java] Framework and interface changes for RecordBatch IPC buffer compression
ARROW-9065 - [C++] Support parsing date32 in dataset partition folders
ARROW-9068 - [C++][Dataset] Simplify partitioning interface
ARROW-9078 - [C++] Parquet read / write extension type with nested storage type
ARROW-9104 - [C++] Parquet encryption tests should write files to a temporary directory instead of the testing submodule's directory
ARROW-9107 - [C++][Dataset] Support temporal partitioning fields
ARROW-9147 - [C++][Dataset] Support projection from null->any type
ARROW-9205 - [Documentation] Fix typos
ARROW-9266 - [Python][Packaging] Enable S3 support in macOS wheels
ARROW-9271 - [R] Preserve data frame metadata in round trip
ARROW-9286 - [C++] Add function "aliases" to compute::FunctionRegistry
ARROW-9328 - [C++][Gandiva] Add LTRIM, RTRIM, BTRIM functions for string
ARROW-9338 - [Rust] Add clippy instructions
ARROW-9344 - [C++][Flight] Measure latency quantiles
ARROW-9358 - [Integration] remove generated_large_batch.json
ARROW-9371 - [Java] Run vector tests for both allocators
ARROW-9377 - [Java] Support unsigned dictionary indices
ARROW-9387 - [R] Use new C++ table select method
ARROW-9388 - [C++] Division kernels
ARROW-9394 - [Python] Support pickling of Scalars
ARROW-9398 - [C++] Register SIMD sum variants to function instance.
ARROW-9402 - [C++] Rework portable wrappers for checked integer arithmetic
ARROW-9405 - [R] Switch to cpp11
ARROW-9412 - [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow
ARROW-9429 - [Python] ChunkedArray.to_numpy
ARROW-9454 - [GLib] Add binding of some dictionary builders
ARROW-9465 - [Python] Improve ergonomics of compute module
ARROW-9469 - [Python] Make more objects weakrefable
ARROW-9487 - [Developer] Cover the archery release utilities with unittests
ARROW-9488 - [Release] Use the new changelog generation when updating the website
ARROW-9507 - [Rust][DataFusion] Implement Display for PhysicalExpr
ARROW-9508 - [Release][APT][Yum] Enable verification for arm64 binaries
ARROW-9516 - [Rust][DataFusion] refactor of column names
ARROW-9517 - [C++/Python] Add support for temporary credentials to S3Options
ARROW-9518 - [Python] Deprecate pyarrow serialization
ARROW-9521 - [Rust][DataFusion] Handle custom CSV file extensions
ARROW-9523 - [Rust] Improve filter kernel performance
ARROW-9534 - [Rust][DataFusion] Added support for lit to all supported rust types.
ARROW-9550 - [Rust] [DataFusion] Remove Rc<RefCell<_>> from hash aggregate operator
ARROW-9553 - [Rust] Release script doesn't bump parquet crate's arrow dependency version
ARROW-9557 - [R] Iterating over parquet columns is slow in R
ARROW-9559 - [Rust][DataFusion] Made function public
ARROW-9563 - [Dev][Release] Use archery's changelog generator when creating release notes for the website
ARROW-9568 - [CI][C++] Use msys2/setup-msys2
ARROW-9576 - [Python][Doc] Fix error in example code for extension types
ARROW-9580 - [JS][Doc] Fix syntax error in example code
ARROW-9581 - [Dev][Release] Bump next snapshot versions to 2.0.0
ARROW-9582 - [Rust] Implement memory size methods
ARROW-9585 - [Rust][DataFusion] Remove duplicated to-do line
ARROW-9587 - [FlightRPC][Java] clean up FlightStream/DoPut
ARROW-9593 - [Python] Add custom pickle reducers for DictionaryScalar
ARROW-9604 - [C++] Add aggregate min/max benchmark
ARROW-9605 - [C++] Speed up aggregate min/max compute kernels on integer types
ARROW-9607 - [C++][Gandiva] Add bitwise_and(), bitwise_or() and bitwise_not() functions for integers
ARROW-9608 - [Rust] Remove arrow flight from parquet's feature gating
ARROW-9615 - [Rust] Added kernel to compute length of a string.
ARROW-9617 - [Rust][DataFusion] Add length of string array
ARROW-9618 - [Rust][DataFusion] Made it easier to write optimizers
ARROW-9619 - [Rust][DataFusion] Add predicate push-down
ARROW-9632 - [Rust] add a func "new" for ExecutionContextSchemaProvider
ARROW-9638 - [C++][Compute] Implement mode kernel
ARROW-9639 - [Ruby] Add dependency version check
ARROW-9640 - [C++][Gandiva] Implement round() for integers and long integers
ARROW-9641 - [C++][Gandiva] Implement round() for floating point and double floating point numbers
ARROW-9645 - [Python] Deprecate pyarrow.filesystem in favor of pyarrow.fs
ARROW-9646 - [C++][Dataset] Support writing with ParquetFileFormat
ARROW-9650 - [Packaging][APT] Drop support for Ubuntu 19.10
ARROW-9654 - [Rust][DataFusion] Add EXPLAIN <SQL> statement
ARROW-9656 - [Rust][DataFusion] Better error messages for unsupported EXTERNAL TABLE types
ARROW-9658 - [Python] Python bindings for dataset writing
ARROW-9665 - [R] head/tail/take for Datasets
ARROW-9667 - [CI][Crossbow] Segfault in 2 nightly R builds
ARROW-9671 - [C++] Fix a bug in BasicDecimal128 constructor that interprets uint64_t integers with highest bit set as negative.
ARROW-9673 - [Rust][DataFusion] Add a param "dialect" for DFParser::parse_sql
ARROW-9678 - [Rust][DataFusion] Improve projection push down to remove unused columns
ARROW-9679 - [Rust][DataFusion] More efficient creation of final batch from HashAggregateExec
ARROW-9681 - [Java] Fix test failures of Arrow Memory - Core on big-endian platform
ARROW-9683 - [Rust][DataFusion] Add debug printing to physical plans and associated types
ARROW-9691 - [Rust][DataFusion] Make sql_statement_to_plan method public
ARROW-9695 - [Rust] Improve comments on LogicalPlan enum variants
ARROW-9699 - [C++][Compute] Optimize mode kernel for small integer types
ARROW-9701 - [CI][Java] Add a job for s390x Java on TravisCI
ARROW-9702 - [C++] Register bpacking SIMD to runtime path.
ARROW-9703 - [Developer][Archery] Restartable cherry-picking process for creating maintenance branches
ARROW-9706 - [Java] Tests of TestLargeListVector correctly read offset
ARROW-9710 - [C++] Improve performance of Decimal128::ToString by 10x, and make the implementation reusable for Decimal256.
ARROW-9711 - [Rust] Add new benchmark derived from TPC-H
ARROW-9713 - [Rust][DataFusion] Remove explicit panics
ARROW-9715 - [R] changelog/doc updates for 1.0.1
ARROW-9718 - [Python] ParquetWriter to work with new FileSystem API
ARROW-9721 - [Packaging][Python] Update wheel dependency files
ARROW-9722 - [Rust] Shorten key lifetime for dict lookup key
ARROW-9723 - [C++][Compute] Count NaN in mode kernel
ARROW-9725 - [Rust][DataFusion] SortExec and LimitExec re-use MergeExec
ARROW-9737 - [C++][Gandiva] Add bitwise_xor() for integers
ARROW-9739 - [CI][Ruby] Don't install gem documents
ARROW-9742 - [Rust][DataFusion] Improved DataFrame trait (formerly known as the Table trait)
ARROW-9751 - [Rust][DataFusion] Allow UDFs to accept multiple data types per argument
ARROW-9752 - [Rust][DataFusion] Add support for User-Defined Aggregate Functions.
ARROW-9753 - [Rust][DataFusion] Replaced Arc<Mutex<>> by Box<>
ARROW-9754 - [Rust][DataFusion] Implement async in ExecutionPlan trait
ARROW-9757 - [Rust][DataFusion] Add prelude.rs
ARROW-9758 - [Rust][DataFusion] Allow physical planner to be replaced
ARROW-9759 - [Rust][DataFusion] Implement DataFrame.sort()
ARROW-9760 - [Rust][DataFusion] Added DataFrame::explain
ARROW-9761 - [C/C++] Add experimental C stream inferface
ARROW-9762 - [Rust][DataFusion] ExecutionContext::sql now returns DataFrame
ARROW-9769 - [Python] Un-skip tests with fsspec in-memory filesystems
ARROW-9775 - [C++] Automatic S3 region selection
ARROW-9781 - [C++] Fix valgrind uninitialized value warnings
ARROW-9782 - [C++][Dataset] More configurable Dataset writing
ARROW-9784 - [Rust][DataFusion] Make running TPCH benchmark repeatable
ARROW-9786 - [R] Unvendor cpp11 before release
ARROW-9788 - [Rust][DataFusion] Rename SelectionExec to FilterExec
ARROW-9792 - [Rust][DataFusion] Aggregate expression functions should not return result
ARROW-9794 - [C++] Add IsVendor API for CpuInfo
ARROW-9795 - [C++][Gandiva] Implement castTIMESTAMP(int64) in Gandiva
ARROW-9806 - [R] More compute kernel bindings
ARROW-9807 - [R] News update/version bump post-1.0.1
ARROW-9808 - [Python] Update read_table doc string
ARROW-9811 - [C++] Unchecked floating point division by 0 should succeed
ARROW-9813 - [C++] Disable semantic interposition
ARROW-9819 - [C++] Bump mimalloc to 1.6.4
ARROW-9821 - [Rust][DataFusion] Support for User Defined ExtensionNodes in the LogicalPlan
ARROW-9821 - [Rust][DataFusion] Make crate::logical_plan and crate::physical_plan modules
ARROW-9823 - [CI][C++][MinGW] Enable S3
ARROW-9832 - [Rust] [DataFusion] Refactor PhysicalPlan to remove Partition
ARROW-9833 - [Rust][DataFusion] TableProvider.scan now returns ExecutionPlan
ARROW-9834 - [Rust] [DataFusion] Remove Partition trait
ARROW-9835 - [Rust][DataFusion] Removed FunctionMeta and FunctionType
ARROW-9836 - [Rust][DataFusion] Improve API for usage of UDFs
ARROW-9837 - [Rust][DataFusion] Added provider for variable
ARROW-9838 - [Rust] [DataFusion] DefaultPhysicalPlanner should insert explicit MergeExec nodes
ARROW-9839 - [Rust][DataFusion] Implement ExecutionPlan.as_any
ARROW-9841 - [Rust] Update checked-in fbs files
ARROW-9844 - [CI] Add Go build job on s390x
ARROW-9845 - [Rust][Parquet] Move serde_json dependency to dev-dependencies as it is only used in tests
ARROW-9848 - [Rust] Implement 0.15 IPC alignment
ARROW-9849 - [Rust][DataFusion] Simplified argument types of ScalarFunctions.
ARROW-9850 - [Go] Defer should not be used inside a loop
ARROW-9853 - [RUST] Implement take kernel for dictionary arrays
ARROW-9854 - [R] Support reading/writing data to/from S3
ARROW-9858 - [Python][Docs] Add user guide for filesystems interface
ARROW-9863 - [C++][Parquet] Compile regexes only once
ARROW-9867 - [C++][Dataset] Add FileSystemDataset::filesystem property
ARROW-9868 - [C++][R] Provide CopyFiles for copying files between FileSystems
ARROW-9869 - [R] Implement full S3FileSystem/S3Options constructor
ARROW-9870 - [R] Friendly interface for filesystems (S3)
ARROW-9871 - [C++] Add uppercase to ARROW_USER_SIMD_LEVEL
ARROW-9873 - [C++][Compute] Optimize mode kernel for integers in small value range
ARROW-9875 - [Python] Let FileSystem.get_file_info accept a single path
ARROW-9884 - [R] Bindings for writing datasets to Parquet
ARROW-9885 - [Rust][DataFusion] Minor code simplification
ARROW-9886 - [Rust][DataFusion] Parameterized testing of physical cast.
ARROW-9887 - [Rust][DataFusion] Added support for complex return types for built-in functions
ARROW-9890 - [R] Add zstandard compression codec in macOS build
ARROW-9891 - [Rust][DataFusion] Made math functions accept f32.
ARROW-9892 - [Rust][DataFusion] Added concat of utf8
ARROW-9893 - [Python] Support parquet options in dataset writing
ARROW-9895 - [Rust] Improve sorting kernels
ARROW-9899 - [Rust][DataFusion] Switch from Box<Schema> --> SchemaRef (Arc<Schema>) to be consistent with the rest of Arrow
ARROW-9900 - [Rust][DataFusion] Switch from Box -> Arc in LogicalPlanNode
ARROW-9901 - [C++] Add hand-crafted Parquet to Arrow reconstruction tests
ARROW-9902 - [Rust][DataFusion] Add array() built-in function
ARROW-9904 - [C++] Unroll the loop of CountSetBits.
ARROW-9908 - [Rust] Add support for temporal types in JSON reader
ARROW-9910 - [Rust][DataFusion] Fixed error in type coercion of Variadic.
ARROW-9914 - [Rust][DataFusion] Document SQL Type --> Arrow type mapping
ARROW-9916 - [RUST] Avoid cloning array data
ARROW-9917 - [Python][Compute] Bindings for mode kernel
ARROW-9919 - [Rust][DataFusion] Speedup math operations by 15%+
ARROW-9921 - [Rust] Replace TryFrom by From in StringArray from Vec<Option<&str>> (+50%)
ARROW-9925 - [GLib] Add low level value readers for GArrowListArray family
ARROW-9926 - [GLib] Use placement new for GArrowRecordBatchFileReader
ARROW-9928 - [C++] Speed up integer parsing slightly
ARROW-9929 - [Dev] Autotune cmake-format
ARROW-9933 - [Developer] Add drone as a CI provider for crossbow
ARROW-9934 - [Rust] Shape and stride check in tensor
ARROW-9941 - [Python] Better string representation for extension types
ARROW-9944 - [Rust][DataFusion] Implement to_timestamp function
ARROW-9949 - [C++] Improve performance of Decimal128::FromString by 46%, and make the implementation reusable for Decimal256.
ARROW-9950 - [Rust][DataFusion] Made UDFs usable without a registry
ARROW-9952 - [Python] Optionally use pyarrow.dataset in parquet.write_to_dataset
ARROW-9954 - [Rust][DataFusion] Made aggregates support the same signatures as functions.
ARROW-9956 - [C++][Gandiva] Implementation of binary_string function in gandiva
ARROW-9957 - [Rust] Replace tempdir with tempfile
ARROW-9961 - [Rust][DataFusion] Make to_timestamp function parses timestamp without timezone offset as local
ARROW-9964 - [C++] Allow reading date types from CSV data
ARROW-9965 - [Java] Improve performance of BaseFixedWidthVector.setSafe by optimizing capacity calculations
ARROW-9966 - [Rust] Speedup kernels for sum,min,max by 10%-60%
ARROW-9967 - [Python] Add compute module docs + expose more option classes
ARROW-9971 - [Rust] Improve speed of take by 2x-3x (change scaling with batch size)
ARROW-9977 - [Rust][Large] StringArray
ARROW-9979 - [Rust] Fix arrow crate clippy lints
ARROW-9980 - [Rust][Parquet] Fix clippy lints
ARROW-9981 - [Rust][Flight] Expose IpcWriteOptions on utils
ARROW-9983 - [C++][Dataset][Python] Use larger default batch size than 32K for Datasets API
ARROW-9984 - [Rust][DataFusion] Minor cleanup DRY
ARROW-9986 - [Rust] allow to_timestamp to parse local times without fractional seconds
ARROW-9987 - [Rust][DataFusion] Improved docs for Expr
ARROW-9988 - [Rust][DataFusion] Added +-/* as operators to logical expressions.
ARROW-9992 - [C++][Python] Refactor python to arrow conversions based on a reusable conversion API
ARROW-9998 - [Python] Support pickling DictionaryScalar
ARROW-9999 - [Python] Support constructing dictionary array directly through pa.array()
ARROW-10000 - [C++][Python] Support constructing StructArray from list of key-value pairs
ARROW-10001 - [Rust][DataFusion] Added developer guide to README.
ARROW-10010 - [Rust] Speedup arithmetic (1.3-1.9x)
ARROW-10015 - [Rust] Simd aggregate kernels
ARROW-10016 - [Rust] Implement is null / is not null kernels
ARROW-10018 - [CI] Disable Sphinx and API documentation build on master
ARROW-10019 - [Rust] Add su

Open source →

1.0.024 Jul 2020Security

ARROW-7175 - [Website] Add a security page to track when vulnerabilities are patched

Bug Fixes

ARROW-1692 - [Java] UnionArray round trip not working
ARROW-3329 - [Python] Python tests for decimal to int and decimal to decimal casts
ARROW-3861 - [Python] ParquetDataset.read() respect specified columns and not include partition columns
ARROW-4018 - [C++] Fix RLE tests' failures on big-endian platforms
ARROW-4309 - [Documentation] Add a docker-compose entry which builds the documentation with CUDA enabled
ARROW-4600 - [Ruby] returns dictionary value
ARROW-5158 - [Packaging][Wheel] Symlink libraries in wheels
ARROW-5310 - [Python] better error message on creating ParquetDataset from empty directory
ARROW-5359 - [Python] Support non-nanosecond out-of-range timestamps in conversion to pandas
ARROW-5572 - , ARROW-5310, ARROW-5666: [Python] ParquetDataset tests for new implementation
ARROW-5666 - [Python] Underscores in partition (string) values are dropped when reading dataset
ARROW-5744 - [C++] Allow Table::CombineChunks to leave string columns chunked
ARROW-5875 - [FlightRPC] integration tests for Flight features
ARROW-6235 - [R] Implement conversion from arrow::BinaryArray to R character vector
ARROW-6523 - [C++][Dataset] arrow_dataset target does not depend on anything
ARROW-6848 - [C++] Support building libraries targeting C++14 or higher
ARROW-7018 - [R] Non-UTF-8 data in Arrow <--> R conversion
ARROW-7028 - [R] Date roundtrip results in different R storage mode
ARROW-7084 - [C++] Check for full type equality in ArrayRangeEquals
ARROW-7173 - [Integration] Add test to verify Map field names can be arbitrary
ARROW-7208 - [Python][Parquet] Raise better error message when passing a directory path instead of a file path to ParquetFile
ARROW-7273 - [Python][C++][Parquet] Do not permit constructing a non-nullable null field in Python, catch this case in Arrow->Parquet schema conversion
ARROW-7480 - [Rust] [DataFusion] Query fails/incorrect when aggregated + grouped columns don't match the selected columns
ARROW-7610 - [Java] Finish support for 64 bit int allocations
ARROW-7654 - [Python] Ability to set column_types to a Schema in csv.ConvertOptions is undocumented
ARROW-7681 - [Rust] Explicitly seeking a BufReader will discard the internal buffer (2)
ARROW-7702 - [C++][Dataset] Provide (optional) deterministic order of batches
ARROW-7782 - [Python] Losing index information when using write_to_dataset with partition_cols
ARROW-7840 - [Java] [Integration] Java executables fail
ARROW-7843 - [Ruby] MSYS2 packages needed for Gandiva
ARROW-7925 - [C++][Docs] Better document use of IWYU, including new 'match' option
ARROW-7939 - [Python] crashes when reading parquet file compressed with snappy
ARROW-7967 - [CI][Crossbow] Pin macOS version in autobrew job to match CRAN
ARROW-8050 - [Python][Packaging] Do not include generated Cython source files in wheel packages
ARROW-8078 - [Python] Missing links in the docs regarding field and schema DataTypes
ARROW-8115 - [Python] Conversion when mixing NaT and datetime objects not working
ARROW-8251 - , ARROW-7782: [Python] Preserve pandas index and extension dtypes in write_to_dataset roundtrip
ARROW-8344 - [C#] Bug-fixes to binary array plus other improvements
ARROW-8360 - [C++][Gandiva] Fixes date32 support for date/time functions
ARROW-8374 - [R] : Table to vector of DictonaryType will error when Arrays don't have the same Dictionary per array
ARROW-8392 - [Java] Fix overflow related corner cases for vector value comparison
ARROW-8448 - [Packaging] Update linux-packages README
ARROW-8455 - [Rust] Parquet Arrow column read on partially compatible files FIX
ARROW-8455 - [Rust] Parquet Arrow column read on partially compatible files
ARROW-8471 - [C++][Integration] Represent 64 bit integers as strings
ARROW-8472 - [Go][Integration] Represent 64 bit integers as JSON::string
ARROW-8473 - [Rust] Untick "Statistics support"
ARROW-8480 - [Rust] Use NonNull well aligned pointer as Unique reference
ARROW-8503 - [Packaging][deb] Fix building apache-arrow-archive-keyring for RC
ARROW-8505 - [Release][C#] "sourcelink test" is failed by Apache.ArrowAssemblyInfo.cs
ARROW-8508 - [Rust] FixedSizeListArray improper offset for value
ARROW-8510 - [C++][Datasets] Do not use variant in WritePlan to fix compiler error with VS 2017
ARROW-8511 - [Release] In verify-release-candidate.bat, exit when CMake build fails, use Unity build
ARROW-8514 - [Developer][Release] Verify Python 3.5 Windows wheel
ARROW-8529 - [C++] Fix usage of NextCounts() on dictionary-encoded data
ARROW-8535 - [Rust] Specify arrow-flight version
ARROW-8536 - [Rust][Flight] Check in proto file, conditional build if file exists
ARROW-8537 - [C++] Revert Optimizing BitmapReader
ARROW-8539 - [CI] "AMD64 MacOS 10.15 GLib & Ruby" fails
ARROW-8554 - [C++][Benchmark] Fix building error "cannot bind lvalue"
ARROW-8556 - [R] zstd symbol not found if there are multiple installations of zstd
ARROW-8566 - [R] error when writing POSIXct to spark
ARROW-8568 - [C++] Fix decimal to decimal cast issues
ARROW-8577 - [Plasma][CUDA] Make CUDA initialization lazy
ARROW-8583 - [C++][Doc] Undocumented parameter in Dataset namespace
ARROW-8584 - [C++] Fix ORC link order
ARROW-8585 - [Packaging][Python] Windows wheels fail to build because of link error
ARROW-8586 - [R] installation failure on CentOS 7
ARROW-8587 - [C++] Fix linking Flight benchmarks
ARROW-8592 - [C++] Update docs to reflect LLVM 8
ARROW-8593 - [C++][Parquet] Fix build with musl libc
ARROW-8598 - [Rust] simd_compare_op creates buffer of incorrect length
ARROW-8602 - [C++][CMake] Fix ws2_32 link issue when cross-compiling on Linux
ARROW-8603 - [C++][Documentation] Add missing params comment
ARROW-8604 - [R][CI] Update CI to use R 4.0
ARROW-8608 - [C++] Update vendored 'variant.hpp' to fix CUDA 10.2
ARROW-8609 - [C++] Fix ORC Java JNI crash
ARROW-8610 - [Rust] DivideByZero when running arrow crate when simd feature is disabled
ARROW-8613 - [C++][Dataset][Python] Raise in discovery on unparsable partition expression
ARROW-8615 - [R] Error better and insist on RandomAccessFile in read_feather
ARROW-8617 - [Rust] Avoid loading simd_load_set_invalid which doesn't exist on aarch64
ARROW-8632 - [C++] Fix conversion error warning in array_union_test.cc
ARROW-8641 - [C++][Python] Sort included indices in IpcReader - Respect column selection in FeatherReader
ARROW-8643 - [Python] Fix failing pandas tests with DatetimeIndex on pandas master
ARROW-8644 - [Python] Restore ParquetDataset behaviour to always include partition column for dask compatibility
ARROW-8646 - [Java] Allow UnionListWriter to write null values
ARROW-8649 - [Java][Website] Java documentation on website is hidden
ARROW-8657 - [C++][Python] Add separate configuration for data pages
ARROW-8663 - [Documentation] Small correction to building.rst
ARROW-8680 - [Rust] Fix ComplexObjectArray null value shifting
ARROW-8684 - [Python] Workaround Cython type initialization bug
ARROW-8689 - [C++] Fix linking S3FS benchmarks
ARROW-8693 - [Python] Insert implicit cast in Dataset.get_fragments with filter
ARROW-8694 - [C++][Parquet] Relax string size limit when deserializing Thrift messages
ARROW-8701 - [Rust] Unresolved import `crate::compute::util::simd_load_set_invalid` on Raspberry Pi
ARROW-8704 - [C++] Fix Parquet undefined behaviour on invalid input
ARROW-8705 - copying null values from ComplexCopier
ARROW-8706 - [C++][Parquet] Tracking JIRA for PARQUET-1857 (unencrypted INT16_MAX Parquet row group limit)
ARROW-8710 - [Rust] Ensure right order of messages written, and flush stream when complete.
ARROW-8722 - [Dev] Pass environment variables to the container when running "archery docker run -e"
ARROW-8726 - [C++] Filename should not be part of DirectoryPartitioning
ARROW-8728 - [C++] Fix bitmap operation buffer overflow
ARROW-8729 - [C++][Dataset] Ensure non-empty batches when only virtual columns are projected
ARROW-8734 - [R] improve nightly build installation
ARROW-8741 - [Python][Packaging] Keep VS2015 with for the windows wheels
ARROW-8750 - [Python] Correctly default to lz4 compression for Feather V2 in Python
ARROW-8768 - [R][CI] Fix nightly as-cran spurious failure
ARROW-8775 - [C++][FlightRPC] fix integration tests
ARROW-8776 - [FlightRPC] Fix discrepancy between headers in Java and C++
ARROW-8798 - [C++] Fix Parquet crash on invalid input
ARROW-8799 - [C++][Parquet] NestedListReader needs to handle empty item batches
ARROW-8801 - [Python] Fix memory leak when converting datetime64-with-tz data to pandas
ARROW-8802 - [C++][Dataset] Preserve dataset schema's metadata on column projection
ARROW-8803 - [Java] Row count should be set before loading buffers in VectorLoader
ARROW-8808 - [Rust] Fix divide by zero error in builder
ARROW-8809 - [Rust] Fix JSON schema bug
ARROW-8811 - [Java] Fix CI
ARROW-8820 - [C++][Gandiva] fix date_trunc functions to return date types
ARROW-8821 - [Rust] fix type cast for nested binary expression using Like, NotLike, Not operators
ARROW-8825 - [C++] Mark parameter as unused
ARROW-8826 - [Crossbow] remote URL should always have .git
ARROW-8832 - [Python] Provide better error message when S3/HDFS is not enabled in installation
ARROW-8848 - [Ruby][CI] Fix MSYS2 update error
ARROW-8848 - [Ruby][CI] Fix MSYS2 update error
ARROW-8858 - [FlightRPC] ensure binary/multi-valued headers are properly exposed
ARROW-8860 - [C++] Fix IPC/Feather decompression for nested types (with child_data)
ARROW-8862 - [C++] NumericBuilder should use MemoryPool passed to CTOR
ARROW-8863 - [C++] Ensure that ArrayData::null_count is always set to 0 when using ArrayData::Make and supplying null validity bitmap
ARROW-8869 - [Rust][DataFusion] Add support for new scan nodes to type coercion rule
ARROW-8871 - [C++] Fix Gandiva for value_parsing.h refactor
ARROW-8872 - [CI] Restore ci/detect-changes.py
ARROW-8874 - [C++][Dataset] Scanner::ToTable race when ScanTask exit early with an error
ARROW-8878 - [R] try_download is confused when download.file.method isn't default
ARROW-8882 - [C#] Add .editorconfig to C# code
ARROW-8888 - [Python] Do not use thread pool when converting pandas columns that are definitely zero-copyable
ARROW-8889 - [Python] avoid SIGSEGV when comparing RecordBatch to None
ARROW-8892 - [C++][CI] CI builds for MSVC do not build benchmarks
ARROW-8909 - [Java] Out of order writes using setSafe
ARROW-8911 - [C++] Fix segfault when slicing ChunkedArray with zero chunks
ARROW-8924 - [C++][Gandiva] Avoid potential int overflow in castDATE_date32()
ARROW-8925 - [Rust][DataFusion] CsvExec::schema bug fix
ARROW-8930 - [C++] libz.so linking error with liborc.a
ARROW-8932 - [C++][CI] Fix link error at arrow-orc-adapter-test
ARROW-8946 - [Python] Add tests for parquet.write_metadata
ARROW-8948 - [Java][Integration] enable duplicate field names integration tests
ARROW-8951 - [C++] Fix compiler warnings on gcc8 in release builds
ARROW-8954 - [Website] ca-certificates should be listed in installation instructions
ARROW-8957 - [FlightRPC][C++] directly use IpcWriteOptions
ARROW-8959 - [Rust] Update benchmark to use new API (fixes broken build)
ARROW-8962 - [C++] Add explicit implementation for junk values
ARROW-8968 - [C++][Gandiva] set data layout for pre-compiled IR to llvm::module
ARROW-8975 - [FlightRPC][C++] try to fix MacOS flaky tests
ARROW-8977 - [R] Table$create with schema crashes with some dictionary index types
ARROW-8978 - [C++][CI] Fix valgrind warnings in cpp-conda-valgrind nightly build
ARROW-8980 - [Python] Ensure that ARROW:schema metadata key is scrubbed when converting Parquet schema back to Arrow schema
ARROW-8982 - [CI] Remove allow_failures for s390x on TravisCI
ARROW-8986 - [Archery][ursabot] Fix benchmark diff checkout of origin/master
ARROW-9000 - [Java] Update errorprone to 2.4.0
ARROW-9009 - [C++][Dataset] ARROW:schema should be removed from schema's metadata when reading Parquet files
ARROW-9013 - [C++] Validate CMake options
ARROW-9020 - [Python] read_json won't respect explicit_schema in parse_options
ARROW-9024 - [C++/Python] Install anaconda-client in conda-clean job
ARROW-9026 - [C++/Python] Force package removal from arrow-nightlies c…
ARROW-9037 - [C++] C-ABI: do not error out when importing array with null_count == -1
ARROW-9040 - [Python][Parquet]"_ParquetDatasetV2" fail to read with columns and use_pandas_metadata=True
ARROW-9057 - [Rust][Datafusion] Fix projection on in memory scan
ARROW-9059 - [Rust] Fix sign in array slice_data_docstring
ARROW-9066 - [Python] Raise correct error in isnull()
ARROW-9071 - [C++] Fixed a bug in MakeArrayOfNull
ARROW-9077 - [C++] Fix aggregate/scalar-compare benchmark null_percent calculation
ARROW-9080 - [C++] arrow::AllocateBuffer returns a Result<unique_ptr<Buffer>>
ARROW-9082 - [Rust] - Stream reader fail when steam not ended with (opt…
ARROW-9084 - [C++] CMake is unable to find zstd target when ZSTD_SOURCE=SYSTEM
ARROW-9085 - [C++][CI] Fix Windows build
ARROW-9087 - [C++] Support additional HDFS options
ARROW-9098 - [C++] Fixed ToStructArray handling of 0 column RecordBatches
ARROW-9105 - [C++][Dataset][Python] Pass an explicit schema to split_by_row_groups
ARROW-9120 - [C++] Do not suppress linting on files with "codegen" in their name
ARROW-9121 - [C++] Forbid empty or root path in FileSystem::DeleteDirContents
ARROW-9122 - [C++] Properly handle sliced arrays in ascii_lower, ascii_upper kernels
ARROW-9126 - [C++] Fix building trimmed Boost bundle on Windows
ARROW-9127 - [Rust] Update thrift dependency to 0.13 (latest)
ARROW-9134 - [Python] Parquet partitioning degrades Int32 to float64
ARROW-9141 - [R] Update cross-package documentation links
ARROW-9142 - [C++] random::RandomArrayGenerator::Boolean "probability" misdocumented / incorrect
ARROW-9143 - [C++] Do not produce internal ArrayData with kUnknownNullCount in RecordBatch::Slice if source ArrayData::null_count is set to 0
ARROW-9146 - [C++][Dataset] Lazily store fragment physical schema
ARROW-9151 - [R][CI] Fix Rtools 4.0 build: pacman sync
ARROW-9160 - [C++] Implement contains for exact matches
ARROW-9174 - [Go] Fix table panic on 386
ARROW-9183 - [C++] Fix build with clang & old libstdc++.
ARROW-9184 - [Rust][Datafusion] table scan without projection should return all columns
ARROW-9194 - [C++] Array::GetScalar not implemented for decimal type
ARROW-9195 - [Java] Fixed UNSAFE.get from bytearray usage
ARROW-9209 - [C++] Benchmarks fail to build ARROW_IPC=OFF and ARROW_BUILD_TESTS=OFF
ARROW-9219 - [R] coerce_timestamps in Parquet write options does not work
ARROW-9221 - [Java] account for big-endian buffers in ArrowBuf.setBytes
ARROW-9223 - [Python] Propagate timezone information in pandas conversion
ARROW-9230 - [FlightRPC][Python] pass through all options in flight.connect
ARROW-9233 - [C++] Add NullType code paths for is_valid, is_null kernels
ARROW-9236 - [Rust] CSV WriterBuilder never writes header
ARROW-9237 - [R] 0.17 install on Arch Linux
ARROW-9238 - [C++][CI][FlightRPC] increase test coverage of round-robin under IPC and Flight
ARROW-9252 - [Integration] Factor out IPC integration tests into script, add back 0.14.1 "gold" files
ARROW-9260 - [CI] Fix non amd64 job failures with Ubuntu 14.04 and 20.04
ARROW-9260 - [CI][TRIAGE] Disable self-hosted builds until ARM64v8 build can be fixed
ARROW-9261 - [Python] Fix CA certificate lookup with S3 filesystem on manylinux
ARROW-9274 - [Rust] Parse 64bit numbers from integration files as strings
ARROW-9282 - [R] Remove usage of _EXTPTR_PTR
ARROW-9284 - [Java] getMinorTypeForArrowType returns sparse minor type for dense union types
ARROW-9288 - [C++][Dataset] Fix PartitioningFactory with dictionary encoding for HivePartioning
ARROW-9297 - [C++][Parquet] Support chunked row groups in RowGroupRecordBatchReader
ARROW-9298 - [C++] Fix crashes with invalid IPC input
ARROW-9303 - [R] Linux static build should always bundle dependencies
ARROW-9305 - [Python] Dependency load failure in Windows wheel build
ARROW-9315 - [Java] Fix the failure of testAllocationManagerType
ARROW-9317 - [Java] add few testcases for arrow-memory
ARROW-9326 - [Python] Remove setuptools pinning
ARROW-9326 - [FOLLOWUP] Use requirements-build.txt for installing setuptools (#7638)
ARROW-9326 - [Python][TRIAGE] Pin to setuptools version prior to distutils-related changes on July 3 (#7636)
ARROW-9330 - [C++] Fix crash and undefined behaviour on corrupt IPC input
ARROW-9334 - [Dev][Archery] Push ancestor docker images
ARROW-9336 - [Ruby] Add support for missing keys in StructArrayBuilder
ARROW-9343 - [C++][Gandiva] CastInt/Float from string functions should handle leading/trailing white spaces
ARROW-9347 - [Python] Fix mv in fsspec handler for directories
ARROW-9350 - [C++] Fix Valgrind failures
ARROW-9351 - [C++] Fix CMake 3.2 detection in option value validation
ARROW-9353 - [Python][CI] Disable known failures in dask integration tests
ARROW-9354 - [C++] Turbodbc latest fails to build in the integration tests
ARROW-9355 - [R] : Fix -Wimplicit-int-float-conversion
ARROW-9360 - [CI][Crossbow] Nightly homebrew-cpp job times out
ARROW-9363 - [C++][Dataset] Preserve schema metadata in ParquetDatasetFactory
ARROW-9368 - [Python] Rename predicate argument to filter in split_by_row_group()
ARROW-9373 - [C++] Fix Parquet crash on invalid input (OSS-Fuzz)
ARROW-9380 - [C++] Fix Filter crashes and bug in kernels with NullHandling::OUTPUT_NOT_NULL
ARROW-9384 - [C++] Avoid memory blowup on invalid IPC input
ARROW-9385 - [Python] Fix JPype tests and JVM buffer lifetime
ARROW-9389 - [C++] Add binary metafunctions for the set lookup kernels isin and match that can be called with CallFunction
ARROW-9397 - [R] Pass CC/CXX et al. to cmake when building libarrow in Linux build
ARROW-9408 - [Integration] Fix Windows numpy datagen issues
ARROW-9409 - [CI][Crossbow] Nightly conda-r fails
ARROW-9410 - [CI][Crossbow] Fix homebrew-cpp again
ARROW-9413 - [Rust] Disable cpm_nan clippy error
ARROW-9415 - [C++] Arrow does not compile on Power9
ARROW-9416 - [Go] Add testcases for some datatypes
ARROW-9417 - [C++] Write length in IPC message by using little-endian
ARROW-9418 - [R] nyc-taxi Parquet files not downloaded in binary mode on Windows
ARROW-9419 - [C++] Expand fill_null function testing, test sliced arrays, fix some bugs
ARROW-9428 - [C++][Doc] Update buffer allocation documentation
ARROW-9436 - [C++][CI] Fix Valgrind failure
ARROW-9438 - [CI] Add spark patch to compile with recent Arrow Java changes
ARROW-9439 - [C++] Fix crash on invalid IPC input
ARROW-9440 - [Python] Expose Fill Null kernel
ARROW-9443 - [C++] Bundled bz2 build should only build libbz2
ARROW-9448 - [Java] fix empty ArrowBuf getting a null log in debug mode
ARROW-9449 - [R] Strip arrow.so
ARROW-9450 - [Python] Fix tests startup time
ARROW-9456 - [Python] Dataset segfault when not importing pyarrow.parquet
ARROW-9458 - [Python] Release GIL in ScanTask.execute
ARROW-9460 - [C++] Fix BinaryContainsExact for pattern with repeated characters
ARROW-9461 - [Rust] Fixed error in reading Date32 and Date64.
ARROW-9476 - [C++][Dataset] Fix incorrect dictionary association in HivePartitioningFactory
ARROW-9486 - [C++][Dataset] Support implicit cast of InExpression::set to dict
ARROW-9497 - [C++][Parquet] Fix fuzz failure case caused by malformed Parquet data
ARROW-9499 - [C++] AdaptiveIntBuilder::AppendNull does not increment the null count
ARROW-9500 - [C++] Do not use std::to_string to fix segfault on gcc 7.x in -O3 builds
ARROW-9501 - Add logic in timestampdiff() when end date is last day of…
ARROW-9503 - [Rust] Comparison sliced arrays is wrong
ARROW-9504 - [C++/Python] Segmentation fault on ChunkedArray.take
ARROW-9506 - [Packaging][Python] Fix macOS wheel build failures
ARROW-9512 - [C++] Avoid variadic template unpack inside lambda to work around gcc 4.8 bug
ARROW-9524 - [CI][Gandiva] Fix c++ unit test failure in Gandiva nightly build
ARROW-9527 - [Rust] Removed un-used dev dependencies.
ARROW-10126 - [Python] Impossible to import pyarrow module in python. Generates this "ImportError: DLL load failed: The specified procedure could not be found."
PARQUET-1839 - Set values read for required column
PARQUET-1857 - [C++] Do not fail to read unencrypted files with over 32767 row groups. Change some DCHECKs causing segfaults to throw exceptions
PARQUET-1865 - [C++] Fix usages of C++17 extensions in parquet/encoding_benchmark.cc
PARQUET-1877 - [C++] Reconcile thrift limits
PARQUET-1882 - [C++] Buffered Reads should allow for 0 length

New Features and Improvements

ARROW-300 - [Format] Proposal for "trivial" IPC body buffer compression using either LZ4 or ZSTD codecs
ARROW-842 - [Python] Recognize pandas.NaT as null when converting object arrays with from_pandas=True
ARROW-971 - [C++][Compute] IsValid, IsNull kernels
ARROW-974 - [Website] Add Use Cases section to the website
ARROW-1277 - Completing integration tests for major implemented data types
ARROW-1567 - [C++] Implement "fill_null" function that replaces null values with a scalar value
ARROW-1570 - [C++] Define API for creating a kernel instance from function of scalar input and output with a particular signature
ARROW-1682 - [Doc] Expand S3/MinIO fileystem dataset documentation
ARROW-1796 - [Python] RowGroup filtering on file level
ARROW-2260 - [C++][Plasma] Use Gflags for command-line parsing
ARROW-2444 - [Python][C++] Better handle reading empty parquet files
ARROW-2702 - [Python] Change a couple of error types in numpy_to_arrow.cc
ARROW-2714 - [Python] Implement variable step slicing with Take
ARROW-2912 - [Website] Build more detailed Community landing page a la Apache Spark
ARROW-3089 - [Rust] Add ArrayBuilder for different Arrow arrays
ARROW-3134 - [C++] Implement n-ary iterator for a collection of chunked arrays with possibly different chunking layouts
ARROW-3154 - [Python] Expand documentation on Parquet metadata inspection and writing of _metadata
ARROW-3244 - [Python] Multi-file parquet loading without scan
ARROW-3275 - [Python] Add documentation about inspecting Parquet file metadata
ARROW-3308 - [R] Convert R character vector with data exceeding 2GB to Large type
ARROW-3317 - [R] Test/support conversions from data.frame with a single character column exceeding 2GB capacity of BinaryArray
ARROW-3446 - [R] Document mapping of Arrow <-> R types
ARROW-3509 - [C++] Standardize on using Field in Type/Array
ARROW-3520 - [C++] Add "list_flatten" vector kernel wrapper for Flatten method of ListArray types
ARROW-3688 - [Rust] Add append_values for primitive builders
ARROW-3764 - [C++] Port Python "ParquetDataset" business logic to C++
ARROW-3827 - [Rust] Implement UnionArray Updated
ARROW-4022 - [C++] Promote Datum variant out of compute namespace
ARROW-4221 - [C++][Python] Add canonical flag in COO sparse index
ARROW-4390 - [R] Serialize "labeled" metadata in Feather files, IPC messages
ARROW-4412 - [DOCUMENTATION] Add explicit version numbers to the arrow specification documents.
ARROW-4427 - [Doc] Move Confluence Wiki pages to the Sphinx docs
ARROW-4429 - [Doc] Add Git conventions to contributing guidelines
ARROW-4526 - [Java] Remove Netty references from ArrowBuf and move Allocator out of vector package
ARROW-5035 - [C#] ArrowBuffer.Builder<bool> is broken
ARROW-5082 - [Python] Substantially reduce Python wheel package and install size
ARROW-5143 - [Flight] Enable integration testing of batches with dictionaries
ARROW-5279 - [C++] Support reading delta dictionaries in IPC streams
ARROW-5377 - [C++] Make IpcPayload public and add GetPayloadSize
ARROW-5489 - [C++] Normalize kernels and ChunkedArray behavior
ARROW-5548 - [Documentation] http://arrow.apache.org/docs/latest/ is not latest
ARROW-5649 - [Integration][C++] Create integration test for extension types
ARROW-5708 - [C#] Null support for BooleanArray
ARROW-5760 - [C++] New compute::Take implementation for better performance, faster dispatch, smaller code size / faster compilation
ARROW-5854 - [Python] Expose compare kernels on Array class
ARROW-6052 - [C++] Split up arrow/array.h/cc into multiple files under arrow/array/, move ArrayData to separate header, make ArrayData::dictionary ArrayData
ARROW-6110 - [Java][Integration] Support LargeList Type and add integration test with C++
ARROW-6111 - [Java] Support LargeVarChar and LargeBinary types
ARROW-6439 - [R] Implement S3 file-system interface in R
ARROW-6456 - [C++] Possible to reduce object code generated in compute/kernels/take.cc?
ARROW-6501 - [C++] Remove non_zero_length_ field from SparseIndex class
ARROW-6521 - [C++] Add an API to query runtime build info
ARROW-6543 - [R] Support LargeBinary and LargeString types
ARROW-6602 - [Doc] Add a feature/implementation matrix
ARROW-6603 - [C#] Adds ArrayBuilder API to support writing null values + BooleanArray null support
ARROW-6645 - [Python] Use common boundschecking function for checking dictionary indices when converting to pandas
ARROW-6689 - [Rust] [DataFusion] Query execution enhancements for 1.0.0 release
ARROW-6691 - [Rust] [DataFusion] Use tokio and Futures instead of spawning threads
ARROW-6775 - [C++][Python] Implement list_value_lengths and list_parent_indices functions
ARROW-6776 - [Python] Need a lite version of pyarrow
ARROW-6800 - [C++] Add CMake option to build libraries targeting a C++14 or C++17 toolchain environment
ARROW-6839 - [Java] Add APIs to read and write "custom_metadata" field of IPC file footer (#7231)
ARROW-6856 - [C++] Use ArrayData instead of Array for ArrayData::dictionary
ARROW-6917 - [Archery][Release] Add support for JIRA curation, changelog generation and commit cherry-picking for maintenance releases
ARROW-6945 - [Rust][Integration] Run rust integration tests
ARROW-6959 - [C++] Clarify what signatures are preferred for compute kernels
ARROW-6978 - [R] Add bindings for sum and mean compute kernels
ARROW-6979 - [R] Enable jemalloc in autobrew formula
ARROW-7009 - [C++] Refactor filter/take kernels to use Datum instead of overloads
ARROW-7010 - [C++] Implement decimal-to-float casts
ARROW-7011 - [C++] Implement casts from float/double to decimal
ARROW-7012 - [C++] Add comments explaining high level detail about ChunkedArray class and questions about chunk sizes
ARROW-7068 - [C++] Add ListArray::offsets and LargeListArray::offsets returning boxed version of offsets as Int32Array/Int64Array
ARROW-7075 - [C++] Boolean kernels should not allocate in Call()
ARROW-7175 - [Website] Add a security page to track when vulnerabilities are patched
ARROW-7229 - [C++] Unify ConcatenateTables APIs
ARROW-7230 - [C++] Use vendored std::optional instead of boost::optional in Gandiva
ARROW-7237 - [C++] Use Result<T> in arrow/json APIs
ARROW-7243 - [Docs] Add common "implementation status" table to the README of each native language implementation, as well as top level README
ARROW-7285 - [C++] ensure C++ implementation meets clarified dictionary spec
ARROW-7300 - [C++][Gandiva] Implement functions to cast from strings to integers/floats
ARROW-7313 - [C++] Add function for retrieving a scalar from an array slot
ARROW-7371 - [GLib] Add GLib binding of Dataset
ARROW-7375 - [Python] Expose C++ MakeArrayOfNull
ARROW-7391 - [C++][Dataset] Remove Expression subclasses from bindings
ARROW-7495 - [Java] Remove "empty" concept from ArrowBuf, replace with custom referencemanager (#6433)
ARROW-7605 - [C++] Create and install "dependency bundle" static library including jemalloc, mimalloc, and any BUNDLED static library so that static linking to libarrow.a is possible
ARROW-7607 - [C++] Example of using Arrow as a dependency of another CMake project
ARROW-7673 - [C++][Dataset] Revisit File discovery failure mode
ARROW-7676 - [Packaging][Python] Ensure that the static libraries are not built in the wheel scripts
ARROW-7699 - [Java] Support concating dense union vectors in batch
ARROW-7705 - [Rust] Initial sort implementation
ARROW-7717 - [CI] Have nightly integration test for Spark's latest release
ARROW-7759 - [C++][Dataset] Add CsvFileFormat
ARROW-7778 - [Integration][C++] Enable nested dictionaries
ARROW-7784 - [C++] Improve compilation time of arrow/array/diff.cc and reduce code size
ARROW-7801 - [Developer] Add issue_comment workflow to fix lint/style/codegen
ARROW-7803 - [R][CI] Autobrew/homebrew tests should not always install from master
ARROW-7831 - [Java] Fix build error from #6402
ARROW-7831 - [Java] do not allocate a new offset buffer if the slice starts at 0 since the relative offset pointer would be unchanged
ARROW-7902 - [Integration] Unskip nested dictionary integration tests
ARROW-7910 - [C++] Add internal GetPageSize() function
ARROW-7924 - [Rust] Add sort for float types
ARROW-7950 - [Python] Determine + test minimal pandas version + raise error when pandas is too old
ARROW-7955 - [Java] Support large buffer for file/stream IPC
ARROW-8020 - [Java] Implement vector validate functionality
ARROW-8023 - [Website] Write a blog post about the C data interface
ARROW-8025 - [C++][CI][FOLLOWUP] Fix test compilation failure due to conflicting changes in scalar_cast_test.cc
ARROW-8025 - [C++] Implement cast from String to Binary
ARROW-8046 - [Developer][Integration] Makefile.docker's target names are broken
ARROW-8062 - [C++][Dataset] Implement ParquetDatasetFactory
ARROW-8065 - [C++][Dataset] Refactor ScanOptions and Fragment relation
ARROW-8074 - [C++][Dataset][Python] FileFragments from buffers and NativeFiles
ARROW-8108 - [Java] Extract a common interface for dictionary encoders
ARROW-8111 - [C++] User-defined timestamp parser option to CSV, new TimestampParser interface, and strptime-compatible impl
ARROW-8114 - [Java][Integration] Enable custom_metadata integration test
ARROW-8121 - [Java] Enhance code style checking for Java code (add spaces after commas, semi-colons and type casts)
ARROW-8149 - [C++/Python] Enable CUDA Support in conda recipes
ARROW-8157 - [C++][Gandiva] Support building with LLVM 9
ARROW-8162 - [Format][Python] Add serialization for CSF sparse tensors to Python
ARROW-8169 - [Java] Improve the performance of JDBC adapter by allocating memory proactively
ARROW-8171 - [Java] Consider pre-allocating memory for fix-width vector in Avro adapter iterator (#7211)
ARROW-8190 - [FlightRPC][C++] Expose IPC options
ARROW-8229 - [Java] Move ArrowBuf into the Arrow package (#6729)
ARROW-8230 - [Java] Remove netty dependency from arrow-memory (#7347)
ARROW-8261 - [Rust-DataFusion] Made limit accept integers and no longer accept expressions.
ARROW-8263 - [Rust][DataFusion] Added some documentation to available SQL functions.
ARROW-8281 - [R] Name collision of arrow.dll on Windows conda
ARROW-8283 - [Python] Limit FileSystemDataset constructor from fragments/paths, no filesystem interaction
ARROW-8287 - [Rust] Add "pretty" util to help with printing tabular output of RecordBatches
ARROW-8293 - [Python] Run flake8 on python/examples also
ARROW-8297 - [FlightRPC][C++] Implement Flight DoExchange for C++
ARROW-8301 - [R] Handle ChunkedArray and Table in C data interface
ARROW-8312 - [Java][Gandiva] support TreeNode in IN expression
ARROW-8314 - [Python] Add a Table.select method to select a subset of columns
ARROW-8318 - [C++][Dataset] Construct FileSystemDataset from fragments
ARROW-8399 - [Rust] Extend memory alignments to include other architectures
ARROW-8413 - [C++][Parquet] Refactor Generating validity bitmap for values column
ARROW-8422 - [Rust][Parquet] Arrow to Parquet schema conversion
ARROW-8430 - [CI] Configure self-hosted runners for Github Actions
ARROW-8434 - [C++] Avoid multiple schema deserializations in RecordBatchFileReader
ARROW-8440 - [C++] Refine SIMD header files
ARROW-8443 - [Gandiva][C++] Fix Trunc and Round output types.
ARROW-8447 - [C++][Dataset] Ensure row deterministic ordering in Scanner::ToTable
ARROW-8456 - [Release] Add python script to help curating JIRA
ARROW-8467 - [C++] Fix TestArrayImport tests for big-endian platforms
ARROW-8474 - [CI][Crossbow] Skip some nightlies we don't need to run
ARROW-8477 - [C++] Enable reading and writing of long filenames for Windows
ARROW-8481 - [Java] Provide an allocation manager based on Unsafe API
ARROW-8483 - [Ruby] Removed irrelevant bits of documentation in Arrow::Table
ARROW-8485 - [Integration][Java] Implement extension types integration
ARROW-8486 - [C++] Fix BitArray failures on big-endian platforms
ARROW-8487 - [FlightRPC] Provide a way to target a particular payload size
ARROW-8488 - [R] Remove VALUE_OR_STOP and STOP_IF_NOT_OK macros
ARROW-8496 - [C++] Refine ByteStreamSplitDecodeScalar
ARROW-8497 - [Archery] Add missing components to build options
ARROW-8499 - [C++][Dataset] In ScannerBuilder, batch_size will not wor…
ARROW-8500 - [C++] Add benchmark for using Filter on RecordBatch
ARROW-8501 - [Packaging][RPM] Upgrade devtoolset to 8 on CentOS 6
ARROW-8502 - [Release][APT][Yum] Ignore all Linux packages for arm64v8
ARROW-8504 - [C++] Add BitRunReader and use it in parquet
ARROW-8506 - [C++] Add tests to verify the encoded stream of RLE with bit_width > 8
ARROW-8507 - [Release] Detect .git directory automatically in changelog.py
ARROW-8509 - [GLib] Add low level record batch read/write functions
ARROW-8512 - [C++] Remove unused expression/operator prototype code
ARROW-8513 - [Python] Expose Take with Table input in Python
ARROW-8515 - [C++] Bitmap::ToString should group by bytes
ARROW-8516 - [Rust] Improve PrimitiveBuilder::append_slice performance
ARROW-8517 - [Release] Update Crossbow release verification tasks for 0.17.0 RC0
ARROW-8520 - [Developer] Use .asf.yaml to direct GitHub notifications to JIRA and mailing lists
ARROW-8521 - [Release] Update CHANGELOG.md to include patch releases
ARROW-8522 - [Release][Developer] Add option to bootstrap NPM when running release verification script
ARROW-8524 - [CI] Free up space on github actions
ARROW-8526 - [Python] Fix non-deterministic row order failure in dataset tests
ARROW-8531 - [C++] Deprecate ARROW_USE_SIMD CMake option
ARROW-8538 - [Packaging] Remove boost from homebrew formula
ARROW-8540 - [C++] Add memory allocation benchmarks
ARROW-8541 - [Release] Don't remove previous source releases automatically
ARROW-8542 - [Release] Fix checksum url in the website post release script
ARROW-8543 - [C++] Single pass coalescing algorithm + Rebase
ARROW-8544 - [CI][Crossbow] Add a status.json to the gh-pages summary of nightly builds to get around rate limiting
ARROW-8548 - [Website] 0.17 release post
ARROW-8549 - [R] Assorted post-0.17 release cleanups
ARROW-8550 - [CI] Don't run cron GHA jobs on forks
ARROW-8551 - [CI][Gandiva] Use LLVM 8 in gandiva linux build
ARROW-8552 - [Rust] support iterate parquet row columns
ARROW-8553 - [C++] Optimize unaligned bitmap operations
ARROW-8555 - [FlightRPC][Java] implement DoExchange
ARROW-8558 - [Rust][CI] GitHub Actions missing rustfmt
[ARROW-8559](http

Open source →

0.17.020 Apr 2020Deprecated

ARROW-8036 - [C++] Avoid gtest 1.10 deprecation warnings

Bug Fixes

ARROW-1907 - [C++/Python] Feather format cannot accommodate string columns containing more than a total of 2GB of data
ARROW-2255 - [C++][Developer][Integration] Serialize custom field/schema metadata
ARROW-2587 - [Python][Parquet] Verify nested data can be written
ARROW-3004 - [Documentation] Builds docs for master rather than a pinned commit
ARROW-3543 - [R] Better support for timestamp format and time zones in R
ARROW-5265 - [Python][CI] Add integration test with kartothek
ARROW-5473 - [C++] Fix googletest_ep build failure on windows+ninja
ARROW-5981 - [C++] Propagate errors from MemoTable to DictionaryBuilder
ARROW-6528 - [C++] Spurious Flight test failures (port allocation failure)
ARROW-6547 - [C++] valgrind errors in diff-test
ARROW-6738 - [Java] Fix problems with current union comparison logic
ARROW-6757 - [Release] Use same CMake generator for C++ and Python when verifying RC, remove Python 3.5 from wheel verification
ARROW-6871 - [Java] Enhance TransferPair related parameters check and tests
ARROW-6872 - [Python] Fix empty table creation from schema with dictionary field
ARROW-6890 - [Rust] [Parquet] ArrowReader fails with seg fault
ARROW-6895 - [C++][Parquet] Do not reset dictionary in ByteArrayDictionaryRecordReader during incremental reads
ARROW-7008 - [C++] Check binary offsets and data buffers for nullness in validation. Produce valid arrays in DictionaryEncode on zero-length arrays
ARROW-7049 - [C++] Fix MinGW64 warning in FieldRef::Get
ARROW-7301 - [Java] Sql type DATE should correspond to DateDayVector
ARROW-7335 - [C++][Gandiva] Add day_time_interval functions: castBIGINT, extractDay
ARROW-7390 - [C++][Dataset] Fix RecordBatchProjector race
ARROW-7405 - [Java] ListVector isEmpty API is incorrect
ARROW-7466 - [CI][Java] Fix gandiva-jar-osx nightly build failure
ARROW-7467 - [Java] ComplexCopier does incorrect copy for Map nullable info
ARROW-7507 - [Rust] Bump Thrift version to 0.13 in parquet-format and parquet
ARROW-7520 - [R] Writing many batches causes a crash
ARROW-7546 - [Java] Use new implementation to concat vectors values in batch
ARROW-7624 - [Rust] Soundness issues via Buffer methods
ARROW-7628 - [Python] Clarify docs of csv reader skip_rows and nulls in strings
ARROW-7631 - [C++][Gandiva] return zero if there is an overflow while downscaling a decimal
ARROW-7672 - [C++] NULL pointer dereference bug
ARROW-7680 - [C++] Fix dataset.factory(...) with Windows paths
ARROW-7701 - [FlightRPC][C++] disable flaky MacOS test
ARROW-7713 - [Java] TastLeak was put at the wrong location
ARROW-7722 - [FlightRPC][Java] disable flaky Flight auth test
ARROW-7734 - [C++] check status details for nullptr in equality
ARROW-7740 - [C++] Fix StructArray::Flatten corruption
ARROW-7755 - [Python] Windows wheel cannot be installed on Python 3.8
ARROW-7758 - [Python] Safe cast to nanosecond timestamps in to_pandas conversion
ARROW-7760 - [Release] Fix verify-release-candidate.sh since pip3 seems to no longer be in miniconda, install miniconda unconditionally
ARROW-7762 - [Python] Do not ignore exception for invalid version in ParquetWriter
ARROW-7766 - [Python][Packaging] Windows py38 wheels are built with wrong ABI tag
ARROW-7772 - [R][C++][Dataset] Unable to filter on date32 object with date64 scalar
ARROW-7775 - [Rust] fix: Don't let safe code arbitrarily transmute readers and writers
ARROW-7777 - [Go] Fix StructBuilder and ListBuilder panics on index out of range
ARROW-7780 - [Release] Fix Windows wheel RC verification script given lack of "m" ABI tag in Python 3.8
ARROW-7781 - [C++] Improve message when referencing a missing field
ARROW-7783 - [C++] Set ARROW_COMPUTE=ON if ARROW_DATASET=ON
ARROW-7785 - [C++] Improve compilation performance of sparse tensor related code
ARROW-7786 - [R] Wire up check_metadata in Table.Equals method
ARROW-7789 - [R] Can't initialize arrow objects when R.oo package is loaded
ARROW-7791 - [C++][Parquet] Fix building error "cannot bind lvalue"
ARROW-7792 - [R] read_* functions should close connection to file
ARROW-7793 - [Java] Release accounted-for reservation memory to parent in case of leak
ARROW-7794 - [Rust][Flight] Remove hard-coded relative path to Flight.proto
ARROW-7794 - [Rust] Support releasing arrow-flight
ARROW-7797 - [Release][Rust] Fix arrow-flight's version in datafusion crate
ARROW-7802 - [C++][Python] Support LargeBinary and LargeString in the hash kernel
ARROW-7806 - [Python] Support LargeListArray and list<LargeBinaryArray> conversion to pandas.
ARROW-7807 - [R] Installation on RHEL 7 Cannot call io___MemoryMappedFile__Open()
ARROW-7809 - [R] vignette does not run on Win 10 nor ubuntu
ARROW-7813 - [Rust] Remove and fix unsafe code
ARROW-7815 - [C++] Improve input validation
ARROW-7827 - [Python] conda-forge pyarrow package does not have s3 enabled
ARROW-7832 - [R] Patches to 0.16.0 release
ARROW-7836 - [Rust] "allocate_aligned"/"reallocate" need to initialize memory to avoid UB
ARROW-7837 - [JAVA] copyFromSafe fails due to a bug in handleSafe
ARROW-7838 - [C++] Only link Boost libraries with tests, not libarrow.so
ARROW-7841 - [C++] Use ${HADOOP_HOME}/lib/native/ to find libhdfs.so again
ARROW-7844 - [R] Converter_List is not thread-safe
ARROW-7848 - [C++][Python][Doc] Add MapType API doc
ARROW-7852 - [Python] 0.16.0 wheels not compatible with older numpy
ARROW-7857 - [Python] Revert temporary changes to pandas extension array tests
ARROW-7861 - [C++][Parquet] Add fuzz regression corpus for parquet reader
ARROW-7884 - [C++] Relax concurrency rules around GetSize()
ARROW-7887 - [Rust] Add date/time/duration/timestamp types to filter kernel
ARROW-7889 - [Rust] Add support to datafusion-cli for parquet files.
ARROW-7899 - [Integration][Java] Fix Flight integration test client to verify each batch
ARROW-7908 - [R] Can't install package without setting LIBARROW_DOWNLOAD=true
ARROW-7922 - [CI][Crossbow] Nightly macOS wheel builds fail (brew bundle edition)
ARROW-7923 - [CI][Crossbow] macOS autobrew fails on homebrew-versions
ARROW-7926 - [Dev] Improve "archery lint" UI
ARROW-7928 - [Python] Update Python flight server and client examples for latest API
ARROW-7931 - [C++] Fix crash on corrupt Map array input (OSS-Fuzz)
ARROW-7936 - [Python] Fix and exercise tests on python 3.5
ARROW-7940 - [C++] Remove ARROW_USE_CLCACHE handling
ARROW-7944 - [Python] Test failures without Pandas
ARROW-7956 - [Python] Memory leak in pyarrow functions .ipc.serialize_pandas/deserialize_pandas
ARROW-7958 - [Java] Update Avro to version 1.9.2
ARROW-7962 - [R][Dataset] Followup to "Consolidate Source and Dataset classes"
ARROW-7968 - [C++] orc_ep build fails on 64-bit Raspbian
ARROW-7973 - [Developer][C++] ResourceWarnings in run_cpplint.py
ARROW-7974 - [C++][Developer] Fix linter warnings when PYTHONDEVMODE enabled
ARROW-7975 - [C++] Preserve intended buffer size by default when writing to IPC format
ARROW-7978 - [Dev] Do not run IWYU in Github Actions "lint" workflow
ARROW-7980 - [Python] Fix creation of tz-aware datetime dtype on first pandas import
ARROW-7981 - [C++][Dataset] Fix compilation on gcc 5.4
ARROW-7985 - [C++] Fix builder capacity check
ARROW-7990 - [Developer][C++] Add option to run "archery lint --iwyu" on all C++ files, not just the ones that you changed. Add "match" option to iwyu.sh
ARROW-7992 - [C++] Fix MSVC warning (#6525)
ARROW-7996 - [Python] Error serializing empty pandas DataFrame with pyarrow
ARROW-7997 - [Python] Schema equals method with inconsistent docs in pyarrow
ARROW-7999 - [C++] Fix crash on corrupt List / Map array input
ARROW-8000 - [C++] Fix compilation on gcc 4.8
ARROW-8003 - [C++] Use CMAKE_C_COMPILER when building bundled bzip2
ARROW-8006 - [C++] Initialize spaced data when reading nulls from Parquet
ARROW-8007 - [Python] Remove unused and defunct assert_get_object_equal in plasma tests
ARROW-8008 - [C++/Python] Set Python3_FIND_FRAMEWORK=LAST
ARROW-8009 - [Java] Fix the hash code methods for BitVector
ARROW-8011 - [C++] Fix buffer size when reading Parquet data to Arrow
ARROW-8013 - [Python][Packaging] Fix building manylinux wheels
ARROW-8021 - [Python] Install test requirements including pandas in Appveyor
ARROW-8029 - [R] rstudio/r-base:3.6-centos7 GHA build failing on master
ARROW-8036 - [C++] Avoid gtest 1.10 deprecation warnings
ARROW-8042 - [Python] Clean up docstring and error message when creating ChunkedArray with no chunks
ARROW-8057 - [Python] Do not compare schema metadata in Schema.equals and Table.equals by default
ARROW-8070 - [C++] Cast segfaults on unsupported cast from list<binary> to utf8
ARROW-8071 - [GLib] Fix build error with configure
ARROW-8075 - [R] Loading R.utils after arrow breaks some arrow functions
ARROW-8088 - [C++][Dataset] Support dictionary partition columns
ARROW-8091 - [CI][Crossbow] Fix nightly homebrew and R failures
ARROW-8092 - [CI][Crossbow] OSX wheels fail on bundled bzip2
ARROW-8094 - [CI][Crossbow] Nightly valgrind test fails
ARROW-8095 - [C++] Add support for string dictionary value with length
ARROW-8098 - [Go] Avoid unsafe unsafe.Pointer usage
ARROW-8099 - [Integration] archery integration --with-LANG flags don't work
ARROW-8101 - [FlightRPC][Java] Fix null arrays in Flight with no buffers
ARROW-8102 - [Dev] Crossbow's version detection doesn't work in the comment bot's scenario
ARROW-8105 - [Python] Fix segfault when shrunken masked array is passed to pyarrow.array
ARROW-8106 - [Python] Ensure extension array conversion tests passes with latest pandas
ARROW-8110 - [C#] BuildArrays fails if NestedType is included
ARROW-8112 - [FlightRPC][C++] make sure status codes round-trip through gRPC
ARROW-8119 - [Dev] Make Yaml optional dependency for archery
ARROW-8122 - [Python] Empty numpy arrays with shape cannot be deserialized
ARROW-8125 - [C++] Restore link between tests created with add_arrow_test and arrow-tests target
ARROW-8127 - [C++][Parquet] Incorrect column chunk metadata for multipage batch writes
ARROW-8128 - [C#] NestedType children serialized on wrong length
ARROW-8132 - [C++] Fix S3FileSystem tests on Windows
ARROW-8133 - [CI] Github Actions sometimes fail to checkout Arrow
ARROW-8136 - [Python] More robust inference of local relative path in dataset
ARROW-8136 - [Python] Restore creating a dataset from a relative path
ARROW-8138 - [C++] parquet::arrow::FileReader cannot read multiple RowGroup
ARROW-8139 - [C++] FileSystem enum causes attributes warning
ARROW-8142 - [C++][Compute] Explicit no chunks case for WrapDatumsLike
ARROW-8144 - [CI] Cmake 3.2 nightly build fails
ARROW-8154 - [Python] HDFS Filesystem does not set environment variables in pyarrow 0.16.0 release
ARROW-8159 - [Python] Support pandas.ExtensionDtype in Schema.from_pandas
ARROW-8166 - [C++] fix AVX512 intrinsics fail with clang-8
ARROW-8176 - [FlightRPC] bind to a free port for integration tests
ARROW-8186 - [Python] Fix dataset expression operation with invalid scalar
ARROW-8188 - [R] Adapt to latest checks in R-devel
ARROW-8193 - [C++] Fix gcc 4.8 compilation error with non-copyable types in Iterator<T>::ToVector
ARROW-8197 - [Rust][DataFusion] Fix schema returned by physical plan
ARROW-8206 - [R] Minor fix for backwards compatibility on Linux installation
ARROW-8209 - [Python] Improve error message when trying to access duplicate Table column
ARROW-8213 - [Python][Dataset] Opening a dataset with a local incorrect path gives confusing error message
ARROW-8216 - [C++][Compute] Filter out nulls by default
ARROW-8217 - [R] Unskip previously failing test on Win32 in test-dataset.R from ARROW-7979
ARROW-8219 - [Rust] sqlparser crate needs to be bumped to version 0.2.5
ARROW-8223 - [Python] Schema.from_pandas breaks with pandas nullable integer dtype
ARROW-8233 - [CI][GLib][R] Fix timeount on MinGW
ARROW-8234 - [CI] Build timeouts on "AMD64 Windows RTools 35"
ARROW-8236 - [Rust] Linting GitHub Actions task failing
ARROW-8237 - [Python][Documentation] Minor corrections to python minimal build documentation
ARROW-8237 - [Python][Documentation] Review Python developer documentation, add Dockerfile showing minimal source build with conda and pip/virtualenv
ARROW-8238 - [C++] Fix FieldPath type definition
ARROW-8239 - [Java] fix param checks in splitAndTransfer method
ARROW-8245 - [Python][Parquet] Skip hidden directories when reading partitioned parquet files
ARROW-8254 - [Rust] [DataFusion] CLI is not working as expected
ARROW-8255 - [Rust][DataFusion] Bug fix for COUNT(*)
ARROW-8259 - [Rust][DataFusion] ProjectionPushDown now respects LIMIT
ARROW-8268 - [CI][Ruby] Enable Zstandard on Ubuntu 16.04
ARROW-8269 - [Python] Add pandas mark to test_parquet_row_group_fragments to fix nopandas build
ARROW-8270 - [Python][Flight] Update Python server example to support TLS
ARROW-8272 - [CI][Python] Fix test failure on Python 3.5
ARROW-8274 - [C++] Use LZ4 frame format for "LZ4" compression in IPC
ARROW-8276 - [C++][Dataset] Use Scanner for Fragment.to_table
ARROW-8280 - [C++] Use c-ares_INCLUDE_DIR
ARROW-8286 - [Python] Ensure to create FileSystemDataset when passing pathlib path
ARROW-8298 - [C++][MinGW] Fix gRPC detection
ARROW-8303 - [Python] Fix test failure on Python 3.5 caused by non-deterministic dict key ordering
ARROW-8304 - [Flight][Python] Fix client example with TLS
ARROW-8305 - [Java] ExtensionTypeVector should make sure underlyingVector not null
ARROW-8310 - [C++] Improve auto-retry in S3 tests
ARROW-8315 - [Python] Fix dataset tests on Python 3.5
ARROW-8323 - [C++] Add pragmas wrapping proto_utils.h to disable conversion warnings
ARROW-8326 - [C++] Use TYPED_TEST_SUITE instead of deprecated TYPED_TEST_CASE
ARROW-8327 - [FlightRPC][Java] check gRPC trailers for null
ARROW-8331 - [C++] Fix filter_benchmark.cc compilation
ARROW-8333 - [C++] Compile benchmarks in at least one C++ CI entry
ARROW-8334 - [C++][Gandiva] Missing DATE32 in LLVM Types
ARROW-8342 - [Python] Continue to return dict from "metadata" properties accessing KeyValueMetadata
ARROW-8345 - [Python] Ensure feather read/write can work without pandas installed
ARROW-8346 - [CI][GLib] Follow pkg-config change in Homebrew
ARROW-8349 - [CI][NIGHTLY:gandiva-jar-osx] Use latest pygit2
ARROW-8353 - [C++] Fix some compiler warnings in release builds
ARROW-8354 - [R] Fix segfault in Table to Array conversion
ARROW-8357 - [Rust][DataFusion] Add format dir to dockerfile for CLI
ARROW-8358 - [C++] Fix some clang-11 compiler warnings
ARROW-8365 - [C++] Error when writing files to S3 larger than 5 GB
ARROW-8366 - [Rust][Rust] Support releasing arrow-flight"
ARROW-8369 - [CI] Fix crossbow wildcard groups
ARROW-8373 - [CI][GLib] Find gio-2.0 manually on macOS
ARROW-8380 - Export StringDictionaryBuilder from arrow::array crate
ARROW-8384 - [Python][C++] Allow configuring Kerberos ticket cache path
ARROW-8386 - [Python] Fix error when pyarrow.jvm gets an empty vector
ARROW-8388 - [C++][CI] Ensure Arrow compiles with GCC 4.8
ARROW-8397 - [C++] Fail to compile aggregate_test.cc on Ubuntu 16.04
ARROW-8406 - [C++][Python] Fix file URI handling
ARROW-8410 - [C++] Fix compilation errors on modest ARMv8 platforms (rockpro64, rpi4)
ARROW-8414 - [Python] Fix non-deterministic row order failure in parquet tests
ARROW-8414 - [Python] Fix non-deterministic row order failure in parquet tests
ARROW-8414 - [Python] Fix non-deterministic row order failure in parquet tests
ARROW-8415 - [C++][Packaging] Fix gandiva linux job
ARROW-8416 - [Python] Add feather alias for ipc format in dataset API
ARROW-8420 - [C++] Distinguish ARMv7 from ARMv8 in SetupCxxFlags.cmake
ARROW-8427 - [C++][Dataset] Only apply ignore_prefixes to selector results
ARROW-8428 - [C++] GCC 4.8 Implicit move-on-return failure in C++ tests
ARROW-8429 - [C++] Implement missing checks in IPC MessageDecoder
ARROW-8432 - [CI] Don't depend on a single apache mirror for dependencies
ARROW-8437 - [C++] Remove std::move return value from MakeRandomNullBitmap test utility
ARROW-8438 - [C++] Fix crash in io-memory-benchmark
ARROW-8439 - [Python] Update options usage in S3FileSystem docs
ARROW-8441 - [C++] Check invalid input in ipc::MessageDecoder
ARROW-8442 - [Python] Change NullType.to_pandas_dtype to return object instead of float64
ARROW-8460 - [Packaging][deb] Reduce disk usage on building packages
ARROW-8465 - [Packaging][Python] Windows py35 wheel build fails because of boost
ARROW-8466 - [Packaging] The python unittests are not running in the windows wheel builds
ARROW-8468 - [C++][Documentation] Fix the incorrect null bits description
ARROW-8469 - [Dev] Fix nightly docker tests on azure
ARROW-8478 - [Java] Revert "ARROW-7534
ARROW-8498 - [Python] Schema.from_pandas fails on extension type, while Table.from_pandas works
PARQUET-1780 - [C++] Set ColumnMetadata.encoding_stats field
PARQUET-1788 - Remove UBSan when rep/dev levels are null
PARQUET-1797 - [C++] Fix fuzzer issues
PARQUET-1799 - [C++] Stream API: Relax schema checking when reading
PARQUET-1810 - [C++] Fix undefined behaviour on invalid enum values (OSS-Fuzz)
PARQUET-1813 - [C++] Remove debug print statement from parquet-arrow-schema-test
PARQUET-1819 - [C++] Refactor decoding
PARQUET-1819 - [C++] Fix crashes on invalid input
PARQUET-1823 - [C++] Invalid RowGroup returned by parquet::arrow::FileReader
PARQUET-1824 - [C++] Fix crashes and undefined behaviour on invalid input
PARQUET-1829 - [C++] Fix crashes on invalid input (OSS-Fuzz)
PARQUET-1831 - [C++] Fix crashes on invalid input (OSS-Fuzz)
PARQUET-1835 - [C++] Fix crashes on invalid input

New Features and Improvements

ARROW-590 - [Integration][C++] Implement union types
ARROW-1470 - [C++] Add BufferAllocator abstract interface
ARROW-1560 - [C++] Kernel implementations for "match" function
ARROW-1571 - [C++][Compute] Optimize sorting integers in small value range
ARROW-1581 - [Packaging] Tooling to make nightly wheels available for install
ARROW-1582 - [Python] Set up + document nightly conda builds for macOS
ARROW-1636 - [C++][Integration] Implement integration test parsing in C++ for null type, add integration test data generation
ARROW-2447 - [C++] Device and MemoryManager API
ARROW-2882 - [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets
ARROW-3054 - [Packaging] Tooling to enable nightly conda packages to be updated to some anaconda.org channel
ARROW-3410 - [C++][Python] Add streaming CSV reader.
ARROW-3750 - [R] Pass various wrapped Arrow objects created in Python into R with zero copy via reticulate
ARROW-4120 - [Python] Testing utility for checking for "macro" memory leaks detectible with psutil.Process
ARROW-4226 - [C++] Add sparse CSF tensor support
ARROW-4286 - [C++/R] Namespace vendored Boost
ARROW-4304 - [Rust] Enhance documentation for arrow
ARROW-4428 - [R] Feature flags for R build
ARROW-4482 - [Website] Add blog archive page
ARROW-4815 - [Rust][DataFusion] Add support for SQL wilcard operator
ARROW-5357 - [Rust] Change Buffer::len to represent total bytes instead of used bytes
ARROW-5405 - [Documentation] Move integration testing documentation to Sphinx docs, add instructions for JavaScript
ARROW-5497 - [Release] Build and publish R/Java/JS docs
ARROW-5501 - [R] Reorganize read/write file/stream functions
ARROW-5510 - [C++][Python][R][GLib] Implement Feather "V2" using Arrow IPC file format
ARROW-5563 - [Format] Update integration test JSON format documentation
ARROW-5585 - [Go] Rename TypeEquals to TypeEqual
ARROW-5742 - [CI][C++] Add nightly Valgrind build
ARROW-5757 - [Python] Remove Python 2.7 support
ARROW-5949 - [Rust] Implement Dictionary Array
ARROW-6165 - [Integration] Run integration tests on multiple cores
ARROW-6176 - [Python] Basic implementation of arrow_ext_class, in pure Python
ARROW-6275 - [C++] Deprecate RecordBatchReader::ReadNext
ARROW-6393 - [C++] Add EqualOptions support in SparseTensor::Equals
ARROW-6479 - [C++] Inline errors from externalprojects on failure
ARROW-6510 - [Python][Filesystem] Expose nanosecond resolution mtime
ARROW-6666 - [Rust] Datafusion parquet string literal support
ARROW-6724 - [C++] Allow simpler BufferOutputStream creation
ARROW-6821 - [C++][Parquet] Do not require Thrift compiler when building (but still require library)
ARROW-6823 - [C++][Python][R] Support metadata in the feather format?
ARROW-6829 - [Docs] Migrate integration test docs to Sphinx, fix instructions after ARROW-6466
ARROW-6837 - [C++] Add APIs to read and write "custom_metadata" field of IPC file footer
ARROW-6841 - [C++] Migrate to LLVM 8
ARROW-6875 - [FlightRPC] implement criteria for ListFlights
ARROW-6915 - [Developer] Do not overwrite point release fix versions with merge tool
ARROW-6947 - [Rust][DataFusion] Scalar UDF support
ARROW-6996 - [Python] Expose boolean filter kernel on ChunkedArray/RecordBatch/Table
ARROW-7044 - [Release] Create a post release script for the home-brew formulas
ARROW-7048 - [Java] Support for combining multiple vectors under VectorSchemaRoot
ARROW-7063 - [C++][Python] Add metadata output and toggle in PrettyPrint, add pyarrow.Schema.to_string, disable metadata output by default
ARROW-7073 - [Java] Support concating vectors values in batch
ARROW-7080 - [C++][Parquet] Read and write "field_id" attribute in Parquet files, propagate to Arrow field metadata. Assorted additional changes
ARROW-7091 - [C++] Move DataType factory decls to type_fwd.h
ARROW-7119 - [C++][CI] Show automatic backtraces
ARROW-7201 - [GLib][Gandiva] Add support for BooleanNode
ARROW-7202 - [R][CI] Improve rwinlib building on CI to stop re-downloading dependencies
ARROW-7222 - [Python][Release] Wipe any existing generated Python API documentation when updating website
ARROW-7233 - [C++] Use Result<T> in remaining value-returning IPC APIs
ARROW-7256 - [C++] Remove ARROW_MEMORY_POOL_DEFAULT macro
ARROW-7330 - [C++] Migrate Arrow Cuda to Result<T>
ARROW-7332 - [C++][Python] Propagate Arrow Status through Parquet errors
ARROW-7336 - [C++][Compute] fix minmax kernel options
ARROW-7338 - [C++] Improve InMemoryDataSource to support generator instead of static list
ARROW-7365 - [Python] Convert FixedSizeList in to_pandas
ARROW-7373 - [C++][Dataset] Remove FileSource
ARROW-7400 - [Java] Avoid the worst case for quick sort
ARROW-7412 - [C++][Dataset] Provide FieldRef to disambiguate field references
ARROW-7419 - [Python] Support SparseCSCMatrix
ARROW-7427 - [Python] Support SparseCSFTensor
ARROW-7428 - [Format][C++] Add serialization for CSF sparse tensors
ARROW-7444 - [GLib] Add LocalFileSystem support
ARROW-7462 - [C++] Add CpuInfo detection for Arm64 Architecture
ARROW-7491 - [Java] Improve the performance of aligning
ARROW-7499 - [C++] CMake should collect libs when making static build
ARROW-7501 - [C++] CMake build_thrift should build flex and bison if necessary
ARROW-7515 - [C++] Rename nonexistent and non_existent to not_found
ARROW-7524 - [C++][CI] Enable Parquet in the VS2019 GHA job
ARROW-7530 - [Developer] Do not include list of PR commits in commit message when using PR merge tool
ARROW-7534 - [Java] Create a new java/contrib module
ARROW-7547 - [C++][Dataset][Python] Add ParquetFileFormat options
ARROW-7555 - [Python] Drop support for python 2.7
ARROW-7587 - [C++][Compute] Implement nth_to_indices kernel
ARROW-7608 - [C++][Dataset] Add the ability to list files in FileSystemSource
ARROW-7615 - [CI][Gandiva] Ensure gandiva_jni library has only a whitelisted set of shared dependencies
ARROW-7616 - [Java] Support comparing value ranges for dense union vector
ARROW-7625 - [Parquet][GLib] Add support for writer properties
ARROW-7641 - [R] Make dataset vignette have executable code:
ARROW-7662 - [R] Support creating ListArray from R list
ARROW-7664 - [C++] Rework FileSystemFromUri
ARROW-7675 - [R][CI] Move Windows CI from Appveyor to GHA
ARROW-7679 - [R] Cleaner interface for creating UnionDataset
ARROW-7684 - [Rust] Example Flight client and server for DataFusion
ARROW-7685 - [Developer] Add support for GitHub Actions to Crossbow
ARROW-7691 - [C++] Check non-scalar Flatbuffers fields are not null
ARROW-7708 - [Developer][Release] Include PARQUET issues in release changelogs by scraping git history
ARROW-7712 - [CI][Crossbow] Delete fuzzit jobs
ARROW-7720 - [C++][Python] Add check_metadata argument to Table.equals
ARROW-7725 - [C++] Add infrastructure for unity builds and precompiled headers
ARROW-7726 - [CI][C++] Use boost binaries on Windows GHA build
ARROW-7729 - [Python][CI] Pin pandas version to 0.25 in the dask integration test
ARROW-7733 - [Developer] Download new enough Go locally in release verification script
ARROW-7735 - [Release][Python] Use pip to install dependencies for wheel verification
ARROW-7736 - [Release] Retry binary download on transient error
ARROW-7739 - [GLib] Use placement new to initialize shared_ptr object in private structs
ARROW-7741 - [C++] Adds parquet write support for nested types
ARROW-7742 - [GLib] Add support for MapArray
ARROW-7745 - [Doc][C++] Update Parquet documentation
ARROW-7749 - [C++] Link more tests together
ARROW-7750 - [Release] Make the source release verification script restartable
ARROW-7751 - [Release] macOS wheel verification also needs arrow-testing
ARROW-7752 - [Release] Enable and test dataset in the verification script
ARROW-7754 - [C++] Make Result<> faster
ARROW-7761 - [C++][Python] Support S3 URIs
ARROW-7764 - [C++] Don't keep a null bitmap in ArrayData if null_count == 0
ARROW-7771 - [Developer] Use ARROW_TMPDIR environment variable in the verification scripts instead of TMPDIR
ARROW-7774 - [Packaging][Python] Update macos and windows wheel filenames
ARROW-7787 - [Rust] Added .collect to Table API
ARROW-7788 - [C++][Parquet] Enable Arrow Schema to Parquet Schema for missing types
ARROW-7790 - [Website] Update how to install Linux packages
ARROW-7795 - [Rust] Added support for NOT
ARROW-7796 - [R] write_* functions should invisibly return their inputs
ARROW-7799 - [R][CI] Remove flatbuffers from homebrew formulae
ARROW-7804 - [C++][R] Compile error on macOS 10.11
ARROW-7812 - [Packaging][Python] Use LLVM 8 in manylinux1 wheels
ARROW-7817 - [CI] macOS R autobrew nightly failed on installing dependency from source
ARROW-7819 - [C++][Gandiva] Add DumpIR to Filter/Projector object
ARROW-7824 - [C++][Dataset] WriteFragments to disk
ARROW-7828 - [Release] Remove SSH keys for internal use
ARROW-7829 - [R] Test R bindings on clang
ARROW-7833 - [R] Make install_arrow() actually install arrow
ARROW-7834 - [Release] Post release task for updating the documentations
ARROW-7839 - [Python][Dataset] Expose IPC format in python bindings
ARROW-7846 - [Python][Dev] Remove dependencies on six
ARROW-7847 - [Website] Write a blog post about fuzzing
ARROW-7849 - [Packaging][Python] Remove the remaining py27 crossbow wheel tasks from the nightlies
ARROW-7858 - [C++][Python] Support casting from ExtensionArray
ARROW-7859 - [R] Minor patches for CRAN submission 0.16.0.2
ARROW-7860 - [C++] Support cast to/from halffloat
ARROW-7862 - [R] Linux installation should run quieter by default
ARROW-7863 - [C++][Python][CI] Ensure running HDFS related tests
ARROW-7864 - [R] Make sure bundled installation works even if there are system packages
ARROW-7865 - [R] Test builds on latest Linux versions
ARROW-7868 - [Crossbow] Reduce GitHub API query parallelism
ARROW-7869 - [Python] Remove boost::system and boost::filesystem from Python wheels
ARROW-7872 - [C++/Python] Support conversion of list of structs to pandas
ARROW-7874 - [Python][Archery] Validate docstrings with numpydoc
ARROW-7876 - [R] Installation fails in the documentation generation image
ARROW-7877 - [Packaging] Fix crossbow deployment to github artifacts
ARROW-7879 - [C++][Doc] Add doc for the Device API
ARROW-7880 - [CI][R] R sanitizer job is not really working
ARROW-7881 - [C++] Fix -Wpedantic warnings
ARROW-7882 - [C++][Gandiva] Optimise like function for substring pattern
ARROW-7886 - [C++][Dataset][Python][R] Consolidate Source and Dataset classes
ARROW-7888 - [Python] Update pyarrow.jvm to support jpype 0.7+
ARROW-7890 - [C++] Add Future implementation
ARROW-7891 - [C++][GLib][Python][R] Make uniform use of check_metadata=false default. Add Py/R/GLib bindings for RecordBatch::Equals with check_metadata
ARROW-7892 - [Python] Add FileSystemDataset.format attribute
ARROW-7895 - [Python] Remove more python 2.7 cruft
ARROW-7896 - [C++] Refactor from #include guards to #pragma once
ARROW-7897 - [Packaging] Temporarily disable artifact uploading until we fix the deployment issues
ARROW-7898 - [Python] Reduce the number docstring violations using numpydoc
ARROW-7904 - [C++][Python] Revamp metadata display, change show_metadata to verbose_metadata
ARROW-7907 - [Python] Add test case for previously failing code involving slicing a 0-length ChunkedArray
ARROW-7912 - [Format] C data interface
ARROW-7913 - [C++][Python][R] C++ implementation of C data interface
ARROW-7915 - [CI][Python] Enable development mode in tests
ARROW-7916 - [C++] Project IPC batches to materialized fields only
ARROW-7917 - [C++] Find Python 3 in CMake configuration
ARROW-7919 - [R] install_arrow() should conda install if appropriate
ARROW-7920 - [R] Fill in some missing input validation
ARROW-7921 - [Go] Add Reset method to various components and clean up comments.
ARROW-7927 - [C++] Fix 'cpu_info.cc' compilation warning.
ARROW-7929 - [C++] Align CMake target names to upstreams
ARROW-7930 - [CI][Python] Test jpype integration
ARROW-7932 - [Rust] implement array_reader for temporal types
ARROW-7934 - [C++] Fix UriEscape for empty string
ARROW-7935 - [Java] Remove Netty dependency for BufferAllocator and ReferenceManager
ARROW-7937 - [Python][Packaging] Remove boost from the macos wheels
ARROW-7941 - [Rust][DataFusion] Add support for named columns in logical plan
ARROW-7943 - [C++][Parquet] Add code to generate rep/def levels for nested arrays
ARROW-7947 - [Rust][Flight][DataFusion] Implement get_schema example
ARROW-7949 - [Git] Ignore macOS specific file: 'Brewfile.lock.json'
ARROW-7951 - [Python] Expose BYTE_STREAM_SPLIT in pyarrow
ARROW-7959 - [Ruby] Add support for Ruby 2.3 again
ARROW-7963 - [C++][Dataset][Python] Expose Dataset Fragments to Python
ARROW-7965 - [Python] Refine higher level dataset API
ARROW-7966 - [FlightRPC][C++] Validate individual batches in integration
ARROW-7969 - [Packaging] Use cURL to upload artifacts
ARROW-7970 - [Packaging][Python] Use system boost to build the macOS wheels
ARROW-7971 - [Rust] Create rowcount utility
ARROW-7977 - [C++] Rename fs::FileStats to fs::FileInfo
ARROW-7979 - [C++] Add experimental buffer compression to IPC write path. Add "field" selection to read path. Migrate some APIs to Result<T>. Read/write Message metadata
ARROW-7982 - [C++] Add function VisitArrayDataInline() helper
ARROW-7983 - [CI][R] Nightly builds should be more verbose when they fail
ARROW-7984 - [R] Check for valid inputs in more places
ARROW-7986 - [Python] pa.Array.from_pandas cannot convert pandas.Series containing pyspark.ml.linalg.SparseVector
ARROW-7987 - [CI][R] Fix for verbose nightly builds
ARROW-7988 - [R] Fix on.exit calls in reticulate bindings
ARROW-7991 - [C++][Plasma] Allow option for evicting if full when creating an object
ARROW-7993 - [Java] Support decimal type in ComplexCopier
ARROW-7994 - [CI][C++][GLib][Ruby] Move MinGW CI to GitHub Actions from AppVeyor
ARROW-7995 - [C++] Add facility to coalesce and cache reads
ARROW-7998 - [C++][Plasma] Make Seal requests synchronous
ARROW-8005 - [Tools] Update apache mirror links
ARROW-8014 - [C++] Provide CMake targets exercising tests with a label
ARROW-8016 - [Developer] Fix jira-python deprecation warning in merge_arrow_pr.py
ARROW-8018 - [C++][Parquet]Parquet Modular Encryption
ARROW-8024 - [R] Bindings for BinaryType and FixedSizeBinaryType
ARROW-8026 - [Python] Support memoryview as a value type for creating binary-like arrays
ARROW-8027 - [Integration] Add test case for duplicated field names
ARROW-8028 - [Go] Allow duplicate field names in schemas and nested types
ARROW-8030 - [Plasma] Uniform comments style
ARROW-8035 - [Developer][Integration] Add integration tests for extension types
ARROW-8039 - [Python] Use dataset API in existing parquet readers and tests
ARROW-8044 - [CI][NIGHTLY:gandiva-jar-osx] Pin pygit2 at 1.0.3 for OSX
ARROW-8055 - [GLib][Ruby] Add some metadata bindings to GArrowSchema
ARROW-8058 - [Dataset] Relax DatasetFactory discovery validation
ARROW-8059 - [Python] Make FileSystem objects serializable
ARROW-8060 - [Python] Make dataset Expression objects serializable
ARROW-8061 - [C++][Dataset] Provide RowGroup fragments for ParquetFileFormat
ARROW-8063 - [Python][Dataset] Start user guide for pyarrow.dataset
ARROW-8064 - [Dev] Implement Comment bot via Github actions
ARROW-8069 - [C++] Should the default value of "check_metadata" arguments of Equals methods be "true"?
ARROW-8072 - [Plasma] Add const for plasma protocol
ARROW-8077 - [Python][Packaging] Add Windows Python 3.5 wheel build script
ARROW-8079 - [Python] Implement a wrapper for KeyValueMetadata, duck-typing dict where relevant
ARROW-8080 - [C++] Add ARROW_SIMD_LEVEL option
ARROW-8082 - [Plasma] Add JNI list() interface
ARROW-8083 - [GLib] Add support for Peek() to GIOInputStream
ARROW-8086 - [Java] Support writing decimal from big endian byte array in UnionListWriter
ARROW-8087 - [C++][Dataset] Partitioning schema fields follow paths' segment ordering
ARROW-8096 - [C++][Gandiva] fix TreeExprBuilder::MakeNull to create node for interval type
ARROW-8097 - [Dev] Comment bot's crossbow command acts on the master branch
ARROW-8103 - [R] Make default Linux build more minimal
ARROW-8104 - [C++] Don't install bundled Thrift
ARROW-8107 - [Packaging][APT] Use HTTPS for LLVM APT repository for Debian GNU/Linux stretch
ARROW-8109 - [Packaging][APT] Drop support for Ubuntu Disco
ARROW-8117 - [Datafusion][Rust] allow cast SQLTimestamp to Timestamp
ARROW-8118 - [R] dim method for FileSystemDataset
[ARROW-8120](https://issues.ap

Open source →

0.16.07 Feb 2020Security

ARROW-6984 - [C++] Update LZ4 to 1.9.2 for CVE-2019-17543

Bug Fixes

ARROW-3783 - [R] Incorrect collection of float type
ARROW-3962 - [Go] Handle null values in CSV
ARROW-4470 - [Python] Pyarrow using considerable more memory when reading partitioned Parquet file
ARROW-4998 - [R] R package fails to install on OSX
ARROW-5575 - [C++] Split Targets.cmake for each module
ARROW-5655 - [Python] Table.from_pydict/from_arrays not using types in specified schema correctly
ARROW-5680 - [Rust][DataFusion] GROUP BY sql tests are now deterministic
ARROW-6157 - [C++] Array data validation
ARROW-6195 - [C++] Detect Apache mirror without Python
ARROW-6298 - [Rust] [CI] Examples are not being tested in CI
ARROW-6320 - [C++] Arrow utilities are linked statically
ARROW-6429 - [CI][Crossbow] Nightly spark integration job fails
ARROW-6445 - [CI][Crossbow] Nightly Gandiva jar trusty job fails
ARROW-6567 - [Rust][DataFusion] Wrap aggregate in projection when needed
ARROW-6581 - [C++] Fix fuzzit job submission
ARROW-6704 - [C++] Check for out of bounds timestamp in unsafe cast
ARROW-6708 - [C++] Fix hardcoded boost library names
ARROW-6728 - [C#] Support reading and writing Date32 and Date64 arrays
ARROW-6736 - [Rust][DataFusion] Evaluate the input to the aggregate expression just once per batch
ARROW-6740 - [C++] Unmap MemoryMappedFile as soon as possible
ARROW-6745 - [Rust] Fix a variety of minor typos.
ARROW-6749 - [Python] Let Array.to_numpy use general conversion code with zero_copy_only=True
ARROW-6750 - [Python] Silence S3 error logs by default
ARROW-6761 - [Rust] Travis build now uses the correct Rust toolchain
ARROW-6762 - [C++] Support reading JSON files with no newline at end
ARROW-6785 - [JS] Remove superfluous child assignment
ARROW-6786 - [C++] arrow-dataset-file-parquet-test is slow
ARROW-6795 - [C#] Fix for reading large (2GB+) files
ARROW-6798 - [CI] [Rust] Improve build times by caching dependencies in the Docker image
ARROW-6801 - [Rust] Arrow source release tarball is missing benchmarks
ARROW-6806 - [C++][Python] Fix crash validating an IPC-originating empty array
ARROW-6808 - [Ruby] Ensure requiring suitable MSYS2 package
ARROW-6809 - [RUBY] Gem does not install on macOS due to glib2 3.3.7 compilation failure
ARROW-6812 - [Java] Fix License header
ARROW-6813 - [Ruby] Arrow::Table.load with headers=true leads to exception in Arrow 0.15
ARROW-6820 - [Format] Update Map type child to "entries"
ARROW-6834 - [C++][TRIAGE] Pin gtest version 1.8.1 to unblock Appveyor builds
ARROW-6835 - [Archery][CMake] Restore ARROW_LINT_ONLY cmake option
ARROW-6842 - [Website] Jekyll error building website
ARROW-6844 - [C++][Parquet] Fix regression in reading List types with item name that is not "item"
ARROW-6846 - [C++] Build failures with glog enabled
ARROW-6857 - [C++] Fix DictionaryEncode for zero-chunk ChunkedArray
ARROW-6859 - [CI][Nightly] Disable docker layer caching for CircleCI tasks
ARROW-6860 - [Python][C++] Do not link shared libraries monolithically to pyarrow.lib, add libarrow_python_flight.so
ARROW-6861 - [C++] Fix length/null_count/capacity accounting through Reset and AppendIndices in DictionaryBuilder
ARROW-6864 - [C++] Add compression-related compile definitions before adding any unit tests
ARROW-6867 - [FlightRPC][Java] clean up default executor
ARROW-6868 - [Go] Fix slicing struct arrays
ARROW-6869 - [C++] Do not return invalid arrays from DictionaryBuilder::Finish when reusing builder. Add "FinishDelta" method and "ResetFull" method
ARROW-6873 - [Python] Remove stale CColumn references
ARROW-6874 - [Python] Fix memory leak when converting to Pandas object data
ARROW-6876 - [C++][Parquet] Use shared_ptr to avoid copying ReaderContext struct, fix performance regression with reading many columns
ARROW-6877 - [C++] Add additional Boost versions to support 1.71 and the presumed next 2 future versions
ARROW-6878 - [Python] Fix creating array from list of dicts with bytes keys
ARROW-6882 - [C++] Ensure the DictionaryArray indices has no dictionary data
ARROW-6885 - [Python] Remove superfluous skipped timedelta test
ARROW-6886 - [C++] Fix arrow::io nvcc compiler warnings
ARROW-6898 - [Java][hotfix] fix ArrowWriter memory leak
ARROW-6898 - [Java] Fix potential memory leak in ArrowWriter and several test classes
ARROW-6899 - [Python] Decode dictionary-encoded List children to dense when converting to pandas
ARROW-6901 - [Rust][Parquet] Increment total_num_rows when closing a row group
ARROW-6903 - [Python] Attempt to fix Python wheels with introduction of libarrow_python_flight, disabling of pyarrow.orc
ARROW-6905 - [Gandiva][Crossbow] Use xcode9.4 for osx builds, do not build dataset, filesystem
ARROW-6910 - [C++][Python] Set jemalloc default configuration to release dirty pages more aggressively back to the OS dirty_decay_ms and muzzy_decay_ms to 0 by default, add C++ / Python option to configure this
ARROW-6913 - [R] Potential bug in compute.cc
ARROW-6914 - [CI] docker-clang-format nightly failing
ARROW-6922 - [Python] Compat with pandas for MultiIndex.levels.names
ARROW-6925 - [C++] Only add -stdlib flag on MacOS when using clang.
ARROW-6929 - [C++] Remove first offset==0 check from Validate()
ARROW-6937 - [Packaging][Python] Fix conda linux and OSX wheel nightly builds
ARROW-6938 - [Packaging][Python] Disable bz2 in Windows wheels and build ZSTD in bundled mode to triage linking issues
ARROW-6948 - [Rust][Parquet] Fix boolean array in arrow reader.
ARROW-6950 - [C++][Dataset] Add dataset benchmark example
ARROW-6957 - [CI][Crossbow] Nightly R with sanitizers build fails installing dependencies
ARROW-6962 - [C++][CI] Stop compiling with -Weverything
ARROW-6966 - [Go] Set a default memset for when the platform doesn't set one
ARROW-6977 - [C++] Disable jemalloc background_thread on macOS
ARROW-6983 - [C++] Fix ThreadedTaskGroup lifetime issue
ARROW-6989 - [Python] Check for out of range precision decimals in python conversion
ARROW-6992 - [C++] : Undefined Behavior sanitizer build option fails with GCC
ARROW-6999 - [Python] Fix unnamed index when specifying schema in Table.from_pandas
ARROW-7013 - [C++] arrow-dataset pkgconfig is incomplete
ARROW-7020 - [Java] Fix the bugs when calculating vector hash code
ARROW-7021 - [Java] UnionFixedSizeListWriter decimal type should check writer index
ARROW-7022 - , ARROW-7023: [Python] fix handling of pandas Index and Period/Interval extension arrays in pa.array
ARROW-7023 - [Python] pa.array does not use "from_pandas" semantics for pd.Index
ARROW-7024 - [CI][R] Update R dependencies for Conda build
ARROW-7027 - [Python] Correctly raise error in pa.table(..) on invalid input
ARROW-7033 - [C++] Set SDKROOT automatically on macOS
ARROW-7045 - [R] Preserve factor in Parquet roundtrip
ARROW-7050 - [R] Fix compiler warnings in R bindings
ARROW-7053 - [Python] setuptools-scm produces incorrect version at apache-arrow-0.15.1 tag
ARROW-7056 - [Python] Fix test_fs failures when S3 not enabled
ARROW-7059 - [C++][Parquet] Mostly fix performance regression when reading Parquet file with many columns
ARROW-7074 - [C++] ASSERT_OK_AND_ASSIGN should use ASSERT_OK instead of EXPE…
ARROW-7077 - [C++] Casting dictionary to unrelated value type shouldn't crash
ARROW-7087 - [Python] Metadata disappear from pandas dataset
ARROW-7097 - [Rust][CI] Apply rustfmt nightly
ARROW-7100 - [C++][HDFS] Fix search directories for libjvm.so
ARROW-7105 - [CI][Crossbow] Nightly homebrew-cpp job fails
ARROW-7106 - [Java] Fix the problem that flight perf test hangs endlessly
ARROW-7117 - [C++][CI] Fix the hanging C++ tests in Windows 2019
ARROW-7128 - [CI] Use proper version for fedora tests in GitHub actions cron jobs
ARROW-7133 - [CI] Allow GH Actions to run on all branches
ARROW-7142 - [C++] GCC compilation failures in nightlies
ARROW-7152 - [Java] Delete useless class DiffFunction
ARROW-7157 - [R] Add validation, helpful error message to Object$new()
ARROW-7158 - [C++] Use compiler information provided by CMake
ARROW-7163 - [Doc] Fix double-and typos
ARROW-7164 - [CI] Dev cron github action is failing every 15 minutes
ARROW-7167 - [CI][Python] Add nightly tests for additional pandas versions to Github Actions
ARROW-7168 - [Python] Respect the specified dictionary type for pd.Categorical conversion
ARROW-7170 - [C++] Fix linking with bundled ORC
ARROW-7180 - [CI] Java builds are not triggered on the master branch
ARROW-7181 - [C++] Fix an Arrow module search bug with pkg-config
ARROW-7183 - [CI][Crossbow] Re-skip r-sanitizer nightly tests
ARROW-7187 - [C++][Doc] doxygen broken on master because of @
ARROW-7188 - [C++][Doc] doxygen broken on master: missing param implicit_casts
ARROW-7189 - [CI][Crossbow] Nightly conda osx builds fail
ARROW-7194 - [Rust] Fix CSV writer recursion issues
ARROW-7199 - [Java] Fix ConcurrentModificationException in BaseAllocator::getChildAllocators
ARROW-7200 - [C++][Flight] Enable the server to serve to remote clients
ARROW-7209 - [Python] Fix tests on pandas master related to extension dtype conversion
ARROW-7212 - [Go] add missing Release to benchmark code
ARROW-7214 - [Python] Fix pickling of DictionaryArray
ARROW-7217 - [CI][Python] Use correct python version in Github Actions
ARROW-7225 - [C++] Fix *std::move(Result<T>) for move-only T
ARROW-7249 - [CI] Release test fails in master due to new arrow-flight Rust crate
ARROW-7250 - [C++] Define constexpr symbols explicitly in StringToFloatConverter::Impl
ARROW-7253 - [CI] Fix failure in release test
ARROW-7254 - [Java] BaseVariableWidthVector#setSafe appears to make value offsets inconsistent
ARROW-7264 - [Java] RangeEqualsVisitor type check is not correct
ARROW-7266 - [C++] Fix ArrayDataVisitor on sliced binary-like array
ARROW-7271 - [C++][Flight] Use the single parameter version of SetTotalBytesLimit
ARROW-7281 - [C++] Make Adaptive builders' length match expectations
ARROW-7282 - [Python] IO functions should raise the right exceptions
ARROW-7291 - [Dev] Fix FORMAT_DIR
ARROW-7294 - [Python] converted_type_name_from_enum(): Incorrect name for INT_64
ARROW-7295 - [R] Fix bad test that causes failure on R < 3.5
ARROW-7298 - [C++] Fix thirdparty dependency downloader script
ARROW-7314 - [Python] Fix compiler warning in pyarrow.union
ARROW-7318 - [C#] TimestampArray serialization failure
ARROW-7320 - [C++] Specify CMAKE_INSTALL_LIBDIR for gbenchmark
ARROW-7327 - [CI] Failing C GLib and R buildbot builders
ARROW-7328 - [CI] GitHub Actions should trigger on changes to GitHub Actions configuration
ARROW-7341 - [CI] Unbreak nightly Conda R job
ARROW-7343 - [Java][FlightRPC] prevent leak in DoGet
ARROW-7349 - [C++] Fix the bug of parsing string hex values
ARROW-7353 - [C++] Ignore -Wmissing-braces when building with clang
ARROW-7354 - [C++] Fix crash in test-io-hdfs
ARROW-7355 - [CI] Environment variables are defined twice for the fuzzit builds
ARROW-7358 - [CI] [Dev] [C++] ccache disabled on conda-python-hdfs
ARROW-7359 - [C++][Gandiva] Don't throw error for locate function for start position exceeding string length
ARROW-7360 - [R] Can't use dplyr filter() with variables defined in parent scope
ARROW-7361 - [Rust] Build directory is not passed to ci/scripts/rust_test.sh
ARROW-7362 - [Python][C++] Added ListArray.Flatten() that properly flattens a ListArray
ARROW-7374 - [Dev][C++] Fix cuda-cpp docker build
ARROW-7381 - [C++] Unbreak manylinux1 wheels after Iterator refactor
ARROW-7386 - [C#] Array offset does not work properly
ARROW-7388 - [Python] Skip HDFS tests if libhdfs cannot be located
ARROW-7389 - [Python][Packaging] Remove pyarrow.s3fs import check from the recipe
ARROW-7393 - [Plasma] Fix plasma executable name in plasma_java build
ARROW-7395 - [C++] Do not warn or error on logical "or" with constants
ARROW-7397 - [C++][JSON] Fix white space length detection error
ARROW-7404 - [C++][Gandiva] Fix utf8 char length error on Arm64
ARROW-7406 - [Java] NonNullableStructVector#hashCode should pass hasher to child vectors
ARROW-7407 - [Python] Declare NumPy a PEP517 build dependency
ARROW-7408 - [C++] Fix compilation of reference benchmarks
ARROW-7435 - [C++] Validate all list / binary offsets in ValidateFull()
ARROW-7436 - [Archery] Enable more benchmark binaries in archery benchmark
ARROW-7437 - [Java] ReadChannel#readFully does not set writer index correctly
ARROW-7442 - [Ruby] Add abstract type check to Arrow::DataType.resolve
ARROW-7447 - [Java] ComplexCopier does incorrect copy in some cases
ARROW-7450 - [C++] Also link boost_filesystem when using static test linkage
ARROW-7458 - [GLib] Fix incorrect build dependency in Makefile
ARROW-7471 - [CI][Python] Run flake8 on Cython files
ARROW-7472 - [Java] Fix some incorrect behavior in UnionListWriter
ARROW-7478 - [Rust][DataFusion] Group by expression ignored unless paired with aggregate expression
ARROW-7492 - [CI][Crossbow] Nightly homebrew-cpp job fails on Python installation
ARROW-7497 - [Python] Stop relying on (deprecated) pandas.util.testing, move to pandas.testing
ARROW-7500 - [C++][Dataset] Remove std::regex usage
ARROW-7503 - [Rust][Parquet] Fix build failures
ARROW-7506 - [Java] JMH benchmarks should be called from main methods
ARROW-7508 - [C#] DateTime32 Reading is Broken
ARROW-7510 - [C++] Make ArrayData::null_count thread-safe
ARROW-7516 - [C#] Fix .NET Benchmarks
ARROW-7518 - [Python] Use PYARROW_WITH_HDFS when building wheels, conda packages
ARROW-7527 - [Python] Fix pandas/feather tests for unsupported types with pandas master
ARROW-7528 - [Python] Remove usage of deprecated pd.np and pd.datetime in tests
ARROW-7535 - [C++] Fix ASAN failures in Array::Validate()
ARROW-7543 - [R] Fixes R arrow::write_parquet() documentation code examples
ARROW-7545 - [C++] [Dataset] Scanning dataset with dictionary type hangs
ARROW-7551 - [FlightRPC][C++] Flight test on macOS fails due to Homebrew gRPC
ARROW-7552 - [C++][CI] Disable timing-sensitive tests on public CI
ARROW-7554 - [C++] Add support for building on FreeBSD
ARROW-7559 - [Rust] Incorrect index check assertion in StringArray and BinaryArray
ARROW-7561 - [Doc][Python] Add missing conda_env_gandiva.yml in python.rst
ARROW-7563 - [Rust] failed to select a version for `byteorder`
ARROW-7582 - [Rust][Flight] Unable to compile arrow.flight.protocol.rs
ARROW-7583 - [FlightRPC][C++] relax auth tests due to nondeterminism
ARROW-7591 - [Python] Fix DictionaryArray.to_numpy() to return decoded numpy array
ARROW-7592 - [C++] Fix crashes on corrupt IPC input
ARROW-7593 - [CI][Python] Python datasets failing / not run on CI
ARROW-7595 - [R][CI] R appveyor job fails due to pacman compression change
ARROW-7596 - [Python] Only permit zero-copy DataFrame block construction when split_blocks=True
ARROW-7599 - [Java] Fix build break due to change in RangeEqualsVisitor
ARROW-7603 - [Packaging][RPM] Add workaround for LLVM on CentOS 8
ARROW-7611 - [Packaging][Python] Fix artifacts patterns for wheel
ARROW-7612 - [Packaging][Python] Fix artifacts path for Conda on Windows
ARROW-7614 - [Python] Limit size of data in test_parquet.py::test_set_data_page_size
ARROW-7618 - [C++] Fix crashes or undefined behaviour on corrupt IPC input
ARROW-7620 - [Rust] Remove call to flatc
ARROW-7621 - [Doc] Fix doc build
ARROW-7634 - [Python] Run pyarrow.dataset tests on Appveyor + fix failures to parse Windows file paths
ARROW-7638 - [C++][Dataset] Fix a segfault in DirectoryPartitioningFactory
ARROW-7639 - [R] Cannot convert Dictionary Array to R when values aren't strings
ARROW-7640 - [C++][Dataset][Parquet] Detect missing compression support
ARROW-7647 - [C++] Repair JSON parser's handling of ListArrays
ARROW-7650 - [C++][Dataset] enable dataset tests on Windows
ARROW-7651 - [CI][Crossbow] Nightly macOS wheel builds fail
ARROW-7652 - [Python][Dataset] Use implicit cast in ScannerBuilder.filter
ARROW-7661 - [Python] Test for optimal CSV chunking
ARROW-7689 - [FlightRPC][C++] bump bundled gRPC to 1.25 to fix MacOS test failure
ARROW-7690 - [R] Cannot write parquet to OutputStream
ARROW-7693 - [CI] Fix test name for Spark integration, add new tests
ARROW-7709 - [Python] Preserve column name in conversion from Table column to pandas for non-ns timestamps
ARROW-7714 - [Release] Add missing variable expansion
ARROW-7718 - [Release] Fix auto-retry in the binary release script
ARROW-7723 - [Python] Triage untested functional regression when converting tz-aware timestamp inside struct to pandas/NumPy format
ARROW-7727 - [Python] Unable to read a ParquetDataset when schema validation is on.
ARROW-8135 - [Python] Problem importing PyArrow on a cluster
ARROW-8638 - Arrow Cython API Usage Gives an error when calling CTable API Endpoints
PARQUET-1692 - [C++] Don't use the same CMake variable name for thirdparty version and found version
PARQUET-1692 - [C++] LogicalType::FromThrift error on Centos 7 RPM
PARQUET-1693 - [C++] Fix parquet examples with compression define guards
PARQUET-1702 - [C++] Make BufferedRowGroupWriter compatible with parquet encryption
PARQUET-1706 - [C++] Wrong dictionary_page_offset when writing only data pages via BufferedPageWriter
PARQUET-1707 - [C++] : parquet-arrow-test fails with UBSAN
PARQUET-1709 - [C++] Avoid unnecessary temporary std::shared_ptr copies
PARQUET-1715 - [C++] Add the Parquet code samples to CI + Refactor Parquet Encryption Samples
PARQUET-1720 - [C++] JSONPrint not showing version correctly
PARQUET-1747 - [C++] Access to ColumnChunkMetaData fails when encryption is on
PARQUET-1766 - [C++] Handle parquet::Statistics NaNs and -0.0f as per upstream parquet-mr
PARQUET-1772 - [C++] ParquetFileWriter: Data overwritten in append mode

New Features and Improvements

ARROW-412 - [Format][Documentation] Clarify that Buffer.size in Flatbuffers should reflect the actual memory size rather than the padded size
ARROW-501 - [C++] Implement concurrent / buffering InputStream for streaming data use cases
ARROW-772 - [C++] Implement take kernel functions
ARROW-843 - [C++][Dataset] Ensure Schemas are unified in DataSourceDiscovery
ARROW-976 - [C++][Python] Provide API for defining and reading Parquet datasets with more ad hoc partition schemes
ARROW-1036 - [C++] Define abstract API for filtering Arrow streams (e.g. predicate evaluation)
ARROW-1119 - [Python/C++] Implement NativeFile interfaces for Amazon S3
ARROW-1175 - [Java] Implement/test dictionary-encoded subfields
ARROW-1456 - [Python] Run s3fs unit tests in Travis CI
ARROW-1562 - [C++] Numeric kernel implementations for add
ARROW-1638 - [Java] IPC roundtrip for null type
ARROW-1900 - [C++] Add kernel for min / max
ARROW-2428 - [Python] Support pandas ExtensionArray in Table.to_pandas conversion
ARROW-2602 - [Packaging] Automate build of development docker containers
ARROW-2863 - [Python] Add context manager APIs to RecordBatch*Writer/Reader classes
ARROW-3085 - [Rust] Add an adapter for parquet.
ARROW-3408 - [C++] Add CSV option to automatically attempt dict encoding
ARROW-3444 - [Python] Add Array/ChunkedArray/Table nbytes attribute
ARROW-3706 - [Rust] Add record batch reader trait.
ARROW-3789 - [Python] Use common conversion path for Arrow to pandas.Series/DataFrame. Zero copy optimizations for DataFrame, add split_blocks and self_destruct options
ARROW-3808 - [R] Array extract, including Take method
ARROW-3813 - [R] lower level construction of Dictionary Arrays
ARROW-4059 - [Rust] Parquet/Arrow Integration
ARROW-4091 - [C++] Curate default list of CSV null spellings
ARROW-4208 - [CI/Python] Have automatized tests for S3
ARROW-4219 - [Rust][Parquet] Initial support for arrow reader.
ARROW-4223 - [Python] Support scipy.sparse integration
ARROW-4224 - [Python] Support integration with pydata/sparse library
ARROW-4225 - [Format][C++] Add CSC sparse matrix support
ARROW-4722 - [C++] Implement Bitmap class to modularize handling of bitmaps
ARROW-4748 - [Rust][DataFusion] Optimize GROUP BY aggregate queries
ARROW-4930 - [C++] Improve find_package() support
ARROW-5180 - [Rust] IPC Support
ARROW-5181 - [Rust] Initial support for Arrow File reader
ARROW-5182 - [Rust] Arrow IPC file writer
ARROW-5227 - [Rust] [DataFusion] Re-implement query execution with an extensible physical query plan
ARROW-5277 - [C#] MemoryAllocator.Allocate(length: 0) doesn't return null
ARROW-5333 - [C++] Clamp build option summary width to 90
ARROW-5366 - [Rust] Duration and Interval Arrays
ARROW-5400 - [Rust] Test/ensure that reader and writer support zero-length record batches
ARROW-5445 - [Website] Remove language that encourages pinning a version
ARROW-5454 - [C++] Implement Take on ChunkedArray for DataFrame use
ARROW-5502 - [R] file readers should mmap
ARROW-5508 - [C++] Create reusable Iterator<T> interface
ARROW-5523 - [Python][Packaging] Use HTTPS consistently for downloading wheel dependencies
ARROW-5712 - [C++][Parquet] Arrow time32/time64/timestamp ConvertedType not being restored properly
ARROW-5767 - [Format] Permit dictionary replacements in IPC protocol
ARROW-5801 - [CI] Dockerize (add to docker-compose) all Travis CI Linux tasks
ARROW-5802 - [CI][Archery] Dockerify lint utilities
ARROW-5804 - [C++] Dockerize C++ CI job with conda-forge toolchain, code coverage from Travis CI
ARROW-5805 - [Python] Dockerize (add to docker-compose) Python Travis CI job
ARROW-5806 - [CI] Dockerize (add to docker-compose) Integration tests Travis CI entry
ARROW-5807 - [JS] Dockerize NodeJS Travis CI entry
ARROW-5808 - [GLib][Ruby] Dockerize (add to docker-compose) current GLib + Ruby Travis CI entry
ARROW-5809 - [CI][Rust] Travis runs dockerized Rust build
ARROW-5810 - [Go] Dockerize Travis CI Go build
ARROW-5831 - [Release] Add Python program to download binary artifacts in parallel, allow abort/resume
ARROW-5839 - [Python] Test manylinux2010 in CI
ARROW-5855 - [Python] Support for Duration (timedelta) type
ARROW-5859 - [Python] Support ExtensionArray.to_numpy using storage array
ARROW-5971 - [Website] Blog post introducing Arrow Flight
ARROW-5994 - [CI] [Rust] Create nightly releases of the Rust implementation
ARROW-6003 - [C++] Better input validation and error messaging in CSV reader
ARROW-6074 - [FlightRPC][Java] Middleware
ARROW-6091 - [Rust][DataFusion] Implement physical execution plan for LIMIT
ARROW-6109 - [Integration] Docker image for integration testing can't be built on windows
ARROW-6112 - [Java] Support int64 buffer lengths in Java
ARROW-6184 - [Java] Provide hash table based dictionary encoder
ARROW-6251 - [Developer] Add PR merge tool to apache/arrow-site
ARROW-6257 - [C++] Add fnmatch compatible globbing function
ARROW-6274 - [Rust][DataFusion] Add support for writing results to CSV
ARROW-6277 - [C++][Parquet] Support direct DictionaryArray write of all parquet types
ARROW-6283 - [Rust][DataFusion] Implement Context::write_csv to write partitioned CSV results
ARROW-6285 - [GLib] Add support for LargeBinary and LargeString types
ARROW-6286 - [GLib] Add support for LargeList type
ARROW-6299 - [C++] Simplify FileFormat classes to singletons
ARROW-6321 - [Python] Ability to create ExtensionBlock on conversion to pandas
ARROW-6340 - [R] Implements low-level bindings to Dataset classes
ARROW-6341 - [Python] Implement low-level bindings for Dataset
ARROW-6352 - [Java] Add implementation of DenseUnionVector
ARROW-6367 - [C++][Gandiva] Implement string reverse
ARROW-6378 - [C++][Dataset] Implement recursive TreeDataSource
ARROW-6386 - [C++][Documentation] Explicit documentation of null slot interpretation
ARROW-6394 - [Java] Support conversions between delta vector and partial sum vector
ARROW-6396 - [C++] Add overloads of Boolean kernels implementing Kleene logic
ARROW-6398 - [C++] Consolidate ScanOptions and ScanContext
ARROW-6405 - [Python] Add std::move wrapper for use in Cython
ARROW-6452 - [Java] Override ValueVector toString() method
ARROW-6463 - [C++][Python] Rename arrow::fs::Selector to FileSelector
ARROW-6466 - [Integration][CI] Move integration test code to archery integration command. Dockerize integration tests
ARROW-6468 - [C++] Remove unused hashing routines
ARROW-6473 - Dictionary encoding format clarifications/future proofing
ARROW-6503 - [C++] Add an argument of memory pool object to SparseTensorConverter
ARROW-6508 - [C++] Add Tensor and SparseTensor factory function with validations
ARROW-6515 - [C++] Clean type_traits.h definitions
ARROW-6578 - [C++] Allow casting number to string
ARROW-6592 - [Java] Add support for skipping decoding of columns/field in Avro converter
ARROW-6594 - [Java] Support logical type encodings from Avro
ARROW-6598 - [Java] Sort the code for ApproxEqualsVisitor and provide an interface for custom vector equality
ARROW-6608 - [C++] Make default for ARROW_HDFS to be OFF
ARROW-6610 - [C++] Add cmake option to disable filesystem layer
ARROW-6611 - [C++] Make ARROW_JSON=OFF the default
ARROW-6612 - [C++] Add ARROW_CSV CMake build flag
ARROW-6619 - [Ruby] Add support for building Gandiva::Expression by Arrow::Schema#build_expression
ARROW-6624 - [C++][Python] Add SparseTensor.ToTensor() method
ARROW-6625 - [C++][Python] Allow concat_tables to null fill missing columns
ARROW-6631 - [C++] Do not build any compression libraries by default in C++ build
ARROW-6632 - [C++] Do not build with ARROW_COMPUTE=on and ARROW_DATASET=on by default
ARROW-6633 - [C++] Vendor double-conversion library
ARROW-6634 - [C++][FOLLOWUP] Remove Flatbuffers EP remnants from C++ Dockerfiles
ARROW-6634 - [C++] Vendor Flatbuffers and check in compiled sources
ARROW-6635 - [C++] Disable glog integration by default
ARROW-6636 - [C++] Do not build command line tools by default
ARROW-6637 - [Packaging][FOLLOWUP] Enable necessary components in Autobrew build for R
ARROW-6637 - [C++] Further streamline default build, add ARROW_CSV CMake option
ARROW-6646 - [Go] Write no IPC buffer metadata for NullType
ARROW-6650 - [Rust][Integration] Compare integration JSON with schema & batch
ARROW-6656 - [Rust][Datafusion] Add MAX, MIN expressions
ARROW-6657 - [Rust][DataFusion] Add Count Aggregate Expression
ARROW-6658 - [Rust][Datafusion] Implement AVG expression
ARROW-6659 - [Rust][DataFusion] Refactor of HashAggregateExec to support custom merge
ARROW-6662 - [Java] Implement equals/approxEquals API for VectorSchemaRoot
ARROW-6671 - [C++][Python] Use more consistent names for sparse tensor items
ARROW-6672 - [Java] Extract a common interface for dictionary builders
ARROW-6685 - [C++] Ignore trailing slashes in S3FS
ARROW-6686 - [CI] Pull and push docker images to speed up the nightly builds
ARROW-6688 - [Packaging] Include s3 support in the conda packages
ARROW-6690 - [Rust][DataFusion] Optimize aggregates without GROUP BY to use SIMD
ARROW-6692 - [Rust][DataFusion] Update examples to use physical query plan
ARROW-6693 - [Rust] [DataFusion] Update unit tests to use physical query plan
ARROW-6694 - [Rust][DataFusion] Integration tests now use physical query plan
ARROW-6695 - [Rust][DataFusion] Remove legacy code for executing logical plan
ARROW-6696 - [Rust][DataFusion] Implement simple math operations in physical query plan
ARROW-6700 - [Rust][DataFusion] Use new Arrow Parquet reader
ARROW-6707 - [Java] Improve the performance of JDBC adapters by using nullable information
ARROW-6710 - [Java] Add JDBC adapter test to cover cases which contains some null values
ARROW-6711 - [C++] Consolidate Filter and Expression
ARROW-6721 - [JAVA] Avro adapter benchmark only runs once in JMH
ARROW-6722 - [Java] Provide a uniform way to get vector name
ARROW-6729 - [C++] Prevent data copying in StlStringBuffer
ARROW-6730 - [CI] Use GitHub Actions for "C++ with clang 7" docker image
ARROW-6731 - [CI] [Rust] Set up Github Action to run Rust tests
ARROW-6732 - [Java] Implement quick sort in a non-recursive way to avoid stack overflow
ARROW-6741 - [Release] Update changelog.py to use APACHE_ prefixed JIRA_USERNAME and JIRA_PASSWORD environment variables
ARROW-6742 - [C++] Remove boost::filesystem dependency in hdfs_internal.cc
ARROW-6743 - [C++] Remove usage of boost::filesystem
ARROW-6744 - [Rust] Publicly expose JsonEqual
ARROW-6754 - [C++] Merge allocator.h into stl.h
ARROW-6758 - [Developer] Install local NodeJS via nvm when running release verification
ARROW-6764 - [C++] Create a readahead iterator
ARROW-6767 - [JS] Lazily bind batches in scan/scanReverse
ARROW-6768 - [C++][Dataset] Add method to convert from Scanner to Table
ARROW-6769 - [Dataset][C++] End to end test
ARROW-6770 - [CI][Travis] Download Minio quietly
ARROW-6777 - [GLib][CI] Unpin gobject-introspection gem
ARROW-6778 - [C++] Support cast for DurationType
ARROW-6782 - [C++] Do not require Boost for minimal C++ build
ARROW-6784 - [C++][R] Move filter and take for ChunkedArray, RecordBatch, and Table from Rcpp to C++ library
ARROW-6787 - [CI][C++] Decommission "C++ with clang 7 and system packages" Travis CI job
ARROW-6788 - [CI][Dev] Exercise merge script tests
ARROW-6789 - [Python] Improve ergonomics by automatically boxing Action and Result in do_action RPC
ARROW-6790 - [Release] Enable selected integration tests in release verification
ARROW-6793 - [R] Arrow C++ binary packaging for Linux
ARROW-6797 - [Release] Use a separately cloned arrow-site repository in the website post release script
ARROW-6802 - [Packaging][deb][RPM] Update qemu-user-static package URL
ARROW-6803 - [Rust][DataFusion] Performance optimization for single partition aggregate queries
ARROW-6804 - [CI][Rust] Migrate Travis job to Github Actions
ARROW-6807 - [Java][FlightRPC] Expose gRPC service & client
ARROW-6810 - [Website] Add docs for R package 0.15 release
ARROW-6811 - [R] Assorted post-0.15 release cleanups
ARROW-6814 - [C++] Resolve compiler warnings occurred on release build
ARROW-6822 - [Website] merge_pr.py is published
ARROW-6824 - [Plasma] Allow creation of multiple objects through a single IPC in Plasma Store
ARROW-6825 - [C++] Rework CSV reader IO around readahead iterator
ARROW-6831 - [R] Update R macOS/Windows builds for change in cmake compression defaults
ARROW-6832 - [R] Implement Codec::IsAvailable
ARROW-6833 - [R][CI] Add crossbow job for full R autobrew macOS build
ARROW-6836 - [Format][KeyValue] field to the Footer table in File.fbs
ARROW-6843 - [Website] Disable deploy on pull request
ARROW-6847 - [C++] Add range_expression adapter to Iterator
ARROW-6850 - [Java] Jdbc converter support Null type
ARROW-6852 - [C++] Fix build issue on memory-benchmark
ARROW-6853 - [Java] Support vector and dictionary encoder use different hasher for calculating hashCode
ARROW-6855 - [FlightRPC][C++][Python] Flight middleware for C++/Python
ARROW-6862 - [Developer] Check pull request title
ARROW-6863 - [Java] Provide parallel searcher
ARROW-6865 - [Java] Improve the performance of comparing an ArrowBuf against a byte array
ARROW-6866 - [Java] Improve the performance of calculating hash code for struct vector
ARROW-6879 - [Rust] Add explicit SIMD for sum kernel
ARROW-6880 - [Rust] Add explicit SIMD for min/max kernel
ARROW-6881 - [Rust] Remove "array_ops" in favor of the "compute" sub-module
ARROW-6884 - [Python] Format friendlier message in Python when a server-side RPC handler fails
ARROW-6887 - [Java] Create prose documentation for using ValueVectors
ARROW-6888 - [Java] Support copy operation for vector value comparators
ARROW-6889 - [Java] ComplexCopier enable FixedSizeList type & fix RangeEqualsVisitor StackOverFlow
ARROW-6891 - [Rust][Parquet] utf8 support for arrow reader.
ARROW-6902 - [C++][Compute] Add String/Binary support to Compare kernel
ARROW-6904 - [Python] Add support for MapArray
ARROW-6907 - [Plasma] Allow Plasma to send batched notifications.
ARROW-6911 - [Java] Provide composite comparator
ARROW-6912 - [Java] Extract a common base class for avro converter consumers
ARROW-6916 - [Developer] Sort tasks by name in Crossbow e-mail report
ARROW-6918 - [R] Make docker-compose setup faster
ARROW-6919 - [Python] Expose more builders in Cython
ARROW-6920 - [Packaging] Build python 3.8 wheels
ARROW-6926 - [Python] Support sizeof protocol for Python objects
ARROW-6927 - [C++] Add gRPC version check
ARROW-6928 - [Rust] Add support for FixedSizeListArray
ARROW-6930 - [Java] Create utility class for populating vector values used for test purpose only
ARROW-6932 - [JAVA] incorrect log on known extension type
ARROW-6933 - [Java] Suppor linear dictionary encoder
ARROW-6936 - [Python] Improve error message when unwrapping object fails
ARROW-6942 - [Developer] Add support for Parquet in pull request check by GitHub Actions
ARROW-6943 - [Website] Translate Apache Arrow Flight introduction to Japanese
ARROW-6944 - [Rust] Add String, FixedSizeBinary types
ARROW-6949 - [Java] Fix promotable writer to handle nullvectors
ARROW-6951 - [C++][Dataset] Column projection in ParquetFragment
ARROW-6952 - [C++][Dataset] Implement predicate pushdown with ParqueFileFragment
ARROW-6954 - [Python][CI] Add Python 3.8 to CI matrix
ARROW-6960 - [R] Add lz4 and zstd to R PKGBUILD
ARROW-6961 - [C++][Gandiva] Add string lower function in Gandiva
ARROW-6963 - [Packaging][Wheel][OSX] Use crossbow's command to deploy artifacts from travis builds
ARROW-6964 - [C++][Dataset] Add multithread support to Scanner::ToTable
ARROW-6965 - [C++][Dataset] Optionally expose partition keys as columns
ARROW-6967 - [C++][Dataset] IN, IS_VALID filter expressions
ARROW-6969 - [C++][Dataset] ParquetScanTask defer memory usage
ARROW-6970 - [Packaging][RPM] Add support for CentOS 8
ARROW-6973 - [C++][ThreadPool] Use perfect forwarding in Submit
ARROW-6975 - [C++] Put make_unique in its own header
ARROW-6980 - [R] dplyr backend for RecordBatch/Table
ARROW-6984 - [C++] Update LZ4 to 1.9.2 for CVE-2019-17543
ARROW-6986 - [R] Add basic Expression class
ARROW-6987 - [CI] Travis OSX failing to install sdk headers
ARROW-6991 - [Packaging][deb] Add support for Ubuntu 19.10
ARROW-6994 - [C++] Fix aggressive RSS inflation on macOS when jemalloc background_thread is not enabled
ARROW-6997 - [Packaging][RPM] Add apache-arrow-release
ARROW-7000 - [C++][Gandiva] Handle empty inputs in string upper, lower functions
ARROW-7003 - [Rust] Generate flatbuffers files in docke

Open source →

0.15.05 Oct 2019Deprecated

ARROW-2769 - [Python] Deprecate and rename add_metadata methods

New Features and Improvements

ARROW-453 - [C++] Filesystem implementation for Amazon S3
ARROW-517 - [C++] array comparison, uses D**2 space Myers
ARROW-750 - [Format][C++] Add LargeBinary and LargeString types
ARROW-1324 - [C++] Add support for bundled Boost with MSVC
ARROW-1561 - [C++] Kernel implementations for IsIn
ARROW-1566 - [C++] Implement non-materializing sort kernels
ARROW-1741 - [C++] Add DictionaryArray::CanCompareIndices
ARROW-1786 - [Format] List expected on-wire buffer layouts for each kind of Arrow physical type in specification
ARROW-1789 - [Format] Consolidate specification documents and improve clarity for new implementation authors
ARROW-1875 - [Java] Write 64-bit ints as strings in integration test JSON files
ARROW-2006 - [C++] Add option to trim excess padding when writing IPC messages
ARROW-2431 - [Rust] Schema fidelity
ARROW-2769 - [Python] Deprecate and rename add_metadata methods
ARROW-2931 - [Crossbow] Windows builds are attempting to run linux and osx packaging tasks
ARROW-3032 - [C++] Clean up Numpy-related headers
ARROW-3204 - [R] Enable R package to be made available on CRAN
ARROW-3243 - [C++] Upgrade jemalloc to version 5
ARROW-3246 - [C++][Python][Parquet] Direct writing of DictionaryArray to Parquet columns, automatic decoding to Arrow
ARROW-3325 - [Python][FOLLOWUP] In Python 2.7, a class's doc member is not writable (#5018)
ARROW-3325 - [Python][Parquet] Add "read_dictionary" argument to parquet.read_table, ParquetDataset to enable direct-to-DictionaryArray reads
ARROW-3531 - [Python] add Schema.field() method / deprecate field_by_name
ARROW-3538 - [Python] ability to override the automated assignment of uuid for filenames when writing datasets
ARROW-3579 - [Crossbow] Unintuitive error message when remote branch has not been pushed
ARROW-3643 - [Rust] optimize BooleanBufferBuilder::append_slice
ARROW-3710 - [Crossbow][Python] Run nightly tests against pandas master
ARROW-3772 - [C++][Parquet] Write Parquet dictionary indices directly to DictionaryBuilder rather than routing through dense form
ARROW-3777 - [C++] Add Slow input streams and slow filesystem
ARROW-3817 - [R] Extract methods for RecordBatch and Table
ARROW-3829 - [Python] add arrow_array protocol to support third-party array classes in conversion to Arrow
ARROW-3943 - [R] Write vignette for R package
ARROW-4036 - [C++] Pluggable Status message, by exposing an abstract delegate class.
ARROW-4095 - [C++] Optimize DictionaryArray::Transpose() for trivial transpositions
ARROW-4111 - [Python] Create time types from Python sequences of integers
ARROW-4218 - [Rust][Parquet] Initial support for array reader.
ARROW-4220 - [Python] Add buffered IO benchmarks with simulated high latency, allow duck-typed files in input_stream/output_stream
ARROW-4365 - [Rust][Parquet] Implement arrow record reader.
ARROW-4398 - [C++][Python][Parquet] Improve BYTE_ARRAY PLAIN encoding write performance. Add BYTE_ARRAY write benchmarks
ARROW-4473 - [Website] Add instructions to do a test-deploy of Arrow website and fix bugs
ARROW-4507 - [Format] Create outline and introduction for new document.
ARROW-4508 - [Format] Copy content from Layout.rst to new document.
ARROW-4509 - [Format] Copy content from Metadata.rst to new document.
ARROW-4510 - [Format] copy content from IPC.rst to new document.
ARROW-4511 - [Format][Docs] Revamp Format documentation, consolidate columnar format docs into a more coherent single document. Add Versioning/Stability page
ARROW-4648 - [Doc] Add documentation about C++ file naming
ARROW-4648 - [C++] Use underscores in source file names
ARROW-4649 - [C++/CI/R] Add nightly job that tests the homebrew formula
ARROW-4752 - [Rust] Add explicit SIMD vectorization for the divide kernel
ARROW-4810 - [Format][C++] Add LargeList type
ARROW-4841 - [C++] Add arrowOptions.cmake with options used to build arrow
ARROW-4860 - [C++] Build AWS C++ SDK for Windows in conda-forge
ARROW-5134 - [R][CI] Run nightly tests against multiple R versions
ARROW-5211 - [Format] Missing documentation under `Dictionary encoding` section on MetaData page
ARROW-5216 - [CI] Add Appveyor badge to README
ARROW-5307 - [CI][GLib] Enable GTK-Doc
ARROW-5337 - [C++] Add RecordBatch::field method, possibly deprecate "column"
ARROW-5343 - [C++] Refactor dictionary unification to incremental interface, and use Buffer for transpose map allocations
ARROW-5344 - [C++] Use ArrayDataVisitor in dict-to-anything cast
ARROW-5351 - [Rust] Take kernel
ARROW-5358 - [Rust] Implement equality check for ArrayData and Array
ARROW-5380 - [C++] Fix memory alignment UBSan errors.
ARROW-5439 - [Java] Utilize stream EOS in File format
ARROW-5444 - [Release][Website] After 0.14 release, update what is an "official" release
ARROW-5458 - [C++] Apache Arrow parallel CRC32c computation optimization
ARROW-5480 - [Python] Add unit test asserting specifically that pandas.Categorical roundtrips to Parquet format without special options
ARROW-5483 - [Java] add ValueVector constructors that take Field object
ARROW-5494 - [Python] Create FileSystem bindings
ARROW-5505 - [R] Normalize file and class names, stop masking base R functions, add vignette, improve documentation
ARROW-5527 - [C++] Uses Buffer/Builder in HashTable and MemoTable
ARROW-5558 - [C++] Support Array::View on arrays with non-zero offset
ARROW-5559 - [C++] Add an IpcOptions structure
ARROW-5564 - [C++] Use uriparser from conda-forge
ARROW-5579 - [Java] Shade flatbuffers
ARROW-5580 - [C++][Gandiva] Correct definitions of timestamp functions in Gandiva
ARROW-5588 - [C++] Better support for building union arrays
ARROW-5594 - [C++] add UnionArrays support to Take/Filter kernels
ARROW-5610 - [Python] define extension types in Python
ARROW-5646 - [Crossbow][Documentation] Move the user guide to the Sphinx documentation
ARROW-5681 - [FlightRPC] Add Flight-specific error APIs
ARROW-5686 - [R] Review R Windows CI build
ARROW-5716 - [Developer] Improve merge PR script to attribute multiple authors
ARROW-5717 - [Python] Unify variable dictionaries when converting to pandas
ARROW-5719 - [Java] Support in-place vector sorting
ARROW-5722 - [Rust] Implement Debug for List/Struct/BinaryArray
ARROW-5734 - [Python] Dispatch to Table.from_arrays from pyarrow.table factory function
ARROW-5736 - [Format][C++] Support small bit-width indices in sparse tensor
ARROW-5741 - [JS] Make numeric vector from functions consistent with TypedArray.from
ARROW-5743 - [C++] Add cmake option and macros for enabling large memory tests
ARROW-5746 - [Website] Move website source out of apache/arrow
ARROW-5747 - [C++] Improve CSV header and column names options
ARROW-5758 - [C++][Gandiva][Java] Support casting decimals to varchar and vice versa
ARROW-5762 - [JS] Align Map type impl with the spec
ARROW-5777 - [C++] Add microbenchmark for some Decimal128 operations
ARROW-5778 - [Java] Extract the logic for vector data copying to the super classes
ARROW-5784 - [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in dev/release/02-source.sh
ARROW-5786 - [Release] Use arrow-jni profile to run "mvm release:perform"
ARROW-5788 - [Rust] Use both "path" and "version" for internal dependencies
ARROW-5789 - [C++] Minor fixes for warnings, remove unused ubsan.cc
ARROW-5792 - [Rust] Add TypeVisitor for parquet type.
ARROW-5798 - [Packaging][deb] Update doc architecture
ARROW-5800 - [R] Dockerize R Travis CI tests so they can be run anywhere via docker-compose
ARROW-5803 - [CI] Dockerize C++ with clang 7 Travis CI
ARROW-5812 - [Java] Refactor method name and param type in BaseIntVector
ARROW-5813 - [C++] Fix TensorEquals for different contiguous tensors
ARROW-5814 - [Java] Implement a <Object, int> HashMap for DictionaryEncoder
ARROW-5827 - [C++] Require c-ares CMake config
ARROW-5828 - [C++] Add required Protocol Buffers versions check
ARROW-5830 - [C++] Stop using memcmp in TensorEquals for tensors with float values
ARROW-5832 - [Java] Support search operations for vector data
ARROW-5833 - [C++] Factor out Status-enriching code
ARROW-5834 - [Java] Apply new hash map in DictionaryEncoder
ARROW-5835 - [Java] Support Dictionary Encoding for binary type
ARROW-5841 - [Website] Add 0.14.0 release note
ARROW-5842 - [Java] Revise the semantic of lastSet in ListVector
ARROW-5843 - [Java] Improve the readability and performance of BitVectorHelper#getNullCount
ARROW-5844 - [Java] Support comparison & sort for more numeric types
ARROW-5846 - [Java] Create Avro adapter module and add dependencies
ARROW-5853 - [Python] Expose boolean filter kernel on Array
ARROW-5861 - [Java] Initial implement to convert Avro record with primitive types
ARROW-5862 - [Java] Provide dictionary builder
ARROW-5864 - [Python] Simplify Result class cython wrapper
ARROW-5865 - [Release] Helper script to rebase PRs on master
ARROW-5866 - [C++] Remove duplicate library in cpp/Brewfile
ARROW-5867 - [C++][Gandiva] add support for cast int to decimal
ARROW-5872 - [C++][Gandiva] Support mod(double, double) function in Gandiva
ARROW-5876 - [C++][Python] add basic auth flight proto message to C++ and Python
ARROW-5877 - [FlightRPC] Fix Python<->Java auth issues
ARROW-5880 - [C++][Parquet] Use TypedBufferBuilder instead of ArrayBuilder in writer.cc
ARROW-5881 - [Java] Provide functionalities to efficiently determine if a validity buffer has completely 1 bits/0 bits
ARROW-5883 - [Java] Support dictionary encoding for List and Struct type
ARROW-5888 - [C++][Parquet][Python] Restore timezone metadata when original Arrow schema has been stored in Parquet metadata
ARROW-5891 - [C++][Gandiva] Remove duplicates in function registry
ARROW-5892 - [C++][Gandiva] Support function aliases
ARROW-5893 - [C++][Python][GLib][Ruby][MATLAB][R] Remove arrow::Column class
ARROW-5897 - [Java] Remove duplicated logic in MapVector
ARROW-5898 - [Java] Provide functionality to efficiently compute hash code for arbitrary memory segment
ARROW-5900 - [Java] Bounds check for decimal args.
ARROW-5901 - [Rust] Add equals to json arrays.
ARROW-5902 - [Java] Implement hash table and equals & hashCode API for dictionary encoding
ARROW-5903 - [Java] Optimise set methods in decimal vector
ARROW-5904 - [Java][Plasma] Fix compilation of Plasma Java client
ARROW-5906 - [CI] Turn off ARROW_VERBOSE_THIRDPARTY_BUILD by default in Docker builds
ARROW-5908 - [C#] ArrowStreamWriter doesn't align buffers to 8 bytes
ARROW-5909 - [Java] Optimize ByteFunctionHelpers equals & compare logic
ARROW-5911 - [Java] Make ListVector and MapVector create reader lazily
ARROW-5917 - [Java] Redesign the dictionary encoder
ARROW-5918 - [Java] Add get to BaseIntVector interface
ARROW-5919 - [R] Test R-in-conda as a nightly build
ARROW-5920 - [Java] Support sort & compare for all variable width vectors
ARROW-5924 - [Plasma] return a replica of GpuProcessHandle::ptr when create or get an object
ARROW-5934 - [Python] Bundle arrow's LICENSE with the wheels
ARROW-5937 - [Release] Stop parallel binary upload
ARROW-5938 - [Release] Create branch for adding release note automatically
ARROW-5939 - [Release] Add support for generating vote email template separately
ARROW-5940 - [Release] Add support for re-uploading sign/checksum for binary artifacts
ARROW-5941 - [Release] Avoid re-uploading already uploaded binary artifacts
ARROW-5943 - [GLib][Gandiva] Add support for function aliases
ARROW-5944 - [C++][Gandiva] Remove 'div' alias for 'divide'
ARROW-5945 - [Rust][DataFusion] Table trait can now be used to build real queries
ARROW-5947 - [Rust][DataFusion] Remove serde crate dependency
ARROW-5948 - [Rust] [DataFusion] create_logical_plan should not call optimizer
ARROW-5955 - [Plasma] Support setting memory quotas per plasma client for better isolation
ARROW-5957 - [C++][Gandiva] Implement div function in Gandiva
ARROW-5958 - [Python] Link zlib statically in the wheels
ARROW-5961 - [R] Be able to run R-only tests even without C++ library
ARROW-5962 - [CI][Python] Remove manylinux1 builds from Travis CI
ARROW-5967 - [Java] DateUtility#timeZoneList is not correct
ARROW-5970 - [Java] Provide pointer to Arrow buffer
ARROW-5974 - [C++] Support reading concatenated compressed streams
ARROW-5975 - [C++][Gandiva] support castTIMESTAMP(date)
ARROW-5976 - [C++] RETURN_IF_ERROR(ctx) should be namespaced
ARROW-5977 - [C++][Python] Allow specifying which columns to include
ARROW-5979 - [FlightRPC] Expose opaque (de)serialization of protocol types
ARROW-5985 - [Developer] Do not suggest setting Fix Version for patch releases by default
ARROW-5986 - [Java] Code cleanup for dictionary encoding
ARROW-5988 - [Java] Avro adapter implement simple Record type
ARROW-5997 - [Java] Support dictionary encoding for Union type
ARROW-5998 - [Java] Open a document to track the API changes
ARROW-6000 - [Python] Add support for LargeString and LargeBinary types
ARROW-6008 - [Release] Stop parallel binary artifacts upload
ARROW-6009 - [JS] Ignore NPM errors in the javascript release script
ARROW-6013 - [Java] Support range searcher
ARROW-6017 - [FlightRPC] Enable creating Flight Locations for unknown schemes
ARROW-6020 - [Java] Refactor ByteFunctionHelper#hash with new added ArrowBufHasher
ARROW-6021 - [Java] Extract copyFrom and copyFromSafe methods to ValueVector interface
ARROW-6022 - [Java] Support equals API in ValueVector to compare two vectors equal
ARROW-6023 - [C++][Gandiva] Add functions in Gandiva
ARROW-6024 - [Java] Provide more hash algorithms
ARROW-6026 - [Doc] Add CONTRIBUTING.md
ARROW-6030 - [Java] Efficiently compute hash code for ArrowBufPointer
ARROW-6031 - [Java] Support iterating a vector by ArrowBufPointer
ARROW-6034 - [C++][Gandiva] Add string functions in Gandiva
ARROW-6035 - [Java] Avro adapter support convert nullable value
ARROW-6036 - [GLib] Add support for skip rows and column_names CSV read option
ARROW-6037 - [GLib] Add a missing version macro
ARROW-6039 - [GLib] Add garrow_array_filter()
ARROW-6041 - [Website] Blog post announcing R library availability on CRAN
ARROW-6042 - [C++][Parquet] Add Dictionary32Builder that always returns 32-bit dictionary indices
ARROW-6045 - [C++] Add benchmark for double and float encoding/decoding, as well as NaN encoding
ARROW-6048 - [C++] Add ChunkedArray::View method that dispatches to Array::View
ARROW-6049 - [C++] Support view from one dictionary type to another in Array::View
ARROW-6053 - [Python] Fix pyarrow's RecordBatchStreamReader::Open2 type signature
ARROW-6063 - [FlightRPC] implement half-closed semantics for DoPut
ARROW-6065 - [C++][Parquet] Clean up parquet/arrow/reader.cc, reduce code duplication, improve readability
ARROW-6069 - [Rust][Parquet] Add converter.
ARROW-6070 - [Java] Avoid creating new schema before IPC sending
ARROW-6077 - [C++][Parquet] Build Arrow "schema tree" from Parquet schema to help with nested data implementation
ARROW-6078 - [Java] Implement dictionary-encoded subfields for List type
ARROW-6079 - [Java] Implement/test UnionFixedSizeListWriter for FixedSizeListVector
ARROW-6080 - [Java] Support search operation for BaseRepeatedValueVector
ARROW-6083 - [Java] Refactor Jdbc adapter consume logic
ARROW-6084 - [Python] Support LargeList
ARROW-6085 - [Rust][DataFusion] Add traits for physical query plan
ARROW-6086 - [Rust][DataFusion] Add support for partitioned Parquet data sources
ARROW-6087 - [Rust] [DataFusion] Implement parallel execution for CSV scan
ARROW-6088 - [Rust][DataFusion] Projection execution plan
ARROW-6089 - [Rust][DataFusion] Implement physical plan for "selection" operator
ARROW-6090 - [Rust][DataFusion] Physical plan for HashAggregate
ARROW-6093 - [Java] reduce branches in algo for first match in VectorRangeSearcher
ARROW-6094 - [FlightRPC] Add Flight RPC method getFlightSchema
ARROW-6096 - [C++] conditionally use boost regex for gcc < 4.9
ARROW-6097 - [Java] Avro adapter implement unions type
ARROW-6100 - [Rust] Pin to specific nightly rust for reproducible/stable builds
ARROW-6101 - [Rust][DataFusion] Parallel execution of physical query plan
ARROW-6102 - [Testing] Add partitioned CSV file to arrow-testing repo
ARROW-6104 - [Rust][DataFusion] Remove use of bare trait objects
ARROW-6105 - [C++][Parquet][Python] Add test case showing dictionary-encoded subfields in nested type
ARROW-6113 - [Java] Support vector deduplicate function
ARROW-6115 - [Python] Support LargeBinary and LargeString in conversion to python
ARROW-6118 - [Java] Replace google Preconditions with Arrow Preconditions
ARROW-6121 - [Tools] Improve merge tool ergonomics
ARROW-6125 - [Python] Remove Python APIs deprecated in 0.14.x and prior
ARROW-6127 - [Website] Add favicons and meta tags
ARROW-6128 - [C++] Suppress a class-memaccess warning
ARROW-6130 - [Release] Use 0.15.0 as the next release
ARROW-6134 - [C++][Gandiva] Add concat function in Gandiva
ARROW-6137 - [C++][Gandiva] Use snprintf instead of stringstream in castVARCHAR(timestamp)
ARROW-6137 - [C++][Gandiva] Change output format of castVARCHAR(timestamp) in Gandiva
ARROW-6138 - [C++] Add a basic (single RecordBatch) implementation of Dataset
ARROW-6139 - [Documentation][R] Build R docs (pkgdown) site and add to arrow-site
ARROW-6141 - [C++] Enable memory-mapping a file region
ARROW-6142 - [R] Install instructions on linux could be clearer
ARROW-6143 - [Java] Unify the copyFrom and copyFromSafe methods for all vectors
ARROW-6144 - [C++][Gandiva] Implement random functions in Gandiva
ARROW-6155 - [Java] Extract a super interface for vectors whose elements reside in continuous memory segments
ARROW-6156 - [Java] Support compare semantics for ArrowBufPointer
ARROW-6161 - [C++][Dataset] Implements ParquetFragment
ARROW-6162 - [C++][Gandiva] Do not truncate string in castVARCHAR_utf8 if output length is zero
ARROW-6164 - [Docs][Format] Document project versioning schema and forward/backward compatibility policies
ARROW-6172 - [Java] Provide benchmarks to set IntVector with different methods
ARROW-6177 - [C++] Add Array::Validate()
ARROW-6180 - [C++][Parquet] Add RandomAccessFile::GetStream that returns InputStream that reads a file segment independent of the file's state, fix concurrent buffered Parquet column reads
ARROW-6181 - [R] Only allow R package to install without libarrow on linux
ARROW-6183 - [R] Document that you don't have to use tidyselect if you don't want
ARROW-6185 - [Java] Provide hash table based dictionary builder
ARROW-6187 - [C++] Fallback to storage type when writing ExtensionType to Parquet
ARROW-6188 - [GLib] Add garrow_array_is_in()
ARROW-6192 - [GLib] Use the same SO version as C++
ARROW-6194 - [Java] Add non-static approach in DictionaryEncoder making it easy to extend and reuse
ARROW-6196 - [Ruby] Add support for building Arrow::TimeNNArray by .new
ARROW-6197 - [GLib] Add garrow_decimal128_rescale()
ARROW-6199 - [Java] Avro adapter avoid potential resource leak.
ARROW-6203 - [GLib] Add garrow_array_sort_to_indices()
ARROW-6204 - [GLib] Add garrow_array_is_in_chunked_array()
ARROW-6206 - [Java][Docs] Document environment variables/java properties
ARROW-6209 - [Java] Extract set null method to the base class for fixed width vectors
ARROW-6212 - [Java] Support vector rank operation
ARROW-6216 - [C++][Parquet] Expose codec compression level to user, add to Parquet writer properties
ARROW-6217 - [Website] Remove needless _site/ directory
ARROW-6219 - [Java] Add API for JDBC adapter that can convert less then the full result set at a time
ARROW-6220 - [Java] Add API to avro adapter to limit number of rows returned at a time.
ARROW-6225 - [Website] Update arrow-site/README and any other places to point website contributors in right direction
ARROW-6229 - [C++][Dataset] implement FileSystemBasedDataSource
ARROW-6230 - [R] Reading in Parquet files are 20x slower than reading fst files in R
ARROW-6231 - [C++] Allow generating CSV column names
ARROW-6232 - [C++] Rename Argsort kernel to SortToIndices
ARROW-6237 - [R] Allow compilation flags to be passed for R package with ARROW_R_CXXFLAGS
ARROW-6238 - [C++][Dataset] Implement SimpleDataSource, SimpleDataFragment and SimpleScanTask
ARROW-6240 - [Ruby] Arrow::Decimal128Array#get_value returns BigDecimal
ARROW-6242 - [C++][Dataset] Implement Dataset, Scanner and ScannerBuilder
ARROW-6243 - [C++][Dataset] Filter expressions
ARROW-6244 - [C++][Dataset] Add partition key to DataSource interface
ARROW-6246 - [Website] Add link to R documentation site
ARROW-6247 - [Java] Provide a common interface for float4 and float8 vectors
ARROW-6249 - [Java] Remove useless class ByteArrayWrapper
ARROW-6250 - [Java] Implement ApproxEqualsVisitor comparing approx for floating point
ARROW-6252 - [C++][Python] Add Array::Diff in C++ and Array.diff in Python to return diff as string
ARROW-6253 - [Python] Expose "enable_buffered_stream" option from parquet::ReaderProperties in pyarrow.parquet.read_table
ARROW-6258 - [R] Add macOS build scripts
ARROW-6260 - [Website] Use deploy key on Travis to build and push to asf-site
ARROW-6262 - [Developer] Show JIRA issue before merging
ARROW-6264 - [Java] There is no need to consider byte order in ArrowBufHasher
ARROW-6265 - [Java] Avro adapter implement Array/Map/Fixed type
ARROW-6267 - [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType value
ARROW-6271 - [Rust][DataFusion] Add example for running SQL against Parquet
ARROW-6272 - [Rust][DataFusion] Add register_parquet convenience method to ExecutionContext
ARROW-6278 - [R] Read parquet files from raw vector
ARROW-6279 - [Python] Add Table.slice, getitem support to match RecordBatch, Array, others
ARROW-6284 - [C++] Allow references in std::tuple when converting tuple to arrow array
ARROW-6287 - [Rust][DataFusion] TableProvider.scan() returns thread-safe BatchIterator
ARROW-6288 - [Java] Implement TypeEqualsVisitor comparing vector type equals considering names and metadata
ARROW-6289 - [Java] Add empty() in UnionVector to create instance
ARROW-6292 - [C++] Add option to use the mimalloc allocator
ARROW-6294 - [C++] Use hyphen for plasma-store-server executable
ARROW-6295 - [Rust][DataFusion] ExecutionError Cannot compare Float32 with Float64
ARROW-6296 - [Java] Cleanup JDBC interfaces and eliminate one memcopy for binary/varchar fields
ARROW-6297 - [Java] Compare ArrowBufPointers by unsinged integers
ARROW-6300 - [C++] Add Abort() method to streams
ARROW-6303 - [Rust] Add a feature to disable SIMD
ARROW-6304 - [Java][Doc] Add a description to each module
ARROW-6306 - [Java] Support stable sort by stable comparators
ARROW-6310 - [C++] Write 64-bit integers as strings in JSON integration test files
ARROW-6311 - [Java] Make ApproxEqualsVisitor accept DiffFunction to make it more flexible
ARROW-6313 - [Format] Tracking for ensuring flatbuffer serialized values are aligned in stream/files.
ARROW-6314 - [C#] Implement IPC message format alignment changes, provide backwards compatibility and "legacy" option to emit old message format
ARROW-6314 - [C++] Implement IPC message format alignment changes, provide backwards compatibility and "legacy" option to emit old message format
ARROW-6315 - [Java] Make change to ensure flatbuffer reads are aligned
ARROW-6316 - [Go] implement new ARROW format with 32b-aligned buffers
ARROW-6317 - [JS] Implement IPC message format alignment changes
ARROW-6318 - [Integration] Run tests against pregenerated files
ARROW-6319 - [C++] Move the core of NumericTensor<T>::Value() to Tensor::Value<T>()
ARROW-6326 - [C++] Nullable fields when converting std::tuple to Table
ARROW-6328 - [Developer][crossbow] Click.option-s should have help text
ARROW-6329 - [Format] Add a padding for Flatbuffer alignment, use 8-byte EOS
ARROW-6331 - [Java] Incorporate ErrorProne into the java build
ARROW-6334 - [Java] Improve the dictionary builder API to return the position of the value in the dictionary
ARROW-6335 - [Java] Improve the performance of DictionaryHashTable
ARROW-6336 - [Python] Add notes to pyarrow.serialize/deserialize to clarify that these functions do not read or write the standard IPC protocol
ARROW-6337 - [R] Changed as_tible to as_dataframe in the R package
ARROW-6338 - [R] Type function names don't match type names
ARROW-6342 - [Python] Add pyarrow.record_batch factory function with same basic API / semantics as pyarrow.table
ARROW-6346 - [GLib] Add garrow_array_view()
ARROW-6347 - [GLib] Add garrow_array_diff()
ARROW-6350 - [Ruby] Remove Arrow::Struct and use Hash instead
ARROW-6351 - [Ruby] Improve Arrow#values performance
ARROW-6353 - [Python][C++] Expose compression_level option to parquet.write_table
ARROW-6355 - [Java] Make range equal visitor reusable
ARROW-6356 - [Java] Avro adapter implement Enum type and nested Record
ARROW-6357 - [C++] Issue S3 file writes in the background by default
ARROW-6358 - [C++] Add FileSystem::DeleteDirContents
ARROW-6360 - [R] Update support for compression
ARROW-6362 - [C++] Allow customizing S3 credentials provider
ARROW-6365 - [R] Should be able to coerce numeric to integer with schema
ARROW-6366 - [Java] Make field vectors final explicitly
ARROW-6368 - [C++][Dataset] Add interface for "projecting" RecordBatch from one schema to another, inserting null values where needed
ARROW-6373 - [C++] Make FixedWidthBinaryBuilder consistent with other fixed width builders in zeroing memory when appending null batches
ARROW-6375 - [C++] Extend ConversionTraits to allow efficiently appending list values in STL API
ARROW-6379 - [C++] Write no IPC buffer metadata for NullType
ARROW-6381 - [C++] BufferOutputStream::Write does extra work that slows down small writes
ARROW-6383 - [Java] Report outstanding child allocators on close
ARROW-6384 - [C++] Bump dependency versions
ARROW-6385 - [C++] Use xxh3 instead of custom hashing code for non-tiny strings
ARROW-6391 - [Python][Flight] Add built-in methods on FlightServerBase to start server and wait for it to be available
ARROW-6397 - [C++][CI] Generate minio server connect string
ARROW-6401 - [Java] Implement dictionary-encoded subfields for Struct type
ARROW-6402 - [C++] Suppress sign-compare warning with g++ 9.2.1
ARROW-6403 - [Python] Expose FileReader::ReadRowGroups() to Python
ARROW-6408 - [Rust] use "if cfg!" pattern
ARROW-6413 - [R] Support autogenerating column names
ARROW-6415 - [R] Remove usage of R CMD config CXXCPP
ARROW-6416 - [Python] Improve API & documentation regarding chunksizes
ARROW-6417 - [C++][Parquet] Miscellaneous optimizations yielding slightly better Parquet binary read performance
ARROW-6419 - [Website] Blog post about Parquet dictionary performance work coming in 0.15.x release
ARROW-6422 - [Gandiva] Fix double-conversion linker issue
ARROW-6426 - [FlightRPC][C++][Java] Expose gRPC configuration knobs
ARROW-6427 - [GLib] Add support for column names autogeneration CSV read option
ARROW-6438 - [R] : Add bindings for filesystem API
ARROW-6447 - [C++] Allow rest of arrow_objlib to build in parallel while memory_pool.cc is waiting on jemalloc_ep
ARROW-6450 - [C++] Use 2x reallocation strategy in BufferBuilder instead of 1.5x
ARROW-6451 - [Format] Add clarifications to Columnar.rst about the contents of "null" slots in Varbinary or List arrays
ARROW-6453 - [C++] More informative error messages with S3
ARROW-6454 - [LICENSE] Add LLVM's license due to static linkage
ARROW-6458 - [Java] Remove value boxing/unboxing for ApproxEqualsVisitor
ARROW-6460 - [Java] Add benchmark and large fake data UT for avro adapter
ARROW-6462 - [C++] Fix build error on CentOS 6 x86_64 with bundled double-conversion
ARROW-6465 - [Python] Improvement to Windows build instructions
ARROW-6474 - [Python] Add option to use legacy / pre-0.15 IPC message format and to set the default using PYARROW_LEGACY_IPC_FORMAT environment variable
ARROW-6475 - [C++] Don't try to dictionary encode dictionary arrays
ARROW-6477 - [Packaging][Crossbow] Use Azure Pipelines to build linux packages
ARROW-6480 - [Crossbow] Summary report e-mailer with polling logic
ARROW-6484 - [Java] Enable create indexType for DictionaryEncoding according to dictionary value count
ARROW-6487 - [Rust][DataFusion] Introduce common test module
ARROW-6489 - [Developer][Documentation] Fix merge script and readme
ARROW-6490 - [Java][Memory] Log error for leak in allocator close
ARROW-6491 - [Java][Hotfix] fix master fail caused by ErrorProne
ARROW-6494 - [C++][Dataset] Implement basic PartitionScheme
ARROW-6504 - [Python][Packaging] Add mimalloc to conda packages for better performance
ARROW-6505 - [Website] Add new committers
ARROW-6518 - [Packaging][Python] Flight failing in OSX Python wheel builds
ARROW-6519 - [Java] Use IPC continuation prefix as part of 8-byte EOS
ARROW-6524 - [Developer][Packaging] Nightly build report's subject should contain Arrow
ARROW-6525 - [C++] Avoid aborting in CloseFromDestructor()
ARROW-6526 - [C++] Poison data in debug mode
ARROW-6527 - [C++] Add OutputStream::Write(Buffer)
ARROW-6531 - [Python] Add detach() method to buffered streams
ARROW-6532 - [R] write_parquet() uses writer properties (general and arrow specific)
ARROW-6533 - [R] Compression codec should take a "level"
ARROW-6534 - [Java] Fix typos and spelling
ARROW-6539 - [R] Provide mechanism to write out old format
ARROW-6540 - [R] Add Validate() methods
ARROW-6541 - [Format][C++] Update Columnar.rst for two-part EOS, update C++ implementation
ARROW-6542 - [R] : Add View() method to array types
ARROW-6544 - [R] Documentation/polishing for 0.15 release
ARROW-6545 - [Go] update IPC writer to use two-part EOS
ARROW-6546 - [C++] Add missing FlatBuffers source dependency
ARROW-6549 - [C++] Switch to jemalloc 5.2.x
ARROW-6556 - [Python] Fix warning for pandas SparseDataFrame removal
ARROW-6556 - [Python] Handle future removal of pandas SparseDataFrame
ARROW-6557 - [Python] Always return pandas.Series from Array/ChunkedArray.to_pandas. Add mechanism to preserve "column names" from RecordBatch, Table as Series.name
ARROW-6558 - [C++] Refactor Iterator to type erased handle
ARROW-6559 - [Developer][C++] Add option to pass ARROW_PACKAGE_PREFIX when using 'archery benchmark'
ARROW-6563 - [Rust][DataFusion] MergeExec
ARROW-6569 - [Website] Add support for auto deployment by GitHub Actions
ARROW-6570 - [Python] Use Arrow's allocators for creating NumPy array instead of leaving it to NumPy
ARROW-6580 - [Java] Support comparison for unsigned integers
ARROW-6584 - [Python][Wheel] Bundle zlib again with the windows wheels
ARROW-6588 - [C++] Suppress class-memaccess warning with g++ 9.2.1
ARROW-6589 - [C++] Error propagation, tests for /MakeArray(OfNulls|FromScalar)/
ARROW-6590 - [C++] Do not require ARROW_JSON to build ARROW_IPC when unit tests are off
ARROW-6591 - [R] Ignore .Rhistory files in source control
ARROW-6599 - [Rust][DataFusion] Add aggregate traits and SUM implementation to physical query plan
ARROW-6601 - [Java] Improve JDBC adapter performance & add benchmark
ARROW-6605 - [C++][Filesystem] Add recursion depth control to fs::Selector
ARROW-6606 - [C++] Add PathTree tree structure
ARROW-6609 - [C++] Add Dockerfile for minimal C++ build
ARROW-6613 - [C++] Remove dependency on boost::filesystem
ARROW-6614 - [C++][Dataset] Implement FileSystemDataSourceDiscovery
ARROW-6616 - [Website] Release announcement blog post for 0.15
ARROW-6621 - [Rust][DataFusion] Run DataFusion examples in CI
ARROW-6629 - [Doc][C++] Add filesystem docs
ARROW-6630 - [Doc] Document C++ file formats
ARROW-6644 - [JS] Amend NullType IPC protocol to append no buffers
ARROW-6647 - [C++] Stop using member initializer for shared_ptr
ARROW-6648 - [Go] Expose the bitutil package
ARROW-6649 - [R] print methods for Array, ChunkedArray, Table, RecordBatch
ARROW-6653 - [Developer] Add support for auto JIRA link on pull request
ARROW-6655 - [Python] Filesystem bindings for S3
ARROW-6664 - [C++] Add CMake option to build without SSE4.2 instructions
ARROW-6665 - [Rust][DataFusion] Implement physical expression for numeric literal types
ARROW-6667 - [Python] remove cyclical object references in pyarrow.parquet
ARROW-6668 - [Rust][DataFusion] Implement CAST expression
ARROW-6669 - [Rust][DataFusion] Implement binary expression for physical plan
ARROW-6675 - [JS] Add scanReverse function to dataFrame and filteredDataframe
ARROW-6683 - [Python] Test for fastparquet <-> pyarrow cross-compatibility
ARROW-6725 - [CI] Disable 3rdparty fuzzit nightly builds
ARROW-6735 - [C++] Suppress sign-compare warning with g++ 9.2.1
ARROW-6752 - [Go] implement Stringer for Null array
ARROW-6755 - [Release] Improvements to Windows release verification script
ARROW-6771 - [Packaging][Python] Missing pytest dependency from conda and wheel builds
PARQUET-1468 - [C++] Clean up ColumnReader/internal::RecordReader code duplication

Bug Fixes

ARROW-1184 - [Java] Dictionary.equals is not working correctly
ARROW-2041 - [Python] pyarrow.serialize has high overhead for list of NumPy arrays
ARROW-2248 - [Python] Nightly or on-demand HDFS test builds
ARROW-2317 - [Python] Fix C linkage warning with Cython
ARROW-2490 - [C++] Normalize input stream concurrency
ARROW-3176 - [Python] Overflow in Date32 column conversion to pandas
ARROW-3203 - [C++] Build error on Debian Buster
ARROW-3651 - [Python] Handle 'datetime' logical type when reconstructing pandas columns from custom metadata
ARROW-3652 - [Python][Parquet] Add unit test exhibiting that pandas.CategoricalIndex survives roundtrip to Parquet format
ARROW-3762 - [Python] Add large_memory unit test exercising BYTE_ARRAY overflow edge cases from ARROW-3762
ARROW-3933 - [C++][Parquet] Handle non-nullable struct children when reading Parquet file, better error messages
ARROW-4187 - [C++] Enable file-benchmark on Windows
ARROW-4746 - [C++/Python] PyDataTime_Date wrongly casted to PyDataTime_DateTime
ARROW-4836 - [C++] Support Tell() on compressed streams
ARROW-4848 - [C++] Static libparquet not compiled with -DARROW_STATIC on Windows
ARROW-4880 - [Python] Rehabilitate ASV benchmark build scripts
ARROW-4883 - [Python] read_csv() returns garbage if given file object in text mode
ARROW-5028 - [Python] Avoid malformed ListArray types caused by reaching StringBuilder capacity when converting from Python sequence
ARROW-5072 - [Python] write_table fails silently on S3 errors
ARROW-5085 - [C++][Parquet][Python] Do not allow reading to dictionary type unless we have implemented support for it
ARROW-5086 - [Python][Parquet] Opt in to file memory-mapping when reading Parquet files rather than opting out
ARROW-5089 - [C++/Python] Writing dictionary encoded columns to parquet is extremely slow when using chunk size
ARROW-5103 - [Python] Segfault when using chunked_

Open source →

0.14.04 Jul 2019Deprecated

ARROW-5000 - [Python] Fix 'SO' DeprecationWarning in setup.py

New Features and Improvements

ARROW-258 - [Format] clarify definition of Buffer in context of RPC, IPC, File
ARROW-653 - [Python / C++] Add debugging function to print an array's buffer contents in hexadecimal
ARROW-767 - [C++] Filesystem abstraction
ARROW-835 - [Format][C++][Java] Create a new Duration type
ARROW-840 - [Python] Expose extension types
ARROW-973 - [Website] Add FAQ page
ARROW-1012 - [C++] Configurable batch size for parquet RecordBatchReader
ARROW-1207 - [C++] Implement MapArray, MapBuilder, MapType classes, and IPC support
ARROW-1261 - [Java] Add MapVector with reader and writer
ARROW-1278 - [Integration] Adding integration tests for fixed_size_list
ARROW-1279 - [Integration] Enable MapType integration tests
ARROW-1280 - [C++] add fixed size list type
ARROW-1349 - [Packaging] Provide APT and Yum repositories
ARROW-1496 - [JS] Upload coverage data to codecov.io
ARROW-1558 - [C++] Implement boolean filter (selection) kernel, rename comparison kernel-related functions
ARROW-1587 - [Format] Add metadata for user-defined logical types
ARROW-1774 - [C++] Add Array::View()
ARROW-1833 - [Java] Add accessor methods for data buffers that skip null checking
ARROW-1957 - [Python] Write nanosecond timestamps using new NANO LogicalType Parquet unit
ARROW-1983 - [C++][Parquet] Add AppendRowGroups and WriteMetaDataFile methods
ARROW-2057 - [Python] Expose option to configure data page size threshold in parquet.write_table
ARROW-2102 - [C++] Implement Take kernel
ARROW-2103 - [C++] Implement take kernel functions - string/binary value type
ARROW-2104 - [C++] take kernel functions for nested types
ARROW-2105 - [C++] Implement take kernel functions - properly handle special indices
ARROW-2186 - [C++] Clean up architecture specific compiler flags
ARROW-2217 - [C++] Add option to use dynamic linking for compression library dependencies
ARROW-2298 - [Python] Add unit tests to assert that float64 with NaN values can be safely coerced to integer types when converting from pandas
ARROW-2412 - [Integration] Add nested dictionary test case, skipped for now
ARROW-2467 - [Rust] Add generated IPC code
ARROW-2517 - [Java] Add list<decimal> writer
ARROW-2618 - [Rust] Bitmap constructor should accept for flag for default state (0 or 1)
ARROW-2667 - [C++/Python] Add pandas-like take method to Array
ARROW-2707 - [C++] Add Table::Slice
ARROW-2709 - [Python] write_to_dataset poor performance when splitting
ARROW-2730 - [C++] Set up CMAKE_C_FLAGS more thoughtfully instead of using CMAKE_CXX_FLAGS
ARROW-2796 - [C++] Simplify version script used for linking
ARROW-2818 - [Python] Better error message when trying to convert sparse pandas data to arrow Table
ARROW-2835 - [C++] Make file position undefined after ReadAt()
ARROW-2969 - [R] Convert between StructArray and "nested" data.frame column containing data frame in each cell
ARROW-2981 - [C++] improve clang-tidy usability
ARROW-2984 - [JS] Refactor release verification script to share code with main source release verification script
ARROW-3040 - [Go] add support for comparing Arrays
ARROW-3041 - [Go] add support for TimeArray
ARROW-3052 - [C++] Detect Apache ORC C++ libraries in system/conda toolchain, add to conda requirements
ARROW-3087 - [C++] Implement Compare filter kernel
ARROW-3144 - [C++/Python] Move "dictionary" member from DictionaryType to ArrayData to allow for variable dictionaries
ARROW-3150 - [Python] Enable Flight in Python wheels for Linux and Windows
ARROW-3166 - [C++] Consolidate IO interfaces used in arrow/io and parquet-cpp
ARROW-3191 - [Java] Make ArrowBuf work with arbitrary underlying memory
ARROW-3200 - [C++] Support dictionaries in Flight streams
ARROW-3290 - [C++] Toolchain support for secure gRPC
ARROW-3294 - [C++][Flight] Support Flight on Windows
ARROW-3314 - [R] Set -rpath using pkg-config when building
ARROW-3330 - [C++] Spawn multiple Flight performance servers in flight-benchmark to test parallel get performance
ARROW-3419 - [C++] Run include-what-you-use checks as nightly build
ARROW-3459 - [C++][Gandiva] Add support for variable length output vectors
ARROW-3475 - [C++] Allow builders to finish to the corresponding array type
ARROW-3570 - [Packaging] Don't bundle test data files with python wheels
ARROW-3572 - [Crossbow] Raise more helpful exception if Crossbow queue has an SSH origin URL
ARROW-3671 - [Go] implement MonthInterval and DayTimeInterval
ARROW-3676 - [Go] implement Decimal128 array
ARROW-3679 - [Go] implement read/write IPC for Decimal128
ARROW-3680 - [Go] implement Float16 array
ARROW-3686 - [Python] support masked arrays in pa.array
ARROW-3702 - [R] POSIXct mapped to DateType not TimestampType?
ARROW-3714 - [CI] Run RAT checks in pre-commit hooks
ARROW-3729 - [C++][Parquet] Use logical annotations in Arrow Parquet reader/writer
ARROW-3732 - [R] Add functions to write RecordBatch or Schema to Message value, then read back
ARROW-3758 - [R] Build R library and dependencies on Windows in Appveyor CI
ARROW-3759 - [R][CI] Build and test (no libarrow) on Windows in Appveyor
ARROW-3767 - [C++] Add cast from null to any other type
ARROW-3780 - [R] : Failed to fetch data: invalid data when collecting int16
ARROW-3791 - [C++ / Python] Add boolean type inference to the CSV parser
ARROW-3794 - [R] : Consider mapping INT8 to integer() not raw()
ARROW-3804 - [R] Support older versions of R runtime
ARROW-3810 - [R] type= argument for Array and ChunkedArray
ARROW-3811 - [R] : Support inferring data.frame column as StructArray in array constructors
ARROW-3814 - [R] RecordBatch$from_arrays()
ARROW-3815 - [R] : refine record batch factory
ARROW-3848 - [R] allow nbytes to be missing in RandomAccessFile$Read()
ARROW-3897 - [MATLAB] Add MATLAB support for writing numeric datatypes to a Feather file
ARROW-3904 - [C++/Python] Validate scale and precision of decimal128 type
ARROW-4013 - [Docs][C++] Add how to build on MSYS2
ARROW-4020 - [Release] Add a post release script to remove RC
ARROW-4047 - [Python] Document use of int96 timestamps and options in Parquet docs
ARROW-4086 - [Java] Add apis to debug memory alloc failures
ARROW-4121 - [C++] Refactor memory allocation from InvertKernel
ARROW-4159 - [C++] Build with -Wdocumentation when using clang and BUILD_WARNING_LEVEL=CHECKIN
ARROW-4194 - [Format][Docs] Remove duplicated / out-of-date logical type information from documentation
ARROW-4302 - [C++] Add OpenSSL to C++ build toolchain (#4384)
ARROW-4337 - [C#] Implemented Fluent API for building arrays and record batches
ARROW-4343 - [C++] Add docker-compose test for gcc 4.8 / Ubuntu 14.04 (Trusty), expand Xenial/16.04 Dockerfile to test Flight
ARROW-4356 - [CI] Add integration (docker) test for turbodbc
ARROW-4369 - [Packaging] Release verification script should test linux packages via docker
ARROW-4452 - [Python] Serialize sparse torch tensors
ARROW-4453 - [Python] Create Cython wrappers for SparseTensor
ARROW-4467 - [Rust][DataFusion] Create a REPL & Dockerfile for DataFusion
ARROW-4503 - [C#] Eliminate allocations in ArrowStreamReader when reading from a Stream
ARROW-4504 - [C++] Reduce number of C++ unit test executables from 128 to 82
ARROW-4505 - [C++] adding pretty print for dates, times, and timestamps
ARROW-4566 - [Flight] Add option to run Flight benchmark against separate server
ARROW-4596 - [Rust][DataFusion] Implement COUNT
ARROW-4622 - [C++][Python] MakeDense and MakeSparse in UnionArray should accept a vector of Field
ARROW-4625 - [Flight][Java] Add method to await Flight server termination in Java
ARROW-4626 - [Flight] Add application-defined metadata to DoGet/DoPut
ARROW-4627 - [Flight] Add application metadata field to DoPut
ARROW-4701 - [C++] Add JSON chunker benchmarks
ARROW-4702 - [C++] Update dependency versions
ARROW-4708 - [C++] add multithreaded json reader
ARROW-4708 - [C++] refactoring JSON parser to prepare for multithreaded impl
ARROW-4714 - [C++][JAVA] Providing JNI interface to Read ORC file via Arrow C++
ARROW-4717 - [C#] Consider exposing ValueTask instead of Task
ARROW-4719 - [C#] Implement ChunkedArray, Column and Table in C#
ARROW-4741 - [Java] Add missing type javadoc and enable checkstyle
ARROW-4787 - [C++] Add support for Null in MemoTable and related kernels
ARROW-4788 - [C++] Less verbose API for constructing StructArray
ARROW-4800 - [C++] Introduce a Result<T> class
ARROW-4805 - [Rust] Write temporal arrays to CSV
ARROW-4806 - [Rust] Temporal array casts
ARROW-4824 - [Python] Fix error checking in read_csv()
ARROW-4827 - [C++] Implement benchmark comparison
ARROW-4847 - [Python] Add pyarrow.table factory function
ARROW-4904 - [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing
ARROW-4911 - [R] Progress towards completing windows support
ARROW-4912 - [C++] add method for easy renaming of a Table's columns
ARROW-4913 - [Java][Memory] Add additional methods for observing allocations.
ARROW-4945 - [Flight] Enable integration tests in Travis
ARROW-4956 - [C#] Allow ArrowBuffers to wrap external Memory
ARROW-4959 - [C++][Gandiva][Crossbow] Gandiva crossbow packaging changes.
ARROW-4968 - [Rust] Assert that struct array field types match data in…
ARROW-4971 - [Go] Add type equality test function
ARROW-4972 - [Go] implement ArrayEquals
ARROW-4973 - [Go] implement ArraySliceEqual
ARROW-4974 - [Go] implement ArrayApproxEqual
ARROW-4990 - [C++] Support Array-Array comparison
ARROW-4993 - [C++] Add simple build configuration summary
ARROW-5000 - [Python] Fix 'SO' DeprecationWarning in setup.py
ARROW-5007 - [C++] Remove DCHECK in intrinsic headers
ARROW-5020 - [CI] Split Gandiva-related packages into separate .yml file
ARROW-5027 - [Python] Python bindings for JSON reader
ARROW-5037 - [Rust] [DataFusion] Refactor aggregate module
ARROW-5038 - [Rust][DataFusion] Implement AVG aggregate function
ARROW-5039 - [Rust][DataFusion] Re-implement CAST support
ARROW-5040 - [C++] ArrayFromJSON can't parse Timestamp from strings
ARROW-5045 - [Rust] Code coverage silently failing in CI
ARROW-5053 - [Rust][DataFusion] Use ARROW_TEST_DATA env var
ARROW-5054 - [Release][Flight] Test Flight in Linux/macOS release verification scripts
ARROW-5056 - [Packaging] Adjust conda recipes to use ORC conda-forge package on unix systems
ARROW-5061 - [Release] Improve 03-binary performance
ARROW-5062 - [Java][FlightRPC] Shade com.google.guava usage in Flight
ARROW-5063 - [FlightRPC][Java] Test that Flight client connections are independent
ARROW-5064 - [Release] Pass PKG_CONFIG_PATH to glib in the verification script
ARROW-5066 - [Integration] Add flags to enable/disable implementations in integration/integration_test.py
ARROW-5071 - [Archery] Implement running benchmark suite
ARROW-5076 - [Release] Improve post binary upload performance
ARROW-5077 - [Rust] Change Cargo.toml to use release versions
ARROW-5078 - [Documentation] Sphinx is failed by RemovedInSphinx30Warning
ARROW-5079 - [Release] Add a script that releases C# package
ARROW-5080 - [Release] Add a script that releases Rust packages
ARROW-5081 - [C++] Use PATH_SUFFIXES when searching for dependencies
ARROW-5083 - [Developer] PR merge script improvements: set already-released Fix Version, display warning when no components set
ARROW-5088 - [C++] Only add -Werror in debug builds. Add C++ documentation about compiler warning levels
ARROW-5091 - [Flight] Rename FlightGetInfo message to FlightInfo
ARROW-5093 - [Packaging] Add support for selective binary upload
ARROW-5094 - [Packaging] Add APT/Yum verification scripts
ARROW-5102 - [C++] Reduce header dependencies
ARROW-5108 - [Go] implement reading primitive arrays from Arrow file
ARROW-5109 - [Go] implement reading binary/string arrays from Arrow file
ARROW-5110 - [Go] implement reading struct arrays from Arrow file
ARROW-5111 - [Go] implement reading list arrays from Arrow file
ARROW-5112 - [Go] implement writing IPC Arrow stream/file
ARROW-5113 - [C++] Fix DoPut with dictionary arrays, add tests
ARROW-5115 - [JS] Add Vector Builders and high-level stream primitives
ARROW-5116 - [Rust] move kernel related files under compute/kernels
ARROW-5124 - [C++] Add support for Parquet in MinGW build
ARROW-5126 - [Rust][Parquet] Convert parquet column desc to arrow data type
ARROW-5127 - [Rust][Parquet] Add page iterator.
ARROW-5136 - [Flight] Call options
ARROW-5137 - [Flight] Implement auth API
ARROW-5145 - [C++] More input validation in release mode
ARROW-5150 - [Ruby] Add Arrow::Table#raw_records
ARROW-5155 - [GLib][Ruby] Add support for building union arrays from data type
ARROW-5157 - [Website] Add MATLAB to powered by Apache Arrow website
ARROW-5162 - [Rust][Parquet] Rename mod reader to arrow.
ARROW-5163 - [Gandiva] Cast timestamp/date are incorrectly evaluating year 0097 to 1997
ARROW-5164 - [Gandiva][C++] Introduce murmur32 for 32 bit types.
ARROW-5165 - [Python] update dev installation docs for --build-type + validate in setup.py
ARROW-5168 - [GLib] Add garrow_array_take()
ARROW-5171 - [C++] Use LESS instead of LOWER in compare enum
ARROW-5172 - [Go] implement reading fixed-size binary arrays from Arrow file
ARROW-5178 - [Python] Add Table.from_pydict()
ARROW-5179 - [Python] Return plain dicts, not OrderedDict, on Python 3.7+
ARROW-5185 - [C++] Add support for Boost with CMake configuration file
ARROW-5187 - [Rust] Add ability to convert StructArray to RecordBatch
ARROW-5188 - [Rust] Add temporal types to struct builders
ARROW-5189 - [Rust][Parquet] Format / display individual fields within a parquet row
ARROW-5190 - [R] : Discussion: tibble dependency in R package
ARROW-5191 - [Rust] Expose CSV and JSON reader schemas
ARROW-5203 - [GLib] Add support for Compare filter
ARROW-5204 - [C++] Improve builder performance
ARROW-5212 - [Go] Support reserve for the data buffer in the BinaryBuilder
ARROW-5218 - [C++] Improve build when third-party library locations are specified
ARROW-5219 - [C++] Build protobuf_ep in parallel when using Ninja build
ARROW-5222 - [Python] Revise pyarrow installation instructions for macOS
ARROW-5225 - [Java] Improve performance of BaseValueVector#getValidityBufferSizeFromCount
ARROW-5226 - [Gandiva] Add cmp functions for decimals
ARROW-5238 - [Python] Convert arguments to pyarrow.dictionary
ARROW-5241 - [Python] expose option to disable writing statistics to parquet file
ARROW-5250 - [Java] Add javadoc comments to public methods, remove style check suppression.
ARROW-5252 - [C++] Use standard-compliant std::variant backport
ARROW-5256 - [C++] Add support for LLVM 7.1
ARROW-5257 - [Website] Update site to use "official" Apache Arrow logo, add clearly marked links to logo
ARROW-5258 - [C++/Python] Collect file metadata of dataset pieces
ARROW-5261 - [C++] Add missing scalar defintions for Intervals
ARROW-5262 - [Python] Fix typo
ARROW-5264 - [Java] Allow enabling/disabling boundary checking by environmental variable
ARROW-5266 - [Go] implement read/write IPC for Float16
ARROW-5268 - [GLib] Add GArrowJSONReader
ARROW-5269 - [C++][Archery] Mark relevant benchmarks as regression
ARROW-5275 - [C++] Generic filesystem tests
ARROW-5281 - [Rust] Extract DataPageBuilder to test common
ARROW-5284 - [Rust] Replace libc with std::alloc for memory allocation
ARROW-5286 - [Python] support struct type in from_pandas
ARROW-5288 - [Documentation] Enhance the contribution guidelines page
ARROW-5289 - [C++] Move arrow/util/concatenate* to arrow/array
ARROW-5290 - [Java] Provide a flag to enable/disable null-checking in vector's get methods
ARROW-5291 - [Python] Add wrapper for take kernel on Array
ARROW-5298 - [Rust] Add debug implementation for buffer data.
ARROW-5299 - [C++] ListArray comparison is incorrect
ARROW-5309 - [Python] clarify that Schema.append returns new object
ARROW-5311 - [C++] use more specific error status types in take
ARROW-5313 - [Format] Comments on Field table are a bit confusing
ARROW-5317 - [Rust][Parquet] impl IntoIterator for SerializedFileReader
ARROW-5319 - [C++][CI][travis skip]
ARROW-5321 - [Gandiva][C++] add isnull impl for string types
ARROW-5323 - [CI][skip travis]
ARROW-5328 - [R] Add shell scripts to do a full package rebuild and test locally
ARROW-5329 - [MATLAB] Add support for building MATLAB interface to Feather directly within MATLAB
ARROW-5334 - [C++] Ensure all type classes end with "Type"
ARROW-5335 - [Python] Raise exception on variable dictionaries in conversion to Python/pandas
ARROW-5339 - [C++] Add jemalloc URL to thirdparty/versions.txt so download_dependencies.sh gets it
ARROW-5341 - [C++][Documentation] developers/cpp.rst should mention documentation warnings
ARROW-5342 - [Format] Formalize "extension types" in Arrow protocol metadata
ARROW-5346 - [C++] Revert changed to vendored datetime library
ARROW-5349 - [C++][Parquet] Add method to set file path in a parquet::FileMetaData instance
ARROW-5361 - [R] Follow DictionaryType/DictionaryArray changes from ARROW-3144
ARROW-5363 - [GLib] Fix coding styles
ARROW-5364 - [C++] Use ASCII rather than UTF-8 in BuildUtils.cmake comment
ARROW-5365 - [C++][CI] Enable ASAN/UBSAN in CI
ARROW-5368 - [C++] Disable jemalloc by default with MinGW
ARROW-5369 - [C++] Add support for glog on Windows
ARROW-5370 - [C++] Use system uriparser if available
ARROW-5372 - [GLib] Add support for null/boolean values CSV read option
ARROW-5378 - [C++] Local filesystem implementation
ARROW-5384 - [Go] implement FixedSizeList array
ARROW-5389 - [C++] Add Temporary Directory facility
ARROW-5392 - [C++][CI] Disable static build with MinGW on AppVeyor
ARROW-5393 - [R] Add tests and example for read_parquet()
ARROW-5395 - [C++] Utilize stream EOS in File format
ARROW-5396 - [JS] Support files and streams with no record batches
ARROW-5401 - [CI][skip appveyor]
ARROW-5404 - [C++] force usage of nonstd::sv_lite::string_view instead of std::string_view
ARROW-5407 - [C++] Allow building only integration test targets
ARROW-5413 - [C++] Skip UTF8 BOM in CSV files
ARROW-5415 - [Release] Release script should update R version everywhere
ARROW-5416 - [Website] Add Homebrew to project installation page
ARROW-5418 - [CI][R] Run code coverage and report to codecov.io
ARROW-5420 - [Java] Implement or remove getCurrentSizeInBytes in Variab…
ARROW-5427 - [Python] pandas conversion preserve_index=True to force RangeIndex serialization
ARROW-5428 - [C++] Add option to set "read extent" in arrow::io::BufferedInputStream
ARROW-5429 - [Java] Provide alternative buffer allocation policy
ARROW-5432 - [Python] Add NativeFile.read_at()
ARROW-5433 - [C++][Parquet] Improve parquet-reader columns information, strip trailing whitespace from test case
ARROW-5434 - [Memory][Java] Introduce wrappers for backward compatibility.
ARROW-5436 - [Python] parquet.read_table add filters keyword
ARROW-5438 - [JS] EOS bytes for sequential readers
ARROW-5441 - [C++] Implement FindArrowFlight.cmake
ARROW-5442 - [Website] Clarify what makes a release artifact "official"
ARROW-5443 - [Crossbow] Turn parquet build off for Gandiva.
ARROW-5447 - [Ruby] Ensure flushing test gz file
ARROW-5449 - [C++] Test extended-length paths on Windows
ARROW-5451 - [C++][Gandiva] Support cast/round functions for decimal
ARROW-5452 - [R] Add API documentation website (pkgdown)
ARROW-5461 - [Java] Add micro-benchmarks for Float8Vector and allocators
ARROW-5463 - [Rust] Add AsRef trait for Buffer.
ARROW-5464 - [Archery] Fix default diff --benchmark-filter
ARROW-5465 - [Crossbow] Support writing submitted job definition yaml to a file
ARROW-5466 - [Java] Dockerize Java builds in Travis CI, run multiple JDKs in single entry
ARROW-5467 - [Go] implement read/write IPC for Time32/64 arrays
ARROW-5468 - [Go] implement read/write IPC for Timestamp arrays
ARROW-5469 - [Go] implement read/write IPC for Date32/64 arrays
ARROW-5470 - [CI] Fix Travis-CI R job that broke with the local fs patch
ARROW-5472 - [Development] Add warning to PR merge tool if no JIRA component is set
ARROW-5474 - [C++] Document Boost 1.58 as minimum supported version, add docker-compose entry for it, fix broken cpp/Dockerfile* builds
ARROW-5475 - [Python] Add Python binding for arrow::Concatenate
ARROW-5476 - [Java][Memory] Fix Netty Arrow Buf.
ARROW-5477 - [C++] Check required RapidJSON version
ARROW-5478 - [Packaging] Drop Ubuntu 14.04 support
ARROW-5481 - [GLib] Add "error" parameter document
ARROW-5485 - [C++] Install libraries from googletest_ep into build output directory on non-Windows platforms.
ARROW-5485 - [Crossbow] Disable unit tests in Gandiva macOS crossbow job until underlying issue resolved
ARROW-5486 - [GLib] Add binding of gandiva::FunctionRegistry and related things
ARROW-5488 - [R] Workaround when C++ lib not available
ARROW-5490 - [C++] Remove ARROW_BOOST_HEADER_ONLY
ARROW-5491 - [C++] Remove unecessary semicolons following MACRO definitions
ARROW-5492 - [R] Add "col_select" argument to read_* functions to read subset of columns
ARROW-5495 - [C++] Update some dependency URLs from http to https
ARROW-5496 - [R][CI] Fix relative paths in R codecov.io reporting
ARROW-5498 - [C++][CI] Fix Flatbuffers related error with MinGW
ARROW-5499 - [R] Alternate bindings for when libarrow is not found
ARROW-5500 - [R] read_csv_arrow() signature should match readr::read_csv()
ARROW-5503 - [R] : add read_json()
ARROW-5504 - [R] : move use_threads argument to global option
ARROW-5509 - [R] Add basic write_parquet
ARROW-5511 - [Packaging] Enable Flight in Conda packages
ARROW-5512 - [C++] Rough API skeleton for C++ Datasets API / framework
ARROW-5513 - [Java] Refactor method name for getstartOffset to use camel case
ARROW-5516 - [Python][Documentation] Development page for pyarrow has a missing dependency in using pip
ARROW-5518 - [Java] Set VectorSchemaRoot rowCount to 0 on allocateNew and clear
ARROW-5524 - [C++] Turn off PARQUET_BUILD_ENCRYPTION in CMake if OpenSSL not found (#4494)
ARROW-5526 - [GitHub] Add more prominent notice to ISSUE_TEMPLATE.md to direct bug reports to JIRA
ARROW-5529 - [Flight] Allow serving with multiple TLS certificates
ARROW-5531 - [Python] Implement Array.from_buffers for varbinary and nested types, add DataType.num_buffers property
ARROW-5533 - [C++][Plasma] make plasma client thread safe
ARROW-5534 - [GLib] Add garrow_table_concatenate()
ARROW-5535 - [GLib] Add garrow_table_slice()
ARROW-5537 - [JS] Support delta dictionaries in RecordBatchWriter and DictionaryBuilder
ARROW-5538 - [C++] Restrict minimum OpenSSL version to 1.0.2
ARROW-5541 - [R] : cast from negative int32 to uint32 and uint64 are now safe
ARROW-5544 - [Archery] Don't return non-zero on regressions
ARROW-5545 - [C++][Docs] Clarify expectation of UTC values for timestamps with time zones
ARROW-5547 - [C++][FlightRPC] Support pkg-config for Arrow Flight
ARROW-5552 - [Go] make Schema, Field and simpleRecord implement Stringer
ARROW-5554 - [Python] Added a python wrapper for arrow::Concatenate()
ARROW-5555 - [R] Add install_arrow() function to assist the user in obtaining C++ runtime libraries
ARROW-5556 - [Doc][Python] Document JSON reader
ARROW-5557 - [C++] Add VisitBits benchmark
ARROW-5565 - [Python][Docs] Add instructions how to use gdb to debug C++ libraries when running Python unit tests
ARROW-5567 - [C++] Fix build error of memory-benchmark
ARROW-5571 - [R] Rework handing of ARROW_R_WITH_PARQUET
ARROW-5574 - [R] documentation error for read_arrow()
ARROW-5581 - [Java] Provide interfaces and initial implementations for vector sorting
ARROW-5582 - [Go] implement RecordEqual
ARROW-5586 - [R] convert Array of LIST type to R lists
ARROW-5587 - [Java] Add more style check rule for Java code
ARROW-5590 - [R] Run "no libarrow" R build in the same CI entry if possible
ARROW-5591 - [Go] implement read/write IPC for Duration & Intervals
ARROW-5597 - [Packaging] Add Flight deb packages
ARROW-5600 - [R] R package namespace cleanup
ARROW-5602 - [Java][Gandiva] Add tests for round/cast
ARROW-5604 - [Go] improve coverage of TypeTraits
ARROW-5609 - [C++] Set CMP0068 CMake policy to avoid macOS warnings
ARROW-5612 - [Python][Doc] Add prominent note that date_as_object option changed with Arrow 0.13
ARROW-5621 - [Go] implement read/write IPC for Decimal128 arrays
ARROW-5622 - [C++][Dataset] Support pkg-config for Arrow Datasets
ARROW-5625 - [R] convert Array of struct type to data frame columns
ARROW-5632 - [Doc] Basic instructions for using Xcode with Arrow
ARROW-5633 - [Python] Enable bz2 in Linux wheels
ARROW-5635 - [C++] Added a Compact() method to Table.
ARROW-5637 - [Java][C++][Gandiva] Complete In Expression Support
ARROW-5639 - [Java] Remove floating point computation from getOffsetBufferValueCapacity
ARROW-5641 - [GLib] Remove enums files generated by GNU Autotools from Git targets
ARROW-5643 - [FlightRPC] Add ability to override SSL hostname checking
ARROW-5650 - [Python] Update manylinux dependency versions
ARROW-5652 - [CI] Fix lint docker image
ARROW-5653 - [CI] Fix cpp docker image
ARROW-5656 - [Python][Packaging] Fix macOS wheel builds, add Flight support
ARROW-5659 - [C++] Add support for finding OpenSSL installed by Homebrew
ARROW-5660 - [GLib][CI] Use Xcode 10.2
ARROW-5661 - [Gandiva][C++] support hash functions for decimals in gandiva
ARROW-5662 - [C++] Add support for BOOST_SOURCE=AUTO|BUNDLED|SYSTEM
ARROW-5663 - [Packaging][RPM] Update CentOS packages for 0.14.0
ARROW-5664 - [Crossbow] Execute nightly crossbow tests on CircleCI instead of Travis
ARROW-5668 - [C++/Python] Include 'not null' in schema fields pretty print
ARROW-5669 - [Python][Packaging] Add ARROW_TEST_DATA env variable to Crossbow Linux Wheel build
ARROW-5670 - [Crossbow] get_apache_mirror.py fails with TLS error on macOS with Python 3.5
ARROW-5671 - [crossbow] mac os python wheels failing
ARROW-5672 - [Java] Refactor redundant method modifier
ARROW-5683 - [R] Add snappy to Rtools Windows builds
ARROW-5684 - [Packaging][deb] Add support for Ubuntu 19.04
ARROW-5685 - [Packaging][deb] Add support for Apache Arrow Datasets
ARROW-5687 - [C++] Remove remaining uses of ARROW_BOOST_VENDORED
ARROW-5690 - [Packaging][Python] Fix macOS wheel building
ARROW-5694 - [Python] Support list of Decimals in conversion to pandas
ARROW-5695 - [C#][Release] Run sourcelink test in verify-release-candidate.sh
ARROW-5696 - [C++][Gandiva] Introduce castVarcharVarchar
ARROW-5699 - [C++] Optimize decimal128 parsing
ARROW-5701 - [C++][Gandiva] Build expr with specific sv
ARROW-5702 - [C++] parquet::arrow::FileReader::GetSchema()
ARROW-5704 - [C++] Stop using ARROW_TEMPLATE_EXPORT for SparseTensorImpl
ARROW-5705 - [Java] Optimize BaseValueVector#computeCombinedBufferSize logic
ARROW-5706 - [Java] Remove type conversion in getValidityBufferValueCapacity
ARROW-5707 - [Java] Improve the performance and code structure for ArrowRecordBatch
ARROW-5710 - [C++] Allow compiling Gandiva with Ninja on Windows
ARROW-5715 - [Release] Verify Ubuntu 19.04 APT repository
ARROW-5718 - [R] auto splice data frames in record_batch() and table()
ARROW-5720 - [C++] Create benchmarks for decimal related classes.
ARROW-5721 - [Rust] Move array related code into a separate module
ARROW-5724 - [R][CI] AppVeyor build should use ccache
ARROW-5725 - [Crossbow] Port conda recipes to azure pipelines
ARROW-5726 - [Java] Implement a common interface for int vectors
ARROW-5727 - [Python][CI] Install pytest-faulthandler before running tests
ARROW-5748 - [Packaging][deb] Add support for Debian GNU/Linux buster
ARROW-5749 - [Python] Added python binding for Table::CombineChunks
ARROW-5751 - [Python][Packaging] Ensure that c-ares is linked statically in Python wheels
ARROW-5752 - [Java] Improve the performance of ArrowBuf#setZero
ARROW-5755 - [Rust][Parquet] Derive clone for Type.
ARROW-5768 - [Release] Remove needless empty lines at the end of CHANGELOG.md
ARROW-5773 - [R] Clean up documentation before release
ARROW-5780 - [C++] Add benchmark for Decimal operations
ARROW-5782 - [Release] Setup test data for Flight in dev/release/01-perform.sh
ARROW-5783 - [Release][C#] Exclude dummy.git from RAT check
ARROW-5785 - [Rust] Rust datafusion implementation should not depend on rustyline
ARROW-5787 - [Release][Rust] Use local modules to verify RC
ARROW-5793 - [Release] Avoid duplicate known host SSH error in dev/release/03-binary.sh
ARROW-5794 - [Release] Skip uploading already uploaded binaries
ARROW-5795 - [Release] Add missing waits on uploading binaries
ARROW-5796 - [Release][APT] Update expected package list
ARROW-5797 - [Release][APT] Update supported distributions
ARROW-5818 - [Java][Gandiva] support varlen output vectors
ARROW-5820 - [Release] Remove undefined variable check from verify script
ARROW-5826 - [Website] Blog post for 0.14.0 release announcement
PARQUET-1243 - [C++] Throw more informative exception when reading a length-0 Parquet file
PARQUET-1411 - [C++] Add parameterized logical annotations to Parquet metadata
PARQUET-1422 - [C++] Use common Arrow IO interfaces throughout codebase
PARQUET-1517 - [C++] Crypto package updates to match the final spec
PARQUET-1523 - [C++] Vectorize Comparator interface, remove virtual calls on inner loop. Refactor Statistics to not require PARQUET_EXTERN_TEMPLATE
PARQUET-1569 - [C++] Consolidate shared unit testing header files
PARQUET-1582 - [C++] Add ToString method to ColumnDescriptor
PARQUET-1583 - [C++] Remove superfluous parquet::Vector class
PARQUET-1586 - [C++] Add --dump options to parquet-reader tool to dump def/rep levels
PARQUET-1603 - [C++] rename parquet::LogicalType to parquet::ConvertedType

Bug Fixes

ARROW-61 - [Java] Method can return the value bigger than long MAX_VALUE
ARROW-352 - [Format] Interval(DAY_TIME) has no unit
ARROW-1837 - [Java][Integration] Fix unsigned round trip integration tests
ARROW-2119 - [IntegrationTest] Add test case with a stream having no record batches
ARROW-2136 - [Python] Check null counts for non-nullable fields when converting from pandas.DataFrame with supplied schema
ARROW-2256 - [C++] Fix libfuzzer builds for clang-7
ARROW-2461 - [Python] Build manylinux2010 wheels
ARROW-2590 - [Python] Pyspark python_udf serialization error on grouped map (Amazon EMR)
ARROW-3344 - [Python] Disable flaky Plasma test
ARROW-3399 - [Python] Implementing numpy matrix serialization
ARROW-3650 - [Python] warn on converting DataFrame with mixed type column names
ARROW-3801 - [Python] Pandas-Arrow roundtrip makes pd categorical index not writeable
ARROW-4021 - [Ruby] Error building red-arrow on msys2
ARROW-4076 - [Python] Validate ParquetDataset schema after filtering
ARROW-4139 - [Python][Parquet] Wrap new parquet::LogicalType, cast min/max statistics based on LogicalType
ARROW-4301 - [Java] use arrow-jni profile for both gandiva/orc
ARROW-4301 - [Java][Gandiva] Update version manually
ARROW-4324 - [Python] Triage broken type inference logic in presence of a mix of NumPy dtype-having objects and other scalar values
ARROW-4350 - [Python] Fix conversion from Python to Arrow with nested lists and NumPy dtype=object items
ARROW-4433 - [R] Segmentation fault when instantiating arrow::table from data frame
ARROW-4447 - [C++] Investigate dynamic linking for libthift
ARROW-4516 - [Python] Error while creating a ParquetDataset on a path without `_common_dataset` but with an empty `_tempfile`
ARROW-4523 - [JS] Add row proxy generation benchmark
ARROW-4651 - [Flight] Use URIs instead of host/port pair
ARROW-4665 - [C++] With glog activated, DCHECK macros are redefined
ARROW-4675 - [Python] Fix pyarrow.deserialize failure when reading payload in Python 3 payload generated in Python 2
ARROW-4694 - [CI] Improve detect-changes.py on Travis PRs
ARROW-4723 - [Python] Ignore "hidden" files that starts with underscore
ARROW-4725 - [C++] Enable dictionary builder tests with MinGW build
ARROW-4823 - [C++][Python] Do not close raw file handle in ReadaheadSpooler, check that file handles passed to read_csv are not closed
ARROW-4832 - [Python] pandas Index metadata for RangeIndex is incorrect
ARROW-4845 - [R] Compiler warnings on Windows MingW64
ARROW-4851 - [Java] BoundsChecking.java defaulting behavior for old drill parameter seems off
ARROW-4877 - [Plasma] CI failure in test_plasma_list
ARROW-4884 - [C++] conda-forge thrift-cpp package not available via pkg-config or cmake
ARROW-4885 - [C++/Python] Enable Decimal parsing in CSV
ARROW-4886 - [Rust] Cast to list with offset
ARROW-4923 - [Java] Add methods to set long value at given index in DecimalVector
ARROW-4934 - [Python] Address deprecation notice that will be a bug in Python 3.8
ARROW-5019 - [C#] ArrowStreamWriter doesn't work on a non-seekable stream
ARROW-5049 - [Python] org/apache/hadoop/fs/FileSystem class not found when pyarrow FileSystem used in spark
ARROW-5051 - [GLib][Gandiva] Don't return temporary memory
ARROW-5055 - [Ruby][MSYS2] libparquet needs to be installed in MSYS2 for ruby
ARROW-5058 - [Release] Fix typos in vote e-mail template
ARROW-5059 - [C++][Gandiva] cbrt_* floating point tests can fail due to exact comparisons
ARROW-5065 - [Rust] cast kernel does not support casting from Int64
ARROW-5068 - [Gandiva][Packaging] Fix gandiva nightly builds after the CMake refactor
ARROW-5090 - Parquet linking fails on MacOS due to @rpath in dylib
ARROW-5092 - [C#] Create a dummy .git directory to download the source files from GitHub with Source Link
ARROW-5095 - [Flight][C++] Expose server error message in DoGet
ARROW-5096 - [Packaging][deb] Add missing plasma-store-server packages
ARROW-5097 - [Packaging][CentOS6] Remove needless dependencies
ARROW-5098 - [Website] Update how to install .deb by APT
ARROW-5100 - [JS] Remove swap while collapsing contiguous buffers
ARROW-5117 - [Go] fix panic when nil or empty slices are appended to builders
[ARROW-5119](https://issues.apac

Open source →

0.13.031 Mar 2019

ARROW-295 - [Documentation] Add DOAP file

Bug Fixes

ARROW-295 - [Documentation] Add DOAP file
ARROW-1171 - [C++] Segmentation faults on Fedora 24 with pyarrow-manylinux1 and self-compiled turbodbc
ARROW-2392 - [C++] Check schema compatibility when writing a RecordBatch
ARROW-2399 - [Rust] Builder<T> should not provide a set() method
ARROW-2598 - [Python] table.to_pandas segfault
ARROW-3086 - [GLib] GISCAN fails due to conda-shipped openblas
ARROW-3096 - [Python] Update Python source build instructions given Anaconda/conda-forge toolchain migration
ARROW-3133 - [C++] Remove allocation from Binary Boolean Kernels.
ARROW-3133 - [C++] Remove allocations from InvertKernel
ARROW-3208 - [C++] Fix Cast dictionary to numeric segfault
ARROW-3426 - [CI] Java integration test very verbose
ARROW-3564 - [C++] Fix dictionary encoding logic for Parquet 2.0
ARROW-3578 - [Release] Resolve all hard and symbolic links in tar.gz
ARROW-3593 - [R] CI builds failing due to GitHub API rate limits
ARROW-3606 - [Crossbow] Fix flake8 crossbow warnings
ARROW-3669 - [Python] Raise error on Numpy byte-swapped array
ARROW-3843 - [C++][Python] Allow a "degenerate" Parquet file with no columns
ARROW-3923 - [Java] JDBC Time Fetches Without Timezone
ARROW-4007 - [Java][Plasma] Plasma JNI tests failing
ARROW-4050 - [Python][Parquet] core dump on reading parquet file
ARROW-4081 - [Go] Sum methods panic when the array is empty
ARROW-4104 - [Java] race in AllocationManager during release
ARROW-4108 - [Python/Java] Spark integration tests do not work
ARROW-4117 - [Python] "asv dev" command fails with latest revision
ARROW-4140 - [C++][Gandiva] Compiled LLVM bitcode file path may result in libraries being non-relocatable
ARROW-4145 - [C++] Find Windows-compatible strptime implementation
ARROW-4181 - [Python] Fixes for Numpy struct array conversion
ARROW-4192 - [CI] Fix broken dev/run_docker_compose.sh script
ARROW-4213 - [Flight] Fix incompatibilities between C++ and Java
ARROW-4244 - [Format] Clarify padding/alignment rationale/recommendation.
ARROW-4250 - [C++] adding explicit epsilon for ApproxEquals and corresponding assert macro
ARROW-4252 - [C++] Fix missing Status code and newline
ARROW-4253 - [GLib] Cannot use non-system Boost specified with $BOOST_ROOT
ARROW-4254 - [C++][Gandiva] Build with Boost from Ubuntu Trusty apt
ARROW-4255 - [C++] Eagerly initialize name_to_index_ to avoid race
ARROW-4261 - [C++] Make CMake paths for IPC, Flight, Thrift, and Plasma subproject compatible
ARROW-4264 - [C++] Clarify use of DCHECKs in Kernels
ARROW-4267 - [C++/Parquet] Handle duplicate and struct columns in RowGroup reads
ARROW-4274 - [C++][Gandiva] split decimal into two parts
ARROW-4275 - [C++][Gandiva] Fix slow decimal test
ARROW-4280 - Update README.md to reflect parquet deps
ARROW-4282 - [Rust] builder benchmark is broken
ARROW-4284 - [C#] File / Stream serialization fails due to type mismatch / missing footer
ARROW-4295 - [C++][Plasma] Fix incorrect log message
ARROW-4296 - [Plasma] Use one mmap file by default, prevent crash with -f
ARROW-4308 - [Python] pyarrow has a hard dependency on pandas
ARROW-4311 - [Python] Regression on pq.ParquetWriter incorrectly handling source string
ARROW-4312 - [C++] Only run 2 * os.cpu_count() clang-format instances at once
ARROW-4319 - [C++][Plasma] plasma/store.h pulls in flatbuffer dependency
ARROW-4320 - [C++] Add tests for non-contiguous tensors
ARROW-4322 - [C++] Don't use _GLIBCXX_USE_CXX11_ABI=0 anymore in docker scripts
ARROW-4323 - [Packaging] Fix failing OSX clang conda forge builds
ARROW-4326 - [C++] Development instructions in python/development.rst will not work for many Linux distros with new conda-forge toolchain
ARROW-4327 - [Python] Add requirements-build.txt convenience file
ARROW-4328 - Add a ARROW_USE_OLD_CXXABI configure var to R
ARROW-4329 - Python should include the parquet headers
ARROW-4342 - [Gandiva][Java] Ignore flaky test.
ARROW-4347 - [CI][Python] Also run Python builds when Java affected.
ARROW-4349 - [C++] Add static linking option for benchmarks, fix Windows benchmark build failures
ARROW-4351 - [C++] Fix CMake errors when neither building shared libraries nor tests
ARROW-4355 - [C++] Reorder testing code into src/arrow/testing
ARROW-4360 - [C++] Query homebrew for Thrift
ARROW-4364 - [C++] Fix CHECKIN warnings
ARROW-4366 - [Docs] Change extension from format/README.md to format/README.rst
ARROW-4367 - [C++] StringDictionaryBuilder segfaults on Finish with only null entries
ARROW-4368 - [Docs] Fix install document for Ubuntu 16.04 or earlier
ARROW-4370 - [Python][Bool] to pandas
ARROW-4374 - [C++] DictionaryBuilder does not correctly report length and null_count
ARROW-4381 - [CI] Update linter container build instructions
ARROW-4382 - [C++] Improve new cpplint output readability
ARROW-4384 - [C++] Running "format" target on new Windows 10 install opens "how do you want to open this file" dialog
ARROW-4385 - [Packaging] Fix PyArrow version update pattern on release
ARROW-4389 - [R] Don't install clang-tools in test job
ARROW-4395 - [JS] Fix ts-node error running bin/arrow2csv
ARROW-4400 - [CI] Switch to https repo for llvm
ARROW-4403 - [Rust] Fix format errors
ARROW-4404 - [CI] AppVeyor toolchain build does not build anything
ARROW-4407 - [C++] Cache compiler for CMake external projects
ARROW-4410 - [C++] Fix edge cases in InvertKernel
ARROW-4413 - [Python] Fix pa.hdfs.connect() on Python 2
ARROW-4414 - [C++] Stop using cmake COMMAND_EXPAND_LISTS because it breaks package builds for older distros
ARROW-4417 - [C++] Fix doxygen build
ARROW-4420 - [INTEGRATION] Make spark integration test pass and test against spark's master branch
ARROW-4421 - [C++][Flight] Handle large RPC messages in Flight
ARROW-4434 - [Python] Allow creating trivial StructArray
ARROW-4440 - [C++] Revert recent changes to flatbuffers EP causing flakiness
ARROW-4457 - [Python] Allow creating Decimal array from Python ints
ARROW-4469 - [CI] Pin conda-forge binutils version to 2.31 for now
ARROW-4471 - [C++] Pass AR and RANLIB to all external projects
ARROW-4474 - Use signed integers in FlightInfo payload size fields
ARROW-4480 - [Python] Drive letter removed when writing parquet file
ARROW-4487 - [C++] Appveyor toolchain build does not actually build the project
ARROW-4494 - [Java] arrow-jdbc JAR is not uploaded on release
ARROW-4496 - [Python] Pin to gfortran<4
ARROW-4498 - [Plasma] Fix building Plasma with CUDA enabled
ARROW-4500 - [C++] Remove pthread / librt hacks causing linking issues in some Linux environments
ARROW-4501 - Fix out-of-bounds read in DoubleCrcHash
ARROW-4525 - [Rust][Parquet] Enable conversion of ArrowError to ParquetError
ARROW-4527 - [Packaging][Linux] Use LLVM 7
ARROW-4532 - [Java] fix bug causing very large varchar value buffers
ARROW-4533 - [Python] Document how to run hypothesis tests
ARROW-4535 - [C++] Fix MakeBuilder to preserve ListType's field name
ARROW-4536 - [GLib] Add data_type argument in garrow_list_array_new
ARROW-4538 - [Python] Remove index column from subschema in write_to_dataframe
ARROW-4549 - [C++] Can't build benchmark code on CUDA enabled build
ARROW-4550 - [JS] Fix AMD pattern
ARROW-4559 - [Python] Allow Parquet files with special characters in their names
ARROW-4563 - [Python] Validate decimal128() precision input
ARROW-4571 - [Format] Tensor.fbs file has multiple root_type declarations
ARROW-4573 - [Python] Add Flight unit tests
ARROW-4576 - [Python] Fix error during benchmarks
ARROW-4577 - [C++] Don't set interface link libs on arrow_shared where there are none
ARROW-4581 - [C++] Do not require googletest_ep or gbenchmark_ep for library targets
ARROW-4582 - [Python/C++] Acquire the GIL on Py_INCREF
ARROW-4584 - [Python] Add built wheel to manylinux1 dockerignore
ARROW-4585 - [C++] Add protoc dependency to flight_testing
ARROW-4587 - [C++] Fix segfaults around DoPut implementation
ARROW-4597 - [C++] Targets for system Google Mock shared library are missing
ARROW-4601 - [Python] Add license header to dockerignore
ARROW-4606 - [Rust] [DataFusion] FilterRelation created RecordBatch with empty schema
ARROW-4608 - [C++] cmake script assumes that double-conversion installs static libs
ARROW-4617 - [C++] Support double-conversion<3.1
ARROW-4624 - [C++] Fix building benchmarks
ARROW-4629 - [Python] Pandas arrow conversion slowed down by imports
ARROW-4635 - [Java] allocateNew to use last capacity
ARROW-4639 - [CI] Switch off GFLAGS_SHARED for osx
ARROW-4641 - [C++][Flight] Suppress strict aliasing warnings from "unsafe" casts in client.cc
ARROW-4642 - [R] change f to file in read_parquet_file()
ARROW-4653 - [C++] Fix bug in decimal multiply
ARROW-4654 - [C++] Explicit flight.cc source dependencies
ARROW-4657 - Don't build benchmarks in release verify script
ARROW-4658 - [C++] Shared gflags is also a run-time conda requirement
ARROW-4659 - [CI] ubuntu/debian nightlies fail because of missing gandiva files
ARROW-4660 - [C++] Use set_target_properties for defining GFLAGS_IS_A_DLL
ARROW-4664 - [C++] Do not execute expressions inside DCHECK macros in release builds
ARROW-4669 - [Java] Add validity checks to slice
ARROW-4672 - [CI] Fix clang-7 build entry
ARROW-4680 - [CI][Rust] Travis CI builds fail with latest Rust 1.34.0…
ARROW-4684 - [Python] CI failures in test_cython.py
ARROW-4687 - [Python] Stop Flight server on incoming signals
ARROW-4688 - [C++][Parquet] Chunk binary column reads at 2^31 - 1 byte boundaries to avoid splitting chunk inside nested string cell
ARROW-4696 - Better CUDA detection in release verification script
ARROW-4699 - [C++] remove json chunker's requirement of null terminated buffers
ARROW-4704 - [GLib][CI] Ensure killing plasma_store_server
ARROW-4710 - [C++][R] New linting script skip files with "cpp" extension
ARROW-4712 - [C++][CI] fix build (sum.cc) has warnings in clang
ARROW-4721 - [Rust][DataFusion] Propagate schema in filter
ARROW-4724 - [C++][CI] Enable Python build and test in MinGW build
ARROW-4728 - [JS] Fix Table#assign when passed zero-length RecordBatches
ARROW-4737 - run C# tests in CI
ARROW-4744 - [C++][CI] Change mingw builds back to debug. Cleanup up some version warnings
ARROW-4750 - [C++] RapidJSON triggers Wclass-memaccess on GCC 8+
ARROW-4760 - [C++] protobuf 3.7 defines EXPECT_OK that clashes with Arrow's macro
ARROW-4766 - [C++] Fix empty array cast segfault
ARROW-4767 - [C#] ArrowStreamReader crashes while reading the end of a stream
ARROW-4768 - [C++][CI] Don't run flaky tests in MinGW build
ARROW-4774 - [C++] Fix FileWriter::WriteTable segfault
ARROW-4775 - [Site] Site navbar cannot be expanded
ARROW-4783 - [C++][CI] Disable arrow thread-pool test on mingw to avoid appveyor timeouts
ARROW-4793 - [Ruby] Suppress unused variable warning
ARROW-4796 - [Flight/Python] Keep underlying Python object alive in FlightServerBase.do_get
ARROW-4802 - [Python] Follow symlinks when deriving Hadoop classpath for HDFS
ARROW-4807 - [Rust] Fix csv_writer benchmark
ARROW-4811 - [C++] Fix misbehaving CMake dependency on flight_grpc_gen
ARROW-4813 - [Ruby] Add tests for == and !=
ARROW-4820 - [Python] hadoop class path derived not correct
ARROW-4822 - [C++/Python] Check for None on calls to equals
ARROW-4828 - [Python] manylinux1 docker-compose context should be python/manylinux1
ARROW-4850 - [CI] Ensure integration_test.py returns non-zero on failures
ARROW-4853 - [Rust] Array slice doesn't work on ListArray and StructArray
ARROW-4857 - [C++/Python/CI] docker-compose in manylinux1 crossbow jobs too old
ARROW-4866 - [C++] Fix zstd_ep build for Debug, static CRT builds. Add separate CMake variable for propagating compiler toolchain to ExternalProjects
ARROW-4867 - [Python] Respect ordering of columns argument passed to Table.from_pandas
ARROW-4869 - [C++] Fix gmock usage in compute/kernels/util-internal-test.cc
ARROW-4870 - [Ruby] Fix mys2_mingw_dependencies
ARROW-4871 - [Java/Flight] Handle large Flight messages
ARROW-4872 - [Python] Keep backward compatibility for ParquetDatasetPiece
ARROW-4879 - [C++] cmake can't use conda's flatbuffers
ARROW-4881 - [C++] remove references to ARROW_BUILD_TOOLCHAIN
ARROW-4900 - [C++] polyfill __cpuidex on mingw-w64
ARROW-4903 - [C++] Fix static/shared-only builds
ARROW-4906 - [Format] Write about SparseMatrixIndexCSR format is sorted
ARROW-4918 - [C++] Add cmake-format to pre-commit
ARROW-4928 - [Python] Fix Hypothesis test failures
ARROW-4931 - [C++] CMake fails on gRPC ExternalProject
ARROW-4938 - [Glib] Undefined symbols error occurred when GIR file is being generated.
ARROW-4942 - [Ruby] Remove needless omits in tests
ARROW-4948 - [JS] Nightly test failure
ARROW-4950 - [C++] Fix CMake 3.2 build
ARROW-4952 - [C++] Floating-point comparisons should consider NaNs unequal
ARROW-4953 - [Ruby] Not loading libarrow-glib
ARROW-4954 - [Python] Fix test failure with Flight enabled
ARROW-4958 - [C++] Parquet benchmarks depend on its static test libs
ARROW-4961 - [C++] Add documentation note that GTest_SOURCE=BUNDLED is current required on Windows
ARROW-4962 - [C++] Warning level to CHECKIN can't compile on modern GCC
ARROW-4976 - [JS] Invalidate RecordBatchReader node/dom streams on reset()
ARROW-4982 - [GLib][CI] Run tests on AppVeyor
ARROW-4984 - Check if Flight gRPC server starts properly
ARROW-4986 - [CI] Travis fails to install llvm@7
ARROW-4989 - [C++] Find re2 on Ubuntu if asked to
ARROW-4991 - [CI] Bump travis node version to 11.12
ARROW-4997 - [C#] ArrowStreamReader doesn't consume whole stream and doesn't implement sync read.
ARROW-5009 - [C++] Remove using std::.* where I could find them
ARROW-5010 - [Release] Fix source release docker
ARROW-5012 - [C++] Install testing headers
ARROW-5023 - [Release] Fix default value syntax in 02-source.sh
ARROW-5024 - [Release] Fix missing variable with --arrow-version
ARROW-5025 - [Python][Packaging] Fix gandiva.dll detection
ARROW-5026 - [Python][Packaging] Fix gandiva.dll detection on non Windows
ARROW-5029 - [C++] Fix compilation warnings in release mode
ARROW-5031 - [Dev] Run CUDA Python tests in release verification script
ARROW-5042 - [Release] Use the correct dependency source in verification script
ARROW-5043 - [Release][Ruby] Fix dependency error in verification script
ARROW-5044 - [Release][Rust] Use stable toolchain for format check in verification script
ARROW-5046 - [Release][C++] Exclude fragile Plasma test from verification script
ARROW-5047 - [Release] Always set up parquet-testing in verification script
ARROW-5048 - [Release][Rust] Set up arrow-testing in verification script
ARROW-5050 - [C++] cares_ep should build before grpc_ep
ARROW-5087 - [Debian] APT repository no longer contains libarrow-dev
ARROW-5658 - [JAVA] Provide ability to resync VectorSchemaRoot if types change
PARQUET-1482 - [C++] Add branch to TypedRecordReader::ReadNewPage for …
PARQUET-1494 - [C++] Recognize statistics built with UNSIGNED sort order by parquet-mr 1.10.0 onwards
PARQUET-1532 - [C++] Fix build error with MinGW

New Features and Improvements

ARROW-47 - [C++] Preliminary arrow::Scalar object model
ARROW-331 - [Doc] Add statement about Python 2.7 compatibility
ARROW-549 - [C++] Add arrow::Concatenate function to combine multiple arrays into a single Array
ARROW-572 - [C++] Apply visitor pattern in IPC metadata
ARROW-585 - [C++] Experimental public API for user-defined extension types and arrays
ARROW-694 - [C++] Initial parser interface for reading JSON into RecordBatches
ARROW-1425 - [Python][Documentation] Examples of convert Timestamps to/from pandas via arrow
ARROW-1572 - [C++] Implement "value counts" kernels for tabulating value frequencies
ARROW-1639 - [Python] Serialize RangeIndex as metadata via Table.from_pandas instead of converting to a column of integers
ARROW-1642 - [GLib] Build GLib using Meson in Appveyor
ARROW-1807 - [JAVA] Reduce Heap Usage (Phase 3): consolidate buffers
ARROW-1896 - [C++] Do not allocate memory inside CastKernel. Clean up template instantiation to not generate dead identity cast code
ARROW-2015 - [Java] Replace Joda time with Java 8 time
ARROW-2022 - [Format] Add metadata to message
ARROW-2112 - [C++] Enable cpplint to be run on Windows
ARROW-2243 - [C++] Enable IPO/LTO
ARROW-2409 - [Rust] Deny warnings in CI.
ARROW-2460 - [Rust] Schema and DataType::Struct should use Vec<Rc<Field>>
ARROW-2487 - [C++] Provide a variant of AppendValues that takes bytemaps for the nullability
ARROW-2523 - [Rust] Implement CAST operations for arrays
ARROW-2620 - [Rust] Integrate memory pool abstraction with rest of codebase
ARROW-2627 - [Python] Add option to pass memory_map argument to ParquetDataset
ARROW-2904 - [C++] Use FirstTimeBitmapWriter instead of SetBit functions in builder.h/cc
ARROW-3066 - [Wiki] Add "How to contribute" to developer wiki
ARROW-3084 - [Python] Do we need to build both unicode variants of pyarrow wheels?
ARROW-3107 - [C++] arrow::PrettyPrint for Column instances
ARROW-3121 - [C++] Mean aggregate kernel
ARROW-3123 - [C++] Implement Count aggregate kernel
ARROW-3135 - [C++] Add helper functions for validity bitmap propagation in kernel context
ARROW-3149 - [C++] Use gRPC (when it exists) from conda-forge for CI builds
ARROW-3162 - [Python][Flight] Enable implementing Flight servers in Python
ARROW-3162 - Flight Python bindings
ARROW-3239 - [C++] Implement simple random array generation
ARROW-3255 - [C++/Python] Migrate Travis CI jobs off Xcode 6.4
ARROW-3289 - [C++] Implement Flight DoPut
ARROW-3292 - [C++] Test Flight RPC in Travis CI
ARROW-3295 - [Packaging] Package gRPC libraries in conda-forge for use in builds, packaging
ARROW-3297 - [Python] Python bindings for Flight C++ client
ARROW-3311 - [R] Functions for deserializing IPC components from arrow::Buffer or from IO interface
ARROW-3328 - [Flight] Allow for optional unique flight identifier to be sent with FlightGetInfo
ARROW-3361 - [R] Also run cpplint on Rcpp source files
ARROW-3364 - [Docs] Add docker-compose integration documentation
ARROW-3367 - [INTEGRATION] Port Spark integration test to the docker-compose setup
ARROW-3422 - [C++] Uniformly add ExternalProject builds to the "toolchain" target. Fix gRPC EP build on Linux
ARROW-3434 - [Packaging] Add Apache ORC C++ library to conda-forge
ARROW-3435 - [C++] Add option to use dynamic linking with re2
ARROW-3511 - [Gandiva] Link filter and project operations
ARROW-3532 - [Python] Emit warning when looking up for duplicate struct or schema fields
ARROW-3550 - [C++] use kUnknownNullCount for the default null_count argument
ARROW-3554 - [C++] Reverse traits for C++
ARROW-3594 - [Packaging] Build "cares" library in conda-forge
ARROW-3595 - [Packaging] Build boringssl in conda-forge
ARROW-3596 - [Packaging] Build gRPC in conda-forge
ARROW-3619 - [R] Expose global thread pool optins
ARROW-3631 - [C#] Add Appveyor configuration
ARROW-3653 - [C++][Python] Support data copying between different GPU devices
ARROW-3735 - [Python] Add test for calling cast() with None
ARROW-3761 - [R] Bindings for CompressedInputStream, CompressedOutputStream
ARROW-3763 - [C++] Write Parquet ByteArray / FixedLenByteArray reader batches directly into arrow::BinaryBuilder
ARROW-3769 - [C++] Add support for reading non-dictionary encoded binary Parquet columns directly as DictionaryArray
ARROW-3770 - [C++] Validate schema for each table written with parquet::arrow::FileWriter
ARROW-3816 - [R] nrow.RecordBatch method
ARROW-3824 - [R] Add basic build and test documentation
ARROW-3838 - [Rust] CSV Writer
ARROW-3846 - [Gandiva][C++] Build Gandiva C++ libraries and get unit tests passing on Windows
ARROW-3882 - [Rust] Cast Kernel for most types
ARROW-3903 - [Python] Random array generator for Arrow conversion and Parquet testing
ARROW-3926 - [Python] Add Gandiva bindings to Python manylinux1 wheels
ARROW-3951 - [Go] implement a CSV writer
ARROW-3954 - [Rust] Add Slice to Array and ArrayData
ARROW-3965 - [Java] JDBC-To-Arrow Configuration
ARROW-3966 - [Java] JDBC Column Metadata in Arrow Field Metadata
ARROW-3972 - [C++] Migrate to LLVM 7. Add option to disable using ld.gold
ARROW-3981 - [C++] Rename json.h
ARROW-3985 - [C++] Let ccache preserve comments
ARROW-4012 - [Website] Add documentation how to install Apache Arrow on MSYS2
ARROW-4014 - [C++] Fix "LIBCMT" warnings on MSVC
ARROW-4023 - [Gandiva] Address long CI times in macOS builds
ARROW-4024 - [Python] Raise minimal Cython version to 0.29
ARROW-4031 - [C++] Refactor bitmap building
ARROW-4040 - [Rust] Add array_ops method for filtering an array
ARROW-4056 - [C++] Unpin boost-cpp in conda_env_cpp.yml
ARROW-4061 - [Rust][Parquet] Implement spaced version for non-diction…
ARROW-4068 - [Gandiva] Support building with Xcode 6.4
ARROW-4071 - [Rust] Add rustfmt as a pre-commit hook
ARROW-4072 - [Rust] Set default value for PARQUET_TEST_DATA
ARROW-4092 - [Rust] Implement common Reader / DataSource trait for CSV and Parquet
ARROW-4094 - [Python] Store RangeIndex in Parquet files as metadata rather than a physical data column
ARROW-4110 - [C++] Do not generate distinct cast kernels when input and output type are the same
ARROW-4123 - [C++] Enable linting tools to be run on Windows
ARROW-4124 - [C++] Draft Aggregate and Sum kernels
ARROW-4142 - [Java] JDBC Array -> Arrow ListVector
ARROW-4165 - [C++] Port cpp/apidoc/Windows.md and other files to Sphinx / rst
ARROW-4180 - [Java] Make CI tests use logback.xml
ARROW-4196 - [Rust] Add explicit SIMD vectorization for arithmetic ops in "array_ops"
ARROW-4198 - [Gandiva] Added support to cast timestamp
ARROW-4204 - [Gandiva] add support for decimal subtract
ARROW-4205 - [Gandiva] Support for decimal multiply
ARROW-4206 - [Gandiva] support decimal divide and mod
ARROW-4212 - [C++][Python] CudaBuffer view of arbitrary device memory object
ARROW-4230 - [C++] Fix Flight builds with gRPC/Protobuf/c-ares
ARROW-4232 - [C++] Follow conda-forge compiler ABI migration
ARROW-4234 - [C++] Improve memory bandwidth test
ARROW-4235 - [GLib] Use "column_builder" in GArrowRecordBatchBuilder
ARROW-4236 - [java] Distinct plasma client create exceptions
ARROW-4245 - [Rust] Add Rustdoc header to source files
ARROW-4247 - [Packaging] Update verify script for 0.12.0
ARROW-4251 - [C++][Release] Add option to set ARROW_BOOST_VENDORED environment variable in verify-release-candidate.sh
ARROW-4262 - [Website] Preview to Spark with Arrow and R improvements
ARROW-4263 - [Rust] Donate DataFusion
ARROW-4265 - [C++] Automatic conversion between Table and std::vector<std::tuple<..>>
ARROW-4268 - [C++] Native C type TypeTraits
ARROW-4271 - [Rust] Move Parquet specific info to Parquet Readme
ARROW-4273 - [Release] Fix verification script to use cf201901 conda-forge label
ARROW-4277 - [C++] Add gmock to the toolchain
ARROW-4281 - [CI] Use Ubuntu Xenial VMs on Travis-CI
ARROW-4285 - [Python] Use proper builder interface for serialization
ARROW-4287 - [C++] Ensure minimal bison version on OSX for Thrift
ARROW-4289 - [C++] Forward AR and RANLIB to thirdparty builds
ARROW-4290 - [C++/Gandiva] Support detecting correct LLVM version in Homebrew
ARROW-4291 - [Dev] Support selecting features in release verification scripts
ARROW-4294 - [C++][Plasma] Add support for evicting Plasma objects to external store
ARROW-4297 - [C++] Fix build error with MinGW-w64 32-bit
ARROW-4298 - [Java] Add javax.annotation-api dependency for JDK >= 9
ARROW-4299 - [Ruby] Depend on the same version as Red Arrow
ARROW-4300 - [C++] Restore apache-arrow Homebrew recipe and define process for maintaining and updating for releases
ARROW-4303 - [Gandiva/Python] Build LLVM with RTTI in manylinux1 container
ARROW-4305 - [Rust] Fix parquet version number in README
ARROW-4307 - [C++] Fix Doxygen warnings
ARROW-4310 - [Website] Update install document for 0.12.0
ARROW-4313 - Define general benchmark database schema
ARROW-4315 - [Website] Add Go and Rust to list of supported languages
ARROW-4318 - [C++] Add Tensor::CountNonZero
ARROW-4321 - [CI] Setup conda-forge channel globally in docker containers
ARROW-4330 - [C++] More robust discovery of pthreads
ARROW-4331 - [C++] Extend Scalar Datum to support more types
ARROW-4332 - [Website] Improve documentation for publishing site
ARROW-4334 - [CI] Setup conda-forge channel globally in travis builds
ARROW-4335 - [C++] Better document sparse tensor support
ARROW-4336 - [C++] Change default build type to RELEASE
ARROW-4339 - [C++][Python] Developer documentation overhaul for 0.13 release
ARROW-4340 - [C++][CI] Build IWYU for LLVM 7 in iwyu docker-compose job
ARROW-4341 - [C++] Refactor Primitive builders and BooleanBuilder to use TypedBufferBuilder<T>
ARROW-4344 - [Java] Further cleanup mvn output, upgrade rat plugin
ARROW-4345 - [C++] Add Apache 2.0 license file to the Parquet-testing repository
ARROW-4346 - [C++] Fix class-memaccess warning on gcc 8.x
ARROW-4352 - [C++] Add support for system Google Test
ARROW-4353 - [CI] Add MinGW builds
ARROW-4358 - [CI] Restore support for trusty in CI
ARROW-4361 - [Website] Update commiters list
ARROW-4362 - [Java] Test OpenJDK 11 in CI
ARROW-4363 - [CI][C++] Add CMake format checks
ARROW-4372 - [C++] Embed precompiled bitcode in the gandiva library
ARROW-4373 - [Packaging] Travis fails to deploy conda packages on OSX
ARROW-4375 - [CI] Sphinx dependencies were removed from docs conda environment
ARROW-4376 - [Rust] Implement from_buf_reader for csv::Reader
ARROW-4377 - [Rust] Implement std::fmt::Debug for PrimitiveArrays
ARROW-4379 - [Python] Register serializers for collections.Counter and collections.deque.
ARROW-4383 - [C++] Use the CMake's standard find features
ARROW-4386 - [Rust] Temporal array support
ARROW-4388 - [Go] add DimNames() method to tensor Interface
ARROW-4393 - [Rust] coding style: apply 90 characters per line limit
ARROW-4396 - [JS] Update Typedoc for TypeScript 3.2
ARROW-4397 - [C++] Add dim_names in Tensor and SparseTensor
ARROW-4399 - [C++] Do not use extern template class with NumericArray<T> and NumericTensor<T>
ARROW-4401 - [Python] Alpine dockerfile fails to build because pandas requires numpy as build dependency
ARROW-4406 - [Python] Exclude HDFS directories in S3 from ParquetManifest
ARROW-4408 - [CPP/Doc] Remove outdated Parquet documentation
ARROW-4422 - [Plasma] Enforce memory limit in plasma, rather than relying on dlmalloc_set_footprint_limit
ARROW-4423 - [C++] Upgrade vendored gmock/gtest to 1.8.1
ARROW-4424 - [Python] Install tensorflow and keras-preprocessing in manylinux1 container
ARROW-4425 - Add link to 'Contributing' page in the top-level Arrow README
ARROW-4430 - [C++] Fix untested TypedByteBuffer<T>::Append method
ARROW-4431 - [C++] Fixes for gRPC vendored builds
ARROW-4435 - Minor fixups to csharp .sln and .csproj file
ARROW-4436 - [Documentation] Update building.rst to reflect pyarrow req
ARROW-4442 - [JS] Add explicit type annotation to Chunked typeId getter
ARROW-4444 - [Testing] Add DataFusion test files to arrow-testing repo
ARROW-4445 - [C++][Gandiva] Run Gandiva-LLVM tests in Appveyor
ARROW-4446 - [C++][Python] Run Gandiva C++ unit tests in Appveyor, get build and tests working in Python
ARROW-4448 - [Java][Flight] Disable flaky TestBackPressure
ARROW-4449 - [Rust] Convert File to T: Read + Seek for schema inference
ARROW-4454 - [C++] fix unused parameter warnings
ARROW-4455 - [Plasma] Suppress class-memaccess warnings
ARROW-4459 - [Testing] Add arrow-testing repo as submodule
ARROW-4460 - [Website] DataFusion Blog Post
ARROW-4461 - [C++] Expose bit map operations that work with raw pointers
ARROW-4462 - [C++] Upgrade LZ4 v1.7.5 to v1.8.3 to compile with VS2017
ARROW-4464 - [Rust][DataFusion] Add support for LIMIT
ARROW-4466 - [Rust][DataFusion] Add support for Parquet data source
ARROW-4468 - [Rust] Implement BitAnd/BitOr for &Buffer (with SIMD) (#3571)
ARROW-4472 - [Website][Python] Blog post about string memory use work in Arrow 0.12
ARROW-4475 - [Python] Fix recursive serialization of self-containing objects
ARROW-4476 - [Rust][DataFusion] Update README to cover DataFusion and new testing git submodule
ARROW-4481 - [Website] Remove generated specification docs from site after docs migration
ARROW-4483 - [Website] Add myself to contributors.yaml to fix broken link in blog post
ARROW-4485 - [CI] Determine maintenance approach to pinned conda-forge binutils package
ARROW-4486 - [Python][CUDA] Add base argument to foreign_buffer
ARROW-4488 - [Rust][u8] > for Buffer does not ensure correct padding
ARROW-4489 - [Rust] PrimitiveArray.value_slice performs bounds checking when it should not
ARROW-4490 - [Rust] Add explicit SIMD vectorization for boolean ops in "array_ops"
ARROW-4491 - [Python] Use StringConverter and stringstream instead of std::stoi and std::to_string
ARROW-4499 - [CI] Unpin flake8 in lint script, fix warnings in dev/
ARROW-4502 - [C#] Add support for zero-copy reads
ARROW-4506 - [Ruby] Add Arrow::RecordBatch#raw_records
ARROW-4513 - [Rust] Implement BitAnd/BitOr for &Bitmap
ARROW-4517 - [JS] remove version number as it is not used
ARROW-4518 - [JS] add jsdelivr to package.json
ARROW-4528 - [C++] Update lint docker container to LLVM-7
ARROW-4529 - [C++] Add test for BitUtil::RoundDown
ARROW-4531 - [C++] Support slices for SumKernel
ARROW-4537 - [CI] Suppress shell warning on travis-ci
ARROW-4539 - [Java] Fix child vector count for lists. (#3625)
ARROW-4540 - [Rust] Basic JSON reader
ARROW-4543 - [C#] Update Flat Buffers code to latest version
ARROW-4546 - Update LICENSE.txt with parquet-cpp licenses
ARROW-4547 - [Python][Documentation] Update python/development.rst with instructions for CUDA-enabled builds
ARROW-4556 - [Rust] Preserve JSON field order when inferring schema
ARROW-4558 - [C++][Flight] Implement gRPC customizations without UB
ARROW-4560 - [R] array() needs to take single input, not ...
ARROW-4562 - [C++] Avoid copies when serializing Flight data
ARROW-4564 - [C++] IWYU docker image silently fails
ARROW-4565 - [R] Fix decimal record batches with no null values
ARROW-4568 - [C++] Add version macros to headers
ARROW-4572 - [C++] Remove memory zeroing from PrimitiveAllocatingUnaryKernel
ARROW-4583 - [Plasma] Fix some small bugs reported by code scan tool
ARROW-4586 - [Rust] Remove arrow/mod.rs as it is not needed
ARROW-4589 - [Rust] Projection push down query optimizer rule
ARROW-4590 - [Rust] Add explicit SIMD vectorization for comparison ops in "array_ops"
ARROW-4592 - [GLib] Stop configure immediately when GLib isn't available
ARROW-4593 - [Ruby][out_of_range] returns nil
ARROW-4594 - [Ruby] returns Arrow::Struct instead of Arrow::Array
ARROW-4595 - [Rust] Implement Table API (a.k.a DataFrame)
ARROW-4598 - [CI] Remove needless LLVM_DIR for macOS
ARROW-4599 - [C++] Add support for system GFlags
ARROW-4602 - [Rust][DataFusion] Integrate query optimizer with ExecutionContext
ARROW-4603 - [Rust] [DataFusion] Execution context should allow in-memory data sources to be registered
ARROW-4604 - [Rust] [DataFusion] Add benchmarks for SQL query execution
ARROW-4605 - [Rust] Move filter and limit code from DataFusion into compute module
ARROW-4609 - [C++] Use google benchmark from toolchain
ARROW-4610 - [Plasma] Avoid Crash in Plasma Java Client
ARROW-4611 - [C++] Rework CMake logic
ARROW-4612 - [Python] Use cython from PyPI for windows wheels build
ARROW-4613 - [C++] Set CMAKE_INSTALL_LIBDIR in gtest thirdparty build
ARROW-4614 - [C++/CI] Activate flight build in ci/docker_build_cpp.sh
ARROW-4615 - [C++] Add checked_pointer_cast
ARROW-4616 - [C++] Log message in BuildUtils as STATUS
ARROW-4618 - [Docker] Makefile to build dependent docker images
ARROW-4619 - [R] Fix the autobrew script
ARROW-4620 - [C#] Add unit tests for "Types" in arrow/csharp
ARROW-4623 - [R] update Rcpp version
ARROW-4628 - [Rust][DataFusion] Implement type coercion query optimizer rule
ARROW-4632 - [Ruby] Add BigDecimal#to_arrow
ARROW-4634 - [Rust][Parquet] Reorganize test_common
ARROW-4637 - [Python] Conditionally import pandas symbols if they are used. Do not require pandas as a test dependency
ARROW-4638 - [R] install instructions using brew
ARROW-4640 - [Python] Add docker-compose configuration to build and test the project without pandas installed
ARROW-4643 - [C++] Force compiler diagnostic colors
ARROW-4644 - [C++/Docker] Build Gandiva in the docker containers
ARROW-4645 - [C++/Packaging] Ship Gandiva with OSX and Windows wheels
ARROW-4646 - [C++/Packaging] Ship gandiva with the conda-forge packages
ARROW-4655 - [Packaging] Parallelize binary upload
ARROW-4662 - [Python] Add support of type_codes in UnionType
ARROW-4667 - [C++] Suppress unused function warnings with MinGW
ARROW-4670 - [Rust] array_ops::sum performance optimizations
ARROW-4671 - [C++] MakeBuilder doesn't support Type::DICTIONARY
ARROW-4673 - [C++] Implement Scalar::Equals and Datum::Equals
ARROW-4676 - [C++] Add support for debug build with MinGW
ARROW-4678 - [Rust] Minimize unstable feature usage
ARROW-4679 - [Rust] Implement in-memory data source for DataFusion
ARROW-4681 - [Rust][DataFusion] Partition aware data sources
ARROW-4686 - [Dev] Only accept 'y' or 'n' in merge_arrow_pr.py prompts
ARROW-4689 - [Go] Add support for wasm
ARROW-4690 - Building TensorFlow compatible wheels for Arrow
ARROW-4692 - [Flight] Explain sidecar in

Open source →

0.12.020 Jan 2019Breaking

ARROW-3859 - [Arrow][Java] Fixed backward incompatible change.

New Features and Improvements

ARROW-45 - [Python] Add unnest/flatten function for List types
ARROW-536 - [C++] Provide non-SSE4 versions of functions that use CPU intrinsics for older processors
ARROW-554 - [C++] Add functions to unify dictionary types and arrays
ARROW-766 - [C++] Introduce zero-copy "StringPiece" type
ARROW-854 - [Format] Add tentative SparseTensor format
ARROW-912 - [Python] Recommend that Python developers use -DCMAKE_INSTALL_LIBDIR=lib when building Arrow C++ libraries
ARROW-1019 - [C++] Implement compressed streams
ARROW-1055 - [C++] GPU support library development
ARROW-1262 - [Packaging] Packaging automation in arrow-dist
ARROW-1423 - [C++] Create non-owned CudaContext from context handle provided by thirdparty user
ARROW-1492 - [C++] Type casting function kernel suite
ARROW-1688 - [Java] Fail build on checkstyle warnings
ARROW-1696 - [C++] Add (de)compression benchmarks
ARROW-1822 - [C++] Add SSE4.2-accelerated hash kernels and use if host CPU supports
ARROW-1993 - [Python] Add function for determining implied Arrow schema from pandas.DataFrame
ARROW-1994 - [Python] Test against Pandas master
ARROW-2183 - [C++] Add helper CMake function for globbing the right header files
ARROW-2211 - [C++] Use simpler hash functions for integers
ARROW-2216 - [CI] CI descriptions and envars are misleading
ARROW-2337 - Use Boost shared libraries in Windows release verification script. Parquet fixes
ARROW-2374 - [Rust] Add support for array of List<T>
ARROW-2475 - [Format] Confusing array length description
ARROW-2476 - [Python/Question] Maximum length of an Array created from ndarray
ARROW-2483 - [Rust] use bit-packing for boolean vectors
ARROW-2504 - [Website] Add ApacheCon NA link
ARROW-2535 - [Python] Provide pre-commit hooks that check flake8
ARROW-2560 - [Rust] The Rust README should include Rust-specific information on contributing
ARROW-2624 - [Python] Random schema generator for Arrow conversion and Parquet testing
ARROW-2637 - [C++/Python] Build support and instructions for development on Alpine Linux
ARROW-2648 - [Packaging] Follow up packaging tasks
ARROW-2653 - [C++] Refactor hash table support
ARROW-2670 - [C++/Python] Add Ubuntu 18.04 / gcc7 as a nightly build
ARROW-2673 - [Python] Add documentation + docstring for ARROW-2661
ARROW-2684 - [Python] Various documentation improvements
ARROW-2712 - [C#] Initial C# .NET library
ARROW-2720 - [C++] Defer setting of -std=c++11 compiler option to CMAKE_CXX_STANDARD, use CMake option for -fPIC
ARROW-2759 - [Plasma] Export plasma notification socket
ARROW-2803 - [C++] Put hashing function into src/arrow/util
ARROW-2807 - [Python][Parquet] Add memory_map= option to parquet.read_table, read_pandas, read_schema
ARROW-2808 - [Python] Add MemoryPool tests
ARROW-2919 - [C++/Python] Improve HdfsFile error messages, fix Python unit test suite
ARROW-2968 - [R] Multi-threaded conversion from Arrow table to R data.frame
ARROW-2995 - [CI] Build Python libraries in same run when running C++ unit tests so project does not need to be rebuilt again right away
ARROW-3020 - [C++/Python] Allow empty arrow::Table objects to be written as empty Parquet row groups
ARROW-3038 - [Go] implement String array
ARROW-3063 - [Go] remove list of TODOs from go/README
ARROW-3070 - [Packaging] Use Bintray
ARROW-3108 - [C++] arrow::PrettyPrint for Table instances
ARROW-3126 - [Python] Make Buffered* IO classes available to Python, incorporate into input_stream, output_stream factory functions
ARROW-3131 - [Go] add Go1.11 to the build matrix
ARROW-3161 - [Packaging] Ensure to run pyarrow unit tests in conda and wheel builds
ARROW-3169 - [C++] Break up array-test into multiple compilation units
ARROW-3184 - [C++] Enable modular builds and installs with ARROW_OPTIONAL_INSTALL option. Remove ARROW_GANDIVA_BUILD_TESTS
ARROW-3194 - [JAVA] Use split length in splitAndTransfer to set value count
ARROW-3199 - [Plasma] File descriptor send and receive retries
ARROW-3209 - [C++] Rename libarrow_gpu to libarrow_cuda
ARROW-3230 - [Python] Missing comparisons on ChunkedArray, Table
ARROW-3233 - [Python] Add prose documentation for CUDA support
ARROW-3248 - [C++] Add "arrow" prefix to Arrow core unit tests, use PREFIX instead of file name for csv, io, ipc tests. Modular target cleanup
ARROW-3254 - [C++] Add option to ADD_ARROW_TEST to compose a test executable from multiple .cc files containing unit tests
ARROW-3260 - [CI][skip appveyor]
ARROW-3272 - [Java][Docs] Add documentation about Java code style
ARROW-3273 - [Java] Fix checkstyle for Javadocs
ARROW-3278 - [Python] Retrieve StructType's and StructArray's field by name
ARROW-3291 - [C++] Add string_view-based constructor for BufferReader
ARROW-3293 - [C++] Test Flight RPC in Travis CI
ARROW-3296 - [Python] Add Flight support to manylinux1 wheels
ARROW-3303 - [C++] API for creating arrays from simple JSON string
ARROW-3306 - [R] Objects and support functions different kinds of arrow::Buffer
ARROW-3307 - [R] Convert chunked arrow::Column to R vector
ARROW-3310 - [R] Create wrapper classes for various Arrow IO interfaces
ARROW-3312 - [R] Use same .clang-format file for both R binding C++ code and main C++ codebase
ARROW-3315 - [R] Support for multi-threaded conversions from RecordBatch, Table to R data.frame
ARROW-3318 - [C++] Push down read-all-batches operation on RecordBatchReader into C++
ARROW-3323 - [Java] Fix checkstyle naming
ARROW-3331 - [Gandiva][C++] Add re2 to toolchain
ARROW-3340 - [R] support for dates and time classes
ARROW-3347 - [Rust] Implement PrimitiveArrayBuilder
ARROW-3353 - [Packaging] Build python 3.7 wheels
ARROW-3355 - [R] Support for factors
ARROW-3358 - [Gandiva][C++] Deprecate Gandiva Status.
ARROW-3362 - [R] Guard against null buffers
ARROW-3366 - [R] Dockerfile for docker-compose setup
ARROW-3368 - [Integration/CI/Python] Add dask integration test to docker-compose setup
ARROW-3380 - [Python] Support reading gzipped CSV files
ARROW-3381 - [C++] Add bz2 codec
ARROW-3383 - [Gandiva][Java] Fix java build
ARROW-3384 - [Gandiva] Sync remaining commits from gandiva repo
ARROW-3385 - [Gandiva][C++][Java] Crossbow support for deploying gandiva jars
ARROW-3387 - [C++] Implement Binary to String cast
ARROW-3398 - [Rust] Update existing Builder to use MutableBuffer internally
ARROW-3402 - [Gandiva][C++] Utilize common bitmap operation implementations in precompiled IR routines
ARROW-3407 - [C++] Add UTF8 handling to CSV conversion
ARROW-3409 - [C++] Streaming compression and decompression interfaces
ARROW-3421 - [C++] Add include-what-you-use setup to primary docker-compose.yml
ARROW-3427 - [C++] Add Windows support, Unix static libs for double-conversion package in conda-forge
ARROW-3429 - [Packaging] Add binary upload script
ARROW-3430 - [Packaging] Add workaround to verify 0.11.0
ARROW-3431 - [GLib] Include Gemfile to archive
ARROW-3432 - [Packaging] Expand variables in commit message
ARROW-3433 - [C++] Validate re2 with Windows toolchain, EP
ARROW-3439 - [R] R language bindings for Feather format
ARROW-3440 - [Gandiva] fix readme for builds
ARROW-3441 - [Gandiva] Use common unit test creation facilities, do not produce multiple executables for the same unit tests
ARROW-3442 - [C++] Allow dynamic linking of (most) unit tests
ARROW-3450 - [R] Wrap MemoryMappedFile class
ARROW-3451 - [C++/Python] pyarrow and numba CUDA interop
ARROW-3455 - [Gandiva][C++] Support pkg-config for Gandiva
ARROW-3456 - [CI] Reuse docker images and optimize docker-compose containers
ARROW-3460 - [Packaging] Add a script to rebase master on local release branch
ARROW-3461 - [Packaging] Add a script to upload RC artifacts as the official release
ARROW-3462 - [Packaging] Update CHANGELOG for 0.11.0
ARROW-3463 - [Website] Update for 0.11.0
ARROW-3464 - [Packaging] Build shared libraries for gandiva fat JAR via crossbow
ARROW-3465 - [Documentation] Fix gen_apidocs' docker image
ARROW-3469 - [Gandiva] Add gandiva travis OSX entry
ARROW-3472 - [Gandiva] remove gandiva_helpers library
ARROW-3473 - [Format] Clarify that 64-bit lengths and null counts are permitted, but not recommended
ARROW-3474 - [GLib] Extend gparquet API with get_schema and read_column
ARROW-3479 - [R] Support to write record_batch as stream
ARROW-3482 - [C++] Build with JEMALLOC by default
ARROW-3487 - [Gandiva] simplify fns that return errors
ARROW-3488 - [Packaging] Separate crossbow task definition files for packaging and tests
ARROW-3489 - [Gandiva][C++] Added support for IN expressions
ARROW-3490 - [R] streaming of arrow objects to streams
ARROW-3492 - [C++] Build jemalloc in parallel
ARROW-3493 - [Java] Make sure bound checks are off
ARROW-3499 - [R] Expose arrow::ipc::Message type
ARROW-3501 - [Gandiva] Enable building with gcc 4.8.x on Ubuntu Trusty, similar distros
ARROW-3504 - [Plasma] Add support for Plasma Client to put/get raw bytes without pyarrow serialization.
ARROW-3505 - [R] Read record batch and table
ARROW-3506 - [Packaging] Nightly tests for docker-compose images
ARROW-3508 - [C++] Build against double-conversion from conda-forge
ARROW-3515 - [C++] Introduce NumericTensor class
ARROW-3518 - Detect HOMEBREW_PREFIX automatically
ARROW-3519 - [Gandiva] Arena for varlen output fns
ARROW-3521 - [GLib] Run Python using find_program in meson.build
ARROW-3529 - [Ruby] Import Red Parquet
ARROW-3530 - [Java/Python] Add conversion for pyarrow.Schema from org.apache…pojo.Schema
ARROW-3533 - [Python/Documentation] Use sphinx_rtd_theme instead of Bootstrap
ARROW-3536 - [C++] Add UTF8 validation functions
ARROW-3537 - [Rust] Implement Tensor Type
ARROW-3539 - [CI/Packaging] Update scripts to build against vendored jemalloc
ARROW-3540 - [Rust] Incorporate BooleanArray into PrimitiveArray
ARROW-3542 - [C++] Use unsafe appends when building array from CSV
ARROW-3545 - [C++/Python] Use "field" terminology with StructType, specify behavior with duplicate field names
ARROW-3547 - [R] Protect against Null crash when reading from RecordBatch
ARROW-3548 - [Plasma] Add CreateAndSeal object store method for faster puts for small objects.
ARROW-3551 - Update MapD to OmniSci on Powered By page
ARROW-3553 - [R] Error when losing data on int64, uint64 conversions to double
ARROW-3555 - [Plasma] Unify plasma client get function using metadata.
ARROW-3556 - [CI] Disable optimizations on Windows
ARROW-3557 - [Python] Set Cython language level
ARROW-3558 - [Plasma] Remove fatal error when calling get on unsealed object.
ARROW-3559 - [Plasma] Static linking for plasma_store_server.
ARROW-3562 - [R] Disallow creation of objects with shared_ptr<T>(nullptr), use bits64::integer64
ARROW-3563 - [C++] Declare public link dependencies so arrow_static, plasma_static automatically pull in transitive dependencies
ARROW-3566 - [Format] Clarify the type of dictonary encoded field
ARROW-3567 - [Gandiva][GLib] Add GLib bindings of Gandiva
ARROW-3568 - [Packaging] Run pyarrow unittests for windows wheels
ARROW-3569 - [Packaging] Run pyarrow unittests when building conda package
ARROW-3574 - [Plasma] Use static libraries in plasma library.
ARROW-3575 - [Python] New documentation page for CSV reader
ARROW-3576 - [Python] Implemented compressed streams
ARROW-3577 - [Go] implement Chunked array
ARROW-3581 - [Gandiva][C++] Use protobuf as shared library when -DARROW_PROTOBUF_USE_SHARED=ON
ARROW-3582 - [CI] fix incantation for C++/Java detection tool
ARROW-3583 - [Python/Java] Create RecordBatch from VectorSchemaRoot
ARROW-3584 - [Go] Implement Table, Schema and Column
ARROW-3587 - [Python] Efficient serialization for Arrow Objects (array, table, tensor, etc)
ARROW-3588 - [Java] Fix checkstyle for header license
ARROW-3589 - [Gandiva] Make gandiva JNI wrappers optional
ARROW-3591 - [R] Support for collecting decimal types
ARROW-3592 - [Python] Allow getting view of a binary scalar
ARROW-3597 - [Gandiva] gandiva should integrate with ADD_ARROW_TEST for tests
ARROW-3600 - [CI/Packaging] Add Ubuntu 18.10
ARROW-3601 - [Rust] Add instructions for publishing to crates.io
ARROW-3602 - [Gandiva][Python] Initial Gandiva Cython bindings
ARROW-3603 - [Gandiva][C++] Support building with ARROW_BOOST_VENDORED=ON
ARROW-3605 - [Plasma] Remove dependence of plasma/events.h on ae.h.
ARROW-3607 - [Java] delete() method via JNI for plasma
ARROW-3608 - [R] Support for time32 and time64 array types
ARROW-3609 - [Gandiva] Convert Gandiva benchmark tests as gbenchmark t…
ARROW-3610 - [C++] Add interface to turn stl_allocator into arrow::MemoryPool
ARROW-3611 - [Python] Give better error message when type_id has wrong type.
ARROW-3612 - [Go] implement RecordBatch and RecordBatchReader
ARROW-3615 - [R] Support for NaN
ARROW-3616 - [Java] Fix remaining checkstyle issues
ARROW-3618 - [Packaging/Documentation] Add -c conda-forge option to avoid PackagesNotFoundError
ARROW-3620 - [Python] Document pa.cpu_count() in Sphinx API docs
ARROW-3621 - [Go] implement Table, Record, RecordReader and TableReader
ARROW-3622 - [Go] implement Schema.Equal
ARROW-3623 - [Go] implement Field.Equal
ARROW-3624 - [Python/C++] Support for zero-sized device buffers and device-to-device copying
ARROW-3625 - [Go] add examples for Table, Record and {Table,Record}Reader
ARROW-3626 - [Go] implement CSV reader
ARROW-3627 - [Go] add RecordBatchBuilder
ARROW-3629 - [Python] Add write_to_dataset to Python Sphinx API listing
ARROW-3630 - [Plasma][GLib] Add GLib bindings of Plasma
ARROW-3632 - [Packaging] Update deb names in dev/tasks/tasks.yml in release process
ARROW-3633 - [Packaging] Update deb names in dev/tasks/tasks.yml for 0.12.0
ARROW-3636 - [C++/Python] Update arrow/python/pyarrow_api.h
ARROW-3638 - [C++][Python] Move reading from Feather as Table feature to C++ from Python
ARROW-3639 - [Packaging] Run gandiva nightly packaging tasks
ARROW-3640 - [Go] implement Tensors
ARROW-3641 - [Python] Remove unneeded public keyword from pyarrow public C APIs
ARROW-3642 - [C++] Add arrowConfig.cmake generation
ARROW-3644 - [Rust] Implement ListArrayBuilder
ARROW-3645 - [Python] Document compression support in Sphinx
ARROW-3646 - [Python] High-level IO API
ARROW-3647 - [R] Fix R bit64 crash and formatting
ARROW-3648 - [Plasma][Java] Add API to get metadata and data at the same time
ARROW-3649 - [Rust] Refactor MutableBuffer's resize
ARROW-3656 - [C++] Allow whitespace in numeric CSV fields
ARROW-3657 - [R] there is no package called bit64
ARROW-3659 - [CI] Fix Travis matrix entry 2 documentation to use gcc
ARROW-3660 - [C++] Don't unnecessarily lock MemoryMappedFile for resizing in readonly files
ARROW-3661 - [Gandiva][GLib] Use "_" as word separator in constant name
ARROW-3662 - [C++] Add a const overload to MemoryMappedFile::GetSize
ARROW-3664 - [Rust] Add benchmark for PrimitiveArrayBuilder
ARROW-3665 - [Rust] Implement StructArrayBuilder
ARROW-3666 - [C++] Improve C++ parser performance
ARROW-3672 - & ARROW-3673: [Go] add support for time32 and time64 array
ARROW-3673 - [Go] implement Time64 array
ARROW-3674 - [Go] Implement Date32 and Date64 array types
ARROW-3675 - [Go] implement Date64 array
ARROW-3677 - [Go] Add fixed-length binary builder and array
ARROW-3681 - [Go] Add benchmarks for CSV reader
ARROW-3682 - [Go] unexport encoding/csv.Reader from CSV reader
ARROW-3683 - [Go] add functional-option style to configure the CSV reader
ARROW-3684 - [Go] Add chunking ability to CSV reader
ARROW-3692 - [Gandiva][Ruby] Add Ruby bindings of Gandiva
ARROW-3693 - [R] Invalid buffer for empty characters with null data
ARROW-3694 - [Java] Avoid superfluous string creation when logging level is disabled
ARROW-3695 - [Gandiva] Use add_arrow_lib()
ARROW-3696 - [C++] Add feather::TableWriter::Write(table)
ARROW-3697 - [Ruby]
ARROW-3701 - [Gandiva] add op for decimal 128
ARROW-3708 - [Packaging] Support CMake files in Linux packages
ARROW-3713 - [Rust] Implement BinaryArrayBuilder
ARROW-3718 - [Gandiva] Remove spurious gtest include
ARROW-3719 - [GLib] Support read/write table to/from Feather
ARROW-3720 - [GLib] Use "indices" instead of "indexes"
ARROW-3721 - [Gandiva][Python] Support all Gandiva literals
ARROW-3722 - [C++] Allow specifying types of CSV columns
ARROW-3723 - [Plasma][Ruby] Add Ruby bindings of Plasma
ARROW-3724 - [GLib] Update .gitignore
ARROW-3725 - [GLib] Add field readers to GArrowStructDataType
ARROW-3726 - [Rust] Add CSV reader with example
ARROW-3727 - [Python] Document use of foreign_buffer()
ARROW-3731 - MVP to read parquet in R library
ARROW-3733 - [GLib] Add to_string() to GArrowTable and GArrowColumn
ARROW-3736 - [CI/Docker] Ninja test in docker-compose run cpp hangs
ARROW-3738 - [C++] Parse ISO8601-like timestamps in CSV columns
ARROW-3741 - [R] Add support for arrow::compute::Cast to convert Arrow arrays from one type to anothe
ARROW-3743 - [Ruby] Add support for saving/loading Feather
ARROW-3744 - [Ruby] Use garrow_table_to_string() in Arrow::Table#to_s
ARROW-3746 - [Gandiva][Python] Print list of functions registered with gandiva
ARROW-3747 - [C++] Switch order of struct members in Decimal128
ARROW-3748 - [GLib] Add GArrowCSVReader
ARROW-3749 - [GLib] Fix typos
ARROW-3751 - [Gandiva][Python] Add more cython bindings for gandiva
ARROW-3752 - [C++] Remove unused status::ArrowError
ARROW-3753 - [Gandiva] Remove debug print
ARROW-3755 - [GLib] Add GArrowCompressedInputStream and GArrowCompressedOutputStream
ARROW-3760 - [R] Support Arrow CSV reader
ARROW-3773 - [C++] Remove redundant AssertArraysEqual function from before monorepo merge
ARROW-3778 - [C++] Compile parts of test-util.h that we can once, link with unit tests
ARROW-3781 - [C++] Implement BufferedOutputStream::SetBufferSize. Allocate buffer from MemoryPool
ARROW-3782 - [C++] Implement BufferedInputStream to pair with BufferedOutputStream
ARROW-3784 - [R] Array with type fails with x is not a vector
ARROW-3785 - [C++] Enable using double-conversion from $ARROW_BUILD_TOOLCHAIN
ARROW-3787 - [Rust] Implement From<ListArray> for BinaryArray
ARROW-3788 - [Ruby] Add support for CSV parser written in C++
ARROW-3795 - [R] Support for retrieving NAs from INT64 arrays
ARROW-3796 - [Rust] Add Example for PrimitiveArrayBuilder
ARROW-3798 - [GLib] Add support for column type CSV read option
ARROW-3800 - [C++] Vendor a string_view backport
ARROW-3803 - [C++/Python] Merge C++ builds and tests, run Python tests in separate CI entries
ARROW-3807 - [R] Missing Field API
ARROW-3819 - [Packaging] Update conda variant files to conform with feedstock after compiler migration
ARROW-3821 - [Format/Documentation] : Fix typos and grammar issues in Flight.proto comments
ARROW-3823 - [R] + buffer.complex
ARROW-3825 - [Python] Document how to run the Python unit tests in python/README.md
ARROW-3826 - [C++] Determine if using ccache caching in Travis CI actually improves build times
ARROW-3830 - [GLib] Add GArrowCodec
ARROW-3834 - [Doc] Merge C++ and Python documentation
ARROW-3836 - [C++] Add PREFIX, EXTRA_LINK_LIBS, DEPENDENCIES to ADD_ARROW_BENCHMARK
ARROW-3839 - [Rust] Add ability to infer schema in CSV reader
ARROW-3841 - [C++] Suppress catching polymorphic type by value warning
ARROW-3842 - [R] RecordBatchStreamWriter api
ARROW-3844 - [C++] Remove ARROW_USE_SSE and ARROW_SSE3
ARROW-3845 - [Gandiva][GLib] Add GGandivaNode
ARROW-3847 - [GLib] Remove unnecessary ''
ARROW-3849 - [C++] Leverage Armv8 crc32 extension instructions to accelerate the hash computation for Arm64
ARROW-3851 - [C++] Run clang-format in parallel
ARROW-3852 - [C++] Suppress used uninitialized warning
ARROW-3853 - [C++] Implement string to timestamp cast
ARROW-3854 - [GLib] Deprecate garrow_gio_{input,output}_stream_get_raw()
ARROW-3855 - [Rust] Schema/Field/Datatype now have derived serde traits
ARROW-3856 - [Ruby] Support compressed CSV save/load
ARROW-3858 - [GLib] Use {class_name}_get_instance_private
ARROW-3859 - [Arrow][Java] Fixed backward incompatible change. (#3018)
ARROW-3860 - [C++] Add ARROW_GANDIVA_STATIC_LIBSTDCPP option to restore hard-coded behavior prior to ARROW-3437
ARROW-3862 - [C++] Improve third-party dependencies download script
ARROW-3863 - [GLib] Use travis_retry with brew bundle command
ARROW-3864 - [GLib] Add support for allow-float-truncate cast option
ARROW-3865 - [Packaging] Add double-conversion dependency to conda forge recipes and the windows wheel build
ARROW-3867 - [Documentation] Uploading binary realase artifacts to Bintray
ARROW-3868 - [Rust] Switch to nightly Rust for required build, stable is now allowed to fail
ARROW-3870 - [C++] Add Peek to InputStream abstract interface
ARROW-3871 - [R] Replace usages of C++ GetValuesSafely with new methods on ArrayData
ARROW-3878 - [Rust] Improve primitive types
ARROW-3880 - [Rust] Implement simple math operations for numeric arrays
ARROW-3881 - [Rust] PrimitiveArray<T> should support comparison operators
ARROW-3883 - [Rust] Update README
ARROW-3884 - [Python] Add LLVM6 to manylinux1 base image
ARROW-3885 - [Rust] Release prepare step should increment Rust version
ARROW-3886 - [C++] Add support for decompressed buffer size check for Snappy
ARROW-3891 - [Java] Remove Long.bitCount with simple bitmap operations
ARROW-3893 - [C++] Improve adaptive int builder performance
ARROW-3895 - [Rust] csv::Reader now returns Result<Option> instead of Option<Result>
ARROW-3899 - [Python] Table.to_pandas converts Arrow date32[day] to pandas datetime64[ns]
ARROW-3900 - [GLib] Add garrow_mutable_buffer_set_data()
ARROW-3905 - [Ruby]
ARROW-3906 - [C++] Break out builder.cc into multiple compilation units
ARROW-3908 - [Rust] Update rust dockerfile to use nightly toolchain
ARROW-3910 - [Python] Set date_as_objects=True as default in to_pandas methods
ARROW-3911 - [Python] Deduplicate datetime.date objects in Table.to_pandas internals
ARROW-3912 - [Plasma][GLib] Add support for creating and referring objects
ARROW-3913 - [Gandiva][GLib] Add GGandivaLiteralNode
ARROW-3914 - [C++/Python/Packaging] Docker-compose setup for Alpine linux
ARROW-3916 - [Python] Add support for filesystem kwarg in ParquetWriter
ARROW-3921 - [GLib][CI] Log Homebrew output
ARROW-3922 - [C++] Micro-optimizations to BitUtil::GetBit
ARROW-3924 - [Packaging][Plasma] Add support for Plasma deb/rpm packages
ARROW-3925 - [Python] Add autoconf to conda install instructions
ARROW-3928 - [Python] Deduplicate Python objects when converting binary, string, date, time types to object arrays
ARROW-3929 - [Go] improve CSV reader memory usage
ARROW-3930 - [C++] Avoid using Mersenne Twister for random test data
ARROW-3932 - [Python] Include Benchmarks.md in Sphinx docs
ARROW-3934 - [Gandiva] Only add precompiled tests if ARROW_GANDIVA_BUILD_TESTS
ARROW-3938 - [Packaging] Stop to refer java/pom.xml to get version information
ARROW-3939 - [Rust] Remove macro definition for ListArrayBuilder
ARROW-3945 - [Website] Update website for Gandiva donation
ARROW-3946 - [GLib] Add support for union
ARROW-3948 - [GLib][CI] Set timeout to Homebrew
ARROW-3950 - [Plasma] Make loading the TensorFlow op optional
ARROW-3952 - [Rust] Upgrade to Rust 2018 Edition
ARROW-3958 - [Plasma] Reduce number of IPCs
ARROW-3959 - [Rust] Add date/time data types
ARROW-3960 - [Rust] remove extern crate for Rust 2018
ARROW-3963 - [Packaging/Docker] Nightly test for building sphinx documentations
ARROW-3964 - [Go] Refactor examples of csv reader
ARROW-3967 - [Gandiva][C++] Make node.h public
ARROW-3970 - [Gandiva][C++] Remove unnecessary boost dependencies.
ARROW-3971 - [Python] Remove deprecations in 0.11 and prior
ARROW-3974 - [C++] Combine field_builders_ and children_ members in array/builder.h
ARROW-3982 - [C++] Allow "binary" input in simple JSON format
ARROW-3983 - [Gandiva][Crossbow] Link Boost statically in JAR packaging scripts
ARROW-3984 - [C++] Exit with error if user hits zstd ExternalProject path
ARROW-3986 - [C++] Document memory management and table APIs
ARROW-3986 - [C++] Write prose documentation
ARROW-3987 - [Java] Benchmark results for ARROW-1807
ARROW-3988 - [C++] Do not build unit tests by default, fix building Gandiva unit tests when ARROW_BUILD_TESTS=OFF
ARROW-3993 - [JS] CI Jobs Failing
ARROW-3994 - [C++] Remove ARROW_GANDIVA_BUILD_TESTS option
ARROW-3995 - [CI] Use understandable names on Travis
ARROW-3997 - [Documentation] Clarify dictionary index type
ARROW-4002 - [C++][Gandiva] Remove needless CMake version check
ARROW-4004 - [GLib] Replace GPU with CUDA
ARROW-4005 - [Plasma][GLib] Add gplasma_client_disconnect()
ARROW-4006 - Add CODE_OF_CONDUCT.md
ARROW-4009 - [CI] Run Valgrind and C++ code coverage in different builds
ARROW-4010 - [C++] Enable Travis CI scripts to only build and install only certain targets
ARROW-4015 - [Plasma] remove unused interfaces for plasma manager
ARROW-4017 - [C++] Move vendored libraries in dedicated directory
ARROW-4026 - [C++] Add *-all, *-tests, *-benchmarks modular CMake targets. Use in Travis CI
ARROW-4028 - [Rust] Merge parquet-rs codebase
ARROW-4029 - [C++] Exclude headers with 'internal' from installation. Document header file conventions in README
ARROW-4030 - [CI] Use travis_terminate in more script commands to fail faster
ARROW-4035 - [Ruby] Support msys2 mingw dependencies
ARROW-4037 - [Packaging] Remove workaround to verify 0.11.0
ARROW-4038 - [Rust] Implement boolean AND, OR, NOT array ops
ARROW-4039 - [Python] Update link to 'development.rst' page from Python README.md
ARROW-4042 - [Rust] Rename BinaryArray::get_value to value
ARROW-4043 - [Packaging/Docker] Python tests on alpine miss pytest dependency
ARROW-4044 - [Packaging/Python] Add hypothesis test dependency to pyarrow conda recipe
ARROW-4045 - [Packaging/Python] Add hypothesis test dependency to wheel crossbow tests
ARROW-4048 - [GLib] Return ChunkedArray instead of Array in gparquet_arrow_file_reader_read_column
ARROW-4051 - [Gandiva][GLib] Add support for null literal
ARROW-4054 - [Python] Update gtest, flatbuffers and OpenSSL in manylinux1 base image
ARROW-4060 - [Rust] Add parquet arrow converter.
ARROW-4069 - [Python] Add tests for casting binary -> string/utf8. Add pyarrow.utf8() type factory alias for readability
ARROW-4075 - [Rust] Reuse array builder after calling finish()
ARROW-4079 - [C++] Add machine benchmark
ARROW-4080 - [Rust] Improving lengthy build times in Appveyor
ARROW-4082 - [C++] Allow RelWithDebInfo, improve FindClangTools
ARROW-4084 - [C++] Make Status static method support variadic arguments
ARROW-4085 - [GLib] Use "field" for struct data type
ARROW-4087 - [C++] Make CSV spellings of null values configurable
ARROW-4093 - [C++] Fix wrong suggested method name
ARROW-4098 - [Python] Deprecate open_file/open_stream top level APIs in favor of using ipc namespace
ARROW-4100 - [Gandiva][C++] Fix regex for special character dot.
ARROW-4102 - [C++] Return common IdentityCast when casting to equal type
ARROW-4103 - [Docs] Move documentation build instructions from source/python/development.rst to docs/README.md
ARROW-4105 - [Rust] Add rust-toolchain to enforce user to use nightly toolchain for building
ARROW-4107 - [Python] Use ninja in pyarrow manylinux1 build
ARROW-4112 - [Packaging] Add support for Gandiva .deb
ARROW-4116 - [Python] Add warning to development instructions to avoid virtualenv when using Anaconda/miniconda
ARROW-4122 - [C++] Initialize class members based on codebase static analysis
ARROW-4127 - [Documentation][Python] Add instructions to build with Docker
ARROW-4129 - [Python] Fix syntax problem in benchmark docs
ARROW-4132 - [GLib] Add more GArrowTable constructors
ARROW-4141 - [Ruby] Add support for creating schema from raw Ruby objects
ARROW-4148 - [CI/Python] Disable ORC on nightly Alpine builds
ARROW-4150 - [C++] Ensure allocated buffers have non-null data pointer
ARROW-4151 - [Rust] Restructure project directories
ARROW-4152 - [GLib] Remove an example to show Torch integration
ARROW-4153 - [GLib] Add builder_append_value() for consistency
ARROW-4154 - [GLib] Add GArrowDecimal128DataType
ARROW-4155 - [Rust] Implement array_ops::sum() for PrimitiveArray<T>
ARROW-4156 - [C++] Don't use object libs with Xcode
ARROW-4158 - Allow committers to set ARROW_GITHUB_API_TOKEN for merge script, better debugging output
ARROW-4160 - [Rust] Add README and executable files to parquet
ARROW-4161 - [GLib] Add PlasmaClientOptions
ARROW-4162 - [Ruby] Add support for creating data types from description
ARROW-4166 - [Ruby] Add support for saving to and loading from buffer
ARROW-4167 - [Gandiva] switch to arrow/util/variant
ARROW-4168 - [GLib] Use property to keep GArrowDataType passed in garrow_field_new()
ARROW-4172 - [Rust] more consistent naming in array builders
ARROW-4174 - [Ruby] Add support for building composite array from raw Ruby objects
ARROW-4175 - [GLib] Add support for decimal compare operators
ARROW-4177 - [C++] Add ThreadPool and TaskGroup microbenchmarks
ARROW-4183 - [Ruby] Add Arrow::Struct as an element of Arrow::StructArray
ARROW-4184 - [Ruby] Add Arrow::RecordBatch#to_table
ARROW-4191 - [C++] Use same CC and AR for jemalloc as for the main sources
ARROW-4199 - [GLib] Add garrow_seekable_input_stream_peek()
ARROW-4207 - [Gandiva][GLib] Add support for IfNode
ARROW-4210 - [Python] Mention boost-cpp directly in the conda meta.yaml for pyarrow
ARROW-4211 - [GLib] Add GArrowFixedSizeBinaryDataType
ARROW-4214 - [Ruby] Add support for building RecordBatch from raw Ruby objects
ARROW-4216 - [Python] Add CUDA API docs
ARROW-4228 - [GLib] Add garrow_list_data_type_get_field()
ARROW-4229 - [Packaging] Set crossbow target explicitly to enable building arbitrary arrow repo
ARROW-4233 - [Packaging] Use Docker to build source archive
ARROW-4239 - [Packaging] Fix version update for the next version
ARROW-4240 - [Packaging] Add missing Plasma GLib and Gandiva GLib documents to souce archive
ARROW-4241 - [Packaging] Disable crossbow conda OSX clang builds
ARROW-4243 - [Python] Fix test failures with pandas 0.24.0rc1
ARROW-4249 - [Plasma] Clean up client namespace
ARROW-4257 - [Release] Update release verification script to check binaries on Bintray
ARROW-4266 - [Python][CI] Disable ORC tests in dask integration test
ARROW-4269 - [Python] Fix serialization in pandas 0.22
ARROW-4270 - [Packaging][Conda] Update xcode version and remove toolchain builds
ARROW-4276 - [Release] Remove needless Bintray authentication from binaries verify script
ARROW-4306 - [Release] Update website and add blog post announcing 0.12.0 release
PARQUET-690 - [C++] Reuse Thrift resources when serializing metadata structures
PARQUET-1271 - [C++] Rename parquet_reader tool to parquet-reader for consistency
PARQUET-1439 - Remove PARQUET_ARROW_LINKAGE option, clean up overall library linking configuration
PARQUET-1449 - [C++] Support building with ARROW_BOOST_VENDORED=ON
PARQUET-1463 - [C++] Utilize common hashing machinery for dictionary encoding
PARQUET-1467 - [C++] Remove defunct ChunkedAllocator code
PARQUET-1473 - [C++] Add helper function that converts ParquetVersion to human-friendly string
PARQUET-1484 - [C++] Improve memory usage of FileMetaDataBuilder

Bug Fixes

ARROW-1847 - [Doc] Document the difference between RecordBatch and Table in an FAQ fashion
ARROW-2026 - [C++] Enforce use_deprecated_int96_timestamps to all time…
ARROW-2038 - [Python] Strip s3:// scheme in S3FSWrapper isdir() and isfile()
ARROW-2113 - /3768: [Python] set classpath to all hadoop jars when HADOOP_HOME present
ARROW-2591 - [Python] Add Parquet test case writing list-typed column with empty lists that caused segfault on 0.9.0
ARROW-2592 - [Python] Add "ignore_metadata" option to Table.to_pandas
ARROW-2654 - [Python] Error with errno 22 when loading 3.6 GB Parquet file
ARROW-2708 - [C++] Internal GetValues function in arrow::compute should check for nullptr
ARROW-2831 - [Plasma] MemoryError in teardown
ARROW-2970 - [Python] Support conversions of NumPy string arrays requiring chunked binary output
ARROW-2987 - [Python] test_cython_api can fail if run in an environment where vsvarsall.bat has been run more than once
ARROW-3048 - [Python] Import pyarrow fails if scikit-learn is installed from conda (boost-cpp / libboost issue)
ARROW-3058 - [Python] Raise more helpful better error message when writing a pandas.DataFrame to Feather format that requires a chunked layout
ARROW-3186 - [GLib][CI] Use the latest Meson again
ARROW-3202 - [C++] Fix compilation on Alpine Linux by using ARROW_WITH_BACKTRACE define
ARROW-3225 - [C++/Python] Pandas object conversion of ListType<DateType> and ListType<TimeType>
ARROW-3324 - [Python] Destroy temporary metadata builder classes more eagerly when building files to reduce memory usage
ARROW-3343 - [Java] Disable flaky tests
ARROW-3405 - [Python] Document CSV reader
ARROW-3428 - [Python] Fix from_pandas conversion from float to bool
ARROW-3436 - [C++] Boost version required by Gandiva is too new for Ubuntu 14.04
ARROW-3437 - [C++] Use older API for boost::optional, remove gtest include from prod code, remove -static-libstdc++ flags
ARROW-3438 - [Packaging] Fix too much Markdown escape in CHANGELOG
ARROW-3445 - [GLib] Fix libarrow-glib link for libparquet-glib
ARROW-3449 - [C++] Fixes to build with CMake 3.2. Document what requires newer CMake
ARROW-3466 - [C++] Avoid leaking protobuf symbols
ARROW-3467 - [C++] Fix building against external double-conversion
ARROW-3470 - [C++] Fix row-wise example
ARROW-3477 - [C++] fixes for 32 bit architectures
[ARROW-3480](https://issues.apac

Open source →