NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
crates.io
crates.io, #2369 most downloaded on crates.io
Tantivy-sub crate: bitpacking
Latest stable
0.27.0
Last release 1 months ago
16 Oct 2026
Ships fairly regularly
a new release about every 7 months
Most releases are documented
notes for 8 of 11 stable releases
Nothing withdrawn
no release was ever pulled
5 years old
11 releases · first in 2021
Drag across the ruler to compare, or tap a release to open it.
.set_fast(..) now takes a &str. The same behavior as .set_fast(None) can be obtained with .set_fast(tantivy::RAW_TOKENIZER_NAME). #3020 #3029 ( @fulmi
================================
.set_fast(..) now takes a &str. The same behavior as .set_fast(None) can be obtained with .set_fast(tantivy::tokenizer::RAW_TOKENIZER_NAME). #3020 #3029(@fulmicoton @trinity-1686a)FieldType::TieBreaker variant; exhaustive matches on FieldType need a new arm.Custom variants to FieldType, Type, OwnedValue, ReferenceValueLeaf and SegmentComponent, and new TantivyError variants. SegmentComponent is no longer Copy, SegmentSerializer is removed and IndexMerger::write now takes a &Segment #2993(@rebasedming)IndexSettings has a new public sort_by_field field, and ColumnarWriter::serialize / FastFieldsWriter::serialize take an optional doc id mapping #2959(@rebasedming)Directory writers only need terminate(), not flush(). RamDirectory::deep_clone is removed #3095(@PSeitz)BooleanWeight::new is removed; use BooleanWeight::with_minimum_number_should_match #3071(@fulmicoton)SumAggregation has a new none_if_no_match field #2878(@mdashti)IntermediateTermBucketResult::entries() returns a slice instead of a hash map, and intermediate aggregation results no longer implement PartialEq #3040(@PSeitz)*AggReqData) and columnar::ColumnBlockAccessor are no longer public #3110 #3066(@fulmicoton)tantivy-sstable: BlockReader::from_multiple_blocks and DeltaReader::from_multiple_blocks take the first term ordinal of each block #3030(@flow3d)CompactDoc::node_data is no longer public #3175(@fulmicoton-dd)missing value also exists as a real term #3163(@PSeitz)missing is used with include/exclude #2907(@barbarj)after_key on a non-empty page, like Elasticsearch #2910(@Abdul-Andha)datasketches for cardinality aggregation, fixing sketch LIST serialization, and switch to HLL8 #2936(@fulmicoton)DisjunctionMaxQuery and other non-summing score combiners being scored as a sum with TopDocs #3022(@marcbachmann)>= 1.5 no longer matches 1) #3074(@fulmicoton)Streamer::term_ord() returning wrong ordinals when an automaton prunes dictionary blocks #3030(@flow3d)FacetCollector returning a facet from an unrelated branch #2867(@majiayu000)DateTime::try_from_utc #3156(@Darkheir)SegmentReader ignoring I/O errors when opening the positions file #2931(@JinheLin)rust-stemmers with frostem, fixing a panic on some Greek words #3028(@Xuanwo)StrColumn::ord_to_str, Term::get_json_path, the doc store and MemoryArena #3175 #3176(@fulmicoton-dd)SchemaBuilder::add_tie_breaker_field. Values are consecutive within a segment, start at a random offset, and are preserved across merges. #3104 #3143 #3158(@PSeitz @Mallets)jitexpr feature)
jitexpr crate, a Cranelift-based JIT expression compiler with arithmetic, comparison, boolean, null, math, string and regex functions #3078 #3083 #3090 #3107 #3109(@fulmicoton @fulmicoton-dd)JitExprPredicate to filter documents with a jitexpr expression over fast fields #3081 #3129(@fulmicoton)JitExprValueSourceProvider to use calculated fields in aggregations #3162 #3166(@fulmicoton)ValueSource abstraction to aggregate on computed values, registered via AggregationCollector::with_value_sources #3112 #3147 #3160 #3171(@fulmicoton)IntermediateAggregationResults::prune_intermediate_results to re-prune intermediate results with the request limits #2990(@trinity-1686a)none_if_no_match option to the sum aggregation #2878(@mdashti)validate_aggregation_fields_exist to check aggregation fields up front #2768(@mdashti)BucketEntries::iter() and TopNComputer::threshold public #2890(@alexanderbianchi)IndexSettings::sort_by_field), now with Str/Bytes fast field support and correct NULL ordering in merges #2959 #3116 #3185(@rebasedming @walter-woodall @fulmicoton)finalize_with_doc_id_mapping) #2978(@Mallets)field:*) in the query parser #2798(@Darkheir)DocPredicateQuery and FunctionPredicate to match documents with a per-document predicate #3072(@fulmicoton-dd)RegexPhraseQuery::from_regexes and RegexPhraseQuery::regexes() #3138(@palmoni5)FuzzyTermQuery::automaton() and make DfaWrapper public #3136(@palmoni5)SeekDangerResult for downstream DocSet implementations #3144(@PSeitz)BlockSegmentPostings::rank() to count docs below a target using the skip list #2958(@Windforce17)SegmentPlugin trait for custom per-segment components and custom field types #2993(@rebasedming)IndexMeta::list_segment_files() #3080(@fulmicoton)Snippet::fragment_range() #3134(@palmoni5)info! logs to debug! #3013(@mmustafasenoglu)select_nth for top-k #2989 #3017 #2987 #2983 #3174(@PSeitz @trinity-1686a @fulmicoton)seek_danger on RangeDocSet #2963(@PSeitz-dd)Intersection::seek #2982 #3164(@PSeitz @fulmicoton-dd)Weight::scorer_danger so intersections can build slow scorers (e.g. phrase) lazily around a candidate doc #3070(@fulmicoton)ExistsQuery on sparse fast fields #3052(@PSeitz)ConstScoreQuery disables scoring of the wrapped query #3059(@JinheLin)RegexPhraseQuery regexes once per query (up to 9x faster) #3135 #3137(@palmoni5)warm_postings_automaton_with_bitset to warm an automaton's postings and return matching docs in one pass #3157(@PSeitz)filter_vec implementations for ARM (~2.5x faster) #2940 #2952(@fulmicoton)Streamer::advance (up to 2x) and without_keys() streamers for automaton and range queries #3126 #3155(@trinity-1686a @fulmicoton)RamDirectory and remove unneeded flushes while writing segments #3095(@PSeitz)Your coding agent can read these notes before it upgrades. Set up the MCP server →
*Tantivy 0.10.0 index format is compatible with the index format in 0.9.0.*
Tantivy 0.10.0 index format is compatible with the index format in 0.9.0.
TopDocs::tweak_scoreand TopScore::custom_score (@pmasurel)query.count in presence of deletes (@pmasurel).explain(...) in Query and Weight to (@pmasurel)delete_all_documents in IndexWriter (@petr-tik).
All segments are simply removed.u16::max_value() - 4 chars are discarded silently instead of panicking.SegmentReader is created.IndexMeta is now public. (@hntd187)IndexWriter add_document, delete_term. IndexWriter is Sync, making it possible to use it with a Arc<RwLock<IndexWriter>>. add_document and delete_term can
only require a read lock. (@pmasurel)Opstamp as an expressive type alias for u64. (@petr-tik)AtomicU64 on all platforms (@petr-tik)Your program should be usable as is.
Fast fields used to be accessed directly from the SegmentReader.
The API changed, you are now required to acquire your fast field reader via the
segment_reader.fast_fields(), and use one of the typed method:
.u64(), .i64() if your field is single-valued ;.u64s(), .i64s() if your field is multi-valued ;.bytes() if your field is bytes fast field.*0.9.0 index format is not compatible with the previous index format.*
0.9.0 index format is not compatible with the previous index format.
Some Mmap objects were being leaked, and would never get released. (@fulmicoton)
INT_STORED and INT_INDEXED. It is now possible to use STORED and INDEXED
for int fields. (@fulmicoton)0.9.0 index format is not compatible with the previous index format.
Mmap objects were being leaked, and would never get released. (@fulmicoton)INT_STORED and INT_INDEXED. It is now possible to use STORED and INDEXED
for int fields. (@fulmicoton)tantivy 0.9 brought some API breaking change. To update from tantivy 0.8, you will need to go through the following steps.
schema::INT_INDEXED and schema::INT_STORED should be replaced by schema::INDEXED and schema::INT_STORED.
The index now does not hold the pool of searcher anymore. You are required to create an intermediary object called
IndexReader for this.
// create the reader. You typically need to create 1 reader for the entire
// lifetime of you program.
let reader = index.reader()?;
// Acquire a searcher (previously `index.searcher()`) is now written:
let searcher = reader.searcher();
// With the default setting of the reader, you are not required to
// call `index.load_searchers()` anymore.
//
// The IndexReader will pick up that change automatically, regardless
// of whether the update was done in a different process or not.
// If this behavior is not wanted, you can create your reader with
// the `ReloadPolicy::Manual`, and manually decide when to reload the index
// by calling `reader.reload()?`.
API Breaking change in the collector API. (@jwolfe, @fulmicoton)
No change in the index format
Special thanks to @drusellers and @jason-wolfe for their contributions to this release!
Special thanks to @drusellers and @jason-wolfe for their contributions to this release!
From now on Tantivy compiles on stable rust.
Configurable tokenization pipeline
TermInfo objectsRaise the limit of number of fields (previously 256 fields) (@fulmicoton)
(age:1)Special thanks to @Kodraus @lnicola @Ameobea @manuel-woelker @celaus for their contribution to this release.
Special thanks to @Kodraus @lnicola @Ameobea @manuel-woelker @celaus for their contribution to this release.
Thanks also to everyone in tantivy gitter chat for their advise and company :)
https://gitter.im/tantivy-search/tantivy
Warning
Tantivy 0.3 is NOT backward compatible with tantivy 0.2 code and index format. You should not expect backward compatibility before tantivy 1.0.
Index.wait_merge_threadsNothing published for this version
Nothing published for this version
Nothing published for this version
One column per quarter.