github.com/dgraph-io/badger

Fixed

• Fix Sequence generates duplicate values (#1281)
• Ensure bitValuePointer flag is cleared for LSM entry values written to LSM (#1313)
• Confirm badgerMove entry required before rewrite (#1302)
• Drop move keys when its key prefix is dropped (#1331)
• Compaction: Expired keys and delete markers are never purged (#1354)
• Restore: Account for value size as well (#1358)
• GC: Consider size of value while rewriting (#1357)
• Rework DB.DropPrefix (#1381)
• Update head while replaying value log (#1372)
• Remove vlog file if bootstrap, syncDir or mmap fails (#1434)
• Levels: Compaction incorrectly drops some delete markers (#1422)
• Fix(replay) - Update head for LSM entries also (#1456)
• Fix(Backup/Restore): Keep all versions (#1462)
• Fix build on Plan 9 (#1451)

New APIs

• Badger.DB
  • NewWriteBatchAt (#948)
• Badger.Options
  • WithEventLogging (#1035)
  • WithVerifyValueChecksum (#1052)
  • WithBypassLockGuard (#1243)

Features

• Support checksum verification for values read from vlog (#1052)
• Add EventLogging option (#1035)
• Support WriteBatch API in managed mode (#948)
• Add support for watching nil prefix in Subscribe API (#1246)

Fixed

• Initialize vlog before starting compactions in db.Open (#1226)
• Fix int overflow for 32bit (#1216)
• Remove the 'this entry should've caught' log from value.go (#1170)
• Fix merge iterator duplicates issue (#1157)
• Fix segmentation fault in vlog.Read (header.Decode) (#1150)
• Fix VerifyValueChecksum checks (#1138)
• Fix windows dataloss issue (#1134)
• Fix request increment ref bug (#1121)
• Limit manifest's change set size (#1119)
• Fix deadlock in discard stats (#1070)
• Acquire lock before unmapping vlog files (#1050)
• Set move key's expiresAt for keys with TTL (#1006)
• Fix deadlock when flushing discard stats. (#976)
• Fix table.Smallest/Biggest and iterator Prefix bug (#997)
• Fix boundaries on GC batch size (#987)
• Lock log file before munmap (#949)
• VlogSize to store correct directory name to expvar.Map (#956)
• Fix transaction too big issue in restore (#957)
• Fix race condition in updateDiscardStats (#973)
• Cast results of len to uint32 to fix compilation in i386 arch. (#961)
• Drop discard stats if we can't unmarshal it (#936)
• Open all vlog files in RDWR mode (#923)
• Fix race condition in flushDiscardStats function (#921)
• Ensure rewrite in vlog is within transactional limits (#911)
• Fix prefix bug in key iterator and allow all versions (#950)
• Fix discard stats moved by GC bug (#929)

Performance

• Use fastRand instead of locked-rand in skiplist (#1173)
• Fix checkOverlap in compaction (#1166)
• Optimize createTable in stream_writer.go (#1132)
• Add capacity to slice creation when capacity is known (#1103)
• Introduce fast merge iterator (#1080)
• Introduce StreamDone in Stream Writer (#1061)
• Flush vlog buffer if it grows beyond threshold (#1067)
• Binary search based table picker (#983)
• Making the stream writer APIs goroutine-safe (#959)
• Replace FarmHash with AESHash for Oracle conflicts (#952)
• Change file picking strategy in compaction (#894)
• Use trie for prefix matching (#851)
• Fix busy-wait loop in Watermark (#920)

This is a release including almost 200 commits, so expect many changes - some of them not backward compatible.

Regarding backward compatibility in Badger versions, you might be interested on reading VERSIONING.md.

Note: The hashes in parentheses correspond to the commits that impacted the given feature.

New APIs

• badger.DB

  • DropPrefix (291295e)
  • Flatten (7e41bba)
  • KeySplits (4751ef1)
  • MaxBatchCount (b65e2a3)
  • MaxBatchSize (b65e2a3)
  • PrintKeyValueHistogram (fd59907)
  • Subscribe (26128a7)
  • Sync (851e462)

• badger.DefaultOptions() and badger.LSMOnlyOptions() (91ce687)

  • badger.Options.WithX methods

• badger.Entry (e9447c9)

  • NewEntry
  • WithMeta
  • WithDiscard
  • WithTTL

• badger.Item

  • KeySize (fd59907)
  • ValueSize (5242a99)

• badger.IteratorOptions

  • PickTable (7d46029, 49a49e3)
  • Prefix (7d46029)

• badger.Logger (fbb2778)

• badger.Options

  • CompactL0OnClose (7e41bba)
  • Logger (3f66663)
  • LogRotatesToFlush (2237832)

• badger.Stream (14cbd89, 3258067)

• badger.StreamWriter (7116e16)

• badger.TableInfo.KeyCount (fd59907)

• badger.TableManifest (2017987)

• badger.Tx.NewKeyIterator (49a49e3)

• badger.WriteBatch (6daccf9, 7e78e80)

Modified APIs

Breaking

• badger.DefaultOptions and badger.LSMOnlyOptions are now functions rather than variables (91ce687)
• badger.Item.Value now receives a function that returns an error (439fd46)
• badger.Txn.Commit doesn't receive any params now (6daccf9)
• badger.DB.Tables now receives a boolean (76b5341)

Features

• badger.LSMOptions changed values (799c33f)
• badger.DB.NewIterator now allows multiple iterators per RO txn (41d9656)
• badger.Options.TableLoadingMode's new default is options.MemoryMap (6b97bac)

Removed APIs

• badger.ManagedDB (d22c0e8)
• badger.Options.DoNotCompact (7e41bba)
• badger.Txn.SetWithX (e9447c9)

Tools

• badger bank disect (13db058)
• badger bank test (13db058) --mmap (03870e3)
• badger fill (7e41bba)
• badger flatten (7e41bba)
• badger info --histogram (fd59907) --history --lookup --show-keys --show-meta --with-prefix (09e9b63) --show-internal (fb2eed9)
• badger benchmark read (239041e)
• badger benchmark write (6d3b67d)

This is a release including almost 200 commits, so expect many changes - some of them not backward compatible.

Regarding backward compatibility in Badger versions, you might be interested on reading VERSIONING.md.

Note: The hashes in parentheses correspond to the commits that impacted the given feature.

New APIs

• badger.DB

  • DropPrefix (291295e)
  • Flatten (7e41bba)
  • KeySplits (4751ef1)
  • MaxBatchCount (b65e2a3)
  • MaxBatchSize (b65e2a3)
  • PrintKeyValueHistogram (fd59907)
  • Subscribe (26128a7)
  • Sync (851e462)

• badger.DefaultOptions() and badger.LSMOnlyOptions() (91ce687)

  • badger.Options.WithX methods

• badger.Entry (e9447c9)

  • NewEntry
  • WithMeta
  • WithDiscard
  • WithTTL

• badger.Item

  • KeySize (fd59907)
  • ValueSize (5242a99)

• badger.IteratorOptions

  • PickTable (7d46029, 49a49e3)
  • Prefix (7d46029)

• badger.Logger (fbb2778)

• badger.Options

  • CompactL0OnClose (7e41bba)
  • Logger (3f66663)
  • LogRotatesToFlush (2237832)

• badger.Stream (14cbd89, 3258067)

• badger.StreamWriter (7116e16)

• badger.TableInfo.KeyCount (fd59907)

• badger.TableManifest (2017987)

• badger.Tx.NewKeyIterator (49a49e3)

• badger.WriteBatch (6daccf9, 7e78e80)

Modified APIs

Breaking changes:

• badger.DefaultOptions and badger.LSMOnlyOptions are now functions rather than variables (91ce687)
• badger.Item.Value now receives a function that returns an error (439fd46)
• badger.Txn.Commit doesn't receive any params now (6daccf9)
• badger.DB.Tables now receives a boolean (76b5341)

Not breaking changes:

• badger.LSMOptions changed values (799c33f)
• badger.DB.NewIterator now allows multiple iterators per RO txn (41d9656)
• badger.Options.TableLoadingMode's new default is options.MemoryMap (6b97bac)

Removed APIs

• badger.ManagedDB (d22c0e8)
• badger.Options.DoNotCompact (7e41bba)
• badger.Txn.SetWithX (e9447c9)

Tools:

• badger bank disect (13db058)
• badger bank test (13db058) --mmap (03870e3)
• badger fill (7e41bba)
• badger flatten (7e41bba)
• badger info --histogram (fd59907) --history --lookup --show-keys --show-meta --with-prefix (09e9b63) --show-internal (fb2eed9)
• badger benchmark read (239041e)
• badger benchmark write (6d3b67d)

• Introduce support for Go Modules

• Introduce support for Go Modules