9.0.0-rc1

Why RC1: Feature set is stable and I use it daily, but have not updated test suite to catch up with the new features yet.

• Changed default cache size from 100 to 10000

  • Index after compression doesn't take up that much space, and storage is
    generally cheap enough these days

• Adjusted cache eviction behaviour to be less strict on when eviction happens
  and thus less expensive

• Renamed --cache-size to --cache-soft-limit

• Removed periodic GC compact call to avoid freezes when working with many
  files

• Removed GC compact call during file indexing core loops to reduce overhead

• Added progress bars to initial document processing stage

• Swapped to using C backend for BLAKE2B hashing, this gives >20x speedup depending on CPU

• Swapped from JSON+GZIP to CBOR+GZIP serialization for indices

• Changed help info rotation key from h to ?

• Renamed discard mode to drop mode

• Added command history editing functionality

• Added --commands-from command line argument

• Added --tokens-per-search-scope-level command line argument

• Concurrency related bug fixes

  • Unlikely to encounter in normal workflows with human input speed

  • 14fcc45

  • bfd63d9

  • 4e0aa67

• Replaced print mode with copy mode

• Replaced single file view with key binding to change screen split ratio
  to remove feature discrepencies

• Added narrow mode for search scope narrowing

• Renamed --index-chunk-token-count to --index-chunk-size

• Renamed --sample-count-per-doc to --samples-per-doc