TLDR Tech / Data
Have Your Cake and Decompress it Too
SpiralDB's Vortex columnar format implements Cascading Compression, a recursive, data-driven approach that chains multiple lightweight, fast-decoding encodings per column. It evaluates schemes on stratified samples (~1% of data), selects the best greedy path, and recursively compresses intermediate outputs (codes, dictionaries, and lengths) in a depth-limited tree to handle skewed, clustered, or mixed distributions without relying on a fixed codec like ZSTD.
Read the full story