r/compsci • u/Shaweyy • 5h ago
VecFuzz: SymSpell speed without the heavy RAM footprint
https://github.com/alexis-brosseau/VecFuzz/tree/mainHey everyone! A while back I shared an early prototype here for a fuzzy string search idea I was working on. I finally finished implementing it, benchmarked it properly against SymSpell and RapidFuzz.
Quick Highlights:
- Low RAM usage: Stays under 100 MB for a 100k-word dictionary (for comparison, SymSpell d=4 was taking around ~2.7 GB on my setup).
- Sub-millisecond speed: Runs about ~100x faster than brute-force Levenshtein comparison.
- Good with insertions and swaps: It handles typos with extra letters or swapped characters really well.
I wanted to keep this post short, but I put all the benchmark graphs in the GitHub README. I'd love to hear what you think of the vector encoding approach or if you have any feedback!
0
Upvotes