TLDR Tech / Data
How We Accelerated Transpilation by Compiling SQLGlot with mypyc
Fivetran dramatically accelerated SQLGlot (the popular pure-Python SQL parser, transpiler, and optimizer) by compiling it with mypyc, a tool that turns well-typed Python code into fast C extensions. They ship the compiled version as an optional package that delivers ~5x faster parsing, ~2.5x faster SQL generation, and 2-2.5x faster optimization, while keeping the original pure-Python version as the default for maximum compatibility.
Read the full story