TLDR Tech / Data
pg_infer 1.0.0 released -- transformer model knowledge as SQL relations
pg_infer is a PostgreSQL 18+ extension that makes transformer internals queryable in SQL, so model inference can be costed, parallelized, joined, and filtered like regular database work. It runs efficiently on CPU, supports BitNet models, and can offload inference to replicas or DR hosts.
Read the full story