Turbolytics logo

Turbolytics

SQLFlow (DuckDB for streaming data) Go Rewrite 10x Throughput

Share on:
Listing image

sqlflow v1 processes up to 927,000 messages per second on a laptop, Kafka in and DuckDB SQL out, inside a flat 250 MiB. Every figure comes from one reproducible command.

sqlflow benchmarks Skip to content turbolytics Products Docs About Contact GitHub sqlflow / benchmarks Measured, and reproducible. The v1 Go engine processes up to 927,000 messages per second on a laptop. Kafka in, DuckDB SQL, sink out, inside a flat 250 MiB of memory regardless of batch size or handler. Every number on this page comes from a single command, and the command is here too. Apple M1 Pro, 10 cores, 32 GB Docker 20.10.13 DuckDB v1.5.2 Go 1.25.5 cp-kafka 7.3.2, one partition commit 337541e 927k msgs/sec Peak throughput, StructuredBatch, batch 5000 250 MiB Container memory, flat acros

Related listings

A free MCP server for facts LLMs get wrong (time zones, holidays, FX)

Live conditions from the weather station on my roof on Long Island, NY.

agents that set themselves up from your GitHub repo

Compare monthly snapshots of Wikipedia articles, inspect changed passages, and check cited sources.

Generate outfit transition videos from a single photo

graph-based MCP memory with an RL-trained forgetting policy