My laptop is now my warehouse
I analyse tens of millions of rows of public transport data that used to crash pandas. The file querying lessons were exactly what I needed.
Browse
Query CSV, Parquet and JSON files with SQL, explore millions of rows in seconds and share results from Python, without a server or a warehouse
Created by Priya Raghavan
DuckDB is an analytical database that runs inside the process that uses it: in your terminal, in a Python script or in a notebook. There is no server to install and no account to create, and it can scan millions of rows from Parquet or CSV files in seconds on an ordinary laptop. For analysts this changes what is practical to do locally.
You should already know basic SQL. The course is aimed at analysts who hit the limits of spreadsheets or pandas memory, and at engineers who want a fast local tool for exploring data before it reaches a warehouse.
We use DuckDB 1.x through its command line client and Python package. Datasets are public: city bike trips, taxi rides and open government data, ranging from a few thousand rows to tens of millions.
Streaming and data platform engineer. Kafka, Python pipelines and DuckDB explained plainly
I work on data platforms where events arrive all day and someone always wants yesterday's numbers fixed. Most of my time goes into Kafka topics, Python ingestion services and the small analytical tools that make debugging them faster.
I started teaching because new data engineers kept asking me the same questions: why is this consumer lagging, why did this file load twice, why is this query slow. My courses answer those questions with small, complete examples rather than slides.
Outside work I maintain a few open source notebooks for teaching SQL over Parquet files, and I like explaining file formats more than I probably should.
I analyse tens of millions of rows of public transport data that used to crash pandas. The file querying lessons were exactly what I needed.
The twenty minute exploration routine is now my first step with every new dataset.
Querying pandas data frames by name with SQL replaced a lot of awkward merge code in my notebooks.
Clear, short lessons. The spatial extension lesson was a nice surprise. I would like more on performance tuning.
I appreciated the note that the friendly SQL shortcuts are DuckDB specific and where they differ in other warehouses.
Solid course. The S3 and httpfs lesson was a bit brief for my use case, but the rest was very good.