alt.hn

12/26/2025 at 8:52:48 AM

Pandas with Rows (2022)

https://datapythonista.me/blog/pandas-with-hundreds-of-millions-of-rows

by fud101

12/29/2025 at 10:51:41 PM

Same query solved in duckdb instead (generated by claude). I wasn't able to run on the full dataset due to an encoding issue I didn't feel like solving... but with everything up until 2001, it returns seconds on my M4 MBP.

https://gist.github.com/ChuckJonas/4ffb0743de0c20a61394a6b95...

by cjonas