#DuckDB (and a tonne of RAM) have absolutely saved my behind these last few months while dealing with huge biological datasets.
If you do any #data munging at all on a daily basis, well worth picking up DuckDB. Don't let the DB part fool you, it's more like #Dask or #Spark but #SQL .
https://duckdb.org/