B Search Erros
Return Home
Newest questions tagged python - Stack Overflow

How to stream and convert 50GB+ Zip of CSVs to Parquet in S3/MinIO without local disk?

I'm writing a Python script as a component of data pipeline that takes a zipped archive of CSV files from the landing bucket, extracts the files, converts them to Parquet, and puts them back into another Minio bucket. La

View original source