Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zip_list fails on some very large zip files but not others #115

Open
mirickmi opened this issue Jun 19, 2024 · 0 comments
Open

zip_list fails on some very large zip files but not others #115

mirickmi opened this issue Jun 19, 2024 · 0 comments

Comments

@mirickmi
Copy link

mirickmi commented Jun 19, 2024

Hi,

so I have received three .zip files.
All of them contain the same data type (a huge number of small CSV files).
zip-File1: 33.7 GB (about 1.4 million files)
zip-File2: 27.9 GB (about 1.4 million files)
zip-File3: 26.7 GB (about 650.000 files)

For some reason I can list the files within the first two zip-files but not within the third (even if I try to read only that particular file). The function zip_list() immediately returns a 'Cannot open zip file XXX.zip' error message.
Unfortunately, I cannot provide the zip files for reproducibility.
I'm working on Windows 10 (64-bit).

Is it possible that this has to do with the sheer amount of files (which appear to be larger in size/file within the third zip-file)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant