-
Notifications
You must be signed in to change notification settings - Fork 185
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Error occurs with downloading kkbox dataset #68
Comments
Thank you for posting the issue. I've not tested obtaining this dataset on windows, so it's not that surprising there might be some bugs. It looks like the code is failing here, so if there is a file not found, then that path might not be correct. The other alternative would be that the 7z command doesn't work as expected. from pycox.datasets import kkbox
self = kkbox
train_path = self._path_dir / "train.csv.7z"
print(train_path.exists()) # This should print "True" if the file is found And if this prints "True", can you then try: print(subprocess.check_output(['7z', '--help']).decode('utf-8')) which should print out the help pages for 7z to ensure that 7z works on your machine. Finally, if both of these works, can you try this and poste the error message that you get from it? import subprocess
subprocess.check_output(['7z', 'x', str(train_path), f"-o{self._path_dir}", '-y']) |
Thanks for your reply!
=> True
=> [WinError 2] The system cannot find the file specified
=> [WinError 2] The system cannot find the file specified |
So then the issues seems to be that 7z doesn't work. Do you know how to check if it installed? And if it is not installed could you try to install it? In the mean time I'll check if there is a way I can unzip with a python package, such that we don't have to call a non-python program for unzipping as we do now. |
So, can you try installing py7zr with import py7zr
archive = py7zr.SevenZipFile(str(train_path), mode='r')
archive.extractall(path=str(self._path_dir))
print((self._path_dir / 'train.csv').exists()) If this doesn't error out, and prints "True", we can use this package for uncompressing instead of the os command. |
Hi, havakv
This command works~ it returns 'True'.
|
Hi, havakv I extracted the data by using the google colab. Many thanks~! |
|
It's great that you found a way to get your data @daehwanahn, and thank you for testing py7zr on windows for me. I'll rewrite the code to use py7zr for windows then. |
Let's just keep it open until this works smoothly in windows too. |
Hi, havakv
I have the same issue with #42. (Error occurs with 'download.kkbox()').
My OS is windows and installed with pip.
I checked the path you suggested and 3 files (for training) were there.
But, I got the same problem (FileNotFoundError) during 'extracting train...'.
Do you have any idea about this?
Thank you
Hi,
What OS are you on (Window, Mac, Linux)?
Have you installed the package using pip or by pulling this repo?
Have you set the
PYCOX_DATA_DIR
environment variable?Can you check the directory <pycox_path>/datasets/data/kkbox and list the files there?
The <pycox_path> can be found by running
and remove the
__init__.py
part. So I want to you list the content of a folder such as/Users/teboozas/anaconda3/envs/some_env/lib/python3.8/site-packages/pycox/datasets/data/kkbox
(if you're on a mac).You should be seeing some *.7z files.
Originally posted by @havakv in #42 (comment)
The text was updated successfully, but these errors were encountered: