Url-Categorization

[rohit-raje-786]

After running the 01_construct_features.py getting an error "['main_category_confidence'] not in index"

[domantasm96]

Hey, thank you for your message.

I think the problem is that URL categorization dataset file is corrupted due to GitHub LFS restrictions. I would suggest you to download an original dataset from https://data.world/crowdflower/url-categorization website.

Let me know if the issue still remains.

[rohit-raje-786]

I have downloaded the dataset mentioned in the link below you send and also set dataset path in config.py file then too it is showing the error main_category_index not found.

…

On Tue, 26 Jan 2021, 01:31 Domantas Meidus, ***@***.***> wrote: Hey, thank you for your message. I think the problem is that URL categorization dataset file is corrupted due to GitHub LFS restrictions. I would suggest you to download an original dataset from https://data.world/crowdflower/url-categorization website. Let me know if the issue still remains. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#5 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AOX63N3VVTPXCHPQH4ZYU4LS3XE2JANCNFSM4WQVP5WQ> .

[domantasm96]

Updated code with the fixed solution. The problem was that data.world provides two datasets with the same set of data but with different columns names:

1. original/URL-categorization-DFE.csv (column: 'main_category:confidence')
2. data/url_categorization_dfe.csv (column: 'main_category_confidence')

In my previous code 2 option dataset was used so if you used 1 option, then the error may occur on different column naming.

Thank you for reporting the problem and let me know if the issue is still remains unsolved or you have any other problems in term of executing this code!

Cheers!

[rohit-raje-786]

It worked.

…

On Thu, 28 Jan 2021 at 9:19 PM, Domantas Meidus ***@***.***> wrote: Updated code with the fixed solution. The problem was that data.world provides two datasets with the same set of data but with different columns names: 1. original/URL-categorization-DFE.csv (column: 'main_category:confidence') 2. data/url_categorization_dfe.csv (column: 'main_category_confidence') In my previous code 2 option dataset was used so if you used 1 option, then the error may occur on different column naming. Thank you for reporting the problem and let me know if the issue is still remains unsolved or you have any other problems in term of executing this code! Cheers! — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#5 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AOX63N653OT4JR4J6O3NSU3S4GBRVANCNFSM4WQVP5WQ> .