Skip to content
This repository has been archived by the owner on May 17, 2022. It is now read-only.

udemyscraper timesout #55

Closed
nuggetsnetwork opened this issue Dec 19, 2021 · 3 comments
Closed

udemyscraper timesout #55

nuggetsnetwork opened this issue Dec 19, 2021 · 3 comments
Labels
bug Something isn't working duplicate This issue or pull request already exists

Comments

@nuggetsnetwork
Copy link

nuggetsnetwork commented Dec 19, 2021

Describe the bug
When running the sample code all I get is timeout.

To Reproduce
Steps to reproduce the behavior:
Run the sample code
from udemyscraper import UdemyCourse

course = UdemyCourse()
course.fetch_course('learn javascript')
print(course.title)

Current behavior
Timed out waiting for page to load or could not find a matching course

OS: MACOS

@nuggetsnetwork nuggetsnetwork added the bug Something isn't working label Dec 19, 2021
@sortedcord
Copy link
Owner

sortedcord commented Dec 19, 2021

Duplicate issue. Please check out the pinned issue #46

@sortedcord sortedcord added the duplicate This issue or pull request already exists label Dec 19, 2021
@nuggetsnetwork
Copy link
Author

I think the problem is the page view source doesnt show the classes that are written in the code. So both the page source and DOM are completely different. Only the DOM elements shows the classes and the search results html code but the actual page source of the search results doesnt have any html that the page is rendering. Is that what was called as scrape shield? In such a case does it mean we wont be able to use this package?

@sortedcord
Copy link
Owner

More or less yes. I have it in the readme as well that I am not working on the project anymore. If you want to fetch course info, you can use Udemy's API. Its wayy more straightforward and u can get ur API credentials relatively easily. I started implementing the use of Udemy's API but then abandoned it midway mainly because of lack of motivation. Its still there, so in case you want to you're always welcome.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working duplicate This issue or pull request already exists
Projects
None yet
Development

No branches or pull requests

2 participants