Skip to content

new-village/nsloader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

nsloader

Test PyPI version
This script collects articles from Wall Street Journal and returns it in dict format.

Installing nsloader and Supported Versions


nsloader is not registered on the pypi. You have to download from github directly.

$ python -m pip install nsloader

nsloader is tested by Python 3.10.

Dependencies


Additionaly, you have to execute install playwright in your execution environment.

Usage


To load the Wall Street Journal articles and parse to dictionay format.

Wall Street Journal

NOTE: You have to set 2 enviroment valiables name as WSJ_USERNAME and WSJ_PASSWORD before execution.

>>> from nsloader import wsj
>>> article = wsj.Article()
>>> article.load('https://www.wsj.com/articles/...')
>>> print(article.to_dict())
{"url": "https://www.wsj.com/articles/...", "title": "The Fed ...", "sub_title": "As expected ...",  ... }

About

This script collects articles from Wall Street Journal and returns it in dict format.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages