Skip to content

Latest commit

 

History

History
177 lines (142 loc) · 32.6 KB

README.md

File metadata and controls

177 lines (142 loc) · 32.6 KB

pib

PIB articles for the year - 2023


Dec, 2023
PIB_Daily - Dec 2023 PIB_Monthly - Dec 2023 PIB_Text - Dec 2023 PIB_Links - Dec 2023
Nov, 2023
PIB_Daily - Nov 2023 PIB_Monthly - Nov 2023 PIB_Text - Nov 2023 PIB_Links - Nov 2023
Oct, 2023
PIB_Daily - Oct 2023 PIB_Monthly - Oct 2023 PIB_Text - Oct 2023 PIB_Links - Oct 2023
Sep, 2023
PIB_Daily - Sep 2023 PIB_Monthly - Sep 2023 PIB_Text - Sep 2023 PIB_Links - Sep 2023
Aug, 2023
PIB_Daily - Aug 2023 PIB_Monthly - Aug 2023 PIB_Text - Aug 2023 PIB_Links - Aug 2023
Jul, 2023
PIB_Daily - Jul 2023 PIB_Monthly - Jul 2023 PIB_Text - Jul 2023 PIB_Links - Jul 2023
Jun, 2023
PIB_Daily - Jun 2023 PIB_Monthly - Jun 2023 PIB_Text - Jun 2023 PIB_Links - Jun 2023
May, 2023
PIB_Daily - May 2023 PIB_Monthly - May 2023 PIB_Text - May 2023 PIB_Links - May 2023
Apr, 2023
PIB_Daily - Apr 2023 PIB_Monthly - Apr 2023 PIB_Text - Apr 2023 PIB_Links - Apr 2023
Mar, 2023
PIB_Daily - Mar 2023 PIB_Monthly - Mar 2023 PIB_Text - Mar 2023 PIB_Links - Mar 2023
Feb, 2023
PIB_Daily - Feb 2023 PIB_Monthly - Feb 2023 PIB_Text - Feb 2023 PIB_Links - Feb 2023
Jan, 2023
PIB_Daily - Jan 2023 PIB_Monthly - Jan 2023 PIB_Text - Jan 2023 PIB_Links - Jan 2023

PIB articles for the year - 2022


Dec, 2022
PIB_Daily - Dec 2022 PIB_Monthly - Dec 2022 PIB_Text - Dec 2022 PIB_Links - Dec 2022
Nov, 2022
PIB_Daily - Nov 2022 PIB_Monthly - Nov 2022 PIB_Text - Nov 2022 PIB_Links - Nov 2022
Oct, 2022
PIB_Daily - Oct 2022 PIB_Monthly - Oct 2022 PIB_Text - Oct 2022 PIB_Links - Oct 2022
Sep, 2022
PIB_Daily - Sep 2022 PIB_Monthly - Sep 2022 PIB_Text - Sep 2022 PIB_Links - Sep 2022
Aug, 2022
PIB_Daily - Aug 2022 PIB_Monthly - Aug 2022 PIB_Text - Aug 2022 PIB_Links - Aug 2022
Jul, 2022
PIB_Daily - Jul 2022 PIB_Monthly - Jul 2022 PIB_Text - Jul 2022 PIB_Links - Jul 2022
Jun, 2022
PIB_Daily - Jun 2022 PIB_Monthly - Jun 2022 PIB_Text - Jun 2022 PIB_Links - Jun 2022
May, 2022
PIB_Daily - May 2022 PIB_Monthly - May 2022 PIB_Text - May 2022 PIB_Links - May 2022
Apr, 2022
PIB_Daily - Apr 2022 PIB_Monthly - Apr 2022 PIB_Text - Apr 2022 PIB_Links - Apr 2022
Mar, 2022
PIB_Daily - Mar 2022 PIB_Monthly - Mar 2022 PIB_Text - Mar 2022 PIB_Links - Mar 2022
Feb, 2022
PIB_Daily - Feb 2022 PIB_Monthly - Feb 2022 PIB_Text - Feb 2022 PIB_Links - Feb 2022
Jan, 2022
PIB_Daily - Jan 2022 PIB_Monthly - Jan 2022 PIB_Text - Jan 2022 PIB_Links - Jan 2022

PIB articles for the year - 2021


Dec, 2021
PIB_Daily - Dec 2021 PIB_Monthly - Dec 2021 PIB_Text - Dec 2021 PIB_Links - Dec 2021
Nov, 2021
PIB_Daily - Nov 2021 PIB_Monthly - Nov 2021 PIB_Text - Nov 2021 PIB_Links - Nov 2021
Oct, 2021
PIB_Daily - Oct 2021 PIB_Monthly - Oct 2021 PIB_Text - Oct 2021 PIB_Links - Oct 2021
Sep, 2021
PIB_Daily - Sep 2021 PIB_Monthly - Sep 2021 PIB_Text - Sep 2021 PIB_Links - Sep 2021
Aug, 2021
PIB_Daily - Aug 2021 PIB_Monthly - Aug 2021 PIB_Text - Aug 2021 PIB_Links - Aug 2021
Jul, 2021
PIB_Daily - Jul 2021 PIB_Monthly - Jul 2021 PIB_Text - Jul 2021 PIB_Links - Jul 2021
Jun, 2021
PIB_Daily - Jun 2021 PIB_Monthly - Jun 2021 PIB_Text - Jun 2021 PIB_Links - Jun 2021
May, 2021
PIB_Daily - May 2021 PIB_Monthly - May 2021 PIB_Text - May 2021 PIB_Links - May 2021
Apr, 2021
PIB_Daily - Apr 2021 PIB_Monthly - Apr 2021 PIB_Text - Apr 2021 PIB_Links - Apr 2021
Mar, 2021
PIB_Daily - Mar 2021 PIB_Monthly - Mar 2021 PIB_Text - Mar 2021 PIB_Links - Mar 2021
Feb, 2021
PIB_Daily - Feb 2021 PIB_Monthly - Feb 2021 PIB_Text - Feb 2021 PIB_Links - Feb 2021
Jan, 2021
PIB_Daily - Jan 2021 PIB_Monthly - Jan 2021 PIB_Text - Jan 2021 PIB_Links - Jan 2021

PIB articles for the year - 2020


Dec, 2020
PIB_Daily - Dec 2020 PIB_Monthly - Dec 2020 PIB_Text - Dec 2020 PIB_Links - Dec 2020
Nov, 2020
PIB_Daily - Nov 2020 PIB_Monthly - Nov 2020 PIB_Text - Nov 2020 PIB_Links - Nov 2020
Oct, 2020
PIB_Daily - Oct 2020 PIB_Monthly - Oct 2020 PIB_Text - Oct 2020 PIB_Links - Oct 2020
Sep, 2020
PIB_Daily - Sep 2020 PIB_Monthly - Sep 2020 PIB_Text - Sep 2020 PIB_Links - Sep 2020
Aug, 2020
PIB_Daily - Aug 2020 PIB_Monthly - Aug 2020 PIB_Text - Aug 2020 PIB_Links - Aug 2020
Jul, 2020
PIB_Daily - Jul 2020 PIB_Monthly - Jul 2020 PIB_Text - Jul 2020 PIB_Links - Jul 2020
Jun, 2020
PIB_Daily - Jun 2020 PIB_Monthly - Jun 2020 PIB_Text - Jun 2020 PIB_Links - Jun 2020
May, 2020
PIB_Daily - May 2020 PIB_Monthly - May 2020 PIB_Text - May 2020 PIB_Links - May 2020
Apr, 2020
PIB_Daily - Apr 2020 PIB_Monthly - Apr 2020 PIB_Text - Apr 2020 PIB_Links - Apr 2020
Mar, 2020
PIB_Daily - Mar 2020 PIB_Monthly - Mar 2020 PIB_Text - Mar 2020 PIB_Links - Mar 2020
Feb, 2020
PIB_Daily - Feb 2020 PIB_Monthly - Feb 2020 PIB_Text - Feb 2020 PIB_Links - Feb 2020
Jan, 2020
PIB_Daily - Jan 2020 PIB_Monthly - Jan 2020 PIB_Text - Jan 2020 PIB_Links - Jan 2020

Download articles from Press Information Bureau, India. This might be helpful for candidates preparing for different govt examinations.

Downloading Articles:

Join the telegram channel to get PIB Articles daily, click here                       or
You can either use the spider by cloning this repo and following the instructions given below
                      or
You can download the articles direcly from the release section or by clicking on the badges above for the year and month.

There are 4 different kind of zips in the release section for every month

  1. Day wise PIB_Daily | MMM_YYYY : These zips contain the PIB articles for the date DD/MMM/YYYY
  2. Month wise PIB_Monthly | MMM_YYYY : These zips contain the PIB articles for the whole month MMM/YYYY
  3. Text files PIB_Text | MMM_YYYY : These zips contain the text extracted from pdf of the whole month MMM/YYYY
  4. Article Link files PIB_LINKS | MMM_YYYY : These text files contains links for the article for the date DD/MMM/YYYY

How to use:

#Clone the repo with:
git clone https://github.com/nit-in/pib
#cd to the cloned repo
cd pib
#installing required packages
pip install -r requirements.txt
#when these steps are done,you are ready to run the spider and download the articles.

#source the env file
source .env

#if you are using shell other than bash then 
bash --init-file .env

#run the spider
pib start_date end_date #(date format: yyyy-mm-dd)
#example => to download the articles from June 1st, 2021 to June 15th, 2021; use
pib 2021-06-01 2021-06-15

For an Entire Month

#For the month of Jan, 2021
pib_month Jan 2021

#For the month of Dec, 2020
pib_month Dec 2020

#For present day
pib_today

#For last day
pib_last_day

You can now fork the repo and Go to (You may have add repo secret named PIB) check the process

Actions > Select "PIB_INDIA_MINISTRY" > Run workflow
and Select appropriate options and run the workflow

IMG_20231106_101656

To run locally

source .env
pib_min start_date end_date ministry_code

For ministry code check ministries.txt file for desired ministry

Read this if you are forking the repo

you may have trouble with github tokens when you are running it after forking it click on profile icon > Settings > Developer settings > Personal access tokens > generate new token(classic) Name it, no expiration in scopes > select repo, workflow, write and delete packages, then generate and copy it IMG_20231117_204211.jpg

then go to pib repo Settings > Secrets and variables > Actions here new repository secret in name enter PIB ( all in caps) and in secret > paste the token you copied IMG_20231117_204101.jpg

Any suggestions and improvements are welcome.