Skip to content

Latest commit

 

History

History
94 lines (64 loc) · 23.3 KB

README.md

File metadata and controls

94 lines (64 loc) · 23.3 KB

Government Resolutions, Government of Maharashtra

This repository contains government resolutions issued by the Government of Maharashtra for the last five years, there are two files for each resolution 1) original marathi (txt file) and 2) english translation of that resolution (txt file). The original government resolutions can be found at https://gr.maharashtra.gov.in/1145/Government-Resolutions.

The English translation is obtained by processing each the pdf file of each Government Resolution through a pipeline where the following operations are performed 1) Download the file using crawler 2) OCR to handle non-standard fonts 3) paragraph detection 4) table detection 5) translation to English. This pipeline is run in sepearate repositories check out orgpedia/mah* for each department.

Data Details

Num Department Name Start Date Last Date # Marathi Orders # Translated Orders Starting Order Last Order
1 Agriculture, Dairy Development, Animal Husbandry and Fisheries Department 16 Mar 2018 24 Sep 2024 4129 4129 201803161624182101.pdf mr en 202409241455193801.pdf mr en
2 Co-operation, Textiles and Marketing Department 19 Mar 2018 24 Sep 2024 2524 2524 201803191257576702.pdf mr en 202409241540466802.pdf mr en
3 Environment Department 02 Dec 2017 28 Aug 2024 569 569 201712041147216904.pdf mr en 202408291638051004.pdf mr en
4 Finance Department 14 Jan 2021 20 Sep 2024 711 711 202101141237329905.pdf mr en 202409201814444405.pdf mr en
5 Food, Civil Supplies and Consumer Protection Department 05 Feb 2018 24 Sep 2024 1060 1060 201802121244545806.pdf mr en 202409241211118206.pdf mr en
6 General Administration Department 16 Mar 2018 23 Sep 2024 4620 4620 201803161224022707.pdf mr en 202409231717145407.pdf mr en
7 Higher and Technical Education Department 12 Oct 2017 23 Sep 2024 2755 2755 201710121514029708.pdf mr en 202409231503481608.pdf mr en
8 Home Department 22 Oct 2008 24 Sep 2024 4153 4153 20081022.pdf mr en 202409241707323629.pdf mr en
9 Housing Department 16 Nov 2017 28 Mar 2024 352 352 201711161447076609.pdf mr en 202403281255554909.pdf mr en
10 Industries, Energy and Labour Department 15 Mar 2018 24 Sep 2024 1985 1985 201803151204055010.pdf mr en 202409241745272110.pdf mr en
11 Information Technology Department 20 Jan 2018 05 Mar 2024 111 111 201801201843024511.pdf mr en 202403051249430211.pdf mr en
12 Law and Judiciary Department 17 Mar 2018 06 Sep 2024 1873 1873 201803171129290212.pdf mr en 202409061555562912.pdf mr en
13 Marathi Language Department 22 Feb 2018 19 Sep 2024 349 349 201802031549154233.pdf mr en 202409191753295533.pdf mr en
14 Medical Education and Drugs Department 12 Mar 2018 23 Sep 2024 1252 1252 201803121137094813.pdf mr en 202409231319504513.pdf mr en
15 Minorities Development Department 09 Mar 2018 24 Sep 2024 972 972 201803091218355314.pdf mr en 202409241641523614.pdf mr en
16 Other Backward Bahujan Welfare Department 07 Mar 2022 24 Sep 2024 958 958 202203081752439334.pdf mr en 202409241507403834.pdf mr en
17 Parliamentary Affairs Department 12 Oct 2017 27 Feb 2024 106 106 201710031642378615.pdf mr en 202402271500283915.pdf mr en
18 Persons with Disabilities Welfare Department 04 Jan 2023 12 Sep 2024 81 81 202301041906309635.pdf mr en 202409131433290735.pdf mr en
19 Planning Department 09 Mar 2018 23 Sep 2024 1632 1632 201803091441032716.pdf mr en 202409231604341416.pdf mr en
20 Public Health Department 08 Feb 2018 23 Sep 2024 5930 5930 201801311722275417.pdf mr en 202409091423545517.pdf mr en
21 Public Works Department 05 Mar 2018 24 Sep 2024 3126 3126 201803051515468118.pdf mr en 202409241716084618.pdf mr en
22 Revenue and Forest Department 23 Mar 2021 23 Sep 2024 4131 4131 202103231328393119.pdf mr en 202409231541264019.pdf mr en
23 Rural Development Department 31 Mar 2021 24 Sep 2024 1708 1708 202103301021181120.pdf mr en 202409241455026520.pdf mr en
24 School Education and Sports Department 15 May 2018 24 Sep 2024 3970 3970 201805161114241221.pdf mr en 202409241731133521.pdf mr en
25 Skill Development and Entrepreneurship Department 17 Mar 2018 24 Sep 2024 974 974 201803171322099003.pdf mr en 202409241237411203.pdf mr en
26 Social Justice and Special Assistance Department 03 Dec 2019 23 Sep 2024 1405 1405 201912051107011622.pdf mr en 202409231110043922.pdf mr en
27 Soil and Water Conservation Department 16 Mar 2018 23 Sep 2024 2090 2090 201803161247582426.pdf mr en 202409231302572426.pdf mr en
28 Tourism and Cultural Affairs Department 14 Mar 2018 24 Sep 2024 1383 1383 201803131542054523.pdf mr en 202409241100133823.pdf mr en
29 Tribal Development Department 14 Mar 2018 20 Sep 2024 1962 1962 201803091105184924.pdf mr en 202409091058507324.pdf mr en
30 Urban Development Department 07 Mar 2018 23 Sep 2024 2732 2732 201803071203178325.pdf mr en 202409231438501925.pdf mr en
31 Water Resources Department 09 Mar 2018 24 Sep 2024 2861 2861 201803091034435527.pdf mr en 202409241654027927.pdf mr en
32 Water Supply and Sanitation Department 13 Mar 2018 19 Sep 2024 3839 3839 201803121414108428.pdf mr en 202409191500071328.pdf mr en
33 Women and Child Development Department 17 Mar 2018 19 Sep 2024 1343 1343 201803171539444330.pdf mr en 202409191138584930.pdf mr en

Total Orders: 67,646 and Total Translated Orders: 67,646

Accessing Data

The easist way to access the data is to clone the repository or download the data as a zip file (Click the green button '< > Code' at the top. All the files are arranged as per department and are in the GRs directory.

Please note that the repository even though it contains only txt file is about 1GB in size.

Running Chatbot

You can run a simple Q & A chatbot on this data using chat.py, a simple chat applications that has no external depedencies and requires you to run Qdrant vector database, have need to have curl on your machine and have an OpenAI API Key.

Start qdrant on your local machine

docker pull qdrant/qdrant
docker run -p 6333:6333 qdrant/qdrant

Provide Open AI API Key, this chat app uses two APIs embeddings and completions.

export OPENAI_API_KEY='XXX'

This will start the chat app on all the orders (GRs) that have 'library' keyword in their subject.

python chat.py GRs/Higher_and_Technical_Education_Department library

screenshot of running chat.py

  • You get clickable links in references if you run in iTerm2 *.

Thanks

Orgpedia would like to thank AI4Bharat for releasing IndicTrans2.

Thanks to its accuracy and performance Orgpedia was able to translate over 50,000 documents relatively quickly and at a fraction of the price of the online servicess.