The fiscal ecosystem operates as a hierarchical system facilitating the flow of funds. At its most granular level, the process involves tendering, where government departments solicit bids for various projects, such as constructing a ramp for a school. In our efforts to enhance the efficiency and transparency of this system, we have created the Assam Public Procurement Platform, specifically for the state of Assam in India. This platform is designed to promote transparency by consolidating all tender information in one central location.
The Assam government regularly uploads contract data on the etenders platform, with new data added almost daily. Unfortunately, the data on this platform is fragmented and often protected by captchas, creating significant hurdles for users attempting to analyze it effectively. To address this issue, we have employed web scraping techniques to collect and organize the data in a user-friendly and comprehensible format. This involved developing multiple scrapers and implementing various data transformations to achieve our goal.
- code
- scraper
- transformation_scripts
- data
- ProcessedData
- RawData
We update the platform with new data in every 3 months
All scripts are published under the GPL v2 license and all datasets are published under the Open Data Commons Open Database License (ODbL).
In case of any queries or concerns reach out at open-contracting@civicdatalab.in