A Map of PyPi Packages

This contains some material to recreate this visualization of around 100000 PyPi packages and their dependencies.

Reproduction Guide

Execute a query like sample_query.sql in BigQuery and export to .jsonl.
Use process_json.py to filter, format and export to .gexf.
Find a graph layout in e.g. Gephi, export back to .gexf.
Either visualize with graph.py or export to .json and visualize with the source of https://fi-le.net/pypi.

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.DS_Store		.DS_Store
.gitignore		.gitignore
README.md		README.md
deps.jsonl		deps.jsonl
deps_smol.jsonl		deps_smol.jsonl
graph.py		graph.py
index.html		index.html
process_gexf.py		process_gexf.py
process_json.py		process_json.py
pypi.png		pypi.png
pypi2.png		pypi2.png
pypi_data.json		pypi_data.json
pypi_data_big.json		pypi_data_big.json
sample_query.sql		sample_query.sql