Data Flow

Overview

You can regenerate this diagram by pasting the linked code into Excalidraw.

Notes

• Production is the only environment with the serializer.

Steps

Step 1: scraping

• Scraper code

  • OSM Scraper: uses https://wiki.openstreetmap.org/wiki/Overpass_API

  • ESIM Scraper scrapes the CMU Building ArcGIS layer.

  • FMS Scraper scrapes the svgs from the FMS website and stores it in the S3 bucket floorplans/svgs folder.

    • Backup link: https://www.cmu.edu/enterprise-space/database/index.html

Step 2

The svgs are rescaled to fit in a 1920x1080 rectangle. The nodes and edges are generated. Info such as room aliases and more strict types are reattached to rooms.

Step 3

The svgs are deserialized locally and placed in the visualizer to be in geo-coordinates.

Step 4

The svgs are deserialized to and tested in staging.

Step 5

The svgs are deserialized to and used in production.