Skip to content

Tools For Hack Oregon

Moss Drake edited this page May 7, 2018 · 4 revisions

Database Tools

PostGres

Hack Oregon uses PostgreSQLs for the database. PostgreSQL (or Postgres), is an object-relational database management system (ORDBMS) with an emphasis on extensibility and standards compliance. As a database server, its primary functions are to store data securely and return that data in response to requests from other software applications. We want to use PostgreSQL 9, since that is most compatible with AWS.

There are two flavors of Postgres installers:

  • EDB
  • BigSQL - This is the suggested installation

To install: https://www.postgresql.org

BigSQL uses a tool called pgc for updates. Use that to install PostGIS in an existing BIGSql PostGresql installation https://www.openscg.com/2017/02/postgis-how-to-create-a-spatial-database-with-pgc-command-line/

  • pgc update
  • pgc install postgis23-pg96

More info: https://en.wikipedia.org/wiki/PostgreSQL

PostGIS

PostGIS is open source software that adds support for geographic objects to the PostgreSQL object-relational database. PostGIS follows the Simple Features for SQL specification from the Open Geospatial Consortium (OGC). Technically PostGIS was implemented as a PostgreSQL's external extension To install: https://postgis.net

More info: https://en.wikipedia.org/wiki/PostGIS

Loading Raster data https://postgis.net/docs/using_raster_dataman.html

pgAdmin

pgAdmin is a free and open source GUI tool for managing PostgreSQL. It is supported on many computer platforms. pgAdmin 4 is the currently supported version. To install: https://www.pgadmin.org/download/

More info: https://en.wikipedia.org/wiki/PostgreSQL#pgAdmin

  • Where is the database?
  • What is the schematic?
  • Adrian - put rasters in cloud

How to Access PostgreSQL Database Remotely Using pgAdmin on Windows https://linode.com/docs/databases/postgresql/how-to-access-postgresql-database-remotely-using-pgadmin-on-windows/

GeoSpatial Tools

QGIS

QGIS is a free and open-source cross-platform desktop geographic information system (GIS) application that supports viewing, editing, and analysis of geospatial data It has the ability to read from PostGIS databases. To install: https://www.qgis.org/en/site/ More info: https://en.wikipedia.org/wiki/QGIS

Manual https://docs.qgis.org/2.8/en/docs/training_manual/index.html

Working with Databases in the QGIS Browser https://docs.qgis.org/2.8/en/docs/training_manual/databases/db_browser.html

GRASS GIS

https://grass.osgeo.org/grass72/manuals/r.to.vect.html

OSGeo4W

https://trac.osgeo.org/osgeo4w/

GDAL - Geospatial Data Abstraction Library

The Geospatial Data Abstraction Library (GDAL) is a computer software library for reading and writing raster and vector geospatial data formats. It is released under the permissive X/MIT style free software license by the Open Source Geospatial Foundation.

http://www.gdal.org

More info: https://en.wikipedia.org/wiki/GDAL

Containers

Docker

Docker is a platform for developers and sysadmins to develop, deploy, and run applications with containers. The use of Linux containers to deploy applications is called containerization.

A container runs natively on Linux and shares the kernel of the host machine with other containers. It runs a discrete process, taking no more memory than any other executable, making it lightweight. By contrast, a virtual machine (VM) runs a full-blown “guest” operating system with virtual access to host resources through a hypervisor. In general, VMs provide an environment with more resources than most applications need.

To install: https://docs.docker.com/install/

After installing docker use the Hack Oregon data-science-pet-containers repo to set up the Postgres environment in a docker container: https://github.com/hackoregon/data-science-pet-containers#quick-start

Docker Toolbox

Docker Toolbox provides a way to use Docker on Windows systems that do not meet minimal system requirements for the Docker for Windows app. Docker Toolbox is only necessary for Windows 10 Home, or earlier editions. To install: https://docs.docker.com/toolbox/toolbox_install_windows/

Oracle VM VirtualBox Manager

VirtualBox is a general-purpose full virtualizer for x86 hardware, targeted at server, desktop and embedded use. Oracle VM VirtualBox is required for Windows systems that do not fully support HyperV.

To install: https://www.virtualbox.org/wiki/Downloads

Data Science

Jupyter Notebook

Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text.

To install: http://jupyter.org

More info: https://en.wikipedia.org/wiki/IPython#Project_Jupyter