Skip to content

Latest commit

 

History

History
81 lines (48 loc) · 3.09 KB

notes.md

File metadata and controls

81 lines (48 loc) · 3.09 KB

Notes

https://github.com/awesomedata/awesome-public-datasets

Possible use cases

Food and drink as department surrogate

http://snap.stanford.edu/data/ - a collection of data. There are online reviews for beers, wines, movies and foods. Perhaps this sort of data could represent different departments interested in slightly different things. A search from a department of beers would return beer first, and then show wines and others and so on.

Open UK Data

Searching for physical locations in public datasets https://data.gov.uk/ Could result in aggregated results, but feedback would be difficult to show.

API Design

Python / Django techniques

A pub/sub or messagebus could be used for communication between apps.

Search options to consider

Search tools to consdier

Problems that need solving

  • The UI has to be progressive and usable with no client side scripting. At the same time the service needs to be ReSTful. How can we return the aggregated results and allow users to drill down to the detail and send feedback? With a single page application it would be easier, as all the infromation could be returned and manipulated on the client side for display, but this cannot be the only option.

Packaging

https://medium.com/analytics-vidhya/how-to-create-a-python-library-7d5aea80cc3f

 

Common questions that need answering

What problems does service to service negotiation sovle?

Typically, as a developer, I know exactly what API I need, which one I want to use and might as well read the documentation and use it.

The above question shows only half of the problem, how to consume APIs. The other half of the problem is how to provide a service through an API. How to offer those services on the scale of decades without tight coupling.

Starting the local apache server for working with static data

docker run --name httpd -p 80:80 -v $(pwd):/usr/local/apache2/htdocs -d httpd

Get original config

docker run --rm httpd cat /usr/local/apache2/conf/httpd.conf > httpd.conf