Aquadex allows you to help us help the Sea
JavaScript HTML
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
img
js
Readme.md
awe-jsartoolkit-dependencies.js
awe.marker_ar.js
geo.html
index.html
marker.png

Readme.md

Aquadex

aquadex logo

Aquadex allows you to help us help the Sea.

It is a fun way to collect information, images, video and sound on the aquatic life around you.

Background:

Collecting marine and aquatic data is an important part of preserving our marine resources. At the same time it is very important to make the collected data available to interested community members, tourists and related researchers.

The Problem

Collecting and sharing marine resource data can be a very lengthy and expensive process considering the enormity of our marine area and aquatic resources. At the same time we have heaps amount of open marine & aquatic data that people are interested in. Collaboration between these two streams of requirement can be through an effective and interactive process and providing a platform where people from each sector can interact with each other. Our goal is to make the process easier with the participation and collaboration of community members and researchers & data analysts.

The Solution

Aquadex provides a mediator solution to exhibit aquatic data through an app in a consolidated way. So the user can just open the app and then select a location of his/her particular interest or next venture. It then invites user to accept challenges of aquatic data collection. At the same time Aquadex provides an interactive and pleasant way of collecting data and logging data using through gaming and “Augmented Reality”. Fun & adventure are two basic human interests and the app uses these to encourage people to actively participate in data collection and ultimately contributing to preserve marine & aquatic resources for our future generations.

How It Works:

Aquadex uses a range of aquatic and marine data. It also collects and process data provided by Aquadex users. It then combines open & user data and provides a consolidated view. Users can get a list of locations marine resources of their interest like - dolphins, whales, fish species and frequency of their sightings. Then there is a list of challenges for user to collect data and share on Aquadex. Here we have included gaming logic, Monocular Image recognition API from Jemsoft and our “Augmented Reality” API to make it most interactive way of collecting data.

Our game-logic enables user to participate in a contest with other app users and score points. Users are encouraged through a range of gift-cards and aquatic points. User take a photo of the marine species and upload it to Aquadex. User can also take a photo from his/her facebook and post it to Aquadex. The app then processes the actual/facebook image using Monocular API to recognize the species and then logs it for the user.

Our Augmented Reality engine, although in a POC right now, provides a very interactive and amusing way to locate & guide you to your next challenge through markers & direction. The key concept is to use the mobile device sensors, mainly accelerometer, magnetometer, GPS, camera to establish the current location, orientation and point-of-view (in terms of camera viewport) of the device. On top, of the camera feed on the phone screen, data is superimposed in transparent/semi-transparent layers. This is done by creating virtual markers based on geolocated dataset(s) and using algorithms to determine the approximate distance and direction of heading for the marker in relation to the user's (and phone camera's) point-of-view. Navigation features can be added by using the phone's motion sensors to determine direction of movement as well.

Team name: Bob's gang

Team memebers: Matt Cejko, Martin Nobis, Muhammad Pavel, Mizanur Rahman, Asheshwor Shrestha, Oshim Somers

Demo url: https://github.com/Unleashed2016/aquadex

Video url: https://youtu.be/9x5itE49uMw

Hackerspace url: https://2016.hackerspace.govhack.org/node/1766

Local Event Location:

Adelaide

Datasets Used:

APIs Used

  • Awe.js: Used to simplify using HTML5 geolocation, orientation and WebGL

  • Three.js: Used as a cool WebGL library

  • Google Maps JS API: Used to superimpose a layer of Roads and Streets with names on top of the camera feed.

  • Google Maps Directions API: Used for routing and navigation from user's current location to destination (location of restaurant, club, etc.)

  • Backendless: On-demand Mobile Backend as a Service (mBaaS) platform.

  • Monocular API (not used in the PoC): Can be used to identify species.