People’s Choice nominee and nominated for global judging - Milan Space Apps Challenge 2017
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
app
demo
gradle/wrapper
.gitignore
README.md
build.gradle
gradle.properties
gradlew
gradlew.bat
settings.gradle

README.md

DEX - A Mixed Reality Earth Dictionary

DEX is a mixed reality peer reviewed platform for indexing and discovering scientific knowledge. Explore the world, collect Knowledge Points and help others understand our planet with the power of crowdsourced based data gathering challenges!

DEX Project Image

Challenge

A creative way for the public and scientists alike to learn scientific & technical Earth-related terms.

Problem

Earth and space are both beautiful and complex, but scientists sometimes struggle to communicate how every aspect of nature is connected and how they interact with each other.

Trends

Starting from some common themes and trends, such as the will and need to protect Earth’s diversity and sustainability, we set out to create an app that aims to spread knowledge both in the scientific community and among the public alike.

Solution

Introducing DEX, an interactive and collective Earth dictionary based on crowdsourcing and mixed reality.

DEX stands on three main pillars:

  1. Mixed reality

    An immersive way to experience content, in order to make complexity understandable, graspable and enjoyable by users.

  2. Crowdsourcing

    A peer reviewed system to collect and share knowledge, where scientists and enthusiasts can collaborate and validate content, while ensuring proper credit to be given through referencing.

  3. Gamification

    A gamified system where increasing knowledge is awarded with in-app points. Each user’s history is shown in their own personal diary, giving an overall sense of progression with total earned “knowledge points” and current level.

Discovering new content and learning new scientific terms is easy, intuitive and direct. It’s always possible to see the source of definitions, images and augmenting material such as explanatory schemes and visualizations. Additionally, the crowdsourced nature of the uploaded contents allows it to be always monitored and corrected if wrong or incomplete.

The user interface of DEX uses metaphors like paper and diaries to create a tactile experience, that paired with mixed reality has the aim to emulate the act of gathering and saving sheets and photos in a researcher’s journal.

Prototypes

App Prototype

We assembled a first prototype of how the app could work in the final product. You can explore all the app's core features, from the map, to the Explore page, down to the Discovery Diary where all progress is stored. Proto.io link: https://share.proto.io/RD4BR1.

Computer Vision Prototype

Our working prototype showcases the potential of the mixed reality feature of DEX. The prototype allows you to take a picture, which is then live processed by the Google Cloud Vision API, and returns text printed on screen detailing the recognized subject of the picture along with its description (automatically retrieved from Wikipedia), all of this with the form factor of the visual user interface showed in the video. Official code repository on GitHub: https://github.com/SpaceAppsMilan/DEX.in.

Head to the demo folder to see the application in action or dig into the code to know more about how it works!

Resources used

NASA Science site glossary: https://science.nasa.gov/glossary

NASA Image and Video Library: https://images.nasa.gov

NASA’s citizen science projects: https://science.nasa.gov/citizenscientists

Team

  • Valeria Aufiero
  • Andrea Benedetti
  • Lorenzo Bracco
  • Elena Mongelli
  • James Simonetta
  • Alessandro Zotta