Skip to content
jog edited this page Nov 9, 2010 · 44 revisions

#Installation Guide

  • Setup an Amazon AMI.
  • SSH in and install mysql.
  • Change the root password via mysqladmin, and login to mysql as root.
  • Create a new account called "dsadmin" and set an appropriate password: '''SQL ..CREATE USER 'dsadmin'@'localhost' IDENTIFIED BY 'yourpassword'; '''
  • Create a database called "datasphere": '''SQL CREATE DATABASE datasphere '''
  • Grant the dsadmin all priveleges to that database: '''SQL GRANT ALL ON datasphere.* TO 'dsadmin'@'localhost' IDENTIFIED BY 'yourpassword'; '''
  • Download the latest datasphere.jar.
  • SFTP the jar to the AMI (or run it on your local machine using an ssh tunnel to forward mysql 3306 to the AMI).
  • The first time you run the jar use the following arguments to setup the system tables: '''SQL java -jar DSCatalog.jar --create '''
  • From then on the --create keyword is not required

#DSUpdate XMPP Message

The DSUpdate XMMP message is responsible for communications of activity updates from active dataware (both native and legacy). The message packets have the following common format:

"source" : string, //-- namespace of dataware source (max 256 chars)

"type" : string, //-- namespace of item, defaulting to "dataware:update" (max 256 chars)

"tags" : array of strings, //-- namespaces of associated item categories (interfaces) (stored as text)

"mtime" : unix timestamp, //-- time that the update was generated by the dataware

"location" : coordinates, //-- WGS-84 coordinate attached to the update

"description" : string, //-- a short (1024 chars) textual summary of the update

"crud" : string, //-- create / read / update / delete

**"total" : long, ** //-- the total number of items represented by this item type

"meta" : array //-- other data associated with the update, specific to its type (stored as text)

#Datasphere source namespaces

All data sources must be identified using a namespace so that the catalog can reference them uniquely. The current list is as follows:

  • ds:facebook
  • ds:twitter

#Data type namespaces

All data items require a type (as specified in the DSUpdate schema), and these types must also have a referrable namespace. Data times may also be "tagged" with additional namespaces indicating their associations and broader categorizations. Currently the following are available:

##Facebook

  • ds:facebook:bio
  • ds:facebook:post
  • ds:facebook:photo
  • ds:facebook:feed
  • ds:facebook:social
  • ds:facebook:update
  • ds:facebook:like
  • ds:facebook:checkin
  • ds:facebook:avatar

##General

  • ds:microblog
  • ds:bio
  • ds:geo
  • ds:media
  • ds:photo
  • ds:unrecognized

Clone this wiki locally