Skip to content
Addresses GNAF, Meshblocks 2016 Linkset
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
methods
.gitattributes
.gitignore
LICENSE
README.md
data00.ttl.gz
data01.ttl.gz
example-data.csv
example-data.ttl
header.ttl
overview.png

README.md

Current Addresses to 2016 Mesh Blocks Linkset

This code repository contains a Linkset - a specialised Dataset linking objects in two other Datasets.

This Linkset contains spatial associations between Address class objects in the latest version of the Geocoded National Address File (GNAF Current) and Mesh Block class objects in the 2016 version of the Australian Statistical Geography Standard (ASGS 2016).

Addresses, in the GNAF Current dataset, are represented spatially as points. Mesh Blocks, in the ASGS 2016, are represented spatially as polygons. Mesh Blocks do not overlap and cover all of Australia, so any GNAF Current Address will lie within one, and only one, Mesh Block.

The formal definition of what a Linkset is, is provided by the Location Index (LocI) project within its project ontology, see: http://linked.data.gov.au/def/loci


Figure 1: Several Mesh Blocks (red borders) with some of the Addresses points (‘+’ symbols) within them shown

Repository Contents

  • data00.ttl.gz & data01.ttl.gz - this Linkset’s main data files. They are compressed RDF turtle files, each less than 100MB
  • header.ttl - this Linkset’s data.ttl header information, stored separately for ease of access
  • example-data.ttl - 10 Statements from the Linkset for ease of access, in RDF (turtle) format, as per the main data file
    • example-data.csv - 10 Statements from the Linkset for ease of access, in simple CSV format
  • README.md - this file
  • LICENSE - the data license assigned to this Linkset’s content
  • overview.png - the image above
  • methods/ - a folder containing information (prose and code) about how this Linkset was generated

Purpose

This repository contains a Linkset. Linksets are specialised Linked Data datasets that link objects, such as Addresses or Catchments, in one Linked Data dataset to objects in another.

Publishing relationships between Datasets as distinct Linksets allows for the independent management of Dataset-to-Dataset relationships.

Linksets for Spatial Relationships

Where LocI objects across multiple datasets have spatial relationships that we wish to represent, we create Linksets with spatial (topological) relationships such as touches, within, overlaps etc. using terms formalised in the (GeoSPARQL Standard](https://www.opengeospatial.org/standards/geosparql).

Linksets for Dataset versions

Some LocI Datasets, such as the ASGS, have multiple, independently delivered versions (the ASGS is released as a Linked Data Datasets in both 2011 and 2016 versions). Linksets can be used to link between these versions of a Dataset too. This allows for information such as correspondence tables (links between ASGS versions, published by the Australian Bureau of Statistics) to be published as Linked Data independently of any other Dataset.

This Linkset

This Linkset - Current Addresses to 2016 Mesh Block Linkset - is a spatial relations Linkset linking GNAF Current Addresses (points) to ASGS 2016 Mesh Blocks (polygons) by indicating which Mesh Block each Address is within.

This Linkset states, per Address and with other details, something like this:

Address GAACT714851043
is within
Mesh Block 80002010000

...and that this particular link was made on the 6th of February, 2015 using a Parcel Level matching method.

How is a Linkset’s data organised?

Linksets include the main facts of relations between objects in two datasets - what the IDs of two objects are and how they are related - and they also include information about how links were created, such as what spatial intersection method was used to establish a topological relation. Linkset generation might have employed multiple methods to make all the object-to-object links within it so a Linkset may relate multiple methods and give the particular method used for each link.

Other per-link information may be recorded too: if the links within a Linkset are generated over a significant period of time then the each link may have a created time; if different people/organisations contributed different links then each link may reference their specific contributor.

Linkset content sections

Linksets use a highly condensed, but still (sort of) human-readable data format to include many (millions) of links. Linkset data files contain:

  • A header
    • Basic information about the Linksets - what, who when
    • Links to methods used in the generation of the Linkset
  • A (long) set of Statements
    • One Statement per link
    • Link type - how the two objects relate, spatially or otherwise
    • Link metadata - time of creation (if important), method used and who created it (if known) etc.

Linksets include all their information in one potentially very large file but they also include the header information in a stand-alone text file - header.ttl.

They also include a few (perhaps 10) example Statements in a stand-alone text file - example-data-… .ttl (numbered as there may be many).

Linkset files

In addition to the main Linkset data file and the header.ttl and example-data.ttl files, there are usually several other files within a Linkset, including this README file. General Linkset files include:

  • data.ttl - the main Linkset data file.
    • since this could be very large (1.5GB+), it is often compressed (data.ttl.gz) and sometimes split into parts (data01.ttl.gz, data02.ttl.gz...)
  • header.ttl - the Linkset’s data.ttl header information, stored separately for ease of access
  • example-data.ttl - a few statements (perhaps 10) from the Linkset for ease of access
  • README.md - this file: a description of this Linkset and general Linkset information
  • LICENSE - the data license assigned to this Linkset’s content

This specific Linkset’s files are listed in above in Repository Content.

Linkset data format

In its long list of statements, this Linkset expresses each link like this:

  • Statement ACT1547495377 says:
    • Address GAACT714851043
    • is within
    • Mesh Block 80002010000
    • Link generated via Method 1
    • Link created at 2015-02-06

In RDF code this link is expressed as:

:ACT1547495377 a rdf:Statement ;
  rdf:subject:     address:GAACT714851043 ;
  rdf:predicate: geo:sfWithin ;
  rdf:object       meshblock:80002010000 ;
  loci:hadGenerationMethod: :method-1: ;
  dct:created    "2015-02-06"^^xsd:date
.

With contractions used to save data volumes resulting in:

:ACT1547495377
  s: g:GAACT714851043 ;
  p: w: ;
  o: b:80002010000 ;
  m: m1: ;
  c: "2015-02-06"^^d: .

See the file example-data.ttl for the first 10 Statements of the Linkset expressed like this and see the header.ttl file to explain all the contractions.

Linkset metrics

Linksets always contain similar information - links between objects in datasets - and a standard set of metrics can be calculated for any Linkset. These metrics, set by the LocI project, are:

  • Number of links
  • Number of items in Dataset A (from) not linked
  • Number of items in Dataset B (to) not linked
  • Number of link creation methods used
  • Numbers of uses of each link-creation method

Metric calculation

A series of queries to calculate Linkset metrics is being prepared here: https://github.com/CSIRO-enviro-informatics/linkset-metrics

This Linkset’s metrics

Metric Value
Number of links 14878851
Number of items in Dataset A (from) not linked not yet calculated
Number of items in Dataset B (to) not linked not yet calculated
Number of link creation methods used 5
Numbers of uses of each link-creation method m1: 14148793
m2: 185588
m3: 89482
m4: 392138
m5: 62849

Rights & License

The content of this API is licensed for use under the Creative Commons 4.0 License. See the license deed all details.

Contacts

LocI Project technical owner:
Nicholas Car
CSIRO Land & Water, Environmental Informatics Group
nicholas.car@csiro.au

Linkset creator:
Edmond Chuc
CSIRO Land & Water, Environmental Informatics Group
edmond.chuc@csiro.au

You can’t perform that action at this time.