Skip to content

Latest commit

 

History

History
40 lines (26 loc) · 2.3 KB

continuous_graph_embedding.md

File metadata and controls

40 lines (26 loc) · 2.3 KB

Continous Graph Embedding

labels: ricci_tensor, riemannian_geometry, experimental, gnn, topology, differential_geometry

Model the graph as a continuous manifold, model entities on the graph as points on the manifold, and a learnable shell parameter. The shell functionally defines the entity as a region of the manifold. Define edge(from: Node, to: Node) as an indicator function that returns true if the veridical graph has an edge from x to y.

def edge(from: Node, to: Node):
  """an indicator function that returns true if the veridical graph has an edge from x to y."""
  d = distance(from, to)
  return d < from.shell.projected_onto(d).norm()

for a simple spherical representation, we can let the shell be a radius term. Any nodes inside the shell's radius, we draw an edge to.

for non-trivial geometry (still assuming trivial topology, no holes) we can fit a local covariance matrix to warp the local hypersphere (fixed radius) to a hyper-elipse (radius modulated by covariance). Covariance here is identical to the Ricci tensor of the local semantic tangent space (i.e. the curvature relative to the riemannian (banach?) "perspective" of that entity).

literal semantic relativity. QUAntiFIABLE semantic relativity.

what can we learn by analyzing that shell?

  • volume: how "big" an idea is..? important? abstract (i.e. hierarchies would nest into matryoshka subsets)?
  • smoothness: how uniformly related it is to its neighbors? no idea..
  • gaussian curvature: some kind of local "density" or "mass". how tightly concentrated the local neighborhood is.
  • sharpness/fuzziness, rate of transition over boundary, permissivity at boundary: how strictly defined the entity is in the space

oooo.... I should do a geometry of semantic space survey

Expected Properties

Semantic arithmetic over graphs

semantic arithmetic where we are conditioning on a graph over inputs. this is actually completely identical to a normal conditioning vector.

BUT: we can take advantage of the shell term to operate as a weighting function, and invert the spatial warps to normalize the weightings in the topology of the space.

Apply this representation to a dataset to learn the local warp tensor. Ricci tensor.

Can we use this to fit just the ricci tensors on a frozen representation? use that to measure the local curvature of the space?