Skip to content

Add step-mark operation, and split sync-tensors into a separate opera…#627

Merged
dlibenzi merged 1 commit into
masterfrom
mark_the_step
Apr 22, 2019
Merged

Add step-mark operation, and split sync-tensors into a separate opera…#627
dlibenzi merged 1 commit into
masterfrom
mark_the_step

Conversation

@dlibenzi

Copy link
Copy Markdown
Collaborator

…tion.

Added ability to associate user defined metadata to IR nodes, to be able to link back IR nodes to the hosting XLATensor::Data core data structure.
Reorganized the XLA tensors arena in a more general device context arena, to be able to host other information on top of live tensors data.

@dlibenzi dlibenzi requested a review from asuhan April 21, 2019 22:34

@asuhan asuhan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Is AddSyncedHash meant to be used by the speculative sync?
  2. What is the API to specify metadata going to be? I assume we want to expose it all the way to Python somehow.

Comment thread torch_xla/csrc/ir.h Outdated
@dlibenzi

Copy link
Copy Markdown
Collaborator Author
  1. Is AddSyncedHash meant to be used by the speculative sync?

Yeah. This is base infra. Missing bits are:

  • Add synced hash into the set
  • When syncing, find possible "companion syncs"
  1. What is the API to specify metadata going to be? I assume we want to expose it all the way to Python somehow.

The metadata is because we know about IR nodes, but we have no idea about which XLATensor::Data hosts them.
When we sync, we need to properly update the Data core structure.
I don't think we need to expose this Python side.
At this time is only as ir::Node -> XLATensor::Data reverse map.

@dlibenzi dlibenzi force-pushed the mark_the_step branch 2 times, most recently from 12b5679 to 4cf04d2 Compare April 22, 2019 17:35
…tion.

Added ability to associate user defined metadata to IR nodes, to be able to link back IR nodes to the hosting XLATensor::Data core data structure.
Reorganized the XLA tensors arena in a more general device context arena, to be able to host other information on top of live tensors data.
@dlibenzi dlibenzi merged commit 9e59aa5 into master Apr 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants