Skip to content
Discussion options

You must be logged in to vote

Persistent is generally better, at the cost of some complexity in the implementation. Persistence becomes more important as tensor cores get faster (so the relative cost of prolog and epilog vs mainloop is higher), so persistence is mostly used for Hopper and Blackwell.
One could certainly implement it for Ampere as well (I think we have some version of that at some point) and get a bit of a boost.

Replies: 1 comment 2 replies

Comment options

You must be logged in to vote
2 replies
@MoooonkIn
Comment options

@MoooonkIn
Comment options

Answer selected by MoooonkIn
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants