Architectural overview doc

[richjames0]

Description

Architectural overview doc

Tests

N/A

Checklist

Before submitting this PR, please make sure (put X in square brackets):

• I have performed a self-review of my code.
• I have necessary comments in my code, particularly in hard-to-understand areas.
• I have run end-to-end tests tests and provided workload links above if applicable.
• I have made or will make corresponding changes to the doc if needed.

[steph-morton]

Really excellent architecture topic. It is super clear and helpful. I've left some specific editorial recommendations inline and here is some editorial feedback that applies to the whole PR:

• Capitalization of titles, headings, and bullet list subheads: we are working to standardize to sentence case (first word cap, proper nouns cap, all others lowercase).
• In headings and subheads, I recommend to spell out and instead of using ampersand
• You might want to mark all inline param names with code ticks as you did with filenames.
• You may want to more directly address the audience as you; it helps make the content more active to address directly to the reader. I left a specific comment inline where this becomes logical
• GCS should be "Cloud Storage" throughout

[gobbleturk]

Very readable doc! This doc seems to by very ambitious - both explaining all of our features, how to run and how we achieve high performance / use the jax stack? Is this the docs purpose?

[gobbleturk]

Thanks Rich!

[melissawm]

I only left a few formatting suggestions and added some links where I thought appropriate. Overall this was quite nice to read 😄

Final suggestion is that this should be added to the docs/reference.md toctree.

[tianshub]

lgtm!