Skip to content
This repository has been archived by the owner on Mar 25, 2018. It is now read-only.

add first draft of ROADMAP.md #70

Merged
merged 7 commits into from
Feb 3, 2016
Merged
Changes from 4 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
226 changes: 226 additions & 0 deletions ROADMAP.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,226 @@
# Docs WG Roadmap

## Jan 2016 → Apr 2016 (Q1)

This is the first of the quarterly roadmaps that this Working Group will
produce, so it will be structured a bit differently than subsequent ones. Since
this is a brand-new process, an explanation of **what it is** and **why it's
necessary** follows.

This roadmap outlines the priorities for the Docs working group for the
quarter. These tasks can be as broadly or narrowly defined as is useful. They
are not necessarily staffed — as folks step up to do the work, we'll link
tracking issues to the tasks for them to self-organize. Every quarter we'll
revisit this roadmap, adding a quick postmortem of how things went, and
creating a new set of priorities for the ensuing quarter.

That brings us to why a roadmap is necessary: the Node.js documentation is a
relatively confined space to work within, and there are many interested
parties: there are groups that consume the documentation as output, like the
[website working group][wg-website], there are groups concerned with ensuring
the [content addresses the needs of diverse audiences][wg-inclusivity], there are
[groups that are required][wg-ctc] to produce API documentation as a
pre-requisite to merging their primary work, there are contributors who wish to
help in a _technical_ fashion, there are contributors who wish to contribute
_editorially_, and there are the readers of the docs. All of these
contributions overlap, so in order to make measurable progress without stepping
on each other's feet, we have to:

* **Set clear priorities** — if two contributions conflict, it should be
straightforward to determine which contribution should take precedence.
* **Message these priorities well in advance** — with this many stakeholders,
we should mention repeatedly, loudly, and clearly what our intentions are.
The Docs WG should aspire to avoid surprise.
* **Make the best use of donated time** — we want to ensure that if someone is
donating their time to improve the documentation, it will be well-spent, and
directed at driving the documentation towards this WG's [stated goals][goals].

[Our goals][goals] can be summarized thusly:

> Node.js should be in friendly competition for "Best Docs in OSS," with docs
> that address the needs of a wide variety of audiences — across skill levels,
> goals, and languages.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have no big stake in it, but I think not having some features as e.g. the es-switcher thing nodejs/node#4915 could work against this. Having a look at newer project's docs they are all the same and imo lack e.g. interactiveness. Sorry for bringing that up. Couldn't read up on the wg meeting yet and also couldn't participate.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No apologies necessary — it's totally my fault. Sorry for dropping the ball on getting that resolution out to where it needed to go. I'll make sure it doesn't happen again. I'm going to start an issue for the next meeting today, which was scheduled for Wednesday at 10AM PST next week. We can definitely revisit the timing of meetings along with that, since there are so many new members.

With regards to interactivity, it can be a double-edged sword. In the ES2015/ES5 switcher case, it's fine to use on the website's front page because the number of code examples there are bounded, as time goes on they can replace ES2015 with ES2016 and up, and due to the smaller number of examples, they can more easily curate that content.

Applying the switcher to the docs is a big maintenance load: it can grow on the axis of number of language versions to support, it can grow on the number of code examples in the docs to be translated into different versions, and because it affects all code examples, it's represents a significant source of churn on the docs.

The most limited resources the Docs WG have are space and volunteered time. Features that cause a lot of churn stand a high risk of blocking other work because the docs are a relatively constrained space. Maintaining separate examples — or being blocked by churn created by maintaining separate examples — spends volunteered time. Anything that takes a lot from both of those resources has to pay back that debt either by making it easier to work on the docs or by greatly increasing value for readers. Because the switcher represents a continual investment of author effort, it can't do the former, and because it doesn't offer any explanation of what the user is switching between, the value offered to readers is marginal — they would likely be better served by us redirecting them to a separate "learn javascript" document, either written by us, or maintained elsewhere (like jsforcats, or mdn.)

More generally, features that greatly increase the usefulness of the docs for readers while not continually spending author time are a net win. Some of the features proposed in the ROADMAP, like per-section YAML containing version information, represent a significant investment in churn and author time, but for the most part it's a one time cost. The ongoing cost can be mitigated by creating an automated linter rule to detect the absence of necessary information, which further reduces the time commitment. Meanwhile, version information is very valuable for users — they can now see at a glance when a feature was introduced, which lets them know immediately if it's available to them for use.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay. Good points Chris. Thx.


### Tasks

Tasks for this quarter were drawn from [responses to this issue][issue-roadmap].
They are divided between three major areas:

* **Content** — the actual content of the docs
* **Features** — reader-focused features, like version metadata or autolinking.
* **Tooling** — author-focused features, like doc linting or html generation.

Since **content** is the ultimate product of this WG, it will usually be the
highest priority. However, when **content** systemically fails audiences, it
may point to a need for better **features** or **tooling**.

**Right now, our features and tooling are lacking, and the content is suffering
for it.**

#### :one: Pulling Guides into [nodejs/node][repo-nodejs]

**This is our highest priority over the next two months.**

Right now the documentation is split between the [website repo][wg-website] and
the [core repo][wg-ctc]. We wish to bring the [guide documentation][guide-docs]
into the core repo.

The existing [node doctool][ref-doctool] is specifically built to _only_
generate API docs. Until we can build the guide docs with Node.js' `make doc`
command, guide documentation will be copied from the website repo into the core
repo, but not *removed* from the website repo.

As a result, we are investigating using [remark][ref-remark] to build the
docs. The stages of this project are as follows:

1. Use remark to build just the guides alongside the existing doctool.
2. Remove the guides from the website repository.
3. Identify and install the necessary remark plugins to faithfully render the
API documentation.
4. Generate all documentation using remark. Fix lint issues pointed out by
`remark-lint`.
5. Once no linting issues remain, wire up docs linting as part of Node.js'
`make test`.

Once this project is complete, all doc style rules will be handled by remark,
which includes line lengths, code samples (via eslint), markdown bullet and
emphasis styles, and link checking. We will have a solid basis on which to add
spelling and grammar checkers in the future, making it easier to maintain the
docs going forward.

##### Subtasks

Want to pitch in? Look here! If someone's already working on the task, see
if they need help.

* Identifying Remark plugins — **@qard**, others! [nodejs/docs#61](https://github.com/nodejs/docs/issues/61)
* Initial Remark integration — **@qard** [nodejs/node#4866](https://github.com/nodejs/node/pull/4866)
* Codify linting rules
* Apply linting rules across API docs
* HTML layout for guide docs
* HTML layout update for API docs to include refs to guide docs

#### :two: Guide and Topic Docs

A _very_ close second to the work on the documentation tooling is the work on
identifying and creating new guides and topic documentation. These two terms
come up a lot, to clarify what they mean, here's an except from our [getting
started][ref-getting-started] guide:

> 1. **Guide** documents explain processes to help the reader learn a concept
> in service of their larger goal. Usually a guide has the reader build
> something — a little webserver, or CLI — and explains the concept it's trying
> to convey using examples from the readers experience with that code. Guides
> are great for introducing new concepts in a comfortable way, by letting the
> reader "simulate" the process of what development will be like using those
> concepts.
> 2. **Topic** documents explain concepts to help the reader make a decision.
> They are a great place for "deep dive" information, and to handle anything
> that's fairly intricate.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Overview" might be a more descriptive term for this kind of documentation than "Topic."

> 3. **Reference** documents explain capabilities to help the reader achieve
> their goal. API documentation is the primary example of this.

Node.js currently has **reference** documentation, but because of the lack of
**topic** and **guide** documentation, it ends up having to repeat itself a
lot. Sometimes the lack of a dedicated place for this kind of documentation
means that reference docs will attempt to include guides or topic docs inline —
this usually doesn't end up working well in the long run.

The Docs WG has identified and created a few guides already, some of which are
the subject of the [first](#one-pulling-guides-into-nodejsnode) task.
*However*, we need help filling in the gaps — both in identifying needed docs,
as well as in executing on them.

It's important to note that this documentation applies as much to topics
*internal* to the project as it does to our externally facing API — we need
guides and overviews for the architecture of Node, as well as how to
collaborate on the project.

##### Subtasks

Want to pitch in? Look here! If someone's already working on the task, see
if they need help.

* Overviews:
* "Encoding", to be used by the Buffer and FS docs.
* "Blocking vs. non-blocking."
* Syscall documentation, to be used primarily by FS, but throughout the codebase.
* Internal: Node.js Architecture
* Internal: Initialization process
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm interested in documenting this. Currently I'm digging through how "process" gets created

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

\o/ :confetti_ball:

* Internal: Timers
* Internal: Event loop

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am working on an overview of the event loop which ellaborates on timers and the differences between nextTick() and setImmediate().

I'm not sure where it should eventually go, however (its just a file on my laptop ATM) and I'm sure it could use some scrutinous eyes once I do get a pull-request submitted.

see #34 (comment)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm interested in helping with this. I've done some local presentations on it for the JS folks in my town. I really enjoyed a talk by Philip Roberts @ JSConf EU 2014 something like that could be made more Node-centric and distilled into some GIFs for a presentation to help illustrate it.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent! Could you create a tracking ticket? I'll add it to the roadmap after it's merged. Thanks!

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done! Created #74

* Internal: Signals
* Internal: Docs WG Process — **@chrisdickinson**
* Guides:
* Internal: New Collaborator guide — **@nodejs/inclusivity**, **@ashleygwilliams** [nodejs/inclusivity#96](https://github.com/nodejs/inclusivity/issues/96)
* Internal: Move "cutting releases" into these guides.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

o/ I can help with this one (cutting releases)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Woo! Could you create a tracking ticket? I'll add it to the roadmap after it's merged.

* Streams: For Authors
* Streams: For Consumers
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✋ Raising my hand on this one.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks — I've added your name. Mind creating a tracking ticket for this? I'll merge the ticket number in after this is merged.

* Walkthroughs for each module
* Reference:
* Glossary of terms, to be used by all docs.
* Streams: remove guide content from API doc once guides have been written.
* Streams: Descriptive spec — **@nodejs/streams** [nodejs/readable-stream#181](https://github.com/nodejs/readable-stream/issues/181)
* Identifying other docs to create

#### :three: Improving API Metadata

One of the most common requests we've received is that the API docs start
including relevant version information alongside methods. This information
should include the version the API was introduced in, when it was last changed,
and when it was deprecated, if applicable. Second to that, we've received
requests to automatically link types of parameters to the appropriate MDN or
Node.js documentation sections, and note what (if any) errors an API will
generate, and how it will propagate them.

This points to the need to standardize tooling around this metadata, and then
execute against that tooling.

This task should track the work being done in task #1 — that is to say, this
metadata should be tracked by remark plugins in as much as is possible.

##### Subtasks

* Per-section YAML — **@qard**, **@tflanagan** [nodejs/node#3867](https://github.com/nodejs/node/pull/3867)
* Noting 'version introduced' on each API — **@tflanagan**
* Ideally this should link to the CHANGELOG for that release.
* Standardizing API method signature documentation
* Type annotation — **@fansworld-claudio** [nodejs/node#4741](https://github.com/nodejs/node/pull/4741)
* (This will have to be brought into the Remark work as well.)
* Error generation
* Automatically linking `syscall(2)`-format terms to the appropriate docs.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if this is relevant but Windows equivalents as well?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do they have any conventions like this?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that applies here, In the docs saying something like mkrdir(2) is relating to a specific command on unix and that is what the Node.js API is setup to function similar to.

* Allow authors to pick a simpler anchor for headings in addition to the
autogenerated anchor.

### Notably Missing

There are a few things notably missing from this list — this is not because
they are not important to us, but because we are primarily constrained by time
and the size of the content we are working within. Foremost among the missing
pieces is an internationalization strategy. This task cannot be approached
lightly, and will likely include touching *all* of the docs in a single PR.
While we welcome discussion on how to approach this issue, we will not be
executing on it until after March 2016. Likewise, search is an extant issue

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might be good to do some lead up and reach out to our current vendors and see if we are able to get one of the search services donated/discounted/etc. Things like AWS elasticsearch come to mind.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Totally not opposed if someone wants to do the legwork on this in advance. I had initially imagined we'd use something like Sphinx's precompiled JS search, but am open to alternatives (keeping in mind that the doc HTML is downloadable and usable separately from the website.)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gotcha. Thanks for the clarification @chrisdickinson yeah if the docs still need to be searchable when downloaded than that throws out the managed solutions.

that we do not have the resources to work on at present.

### Pitching In

If you would like to help out with the Docs, you can:

* Find a subtask above and raise your hand on the associated issue or create
an issue on the [docs issue tracker][docs-tracker].
* Raise your hand [here][weekly-review] to help with the weekly docs review
load.

[docs-tracker]: https://github.com/nodejs/docs/issues/new
[goals]: https://github.com/nodejs/node/blob/master/WORKING_GROUPS.md#documentation
[guide-docs]: https://github.com/nodejs/nodejs.org/tree/master/locale/en/docs/guides
[issue-roadmap]: https://github.com/nodejs/docs/issues/59
[ref-doctool]: https://github.com/nodejs/node/tree/master/tools/doc
[ref-getting-started]: ./GETTING-STARTED.md
[ref-remark]: https://www.npmjs.com/package/remark
[repo-nodejs]: https://github.com/nodejs/node
[weekly-review]: https://github.com/nodejs/docs/issues/69
[wg-ctc]: https://github.com/nodejs/node
[wg-inclusivity]: https://github.com/nodejs/inclusivity/
[wg-website]: https://github.com/nodejs/nodejs.org/