feat: Add token methods to JSONSourceCode

[nzakas]

Prerequisites checklist

• I have read the contributing guidelines.

What is the purpose of this pull request?

Adds token methods to JSONSourceCode.

What changes did you make? (Give an overview)

Added the following methods to JSONSourceCode:

• getTokenBefore()
• getTokenAfter()
• getTokenOrCommentBefore()
• getTokenOrCommentAfter()

Also added tests for these methods.

Additionally, I changed comments to a getter so it can be lazily initialized.

(The tokens array from Momoa contains both tokens and comments, so it makes sense to lazily initialize it all together.)

Related Issues

fixes #83

Is there anything you'd like reviewers to focus on?

I wasn't sure if we needed getTokenOrCommentBefore() or getTokenOrCommentAfter(). These appear as convenience methods on SourceCode in the eslint package, but getTokenBefore() and getTokenAfter() also have a second argument that lets you specify whether or not to include comments. We could go that way here and eliminate two methods, or we could keep these as-is. I'm not sure what the better path is as we'd likely want to encourage other languages to match whatever we decide on here.

[lumirlumir]

Could you take a look at the CI failure? Bun CI is currently throwing an error.

Also, I’ve left comments on a few parts!

[nzakas]

Bun test looks like it was a temporary issue.

[lumirlumir]

Overall looks good to me! I've left a few comments on some missing parts.

[mdjermanovic]

I wasn't sure if we needed getTokenOrCommentBefore() or getTokenOrCommentAfter(). These appear as convenience methods on SourceCode in the eslint package, but getTokenBefore() and getTokenAfter() also have a second argument that lets you specify whether or not to include comments. We could go that way here and eliminate two methods, or we could keep these as-is. I'm not sure what the better path is as we'd likely want to encourage other languages to match whatever we decide on here.

getTokenOrCommentBefore() and getTokenOrCommentAfter() are deprecated in the eslint package:

https://eslint.org/docs/latest/extend/custom-rules#deprecated-sourcecode-methods

So I think we shouldn't have these methods here, but an option to include comments in getTokenBefore() and getTokenAfter().

[nzakas]

@mdjermanovic good call. Don't know how I missed that. 👍