Tokens missing in template literals

[golopot]

When parsing this template literal,

`${a}b`

, there is no token corresponding to b.

Code:

const meriyah = require("meriyah");

const tokens = [];
const source = "`${a}b`";
const ast = meriyah.parse(source, {
  onToken(type, start, end) {
    tokens.push({
      type,
      value: source.slice(start, end),
      range: [start, end],
    });
  },
});

console.log(tokens);

Actual output:

[
  { type: 'TemplateLiteral', value: '`${', range: [ 0, 3 ] },
  { type: 'Identifier', value: 'a', range: [ 3, 4 ] },
  { type: 'Punctuator', value: '}', range: [ 4, 5 ] }
]

Expected:
The b part appears somewhere in the tokens.

[3cp]

scanTemplateTail() was called directly by parseTemplate() without going through standard nextToken(). This is bit odd. Needs some study to refactor template tail into nextToken().