Tag Value Lexer

The class spdx.parsers.lexers.tagvalue.Lexer is responsible for converting a Tag/Value format SPDX file to a stream of tokens to be parsed. It has a token for every valid Tag. The Lexer by default ignores all empty lines and lines starting with a # character.

It's implemented using ply.lex

Fields

• reserved A list of keyword, it contains all of the valid tags in addition to the special values UNKNOWN, NOASSERTION, NONE, SOURCE, BINARY, OTHER and ARCHIVE.
• states a tuple of states for the lexer.

Lexer States

There are two states INITIAL which is the default initial state and text which is the state for recognizing free form text between <text> and </text> tags. The rules for the text state are exclusive to it.