Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP - Whitespace lexing after Keywords - collecting issue #1905

Open
blu-base opened this issue Oct 2, 2021 · 6 comments · Fixed by #1908 or #2159
Open

WIP - Whitespace lexing after Keywords - collecting issue #1905

blu-base opened this issue Oct 2, 2021 · 6 comments · Fixed by #1908 or #2159

Comments

@blu-base
Copy link
Contributor

blu-base commented Oct 2, 2021 •
edited by Anteru
Loading

In a recent PR, it become apparent, that there are a lot of places where the whitespace following a Keyword has been often implemented as the Text token. Instead the more specific Text.Whitespace token is more applicable here.

This issue shall serve as reference and log for similar issues/PRs.

Since initial tests showed a large number of lexers which can be updated, a more systematic approach is tried with the table below. The table lists all lexers in pygments, the status of work, and related issues and PRs. The status shows whether a quick check shows a need for change, whether Whitespace token are already used (hence nothing needs to be done in these cases), or whether the lexers still needs to be inspected whether there is this issue.

State of the cleanup

Lexer Status PRs and issues
actionscript ✔️ merged #1911
agile ✅ nothing to do
algebra ✅ nothing to do
ambient ✔️ merged #1914
amdgpu ✅ nothing to do
ampl ✔️ merged #1914
apdlexer ✔️ merged #1914
apl ✔️ merged #1914
archetype ✔️ merged #1914
arrow ✔️ merged #1914
asc ✅ nothing to do
asm ✔️ merged #1914
automation 🚩 more elaborate change necessary
bare ✔️ merged #1911
basic ✔️ merged #1923
bibtex ✔️ merged #1923
boa ✔️ merged #1923
business ✔️ merged ➰ needs refactor #1911
capnproto ✔️ merged #1923
c_cpp ✔️ merged #1237(#1904)
cddl ✔️ merged #1923
chapel ✔️ merged #1923
clean ✅ nothing to do
c_like ✔️ merged #1923
compiled ✅ nothing to do
configs ✔️ merged #1923
console ✔️ merged #1923
crystal ✔️ merged #1923
csound ✔️ merged #1923
css ✔️ merged #1923
dalvik ✔️ merged #1939
data ✔️ merged #1939
devicetree ✔️ merged #1939
diff ✔️ merged #1939, #1911
dotnet ✔️ merged #1939
d ✔️ merged #1939
dsls ✔️ merged #1939
dylan ✔️ merged #1939
ecl ✔️ merged #1957
eiffel ✔️ merged #1957
elm ✔️ merged #1957
email ✅ nothing to do
erlang ✔️ merged #1957
esoteric ✔️ merged #1957
ezhil ✔️ merged #1957
factor ✔️ merged #1957
fantom ✔️ merged #1957
felix ✔️ merged #1957
floscript ✔️ merged #1957
forth ✔️ merged #1957
fortran ✅ nothing to do
foxpro 🚩 needs change, major refactor for reserved Keywords
freefem ✅ nothing to do
functional ✅ nothing to do
futhark ✔️ merged #1957
gcodelexer ✅ nothing to do
gdscript ✔️ merged #1978
go ✔️ merged #1978
grammar_notation ✔️ merged 🚩 needs refactor (multiline comment, floats,...) #1978
graphics ✔️ merged #1978
graph ✔️ merged #1978
graphviz ✅ nothing to do
gsql.py ✅ nothing to do
haskell ✔️ merged #1978
haxe ✔️ merged #1978
hdl ✔️ merged #1978
hexdump ✔️ merged #1978
html ➰ in review #2012
idl ✔️ merged #2025
igor ✔️ merged #2025
inferno ✔️ merged #2025
installers ✔️ merged #2025
int_fiction ✔️ merged #2025
iolang ✔️ merged #2025
javascript ✔️ merged #2025
j ✔️ merged #2025
jslt ✅ nothing to do
julia ✔️ merged #2025
jvm ✔️ merged #2025
kuin ✔️ merged #2025
lisp ✔️ merged #2025
make ✔️ merged , 🚩 needs more change, missed some spaces #1911
markup 🚩 needs change
math ✅ nothing to do
matlab 🚩 needs change
maxima ✅ nothing to do
meson ✅ nothing to do
mime ❔ looks good, but check again later
ml 🚩 needs change
modeling 🚩 needs change
modula2 🚩 needs change
monte ✅ nothing to do
mosel 🚩 needs change
ncl 🚩 needs change
nimrod 🚩 needs change
nit 🚩 needs change
nix 🚩 needs change
oberon 🚩 needs change
objective 🚩 needs change
ooc 🚩 needs change
other ✅ nothing to do
parasail 🚩 needs change
parsers 🚩 needs change
pascal 🚩 needs change
pawn 🚩 needs change
perl 🚩 needs change
php 🚩 needs change
pointless 🚩 needs change
pony 🚩 needs change
praat 🚩 needs change
procfile ✅ nothing to do
prolog 🚩 needs change
promql ✅ nothing to do
python 🚩 needs change
qvt 🚩 needs change
rdf 🚩 needs change
rebol 🚩 needs change
resource 🚩 needs change
ride 🚩 needs change
rnc 🚩 needs change
roboconf 🚩 needs change
robotframework 🚩 needs change, seems more work
r 🚩 needs change
ruby ✔️ c1fe7bb
rust 🚩 needs change
sas 🚩 needs change
scdoc 🚩 needs change
scripting 🚩 needs change
sgf ✅ nothing to do
shell 🚩 needs change 2f78a7b
sieve 🚩 needs change
slash ✅ nothing to do
smalltalk 🚩 needs change
smithy 🚩 needs change
smv ✅ nothing to do
snobol 🚩 needs change
solidity ✅ nothing to do
special ✅ nothing to do
sql ✔️ merged, 🚩 needs more change #1908
srcinfo ✅ nothing to do
stata 🚩 needs change
supercollider 🚩 needs change
tcl 🚩 needs change
teal 🚩 needs change
templates 🚩 needs change
teraterm 🚩 needs change
testing 🚩 needs change
textedit 🚩 needs change
textfmts 🚩 needs change
text ✅ nothing to do
theorem 🚩 needs change
thingsdb 🚩 needs change
tnt 🚩 needs change
trafficscript 🚩 needs change
typoscript 🚩 needs change
unicon 🚩 needs change
urbi 🚩 needs change
usd ✅ nothing to do
varnish 🚩 needs change
verification 🚩 needs change
webassembly 🚩 needs change
webidl 🚩 needs change
webmisc 🚩 needs change
web ✅ nothing to do
whiley 🚩 needs change
x10 🚩 needs change
xorg 🚩 needs change
yang ✅ nothing to do
zig ✅ nothing to do
@blu-base
Copy link
Contributor Author

blu-base commented Oct 4, 2021

The following command searches the example files for occurrences where spaces following a Keyword class token or a name class token is not marked as Text.Whitespace token

grep -rPzo "(Keyword(\.\w+)?|Name(\.\w+))\n'\s+'\s+Text\n" | sort -u  | sed 's/[\x0]//g'

run this in test/examplefiles/

This results in a rather long list (and a little bit of noise) 
abnf/abnf_example1.abnf.output:Keyword
abnf/abnf_example1.abnf.output:Name.Class
abnf/abnf_example2.abnf.output:Name.Class
ada/test.adb.output:Keyword.Constant
ada/test.adb.output:Keyword.Declaration
ada/test.adb.output:Keyword.Namespace
ada/test.adb.output:Keyword.Reserved
ada/test.adb.output:Keyword.Type
ada/test.adb.output:Name.Attribute
ada/test.adb.output:Name.Class
ada/test.adb.output:Name.Constant
ada/test.adb.output:Name.Function
ada/test.adb.output:Name.Variable
adl/test.adls.output:Name.Class
adl/test_basic.adls.output:Name.Class
agda/test.agda.output:Keyword.Reserved
agda/test.agda.output:Keyword.Type
agda/test.agda.output:Name.Function
ahk/demo.ahk.output:Name.Builtin
ahk/demo.ahk.output:Name.Label
ahk/demo.ahk.output:Name.Variable
alloy/example.als.output:Keyword
alloy/example.als.output:Keyword.Declaration
alloy/example.als.output:Keyword.Namespace
apacheconf/apache2.conf.output:Name.Builtin
apacheconf/apache2.conf.output:Name.Tag
apdl/example1apdl.ans.output:Name.Variable
apdl/example2apdl.ans.output:Keyword
apdl/example2apdl.ans.output:Name.Variable
apl/test.apl.output:Keyword.Declaration
apl/test.apl.output:Keyword.Type
apl/test.apl.output:Name.Attribute
apl/test.apl.output:Name.Variable
applescript/pppoe.applescript.output:Keyword
applescript/pppoe.applescript.output:Name.Builtin
applescript/pppoe.applescript.output:Name.Variable
applescript/unicode.applescript.output:Keyword
applescript/unicode.applescript.output:Name.Variable
arrow/primesieve.arw.output:Keyword.Reserved
arrow/primesieve.arw.output:Keyword.Type
arrow/primesieve.arw.output:Name.Variable
as3/as3_test2.as.output:Keyword
as3/as3_test2.as.output:Keyword.Constant
as3/as3_test2.as.output:Keyword.Declaration
as3/as3_test2.as.output:Keyword.Type
as3/as3_test2.as.output:Name.Attribute
as3/as3_test2.as.output:Name.Namespace
as3/as3_test3.as.output:Keyword
as3/as3_test3.as.output:Keyword.Declaration
as3/as3_test3.as.output:Keyword.Type
as3/as3_test.as.output:Keyword
as3/as3_test.as.output:Keyword.Declaration
as3/as3_test.as.output:Keyword.Type
as3/as3_test.as.output:Name.Attribute
aspx-cs/aspx-cs_example.output:Keyword
aspx-cs/aspx-cs_example.output:Keyword.Type
aspx-cs/aspx-cs_example.output:Name.Tag
aspx-vb/example2.aspx.output:Keyword
aspx-vb/example2.aspx.output:Name.Tag
asy/test.asy.output:Keyword
asy/test.asy.output:Keyword.Type
asy/test.asy.output:Name.Function
asy/test.asy.output:Name.Variable
at/hello.at.output:Keyword
at/hello.at.output:Name.Builtin
at/hello.at.output:Name.Variable
autoit/autoit_submit.au3.output:Name.Builtin
autoit/autoit_submit.au3.output:Name.Variable
awk/test.awk.output:Keyword
awk/test.awk.output:Keyword.Reserved
awk/test.awk.output:Name.Builtin
awk/test.awk.output:Name.Other
bare/bare.bare.output:Keyword
bare/bare.bare.output:Name.Attribute
bash/example.sh.output:Keyword
bash/example.sh.output:Name.Builtin
bash/ltmain.sh.output:Keyword
bash/ltmain.sh.output:Name.Builtin
bash/ltmain.sh.output:Name.Variable
bat/example.bat.output:Keyword
bat/example.bat.output:Name.Label
bat/example.bat.output:Name.Variable
bc/example.bc.output:Keyword
bib/test.bib.output:Name.Attribute
bib/test.bib.output:Name.Variable
blitzbasic/test.bb.output:Keyword.Declaration
blitzbasic/test.bb.output:Keyword.Reserved
blitzbasic/test.bb.output:Keyword.Type
blitzbasic/test.bb.output:Name.Class
blitzbasic/test.bb.output:Name.Variable
blitzmax/test.bmx.output:Keyword.Declaration
blitzmax/test.bmx.output:Keyword.Reserved
blitzmax/test.bmx.output:Keyword.Type
blitzmax/test.bmx.output:Name.Class
blitzmax/test.bmx.output:Name.Function
blitzmax/test.bmx.output:Name.Variable
boa/example.boa.output:Keyword.Reserved
boa/example.boa.output:Name.Classes
boa/example.boa.output:Name.Variable
boogie/test.bpl.output:Keyword
boogie/test.bpl.output:Keyword.Reserved
boogie/test.bpl.output:Keyword.Type
boo/test.boo.output:Keyword
boo/test.boo.output:Name.Builtin
bst/plain.bst.output:Keyword
bst/plain.bst.output:Name.Builtin
bst/plain.bst.output:Name.Function
bst/plain.bst.output:Name.Variable
bugs/example.bug.output:Keyword.Namespace
bugs/example.bug.output:Keyword.Reserved
ca65/ca65_example.output:Keyword
ca65/ca65_example.output:Keyword.Pseudo
cadl/example1.cadl.output:Name.Class
cadl/test.cadl.output:Name.Class
camkes/simple.camkes.output:Keyword
camkes/simple.camkes.output:Keyword.Reserved
camkes/simple.camkes.output:Keyword.Type
capdl/capdl_example.cdl.output:Keyword
capdl/capdl_example.cdl.output:Keyword.Type
cbmbas/cbmbas_example.output:Keyword.Declaration
cddl/example.cddl.output:Name.Builtin
cddl/example.cddl.output:Name.Class
ceylon/example.ceylon.output:Keyword
ceylon/example.ceylon.output:Keyword.Declaration
ceylon/example.ceylon.output:Keyword.Namespace
ceylon/example.ceylon.output:Keyword.Type
ceylon/example.ceylon.output:Name.Attribute
ceylon/example.ceylon.output:Name.Class
ceylon/example.ceylon.output:Name.Decorator
ceylon/example.ceylon.output:Name.Namespace
cfc/exampleScript.cfc.output:Keyword
cfc/exampleScript.cfc.output:Name.Variable
cfc/exampleTag.cfc.output:Name.Variable
cfm/demo.cfm.output:Name.Builtin
cfm/demo.cfm.output:Name.Tag
cfm/demo.cfm.output:Name.Variable
chai/example.chai.output:Keyword.Declaration
chai/example.chai.output:Keyword.Reserved
chai/example.chai.output:Name.Other
chapel/99_bottles_of_beer.chpl.output:Keyword
chapel/99_bottles_of_beer.chpl.output:Keyword.Declaration
chapel/99_bottles_of_beer.chpl.output:Keyword.Type
chapel/99_bottles_of_beer.chpl.output:Name.Class
chapel/99_bottles_of_beer.chpl.output:Name.Other
charmci/Charmci.ci.output:Keyword
clay/example.clay.output:Keyword
clojure/clojure-weird-keywords.clj.output:Name.Variable
clojure/escape_semicolon.clj.output:Name.Function
clojure/escape_semicolon.clj.output:Name.Variable
clojure/genclass.clj.output:Name.Function
clojure/genclass.clj.output:Name.Variable
clojurescript/core.cljs.output:Name.Function
clojurescript/core.cljs.output:Name.Variable
cobol/example.cob.output:Keyword.Pseudo
cobol/example.cob.output:Keyword.Reserved
cobol/example.cob.output:Keyword.Type
cobol/example.cob.output:Name.Builtin
cobol/example.cob.output:Name.Constant
cobol/example.cob.output:Name.Variable
coffee-script/example.coffee.output:Name.Function
coffee-script/underscore.coffee.output:Keyword
coffee-script/underscore.coffee.output:Keyword.Constant
coffee-script/underscore.coffee.output:Name.Builtin
coffee-script/underscore.coffee.output:Name.Function
coffee-script/underscore.coffee.output:Name.Other
coffee-script/underscore.coffee.output:Name.Variable
common-lisp/type.lisp.output:Keyword
common-lisp/type.lisp.output:Name.Builtin
common-lisp/type.lisp.output:Name.Class
common-lisp/type.lisp.output:Name.Constant
common-lisp/type.lisp.output:Name.Variable
console/example.shell-session.output:Name.Builtin
console/example.sh-session.output:Name.Builtin
coq/coq_RelationClasses.output:Keyword
coq/coq_RelationClasses.output:Keyword.Namespace
coq/coq_RelationClasses.output:Keyword.Pseudo
coq/coq_RelationClasses.output:Keyword.Reserved
coq/coq_RelationClasses.output:Keyword.Type
cpsa/yahalom.cpsa.output:Keyword
cpsa/yahalom.cpsa.output:Name.Builtin
cpsa/yahalom.cpsa.output:Name.Function
cpsa/yahalom.cpsa.output:Name.Variable
croc/simple.croc.output:Keyword
croc/simple.croc.output:Keyword.Constant
cr/test.cr.output:Keyword
cr/test.cr.output:Keyword.Constant
cr/test.cr.output:Keyword.Pseudo
cr/test.cr.output:Name.Builtin
cr/test.cr.output:Name.Class
cr/test.cr.output:Name.Constant
cr/test.cr.output:Name.Function
csharp/test.cs.output:Keyword
csharp/test.cs.output:Keyword.Type
csharp/test.cs.output:Name.Class
csharp/test.cs.output:Name.Function
csharp/test.cs.output:Name.Namespace
csound-document/test.csd.output:Keyword
csound-document/test.csd.output:Name.Builtin
csound-score/test.sco.output:Keyword
csound/test.orc.output:Keyword
csound/test.orc.output:Keyword.Pseudo
csound/test.orc.output:Name.Builtin
css+mozpreproc/demo.css.in.output:Name.Class
css/test.css.output:Keyword
css/test.css.output:Keyword.Constant
css/test.css.output:Keyword.Type
css/test.css.output:Name.Class
css/test.css.output:Name.Decorator
css/test.css.output:Name.Namespace
css/test.css.output:Name.Tag
css/webkit-transition.css.output:Keyword
css/webkit-transition.css.output:Keyword.Type
css/webkit-transition.css.output:Name.Tag
dart/test.dart.output:Keyword
dart/test.dart.output:Keyword.Declaration
dart/test.dart.output:Keyword.Type
dart/test.dart.output:Name.Class
delphi/example.pas.output:Keyword
delphi/example.pas.output:Keyword.Pseudo
delphi/example.pas.output:Keyword.Type
delphi/example.pas.output:Name.Builtin
delphi/test.pas.output:Keyword
delphi/test.pas.output:Keyword.Pseudo
delphi/test.pas.output:Keyword.Type
delphi/test.pas.output:Name.Builtin
delphi/test.pas.output:Name.Function
devicetree/example.dts.output:Keyword.Reserved
devicetree/example.dts.output:Name.Attribute
dg/inet_pton6.dg.output:Keyword.Reserved
dg/inet_pton6.dg.output:Name.Builtin
dg/inet_pton6.dg.output:Name.Exception
django/django_sample.html+django.output:Keyword
django/django_sample.html+django.output:Name.Function
django/django_sample.html+django.output:Name.Variable
docker/docker.docker.output:Keyword
docker/docker.docker.output:Name.Builtin
docker/docker.docker.output:Name.Variable
d/string_delimiters.d.output:Keyword
d/string_delimiters.d.output:Keyword.Type
dtd/test.dtd.output:Keyword
dtd/test.dtd.output:Keyword.Constant
dtd/test.dtd.output:Name.Attribute
dtd/test.dtd.output:Name.Entity
dtd/test.dtd.output:Name.Tag
d/test.d.output:Keyword
d/test.d.output:Keyword.Constant
d/test.d.output:Keyword.Type
d/test.d.output:Name.Builtin
duel/jbst_example1.jbst.output:Keyword
duel/jbst_example1.jbst.output:Name.Other
duel/jbst_example1.jbst.output:Name.Tag
duel/jbst_example2.jbst.output:Keyword
duel/jbst_example2.jbst.output:Keyword.Declaration
duel/jbst_example2.jbst.output:Name.Other
duel/jbst_example2.jbst.output:Name.Tag
dylan/classes.dylan.output:Keyword
dylan/classes.dylan.output:Name.Builtin
dylan/classes.dylan.output:Name.Class
dylan/classes.dylan.output:Name.Constant
dylan-console/session.dylan-console.output:Keyword
dylan-console/session.dylan-console.output:Name.Builtin
dylan/nanomsg.intr.output:Keyword
dylan/nanomsg.intr.output:Name.Builtin
dylan/nanomsg.intr.output:Name.Class
earl-grey/eg_example1.eg.output:Keyword.Pseudo
earl-grey/eg_example1.eg.output:Name.Function
earl-grey/eg_example1.eg.output:Name.Symbol
earl-grey/eg_example1.eg.output:Name.Variable
ebnf/test.ebnf.output:Name.Entity
eiffel/example.e.output:Keyword.Constant
eiffel/example.e.output:Keyword.Reserved
eiffel/example.e.output:Name.Class
elixir/example_elixir.ex.output:Keyword
elixir/example_elixir.ex.output:Keyword.Declaration
elixir/example_elixir.ex.output:Keyword.Namespace
elixir/example_elixir.ex.output:Name.Attribute
elixir/example_elixir.ex.output:Name.Class
elixir/example_elixir.ex.output:Name.Constant
elixir/example_elixir.ex.output:Name.Entity
elm/example.elm.output:Keyword.Reserved
elm/example.elm.output:Keyword.Type
elm/example.elm.output:Name.Class
elm/example.elm.output:Name.Function
elm/example.elm.output:Name.Variable
emacs/subr.el.output:Keyword
emacs/subr.el.output:Keyword.Pseudo
emacs/subr.el.output:Name.Builtin
emacs/subr.el.output:Name.Constant
emacs/subr.el.output:Name.Exception
emacs/subr.el.output:Name.Function
emacs/subr.el.output:Name.Variable
erlang/test.erl.output:Keyword
erlang/test.erl.output:Name.Label
erlang/test.erl.output:Name.Variable
erl/erl_session.output:Name.Variable
execline/example.exec.output:Name.Builtin
extempore/example.xtm.output:Keyword
extempore/example.xtm.output:Keyword.Type
extempore/example.xtm.output:Name.Function
extempore/example.xtm.output:Name.Variable
ezhil/ezhil_primefactors.n.output:Keyword
factor/wiki.factor.output:Keyword
factor/wiki.factor.output:Keyword.Namespace
factor/wiki.factor.output:Name.Class
factor/wiki.factor.output:Name.Function
factor/wiki.factor.output:Name.Namespace
factor/wiki.factor.output:Name.Variable
fancy/example_file.fy.output:Keyword
fancy/example_file.fy.output:Name.Builtin
fancy/example_file.fy.output:Name.Constant
fancy/example_file.fy.output:Name.Function
fan/test.fan.output:Keyword
fan/test.fan.output:Keyword.Constant
fan/test.fan.output:Keyword.Namespace
fan/test.fan.output:Name.Class
fan/test.fan.output:Name.Function
fan/test.fan.output:Name.Variable
felix/test.flx.output:Keyword
felix/test.flx.output:Keyword.Declaration
felix/test.flx.output:Keyword.Type
felix/test.flx.output:Name.Decorator
felix/test.flx.output:Name.Function
fennel/fennelview.fnl.output:Name.Constant
fennel/fennelview.fnl.output:Name.Variable
fish/example.fish.output:Keyword
fish/example.fish.output:Name.Builtin
fish/example.fish.output:Name.Variable
flatline/flatline_example.output:Name.Function
flatline/flatline_example.output:Name.Variable
floscript/example.flo.output:Keyword
floscript/example.flo.output:Name.Builtin
forth/demo.frt.output:Keyword
forth/demo.frt.output:Keyword.Namespace
forth/demo.frt.output:Name.Class
forth/demo.frt.output:Name.Function
fortran/example.f90.output:Keyword
fortran/example.f90.output:Keyword.Declaration
fortranfixed/ahcon.f.output:Keyword
fortranfixed/ahcon.f.output:Name.Label
fortran/zmlrpc.f90.output:Keyword
fortran/zmlrpc.f90.output:Keyword.Declaration
fortran/zmlrpc.f90.output:Keyword.Type
foxpro/example.prg.output:Keyword.Reserved
foxpro/example.prg.output:Name.Builtin
foxpro/example.prg.output:Name.Class
foxpro/example.prg.output:Name.Function
foxpro/example.prg.output:Name.Variable
fsharp/Deflate.fs.output:Keyword
fsharp/Deflate.fs.output:Keyword.Type
fsharp/Deflate.fs.output:Name.Function
fsharp/Deflate.fs.output:Name.Variable
fstar/example.fst.output:Keyword
fstar/example.fst.output:Keyword.Declaration
fstar/example.fst.output:Keyword.Type
fstar/example.fst.output:Name.Class
fstar/example.fst.output:Name.Exception
gap/example.gd.output:Name.Variable
gap/example.gi.output:Keyword
gap/example.gi.output:Name.Variable
gdscript/gdscript_example.gd.output:Keyword
genshi/genshi_example.xml+genshi.output:Keyword
genshi/genshi_example.xml+genshi.output:Name.Tag
genshi/genshi_example.xml+genshi.output:Name.Variable
genshitext/genshitext_example.genshitext.output:Keyword
glsl/glsl.frag.output:Keyword.Type
glsl/glsl.vert.output:Keyword
glsl/glsl.vert.output:Keyword.Type
glsl/glsl.vert.output:Name.Builtin
gnuplot/test.plot.output:Keyword
gnuplot/test.plot.output:Name.Builtin
gnuplot/test.plot.output:Name.Variable
golo/example.golo.output:Keyword
golo/example.golo.output:Keyword.Constant
golo/example.golo.output:Keyword.Declaration
golo/example.golo.output:Keyword.Namespace
golo/example.golo.output:Name.Class
golo/example.golo.output:Name.Function
golo/example.golo.output:Name.Namespace
golo/example.golo.output:Name.Variable
golo/hello.golo.output:Keyword.Declaration
golo/hello.golo.output:Keyword.Namespace
golo/hello.golo.output:Name.Function
gosu/example.gs.output:Keyword
gosu/example.gs.output:Keyword.Declaration
gosu/example.gs.output:Keyword.Namespace
gosu/example.gs.output:Keyword.Type
gosu/example.gs.output:Name.Attribute
gosu/example.gs.output:Name.Class
go/unicode.go.output:Keyword.Declaration
go/unicode.go.output:Keyword.Namespace
go/unicode.go.output:Name.Other
groff/perlfunc.1.output:Keyword
groovy/quoted.groovy.output:Keyword
groovy/quoted.groovy.output:Keyword.Type
groovy/test.gradle.output:Keyword
groovy/test.gradle.output:Keyword.Declaration
groovy/test.gradle.output:Keyword.Type
groovy/test.gradle.output:Name.Class
groovy/test.gradle.output:Name.Label
groovy/test.groovy.output:Keyword
groovy/test.groovy.output:Keyword.Declaration
groovy/test.groovy.output:Keyword.Namespace
groovy/test.groovy.output:Keyword.Type
groovy/test.groovy.output:Name.Attribute
groovy/test.groovy.output:Name.Class
groovy/test.groovy.output:Name.Label
gst/example.gst.output:Keyword
haskell/AcidStateAdvanced.hs.output:Keyword
haskell/AcidStateAdvanced.hs.output:Keyword.Reserved
haskell/AcidStateAdvanced.hs.output:Keyword.Type
haskell/AcidStateAdvanced.hs.output:Name.Function
haskell/AcidStateAdvanced.hs.output:Name.Namespace
haskell/example.hs.output:Keyword.Reserved
haskell/example.hs.output:Keyword.Type
haskell/example.hs.output:Name.Function
haskell/example.hs.output:Name.Namespace
haskell/SmallCheck.hs.output:Keyword.Reserved
haskell/SmallCheck.hs.output:Keyword.Type
haskell/SmallCheck.hs.output:Name.Builtin
haskell/SmallCheck.hs.output:Name.Exception
haskell/SmallCheck.hs.output:Name.Function
haskell/SmallCheck.hs.output:Name.Namespace
hexdump/hexdump_debugexe.output:Name.Label
hexdump/hexdump_hd.output:Name.Label
hexdump/hexdump_hexcat.output:Name.Label
hexdump/hexdump_hexdump.output:Name.Label
hexdump/hexdump_od.output:Name.Label
hlsl/example.hlsl.output:Keyword
hlsl/example.hlsl.output:Keyword.Type
hsail/test.hsail.output:Keyword
hsail/test.hsail.output:Keyword.Type
html/example.xhtml.output:Keyword
html/example.xhtml.output:Keyword.Constant
html/example.xhtml.output:Keyword.Type
html/example.xhtml.output:Name.Class
html/example.xhtml.output:Name.Other
html+handlebars/demo.hbs.output:Keyword
html+handlebars/demo.hbs.output:Name.Tag
html+handlebars/demo.hbs.output:Name.Variable
html+handlebars/ember.handlebars.output:Name.Tag
html+handlebars/ember.handlebars.output:Name.Variable
html+ng2/example.ng2.output:Name.Tag
html/test.html.output:Keyword.Constant
html/test.html.output:Keyword.Declaration
html/test.html.output:Keyword.Type
html/test.html.output:Name.Class
html/test.html.output:Name.Other
html/test.html.output:Name.Tag
http/http_request_example.output:Name.Function
http/http_request_example.output:Name.Namespace
hx/example.hx.output:Keyword
hx/example.hx.output:Keyword.Constant
hx/example.hx.output:Keyword.Declaration
hx/example.hx.output:Keyword.Namespace
hx/example.hx.output:Name.Decorator
hx/OrderedMap.hx.output:Keyword
hx/OrderedMap.hx.output:Keyword.Constant
hx/OrderedMap.hx.output:Keyword.Declaration
hx/OrderedMap.hx.output:Keyword.Namespace
hybris/hybris_File.hy.output:Keyword
hybris/hybris_File.hy.output:Keyword.Constant
hybris/hybris_File.hy.output:Keyword.Declaration
hybris/hybris_File.hy.output:Keyword.Namespace
hybris/hybris_File.hy.output:Keyword.Type
hybris/hybris_File.hy.output:Name.Attribute
hybris/hybris_File.hy.output:Name.Builtin
hybris/hybris_File.hy.output:Name.Class
hylang/language.hy.output:Keyword
hylang/language.hy.output:Name.Builtin
hylang/language.hy.output:Name.Exception
hylang/language.hy.output:Name.Function
hylang/language.hy.output:Name.Variable
i6t/example.i6t.output:Keyword
i6t/example.i6t.output:Keyword.Pseudo
i6t/example.i6t.output:Name.Function
icon/example.icon.output:Keyword.Constant
icon/example.icon.output:Keyword.Declaration
icon/example.icon.output:Keyword.Reserved
icon/example.icon.output:Name.Function
idl/idl_sample.pro.output:Keyword
idris/test.idr.output:Keyword.Reserved
idris/test.idr.output:Keyword.Type
idris/test.idr.output:Name.Function
inform6/inform6_example.output:Keyword
inform6/inform6_example.output:Keyword.Declaration
inform6/inform6_example.output:Keyword.Pseudo
inform6/inform6_example.output:Name.Builtin
inform6/inform6_example.output:Name.Class
inform6/inform6_example.output:Name.Constant
inform6/inform6_example.output:Name.Function
inform6/inform6_example.output:Name.Label
inform6/inform6_example.output:Name.Variable
inform7/example.i7x.output:Keyword
inform7/example.ni.output:Keyword
inform7/example.ni.output:Name.Constant
inform7/example.ni.output:Name.Function
ini/test.ini.output:Name.Attribute
ioke/intro.ik.output:Name.Class
ioke/intro.ik.output:Name.Variable
isabelle/example.thy.output:Keyword
isabelle/example.thy.output:Keyword.Namespace
isabelle/example.thy.output:Keyword.Pseudo
isabelle/example.thy.output:Name.Type
jags/example.jag.output:Keyword.Namespace
jags/example.jag.output:Keyword.Reserved
jasmin/example.j.output:Keyword
jasmin/example.j.output:Keyword.Reserved
jasmin/example.j.output:Keyword.Type
jasmin/example.j.output:Name.Class
jasmin/example.j.output:Name.Exception
jasmin/example.j.output:Name.Label
jasmin/example.j.output:Name.Variable
java/badcase.java.output:Keyword.Declaration
java/badcase.java.output:Keyword.Type
java/example.java.output:Keyword
java/example.java.output:Keyword.Declaration
java/example.java.output:Keyword.Type
javascript+mozpreproc/demo.js.in.output:Name.Other
java/test.java.output:Keyword
java/test.java.output:Keyword.Constant
java/test.java.output:Keyword.Declaration
java/test.java.output:Keyword.Namespace
java/test.java.output:Keyword.Type
java/test.java.output:Name.Attribute
java/test.java.output:Name.Class
j/pacman.ijs.output:Keyword.Constant
j/pacman.ijs.output:Name.Decorator
j/pacman.ijs.output:Name.Label
j/pacman.ijs.output:Name.Variable
js/evil_regex.js.output:Keyword
js/evil_regex.js.output:Keyword.Declaration
js/evil_regex.js.output:Name.Other
js/general.js.output:Keyword
js/general.js.output:Keyword.Declaration
js/general.js.output:Name.Builtin
js/general.js.output:Name.Other
jsgf/example.jsgf.output:Keyword.Reserved
jsp/test.jsp.output:Keyword
jsp/test.jsp.output:Keyword.Declaration
jsp/test.jsp.output:Keyword.Type
js/regex.js.output:Keyword
js/regex.js.output:Keyword.Declaration
js/regex.js.output:Name.Other
js/unicode.js.output:Keyword.Declaration
julia/string.jl.output:Keyword
julia/string.jl.output:Keyword.Type
julia/string.jl.output:Name.Builtin
julia/string.jl.output:Name.Decorator
juttle/example.juttle.output:Keyword
juttle/example.juttle.output:Keyword.Declaration
juttle/example.juttle.output:Keyword.Reserved
juttle/example.juttle.output:Name.Other
kal/example.kal.output:Keyword
kal/example.kal.output:Keyword.Declaration
kal/example.kal.output:Name.Builtin
kal/example.kal.output:Name.Variable
kconfig/Config.in.cache.output:Keyword
kconfig/Config.in.cache.output:Name.Builtin
koka/garcia-wachs.kk.output:Keyword
koka/garcia-wachs.kk.output:Name.Attribute
koka/garcia-wachs.kk.output:Name.Namespace
kotlin/example.kt.output:Keyword
kotlin/example.kt.output:Keyword.Declaration
kotlin/example.kt.output:Name.Class
kotlin/example.kt.output:Name.Variable
kuin/example.kn.output:Keyword
kuin/example.kn.output:Keyword.Type
kuin/example.kn.output:Name.Variable
lagda/example.lagda.output:Keyword.Reserved
lagda/example.lagda.output:Keyword.Type
lagda/example.lagda.output:Name.Function
lasso/json.lasso9.output:Keyword
lasso/json.lasso9.output:Keyword.Declaration
lasso/json.lasso9.output:Name.Builtin
lasso/json.lasso9.output:Name.Label
lasso/json.lasso.output:Keyword
lasso/json.lasso.output:Name.Builtin
lean/test.lean.output:Keyword
lean/test.lean.output:Keyword.Declaration
lean/test.lean.output:Keyword.Namespace
lean/test.lean.output:Keyword.Type
lhs/DancingSudoku.lhs.output:Keyword
lhs/DancingSudoku.lhs.output:Keyword.Reserved
lhs/DancingSudoku.lhs.output:Keyword.Type
lhs/DancingSudoku.lhs.output:Name.Exception
lhs/DancingSudoku.lhs.output:Name.Function
lhs/DancingSudoku.lhs.output:Name.Namespace
lhs/Sudoku.lhs.output:Keyword.Reserved
lhs/Sudoku.lhs.output:Keyword.Type
lhs/Sudoku.lhs.output:Name.Exception
lhs/Sudoku.lhs.output:Name.Function
lhs/Sudoku.lhs.output:Name.Namespace
lighty/lighttpd_config.conf.output:Keyword
limbo/limbo.b.output:Keyword
limbo/limbo.b.output:Keyword.Constant
limbo/limbo.b.output:Keyword.Type
live-script/livescript-demo.ls.output:Keyword
live-script/livescript-demo.ls.output:Keyword.Constant
live-script/livescript-demo.ls.output:Name.Function
live-script/livescript-demo.ls.output:Name.Other
llvm-mir/llvm-mir.mir.output:Keyword
llvm-mir/llvm-mir.mir.output:Name.Builtin
logos/logos_example.xm.output:Keyword
logtalk/source.lgt.output:Keyword
logtalk/source.lgt.output:Name.Variable
lua/example.lua.output:Keyword.Declaration
lua/example.lua.output:Keyword.Reserved
lua/example.lua.output:Name.Class
lua/example.lua.output:Name.Function
lua/example.lua.output:Name.Label
make/automake.mk.output:Name.Variable
make/firefox.mak.output:Keyword
make/firefox.mak.output:Name.Builtin
make/firefox.mak.output:Name.Variable
make/Makefile.output:Keyword
make/Makefile.output:Name.Builtin
make/Makefile.output:Name.Variable
make/python25-bsd.mak.output:Keyword
make/python25-bsd.mak.output:Name.Builtin
make/vpath.mk.output:Keyword
make/vpath.mk.output:Name.Variable
mako/test.mao.output:Keyword
maql/test.maql.output:Keyword
maql/test.maql.output:Name.Builtin
maql/test.maql.output:Name.Variable
mask/test.mask.output:Name.Attribute
mask/test.mask.output:Name.Builtin
mask/test.mask.output:Name.Class
mask/test.mask.output:Name.Function
mask/test.mask.output:Name.Tag
mask/test.mask.output:Name.Variable
md/example.md.output:Keyword
md/example.md.output:Keyword.Namespace
md/example.md.output:Name.Entity
md/example.md.output:Name.Namespace
mime/MIME_example.eml.output:Name.Tag
modelica/Constants.mo.output:Keyword.Reserved
modelica/Constants.mo.output:Name.Builtin
modelica/Constants.mo.output:Name.Tag
modula2/modula2_test_cases.def.output:Keyword.Reserved
modula2/modula2_test_cases.def.output:Name.Builtin
modula2/Sorting.mod.output:Keyword.Reserved
modula2/Sorting.mod.output:Name.Builtin
modula2/test.mod.output:Keyword.Reserved
modula2/test.mod.output:Name.Builtin
monkey/example.monkey.output:Keyword.Declaration
monkey/example.monkey.output:Keyword.Namespace
monkey/example.monkey.output:Keyword.Reserved
monkey/example.monkey.output:Keyword.Type
monkey/example.monkey.output:Name.Class
monkey/example.monkey.output:Name.Constant
monkey/example.monkey.output:Name.Function
monkey/example.monkey.output:Name.Variable
moocode/example.moo.output:Keyword
moocode/test.moo.output:Keyword
moon/example.moon.output:Keyword
moon/example.moon.output:Keyword.Constant
moon/example.moon.output:Keyword.Type
moon/example.moon.output:Name.Builtin
moon/example.moon.output:Name.Class
moon/example.moon.output:Name.Function
moon/example.moon.output:Name.Variable
ms/example.ms.output:Keyword
ms/example.ms.output:Keyword.Constant
ms/example.ms.output:Name.Builtin
ms/example.ms.output:Name.Variable
mupad/AlternatingGroup.mu.output:Keyword
mupad/AlternatingGroup.mu.output:Name.Constant
mupad/AlternatingGroup.mu.output:Name.Variable
mupad/function.mu.output:Name.Function
myghty/test.myt.output:Keyword
myghty/test.myt.output:Keyword.Constant
myghty/test.myt.output:Keyword.Namespace
myghty/test.myt.output:Name.Tag
nasm/nasm_aoutso.asm.output:Keyword.Constant
nasm/nasm_aoutso.asm.output:Keyword.Declaration
nasm/nasm_aoutso.asm.output:Keyword.Type
nasm/nasm_aoutso.asm.output:Name.Builtin
nasm/nasm_aoutso.asm.output:Name.Function
nasm/nasm_aoutso.asm.output:Name.Label
nasm/nasm_aoutso.asm.output:Name.Variable
nasm/nasm_objexe.asm.output:Keyword.Declaration
nasm/nasm_objexe.asm.output:Name.Function
nasm/nasm_objexe.asm.output:Name.Label
nasm/nasm_objexe.asm.output:Name.Variable
ncl/test.ncl.output:Keyword
ncl/test.ncl.output:Name.Builtin
nemerle/nemerle_sample.n.output:Keyword
nemerle/nemerle_sample.n.output:Name.Class
newlisp/irc.lsp.output:Keyword
newlisp/irc.lsp.output:Name.Variable
newlisp/markdown.lsp.output:Keyword
newlisp/markdown.lsp.output:Name.Variable
newlisp/reversi.lsp.output:Keyword
newlisp/reversi.lsp.output:Name.Variable
newspeak/example.ns2.output:Keyword.Declaration
newspeak/example.ns2.output:Name.Attribute
newspeak/example.ns2.output:Name.Class
newspeak/example.ns2.output:Name.Function
newspeak/example.ns2.output:Name.Variable
newspeak/minimal.ns2.output:Keyword
newspeak/minimal.ns2.output:Keyword.Declaration
newspeak/minimal.ns2.output:Name.Attribute
newspeak/minimal.ns2.output:Name.Class
newspeak/minimal.ns2.output:Name.Function
newspeak/minimal.ns2.output:Name.Variable
nginx/nginx_nginx.conf.output:Keyword
nginx/nginx_nginx.conf.output:Keyword.Namespace
nginx/nginx_nginx.conf.output:Name.Variable
nim/example.nim.output:Keyword
nim/example.nim.output:Keyword.Declaration
nim/example.nim.output:Keyword.Namespace
nim/example.nim.output:Keyword.Pseudo
nim/example.nim.output:Keyword.Type
nim/test.nim.output:Keyword
nim/test.nim.output:Keyword.Declaration
nim/test.nim.output:Keyword.Namespace
nim/test.nim.output:Keyword.Type
nit/all.nit.output:Keyword
nit/all.nit.output:Name.Class
nixos/example.nix.output:Keyword
nixos/example.nix.output:Name.Constant
nodejsrepl/nodejsrepl_test.nodejsrepl.output:Keyword.Declaration
nodejsrepl/nodejsrepl_test.nodejsrepl.output:Name.Other
notmuch/notmuch_example.output:Name.Builtin
nsis/bigtest.nsi.output:Keyword
nsis/bigtest.nsi.output:Keyword.Pseudo
nsis/bigtest.nsi.output:Name.Attribute
nsis/bigtest.nsi.output:Name.Constant
objective-c/objc_example.m.output:Keyword
objective-j/CPDictionary.j.output:Keyword
objective-j/CPDictionary.j.output:Keyword.Constant
objective-j/CPDictionary.j.output:Keyword.Declaration
objective-j/CPDictionary.j.output:Name.Builtin
objective-j/CPDictionary.j.output:Name.Class
ocaml/format.ml.output:Keyword
ocaml/format.ml.output:Keyword.Type
ocaml/format.ml.output:Name.Class
odin/test2.odin.output:Name.Class
odin/test.odin.output:Name.Class
opa/test.opa.output:Keyword
openedge/example.cls.output:Keyword.Declaration
openedge/example.cls.output:Keyword.Type
openedge/example.cls.output:Name.Builtin
openedge/example.cls.output:Name.Variable
openedge/openedge_example.output:Keyword.Declaration
openedge/openedge_example.output:Keyword.Type
openedge/openedge_example.output:Name.Builtin
openedge/openedge_example.output:Name.Variable
pacmanconf/pacman.conf.output:Name.Attribute
pacmanconf/pacman.conf.output:Name.Variable
pan/test.pan.output:Keyword
pan/test.pan.output:Name.Variable
parasail/test.psl.output:Keyword.Reserved
pawn/pawn_example.output:Keyword
pawn/test.pwn.output:Keyword
perl6/RoleQ.pm6.output:Keyword
perl6/RoleQ.pm6.output:Name.Builtin
perl6/test.p6.output:Keyword
perl6/test.p6.output:Name.Builtin
perl6/test.p6.output:Name.Variable
perl/perl_misc.output:Keyword
perl/perl_misc.output:Name.Builtin
perl/perl_misc.output:Name.Namespace
perl/perl_misc.output:Name.Variable
perl/perl_perl5db.output:Keyword
perl/perl_perl5db.output:Name.Builtin
perl/perl_perl5db.output:Name.Function
perl/perl_perl5db.output:Name.Namespace
perl/perl_perl5db.output:Name.Variable
perl/perl_regex-delims.output:Keyword
perl/perl_regex-delims.output:Name.Variable
php/ints.php.output:Name.Variable
php/test.php.output:Keyword
php/test.php.output:Name.Attribute
php/test.php.output:Name.Class
php/test.php.output:Name.Other
php/test.php.output:Name.Variable
pig/test.pig.output:Keyword
pointless/example.ptls.output:Keyword
pointless/example.ptls.output:Name.Variable
pony/example.pony.output:Keyword
pony/example.pony.output:Name.Type
postgresql/postgresql_test.txt.output:Keyword
postgresql/postgresql_test.txt.output:Name.Builtin
postgresql/postgresql_test.txt.output:Name.Variable
postscript/cells.ps.output:Name.Function
postscript/cells.ps.output:Name.Variable
pot/de.MoinMoin.po.output:Name.Variable
pov/sphere.pov.output:Keyword
pov/sphere.pov.output:Name.Builtin
pov/while.pov.output:Name.Builtin
powershell/Get-CommandDefinitionHtml.ps1.output:Keyword
powershell/Get-CommandDefinitionHtml.ps1.output:Name.Builtin
powershell/Get-CommandDefinitionHtml.ps1.output:Name.Variable
powershell/test.ps1.output:Keyword
powershell/test.ps1.output:Name.Builtin
powershell/test.ps1.output:Name.Variable
praat/example.praat.output:Keyword
praat/example.praat.output:Name.Class
praat/example.praat.output:Name.Function
prolog/qsort.prolog.output:Name.Variable
properties/java.properties.output:Name.Attribute
protobuf/addressbook.proto.output:Keyword
protobuf/addressbook.proto.output:Keyword.Declaration
protobuf/addressbook.proto.output:Keyword.Namespace
protobuf/addressbook.proto.output:Keyword.Type
protobuf/addressbook.proto.output:Name.Attribute
protobuf/addressbook.proto.output:Name.Class
psql/psql_session.txt.output:Keyword
psql/psql_session.txt.output:Keyword.Pseudo
psql/psql_session.txt.output:Name.Builtin
psysh/psysh_test.psysh.output:Keyword
psysh/psysh_test.psysh.output:Name.Class
psysh/psysh_test.psysh.output:Name.Other
psysh/psysh_test.psysh.output:Name.Variable
puppet/example.pp.output:Keyword
puppet/example.pp.output:Name.Attribute
pycon/pycon_ctrlc_traceback.output:Keyword
pycon/pycon_ctrlc_traceback.output:Keyword.Namespace
pycon/pycon_ctrlc_traceback.output:Name.Builtin
pytb/database.pytb.output:Keyword
pytb/error_locations.pytb.output:Keyword
pytb/truncated.pytb.output:Keyword
python/linecontinuation.py.output:Keyword
python/linecontinuation.py.output:Keyword.Namespace
python/linecontinuation.py.output:Name.Class
python/linecontinuation.py.output:Name.Function
python/linecontinuation.py.output:Name.Namespace
python/py3_test.txt.output:Keyword
python/unicodedoc.py.output:Keyword
qml/minehunt.qml.output:Keyword
qml/minehunt.qml.output:Keyword.Reserved
qml/minehunt.qml.output:Name.Other
qvto/sample.qvto.output:Keyword.Word
racket/example.rkt.output:Keyword
racket/example.rkt.output:Keyword.Namespace
rb/condensed_ruby.rb.output:Keyword
rbcon/irb_heredoc.output:Name.Builtin
rb/example.rb.output:Keyword
rb/example.rb.output:Keyword.Pseudo
rb/example.rb.output:Name.Builtin
rb/example.rb.output:Name.Class
rb/example.rb.output:Name.Constant
rb/example.rb.output:Name.Function
rb/fucked_up.rb.output:Keyword
rb/fucked_up.rb.output:Name.Builtin
rb/pleac.in.rb.output:Keyword
rb/pleac.in.rb.output:Keyword.Pseudo
rb/pleac.in.rb.output:Name.Builtin
rb/ruby_func_def.rb.output:Keyword
rb/ruby_func_def.rb.output:Name.Function
rb/test.rb.output:Keyword
rb/test.rb.output:Name.Builtin
rb/test.rb.output:Name.Function
rd/example.Rd.output:Keyword
rd/example.Rd.output:Keyword.Constant
rd/example.Rd.output:Name.Builtin
reason/test.re.output:Keyword
reason/test.re.output:Keyword.Type
reason/test.re.output:Name.Class
rebol/test.r3.output:Keyword
rebol/test.r3.output:Keyword.Namespace
rebol/test.r3.output:Keyword.Type
rebol/test.r3.output:Name.Attribute
rebol/test.r3.output:Name.Builtin
rebol/test.r3.output:Name.Decorator
rebol/test.r3.output:Name.Exception
rebol/test.r3.output:Name.Function
rebol/test.r3.output:Name.Label
rebol/test.r3.output:Name.Variable
redcode/dwarf.cw.output:Name.Decorator
redcode/dwarf.cw.output:Name.Function
red/example.red.output:Keyword
red/example.red.output:Keyword.Namespace
red/example.red.output:Keyword.Type
red/example.red.output:Name.Attribute
red/example.red.output:Name.Builtin
red/example.red.output:Name.Exception
red/example.red.output:Name.Function
red/example.red.output:Name.Variable
red/example.reds.output:Keyword
red/example.reds.output:Keyword.Namespace
red/example.reds.output:Keyword.Type
red/example.reds.output:Name.Attribute
red/example.reds.output:Name.Exception
red/example.reds.output:Name.Function
red/example.reds.output:Name.Variable
registry/example.reg.output:Name.Attribute
resource/resourcebundle_demo.output:Keyword
rhtml/example.rhtml.output:Keyword
rhtml/example.rhtml.output:Name.Tag
rhtml/test.rhtml.output:Keyword
rhtml/test.rhtml.output:Name.Tag
ride/auction.ride.output:Keyword.Reserved
ride/auction.ride.output:Name.Function
ride/auction.ride.output:Name.Variable
rnc/rnc_example.rnc.output:Keyword.Type
rql/rql-queries.rql.output:Keyword
rql/rql-queries.rql.output:Name.Builtin
rsl/test.rsl.output:Keyword
rsl/test.rsl.output:Keyword.Type
rst/functional.rst.output:Name.Variable
rst/jinjadesignerdoc.rst.output:Keyword
rst/jinjadesignerdoc.rst.output:Name.Class
rst/jinjadesignerdoc.rst.output:Name.Function
rst/jinjadesignerdoc.rst.output:Name.Tag
rst/jinjadesignerdoc.rst.output:Name.Variable
rts/example.rts.output:Keyword
rts/example.rts.output:Name.Function
rts/example.rts.output:Name.Variable
rust/eval.rs.output:Keyword
rust/eval.rs.output:Keyword.Type
rust/eval.rs.output:Name.Attribute
scala/constants.scala.output:Keyword.Constant
scala/declarations.scala.output:Keyword
scala/declarations.scala.output:Keyword.Declaration
scala/declarations.scala.output:Name.Class
scala/declarations.scala.output:Name.Function
scala/declarations.scala.output:Name.Namespace
scala/dependent-types.scala.output:Keyword
scala/dependent-types.scala.output:Keyword.Declaration
scala/dependent-types.scala.output:Name.Class
scala/end.scala.output:Keyword
scala/end.scala.output:Keyword.Declaration
scala/end.scala.output:Name.Class
scala/end.scala.output:Name.Function
scala/end.scala.output:Name.Namespace
scala/exports.scala.output:Keyword
scala/extensions.scala.output:Keyword
scala/extensions.scala.output:Keyword.Declaration
scala/extensions.scala.output:Name.Class
scala/extensions.scala.output:Name.Function
scala/for-comprehension.scala.output:Keyword
scala/imports.scala.output:Keyword
scala/inheritance.scala.output:Keyword
scala/inheritance.scala.output:Name.Class
scala/inline.scala.output:Keyword
scala/inline.scala.output:Keyword.Declaration
scala/inline.scala.output:Name.Class
scala/interpolated-string.scala.output:Keyword
scala/interpolated-string.scala.output:Keyword.Declaration
scala/match-types.scala.output:Keyword
scala/match-types.scala.output:Name.Class
scala/new.scala.output:Keyword
scala/new.scala.output:Name.Function
scala/package.scala.output:Keyword
scala/pattern-matching.scala.output:Keyword
scala/pattern-matching.scala.output:Name.Class
scala/quoted.scala.output:Name.Class
scala/singleton-types.scala.output:Keyword
scala/singleton-types.scala.output:Keyword.Declaration
scala/singleton-types.scala.output:Name.Class
scala/soft-keywords.scala.output:Keyword
scala/soft-keywords.scala.output:Keyword.Declaration
scala/storage-modifiers.scala.output:Keyword
scala/storage-modifiers.scala.output:Keyword.Declaration
scala/storage-modifiers.scala.output:Name.Class
scala/storage-modifiers.scala.output:Name.Decorator
scala/storage-modifiers.scala.output:Name.Function
scala/type-operators.scala.output:Keyword
scala/type-operators.scala.output:Keyword.Declaration
scala/type-operators.scala.output:Name.Class
scala/using.scala.output:Keyword
scala/using.scala.output:Name.Class
scaml/test.scaml.output:Keyword
scaml/test.scaml.output:Keyword.Declaration
scaml/test.scaml.output:Name.Class
scdoc/scdoc_manual.scd.output:Keyword
sc/example.scd.output:Keyword.Declaration
sc/example.scd.output:Name.Other
scheme/boot-9.scm.output:Name.Constant
scheme/boot-9.scm.output:Name.Function
scheme/boot-9.scm.output:Name.Variable
scheme/r6rs-comments.scm.output:Name.Function
scheme/r6rs-comments.scm.output:Name.Variable
scilab/scilab.sci.output:Keyword
scilab/scilab.sci.output:Name.Builtin
shen/test.shen.output:Keyword
shen/test.shen.output:Keyword.Pseudo
shen/test.shen.output:Keyword.Type
shen/test.shen.output:Name.Builtin
shen/test.shen.output:Name.Function
shen/test.shen.output:Name.Namespace
shen/test.shen.output:Name.Variable
shexc/example.shex.output:Keyword
shexc/example.shex.output:Name.Tag
sieve/example.sieve.output:Keyword.Namespace
sieve/example.sieve.output:Name.Builtin
sieve/example.sieve.output:Name.Tag
silver/test.sil.output:Keyword
silver/test.sil.output:Keyword.Type
silver/test.sil.output:Name.Decorator
singularity/Singularity.output:Keyword
singularity/Singularity.output:Name.Builtin
singularity/Singularity.output:Name.Variable
slim/example.slim.output:Keyword
slurm/example.sl.output:Name.Builtin
smali/hello.smali.output:Keyword
smalltalk/Object.st.output:Name.Builtin
smalltalk/Object.st.output:Name.Class
smalltalk/Object.st.output:Name.Function
smalltalk/Object.st.output:Name.Variable
smarty/smarty_example.html.output:Keyword
smarty/smarty_example.html.output:Name.Attribute
smarty/smarty_example.html.output:Name.Function
smarty/smarty_example.html.output:Name.Variable
sml/example.sml.output:Keyword.Reserved
sml/example.sml.output:Keyword.Type
sml/example.sml.output:Name.Class
sml/example.sml.output:Name.Decorator
sml/example.sml.output:Name.Function
sml/example.sml.output:Name.Label
sml/example.sml.output:Name.Namespace
sml/example.sml.output:Name.Variable
sml/intsyn.fun.output:Keyword.Reserved
sml/intsyn.fun.output:Keyword.Type
sml/intsyn.fun.output:Name.Class
sml/intsyn.fun.output:Name.Decorator
sml/intsyn.fun.output:Name.Function
sml/intsyn.fun.output:Name.Namespace
sml/intsyn.fun.output:Name.Variable
sml/intsyn.sig.output:Keyword.Reserved
sml/intsyn.sig.output:Keyword.Type
sml/intsyn.sig.output:Name.Class
sml/intsyn.sig.output:Name.Decorator
sml/intsyn.sig.output:Name.Namespace
sml/intsyn.sig.output:Name.Variable
snobol/example.snobol.output:Name.Builtin
snobol/example.snobol.output:Name.Label
snowball/example.sbl.output:Keyword.Reserved
snowball/example.sbl.output:Name.Builtin
sourceslist/sources.list.output:Keyword
sourceslist/sources.list.output:Keyword.Pseudo
sparql/sparql.rq.output:Keyword
sparql/sparql.rq.output:Keyword.Constant
sparql/sparql.rq.output:Name.Function
sparql/sparql.rq.output:Name.Label
sparql/sparql.rq.output:Name.Tag
sparql/sparql.rq.output:Name.Variable
spec/phpMyAdmin.spec.output:Keyword
sp/hello.sp.output:Keyword
splus/test.R.output:Keyword.Constant
sqlite3/sqlite3.sqlite3-console.output:Keyword
ssp/test.ssp.output:Keyword
ssp/test.ssp.output:Keyword.Namespace
ssp/test.ssp.output:Name.Namespace
stan/example.stan.output:Keyword
stan/example.stan.output:Keyword.Namespace
stan/example.stan.output:Keyword.Type
swift/test.swift.output:Keyword
swift/test.swift.output:Keyword.Declaration
swift/test.swift.output:Keyword.Reserved
swift/test.swift.output:Name.Builtin
swift/test.swift.output:Name.Class
swift/test.swift.output:Name.Variable
systemverilog/flipflop.sv.output:Keyword
systemverilog/flipflop.sv.output:Keyword.Type
tads3/tads3_example.t.output:Keyword
tads3/tads3_example.t.output:Keyword.Reserved
tads3/tads3_example.t.output:Name.Attribute
tads3/tads3_example.t.output:Name.Builtin
tads3/tads3_example.t.output:Name.Class
tads3/tads3_example.t.output:Name.Constant
tads3/tads3_example.t.output:Name.Exception
tads3/tads3_example.t.output:Name.Function
tads3/tads3_example.t.output:Name.Tag
tads3/tads3_example.t.output:Name.Variable
tap/example.tap.output:Keyword.Declaration
tap/example.tap.output:Keyword.Reserved
tasm/example.tasm.output:Keyword
tasm/example.tasm.output:Keyword.Declaration
tasm/example.tasm.output:Keyword.Type
tasm/example.tasm.output:Name.Builtin
tasm/example.tasm.output:Name.Function
tasm/example.tasm.output:Name.Variable
tcsh/test.tcsh.output:Keyword
tcsh/test.tcsh.output:Name.Builtin
tcsh/test.tcsh.output:Name.Variable
tea/example.tea.output:Keyword
tea/example.tea.output:Keyword.Declaration
teal/example.teal.output:Keyword
teal/example.teal.output:Name.Function
thingsdb/test.ti.output:Name.Attribute
thingsdb/test.ti.output:Name.Variable
tid/TiddlyWiki5.tid.output:Keyword
tid/TiddlyWiki5.tid.output:Keyword.Type
tid/TiddlyWiki5.tid.output:Name.Builtin
tid/TiddlyWiki5.tid.output:Name.Class
tid/TiddlyWiki5.tid.output:Name.Tag
tnt/example.tnt.output:Keyword
trac-wiki/moin_SyntaxReference.txt.output:Name.Builtin
treetop/metagrammar.treetop.output:Keyword
ts/typescript_example.output:Keyword
ts/typescript_example.output:Keyword.Declaration
ts/typescript_example.output:Keyword.Type
ts/typescript_example.output:Name.Other
ttl/teraterm.ttl.output:Keyword
ttl/teraterm.ttl.output:Name.Builtin
ttl/teraterm.ttl.output:Name.Variable
turtle/example.ttl.output:Keyword.Type
turtle/example.ttl.output:Name.Tag
turtle/example.ttl.output:Name.Variable
twig/twig_test.output:Keyword
twig/twig_test.output:Keyword.Pseudo
twig/twig_test.output:Name.Builtin
twig/twig_test.output:Name.Function
twig/twig_test.output:Name.Variable
typoscript/typoscript_example.output:Name.Builtin
typoscript/typoscript_example.output:Name.Class
typoscript/typoscript_example.output:Name.Constant
typoscript/typoscript_example.output:Name.Function
ucode/example.u1.output:Keyword.Declaration
ucode/example.u1.output:Name.Function
unicon/example.icn.output:Keyword.Declaration
unicon/example.icn.output:Keyword.PreProc
unicon/example.icn.output:Keyword.Reserved
unicon/example.icn.output:Name.Function
urbiscript/example.u.output:Keyword
urbiscript/example.u.output:Keyword.Constant
urbiscript/example.u.output:Keyword.Declaration
urbiscript/example.u.output:Keyword.Reserved
urbiscript/example.u.output:Name.Other
vb.net/test.vb.output:Keyword
vb.net/test.vb.output:Keyword.Type
vb.net/test.vb.output:Name.Class
vb.net/vbnet_test.bas.output:Keyword
vcl/varnish.vcl.output:Keyword
vcl/varnish.vcl.output:Name.Variable
vgl/example.rpf.output:Keyword.Constant
vhdl/test.vhdl.output:Keyword
vhdl/test.vhdl.output:Keyword.Type
vhdl/test.vhdl.output:Name.Class
vim/phpcomplete.vim.output:Keyword
vim/vimrc.output:Keyword
vim/vimrc.output:Name.Builtin
wat/fib.wat.output:Keyword
wat/fib.wat.output:Name.Builtin
wat/fib.wat.output:Name.Variable
webidl/example.webidl.output:Keyword
webidl/example.webidl.output:Keyword.Type
webidl/example.webidl.output:Name.Class
webidl/example.webidl.output:Name.Constant
webidl/example.webidl.output:Name.Namespace
webidl/example.webidl.output:Name.Variable
whiley/example.whiley.output:Keyword.Constant
whiley/example.whiley.output:Keyword.Declaration
whiley/example.whiley.output:Keyword.Namespace
whiley/example.whiley.output:Keyword.Reserved
whiley/example.whiley.output:Keyword.Type
x10/example.x10.output:Keyword
x10/example.x10.output:Keyword.Declaration
xml/xml_example.output:Name.Tag
xorg.conf/xorg.conf.output:Name.Builtin
xquery/test-3.0.xq.output:Keyword
xquery/test-3.0.xq.output:Keyword.Declaration
xquery/test-3.0.xq.output:Keyword.Pseudo
xquery/test-3.0.xq.output:Keyword.Type
xquery/test-3.0.xq.output:Name.Decorator
xquery/test-3.0.xq.output:Name.Namespace
xquery/test-3.0.xq.output:Name.Tag
xquery/test-exist-update.xq.output:Keyword
xquery/test-exist-update.xq.output:Keyword.Declaration
xquery/test-exist-update.xq.output:Keyword.Pseudo
xquery/test-exist-update.xq.output:Name.Attribute
xquery/test-exist-update.xq.output:Name.Tag
xquery/test-exist-update.xq.output:Name.Variable
xquery/test.xqy.output:Keyword
xquery/test.xqy.output:Keyword.Declaration
xquery/test.xqy.output:Keyword.Pseudo
xquery/test.xqy.output:Keyword.Type
xquery/test.xqy.output:Name.Attribute
xquery/test.xqy.output:Name.Namespace
xquery/test.xqy.output:Name.Tag
xquery/test.xqy.output:Name.Variable
xtend/example.xtend.output:Keyword
xtend/example.xtend.output:Keyword.Declaration
xtend/example.xtend.output:Keyword.Namespace
xtend/example.xtend.output:Keyword.Type
xtend/example.xtend.output:Name.Class
xtend/example.xtend.output:Name.Namespace
yaml/example.yaml.output:Keyword.Type
yaml/example.yaml.output:Name.Label
yaml/example.yaml.output:Name.Namespace
yaml/example.yaml.output:Name.Tag
yaml/example.yaml.output:Name.Variable
yaml+jinja/example.sls.output:Keyword
yaml+jinja/example.sls.output:Name.Variable
zeek/test.bro.output:Keyword
zeek/test.bro.output:Keyword.Constant
zeek/test.bro.output:Keyword.Declaration
zeek/test.bro.output:Keyword.Namespace
zeek/test.bro.output:Keyword.Pseudo
zeek/test.bro.output:Keyword.Type
zeek/test.bro.output:Name.Class
zeek/test.zeek.output:Keyword
zeek/test.zeek.output:Keyword.Constant
zeek/test.zeek.output:Keyword.Declaration
zeek/test.zeek.output:Keyword.Namespace
zeek/test.zeek.output:Keyword.Type
zeek/test.zeek.output:Name.Class
zeek/test.zeek.output:Name.Function
zephir/test.zep.output:Keyword
zephir/test.zep.output:Keyword.Declaration
zephir/test.zep.output:Keyword.Reserved
zephir/test.zep.output:Name.Other
abnf/abnf_example1.abnf.output:Name.Class

These must be all cases where I think the trailing spaces could be marked with the more specific Text.Whitespace than being plain Text tokens.

blu-base added a commit to blu-base/pygments that referenced this issue Oct 4, 2021
@blu-base
SQL whitespaces - regarding pygments#1905
bf7cdbd
blu-base added a commit to blu-base/pygments that referenced this issue Oct 4, 2021
@blu-base
SQL whitespaces - regarding pygments#1905
c1a0868
@blu-base blu-base mentioned this issue Oct 4, 2021
Merged
Anteru pushed a commit that referenced this issue Oct 6, 2021
@blu-base
lexer SQL to use whitespace token - regarding #1905 (#1908)
0ef9b78 
* SQL whitespaces - regarding #1905

* Sqlite prompt ungrouped from trailing space

* sqlite prompt with Explicit trailing whitespace token

* Fix insertion of sqlite trail space token
@blu-base blu-base mentioned this issue Oct 8, 2021
Merged
@blu-base
Copy link
Contributor Author

blu-base commented Oct 8, 2021

This project will likely take me a while to finish - extrapolating my currently invested free time: at best a couple of month. If anyone is interested to join in, please do so!

@blu-base
Copy link
Contributor Author

blu-base commented Oct 8, 2021 •
edited
Loading

Some spot checking shows, there are more occurrences of Non-Whitespace token for space characters in lexers than i have in the list in the top. Hence, it might be a good idea to go through all lexers - maybe alphabetically.

EDIT
I updated the first post with a list of the current state, which lexers definitely apply for change.

Anteru pushed a commit that referenced this issue Oct 9, 2021
@blu-base
Modernize Whitespace token - regarding #1905 (#1911)
b42c723 
* Diff lexer - match whitespace

* Make lexer - whitespace token set

* Actionscript lexer - whitespace token

* Bare lexer - whitespace token

* Business(cobol) lexers - whitespace token
This was referenced Oct 10, 2021
Merged
Open
@blu-base blu-base mentioned this issue Oct 20, 2021
Merged
Anteru pushed a commit that referenced this issue Oct 23, 2021
@blu-base
Whitespace token modernization - [bc] lexers - regarding #1905 (#1923)
7c358cd 
* Modernize Whitespace token: basic lexer

* Modernize Whitespace token: bibtex lexer

* Modernize Whitespace token: boa lexer

* Modernize Whitespace token: capnproto lexer + new example

* Modernize Whitespace token: cddl lexer

* Modernize Whitespace token: chapel lexer

* Modernize Whitespace token: c_like lexer

* Modernize Whitespace token: configs lexer

* Modernize Whitespace token: console lexer

* Modernize Whitespace token: crystal lexer

* Modernize Whitespace token: csound lexer

* Modernize Whitespace token: css lexer

* Revert a change in basic lexer
Anteru pushed a commit that referenced this issue Oct 23, 2021
@blu-base
Whitespace token modernization - a* lexers - regarding #1905 (#1914)
907df2c 
* Whitespace token modernization - ambient lexer

* Whitespace token modernization - ampl lexer

* Whitespace token modernization - apdlexer lexer

* Whitespace token modernization - apl lexer

* Whitespace token modernization - adl lexer

* Whitespace token modernization - arrow lexer

* Whitespace token modernization - asm lexer
This was referenced Nov 2, 2021
Merged
Merged
@blu-base blu-base mentioned this issue Nov 14, 2021
Merged
@blu-base blu-base mentioned this issue Dec 3, 2021
Merged
@Anteru Anteru linked a pull request Dec 12, 2021 that will close this issue
lexer SQL to use whitespace token - regarding #1905 #1908
Merged
@jeanas jeanas mentioned this issue Dec 28, 2021
Open
@blu-base blu-base mentioned this issue Jan 6, 2022
Merged
This was referenced Feb 3, 2022
Merged
Merged
@stanislavlevin stanislavlevin mentioned this issue Feb 28, 2022
Closed
3 tasks
@jeanas jeanas mentioned this issue Feb 28, 2022
Merged
@jeanas jeanas mentioned this issue Mar 14, 2022
Closed
@Dacit Dacit mentioned this issue Jun 10, 2022
Merged
kurtmckee added a commit to kurtmckee/pr-pygments that referenced this issue Jun 19, 2022
@kurtmckee
Modify the Tera Term lexer so it outputs Text.Whitespace tokens corre…
a5e49f0 
…ctly

Related to pygments#1905
@kurtmckee kurtmckee mentioned this issue Jun 19, 2022
Merged
birkenfeld pushed a commit that referenced this issue Jun 21, 2022
@kurtmckee @birkenfeld
Modify the Tera Term lexer so it outputs Text.Whitespace tokens corre…
e6b5cf7 
…ctly

Related to #1905
@amitkummer
Copy link
Contributor

Hey @jean-abou-samra, I think this issue was unintentionally closed by #2159.

@birkenfeld birkenfeld reopened this Jun 29, 2022
@jeanas
Copy link
Contributor

jeanas commented Jun 29, 2022

Oops, you're right, thanks!

@Anteru
Copy link
Collaborator

Anteru commented Oct 23, 2022

Update: #2025 was merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
5 participants
@birkenfeld @Anteru @jeanas @blu-base @amitkummer