This is a C++ porting of prism.js library. The code depends on Boost.Regex, as it's a faster and more comprehensive than STD's.

Grammars file is generated from prism.js source code itself, instructions later in the file.

Key concepts:

string text = ReadFile("grammars.dat");
m_highlighter = std::make_shared<SyntaxHighlighter>(text);
TokenList tokens = m_highlighter->tokenize(code, language);

for (auto it = tokens.begin(); it != tokens.end(); ++it)
{
    auto& node = *it;
    if (node.isSyntax())
    {
        const auto& child = dynamic_cast<const Syntax&>(node);
        // child.type() <- main token type (eg "include")
        // child.alias() <- "base" token type (eg "keyword")
        // child.begin() + node.end() <- list of tokens
    }
    else
    {
        const auto& child = dynamic_cast<const Text&>(node);
        // child.value() <- the actual text to highlight
    }
}

How to update

Run

npm install
npm start

The new version of grammars.dat will appear in the libprisma/grammars.dat.

Supported languages

Language	Aliases
Markup	markup,markup,html,xml,svg,mathml,ssml,atom,rss
CSS	css
C-like	clike
Regex	regex
JavaScript	javascript,js
ABAP	abap
ABNF	abnf
ActionScript	actionscript
Ada	ada
Agda	agda
AL	al
ANTLR4	antlr4,g4
Apache Configuration	apacheconf
SQL	sql
Apex	apex
APL	apl
AppleScript	applescript
AQL	aql
C	c
C++	cpp
Arduino	arduino,ino
ARFF	arff
ARM Assembly	armasm,arm-asm
Bash	bash,bash,sh,shell
YAML	yaml,yml
Markdown	markdown,md
Arturo	arturo,art
AsciiDoc	asciidoc,adoc
C#	csharp,csharp,cs,dotnet
ASP.NET (C#)	aspnet
6502 Assembly	asm6502
Atmel AVR Assembly	asmatmel
AutoHotkey	autohotkey
AutoIt	autoit
AviSynth	avisynth,avs
Avro IDL	avro-idl,avdl
AWK	awk,gawk
BASIC	basic
Batch	batch
BBcode	bbcode,shortcode
BBj	bbj
Bicep	bicep
Birb	birb
Bison	bison
BNF	bnf,rbnf
BQN	bqn
Brainfuck	brainfuck
BrightScript	brightscript
Bro	bro
CFScript	cfscript,cfc
ChaiScript	chaiscript
CIL	cil
Cilk/C	cilkc,cilk-c
Cilk/C++	cilkcpp,cilkcpp,cilk-cpp,cilk
Clojure	clojure
CMake	cmake
COBOL	cobol
CoffeeScript	coffeescript,coffee
Concurnas	concurnas,conc
Content-Security-Policy	csp
Cooklang	cooklang
Ruby	ruby,rb
Crystal	crystal
CSV	csv
CUE	cue
Cypher	cypher
D	d
Dart	dart
DataWeave	dataweave
DAX	dax
Dhall	dhall
Diff	diff
Markup templating	markup-templating
Django/Jinja2	django,jinja2
DNS zone file	dns-zone-file,dns-zone
Docker	docker,dockerfile
DOT (Graphviz)	dot,gv
EBNF	ebnf
EditorConfig	editorconfig
Eiffel	eiffel
EJS	ejs,eta
Elixir	elixir
Elm	elm
Lua	lua
Embedded Lua templating	etlua
ERB	erb
Erlang	erlang
Excel Formula	excel-formula,excel-formula,xlsx,xls
F#	fsharp
Factor	factor
False	false
Firestore security rules	firestore-security-rules
Flow	flow
Fortran	fortran
FreeMarker Template Language	ftl
GameMaker Language	gml,gamemakerlanguage
GAP (CAS)	gap
G-code	gcode
GDScript	gdscript
GEDCOM	gedcom
gettext	gettext,po
Git	git
GLSL	glsl
GN	gn,gni
GNU Linker Script	linker-script,ld
Go	go
Go module	go-module,go-mod
Gradle	gradle
GraphQL	graphql
Groovy	groovy
Less	less
Sass (SCSS)	scss
Textile	textile
Haml	haml
Handlebars	handlebars,handlebars,hbs,mustache
Haskell	haskell,hs
Haxe	haxe
HCL	hcl
HLSL	hlsl
Hoon	hoon
HTTP Public-Key-Pins	hpkp
HTTP Strict-Transport-Security	hsts
JSON	json,webmanifest
URI	uri,url
HTTP	http
IchigoJam	ichigojam
Icon	icon
ICU Message Format	icu-message-format
Idris	idris,idr
.ignore	ignore,ignore,gitignore,hgignore,npmignore
Inform 7	inform7
Ini	ini
Io	io
J	j
Java	java
Scala	scala
PHP	php
JavaDoc-like	javadoclike
JavaDoc	javadoc
Java stack trace	javastacktrace
Jolie	jolie
JQ	jq
TypeScript	typescript,ts
JSDoc	jsdoc
N4JS	n4js,n4jsd
JSON5	json5
JSONP	jsonp
JS stack trace	jsstacktrace
Julia	julia
Keepalived Configure	keepalived
Keyman	keyman
Kotlin	kotlin,kotlin,kt,kts
Kusto	kusto
LaTeX	latex,latex,tex,context
Latte	latte
Scheme	scheme
LilyPond	lilypond,ly
Liquid	liquid
Lisp	lisp,lisp,emacs,elisp,emacs-lisp
LiveScript	livescript
LLVM IR	llvm
Log file	log
LOLCODE	lolcode
Magma (CAS)	magma
Makefile	makefile
Mata	mata
MATLAB	matlab
MAXScript	maxscript
MEL	mel
Mermaid	mermaid
METAFONT	metafont
Mizar	mizar
MongoDB	mongodb
Monkey	monkey
MoonScript	moonscript,moon
N1QL	n1ql
Nand To Tetris HDL	nand2tetris-hdl
Naninovel Script	naniscript,nani
NASM	nasm
NEON	neon
Nevod	nevod
nginx	nginx
Nim	nim
Nix	nix
NSIS	nsis
Objective-C	objectivec,objc
OCaml	ocaml
Odin	odin
OpenCL	opencl
OpenQasm	openqasm,qasm
Oz	oz
PARI/GP	parigp
Parser	parser
Pascal	pascal,objectpascal
Pascaligo	pascaligo
PATROL Scripting Language	psl
PC-Axis	pcaxis,px
PeopleCode	peoplecode,pcode
Perl	perl
PHPDoc	phpdoc
PlantUML	plant-uml,plantuml
PL/SQL	plsql
PowerQuery	powerquery,powerquery,pq,mscript
PowerShell	powershell
Processing	processing
Prolog	prolog
PromQL	promql
.properties	properties
Protocol Buffers	protobuf
Stylus	stylus
Twig	twig
Pug	pug
Puppet	puppet
PureBasic	purebasic,pbfasm
Python	python,py
Q#	qsharp,qs
Q (kdb+ database)	q
QML	qml
Qore	qore
R	r
Racket	racket,rkt
Razor C#	cshtml,razor
React JSX	jsx
React TSX	tsx
Reason	reason
Rego	rego
Ren'py	renpy,rpy
ReScript	rescript,res
reST (reStructuredText)	rest
Rip	rip
Roboconf	roboconf
Robot Framework	robotframework,robot
Rust	rust
SAS	sas
Sass (Sass)	sass
Shell session	shell-session,shell-session,sh-session,shellsession
Smali	smali
Smalltalk	smalltalk
Smarty	smarty
SML	sml,smlnj
Solidity (Ethereum)	solidity,sol
Solution file	solution-file,sln
Soy (Closure Template)	soy
Splunk SPL	splunk-spl
SQF: Status Quo Function (Arma 3)	sqf
Squirrel	squirrel
Stan	stan
Stata Ado	stata
Structured Text (IEC 61131-3)	iecst
SuperCollider	supercollider,sclang
Swift	swift
Systemd configuration file	systemd
T4 templating	t4-templating
T4 Text Templates (C#)	t4-cs,t4
VB.Net	vbnet
T4 Text Templates (VB)	t4-vb
TAP	tap
Tcl	tcl
Template Toolkit 2	tt2
TOML	toml
Tremor	tremor,tremor,trickle,troy
TypoScript	typoscript,tsconfig
UnrealScript	unrealscript,unrealscript,uscript,uc
UO Razor Script	uorazor
V	v
Vala	vala
Velocity	velocity
Verilog	verilog
VHDL	vhdl
vim	vim
Visual Basic	visual-basic,visual-basic,vb,vba
WarpScript	warpscript
WebAssembly	wasm
Web IDL	web-idl,webidl
WGSL	wgsl
Wiki markup	wiki
Wolfram language	wolfram,wolfram,mathematica,nb,wl
Wren	wren
Xeora	xeora,xeoracube
Xojo (REALbasic)	xojo
XQuery	xquery
YANG	yang
Zig	zig