Unable to create a database for a Javascript project

[Shivam60]

Description of the issue

I am using codeQl CLI to create a database and analyze it
I am using codeql cli version to create a database of the extension Links para Serviços Públicos em Portugal. Downloads link here I extracted the link using fiddler.

I first unzip the package using 7Zip and then use codeql cli to create a database out of it.
codeql database create %databaseOutputPath% --source-root=%sourcePath% --language=javascript --threads=0

Each time i run i get this following error.

[2021-11-23 12:14:37] [build-stdout] Done extracting E:\codeql-home\codeql\javascript\tools\data\externs\web\w3c_rtc.js (291 ms) [2021-11-23 12:14:37] [build-stdout] Done extracting E:\codeql-home\codeql\javascript\tools\data\externs\web\webgl.js (250 ms) [2021-11-23 12:14:37] [build-stderr] Only found JavaScript or TypeScript files that were empty or contained syntax errors. [2021-11-23 12:14:37] [ERROR] Spawned process exited abnormally (code -1; tried to run: [E:\codeql-home\codeql\tools\win64\runner.exe, cmd.exe, /C, type, NUL, &&, E:\codeql-home\codeql\javascript\tools\autobuild.cmd]) A fatal error occurred: Exit status -1 from command: [E:\codeql-home\codeql\tools\win64\runner.exe, cmd.exe, /C, type, NUL, &&, E:\codeql-home\codeql\javascript\tools\autobuild.cmd]

My codeQl CLI version is 2.6.0

CodeQL command-line toolchain release 2.6.0. Copyright (C) 2019-2021 GitHub, Inc. Unpacked in: E:\codeql-home\codeql Analysis results depend critically on separately distributed query and extractor modules. To list modules that are visible to the toolchain, use 'codeql resolve qlpacks' and 'codeql resolve languages'.

Why is CodeQl not able to create a db here and what can I do to mitigate this ?

[Shivam60]

This is what the log file is showing me in terms of exception
[2021-11-23 12:20:04] Exception caught at top level: Exit status -1 from command: [E:\codeql-home\codeql\tools\win64\runner.exe, cmd.exe, /C, type, NUL, &&, E:\codeql-home\codeql\javascript\tools\autobuild.cmd] com.semmle.cli2.database.DatabaseProcessCommandCommon.executeSubcommand(DatabaseProcessCommandCommon.java:176) com.semmle.cli2.database.TraceCommandCommand.executeSubcommand(TraceCommandCommand.java:86) com.semmle.cli2.picocli.PlumbingRunner.run(PlumbingRunner.java:110) com.semmle.cli2.picocli.SubcommandCommon.runPlumbingInProcess(SubcommandCommon.java:160) com.semmle.cli2.database.CreateCommand.executeSubcommand(CreateCommand.java:147) com.semmle.cli2.picocli.SubcommandCommon.call(SubcommandCommon.java:456) com.semmle.cli2.picocli.SubcommandMaker.runMain(SubcommandMaker.java:205) com.semmle.cli2.picocli.SubcommandMaker.runMain(SubcommandMaker.java:214) com.semmle.cli2.CodeQL.main(CodeQL.java:98)

[Shivam60]

found the same error while using codeQl CLI 2.7.2

[mbaluda]

Hi @Shivam60
CodeQL does not extract files with the .min.js extension as scanning minified files is not considered a normal use case for the tool. You can however rename the files and ideally run them through a code formatter.
Alternatively you can include the minified extensions

• in the CLI setting the environment variable LGTM_INDEX_FILTERS="include:*.min.js"
• in lgtm.yml as a filter (see https://github.com/github/codeql/blob/main/change-notes/1.19/extractor-javascript.md)

Refer to this issue for further clarification:
github/codeql-cli-binaries#75

[Shivam60]

Unfortunately this did not work.

I added the variable `` as Environment variable

I also added the yml file in source directory of the project that I am trying to convert

Please let me know if i did any step incorrectly and what else I can do here onwards

[mbaluda]

Dear @Shivam60 ,
that pattern will only add sources from the current folder.
I tried with the following:
LGTM_INDEX_FILTERS="include:**/*.min.js"
and I managed to create a database

[FaiqueAli]

in which file should we add this variable for Makefile on windows?
I am using CodeQL CLI..