Document Q&A (#140) #141
Document Q&A (#140) #141
Conversation
* Add pdfjs for reading PDF files. * Upgrade various dependeny minor versions. * Add chat button to source action bar. * Add chat model selector in chat toolbar. * chore: bump dependencies * feat(Chat): provide a list of local file types that can be read for chat purposes (PDF and plain text file types). * feat(Chat): Implement online PDF and local file processing for use in Chat. Dramatically improved the ability to summarize, especially larger documents. * chore: Remove unused functions but keep stubs for later use. * fix: a bug where theme settings were not saved to file correctly.
|
Addresses #115 |
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
| console.log("PDF detected, attempting to extract text from PDF..."); | ||
|
|
||
| // Use http to get the PDF, then use pdfjs to extract the text | ||
| const response = await axios.get(reqUrl, { responseType: "arraybuffer" }); |
Check failure
Code scanning / CodeQL
Server-side request forgery
|
|
||
| return text; | ||
| } else { | ||
| const response = await axios.get(reqUrl); |
Check failure
Code scanning / CodeQL
Server-side request forgery
| ); | ||
| router.delete( | ||
| "/key", | ||
| this.apiKeyController.deleteApiKey.bind(this.apiKeyController) |
Check failure
Code scanning / CodeQL
Missing rate limiting
|
|
||
| getRouter() { | ||
| // Load the source from the database | ||
| router.use(SourceLoader.load); |
Check failure
Code scanning / CodeQL
Missing rate limiting
| router.use(this.summarizer.summarize()); | ||
|
|
||
| // Store the source in the database | ||
| router.use(SourceLoader.store); |
Check failure
Code scanning / CodeQL
Missing rate limiting
| ); | ||
|
|
||
| // Check for the Source in local JSON files. Append to req.body if found. | ||
| if (fs.existsSync(filepath)) { |
Check failure
Code scanning / CodeQL
Uncontrolled data used in path expression
|
|
||
| // Check for the Source in local JSON files. Append to req.body if found. | ||
| if (fs.existsSync(filepath)) { | ||
| const json = fs.readFileSync(filepath, "utf8"); |
Check failure
Code scanning / CodeQL
Uncontrolled data used in path expression
|
|
||
| // Store the Source into local JSON file using ID as filename. | ||
| const json = JSON.stringify([text, summary]); | ||
| fs.writeFileSync(filepath, json, "utf8"); |
Check failure
Code scanning / CodeQL
Uncontrolled data used in path expression
| ]; | ||
|
|
||
| // Read the file and check if it is a plain text file | ||
| const dataBuffer = fs.readFileSync(filePath); |
Check failure
Code scanning / CodeQL
Uncontrolled data used in path expression
| } | ||
|
|
||
| static async fromPdf(filePath: string) { | ||
| const dataBuffer = fs.readFileSync(filePath); |
Check failure
Code scanning / CodeQL
Uncontrolled data used in path expression
Add PDFjs for reading PDF files (local and remote).
chore: upgrade various dependency minor versions.
feat(Chat): add chat button to source action bar and context menus.
feat(Chat): add model selector in chat toolbar for quickly changing models without opening the settings menu.
chore: bump dependencies
feat(Chat): provide a list of local file types that can be read for chat purposes (PDF and plain text file types).
feat(Chat): Implement online PDF and local file processing for use in Chat. Dramatically improved the ability to summarize, especially larger documents.
fix: a bug where theme settings were not saved to file correctly.
bump version to 0.8.5