Skip to content

add-beta-algorithms#960

Merged
Sallaa merged 2 commits intobeta-masterfrom
add-beta-algorithms
Oct 30, 2025
Merged

add-beta-algorithms#960
Sallaa merged 2 commits intobeta-masterfrom
add-beta-algorithms

Conversation

@Sallaa
Copy link
Copy Markdown
Contributor

@Sallaa Sallaa commented Oct 30, 2025

  • Adds TruFor, MM-Fusion Forensic filters for beta users
  • Adds Dino Multigen ITW Rine, ITW SPAI algorithms for beta users
  • Forensics results algorithms refactoring

@Sallaa Sallaa merged commit 413e3c0 into beta-master Oct 30, 2025
1 check passed
Sallaa added a commit that referenced this pull request Nov 7, 2025
* updates to sna features

* add text analysis

* add tfidf

* more tfidf

* some fixes

* detail view change, easier upload, bug fixes

* local d3lta test, add some user details, some fixes

* update tweet retrieval, timeline

* update d3lta server call

* bug fixes, improvements and refactorings, new d3ltaserver, new db interaction, tiktok support,

* remove deprecated var

* update d3lta url to env var

* Video closing tag

* fix imports, replace jsx passed in state w conditional renders

* imports, styling fixes

* fix from global vars, fix sna permissions

* fix dependency versions to match ref branch

* fix package for merge

* update package-lock

* hashtag preprocess for meta uploads fix

* log cleaning

* fix bug in account activity bar chart

* remove wrong permission

* cleaning

* cap table heights + fix wordcloud bug

* Add error messages

* d3lta fixes + icon button fixes

* fix barchart scrollbar

* cleanup + add table virtualization

* add refresh on switch to tab

* clean up

* fix webpack to watch injected script for social media capture

* fix text overflow

* fix image & video link retrieval

* fix button text overflox + add labels to icon buttons

* import, comment, structure fixes

* memoize tool result visualisations

* upload and other bug fixes, display fixes for dark mode

* Several fixes and permission update

* fix prop passing syntax

* prevent empty d3lta calls

* update logos

* Added waveform regions

* VideoGridList now shows thumbnails instead of just links

* alphabetically sorted extracted URLs so user sees same order for same input URL

* fix title for DBKF and remove unused imports

* removed more unused code

* add in old threshold code

* display and bug fixes

* more fixes

* Fixed image heights

* Chequered bg, plus done the same for videos

* Fixed types coercions and other warnings

* Fixed warning

* Removed ToArray

* Chunking entities in batches of 25 when calling dbpedia linking

* output filteredResult

* Bump tmp from 0.2.3 to 0.2.4

Bumps [tmp](https://github.com/raszi/node-tmp) from 0.2.3 to 0.2.4.
- [Changelog](https://github.com/raszi/node-tmp/blob/master/CHANGELOG.md)
- [Commits](raszi/node-tmp@v0.2.3...v0.2.4)

---
updated-dependencies:
- dependency-name: tmp
  dependency-version: 0.2.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix undefined error

* Improved UI, make pure function

* Removed type coercion

* Removed unused fct

* removed functions as components

* removed functions as components

* add ids to form fields

* new translation keys

* removed document.getelementbyId, stop modifying the parent state, no more splicing

* fixed typos, removed invalid jsx, removed alert, use try catch

* Render components instead of functions

* Render components instead of functions

* fix translation label

* replace fct with jsx

* Added dbpedia URL to .env

* fixes

* Put query params back in the code

* Fixed type coercion, inline variables, jsdoc

* memoize function, prevent mutating variable param

* Updated offline translations

* prevent mutations, bug fixes

* fix roles and footer

* fix hashtag graph error

* Filtering all tools rather than having a special assistant list

* Added dispatch requests in the tools themselves to avoid big if statement

* c2pa_text

* Moved KNOWN_LINKS into tools.jsx from AssistantRuleBook.jsx

* Removed checkered background

* Restored download links

* Upped image filter to 40x40

* hidden comments box and not calling stance classifier when comments empty

* limit text to 100, score threshold of 50

* dbkfTextMatch now pulls from state

* removed collapse and expand/minimise button

* score threshold set to 40

* removed console.logs

* removed filtering code

* Removed min-height property for previos fact checks

* Removed console.log

* Removed Collapse entirely

* Changed NE tag classification order

* Housekeeping

* Added missing offline translation

* REfactored Keyframes, added ImageWithFade for keyframes

* Fixed flickering, fixed react error, added handleClose, detailedView, fixed zoom, fixed LoadingButton warning

* Removed old code

* Revoke url

* Cleanup, added downloadFile utils function

* Test whether collectedComments is defined before checking its length

* genre no longer considered under threshold

* changed from get to post request

* Added onClick with reverse search

* Added KSE file upload

* added tooltips

* added check for collectedComments existing

* showing results in same way as URL domain analysis

* tidied code

* removed footer

* Fixed #929

* Refactoring

* Add staging icon

* Cleanup, fix place footer at the footer

* Moved text before faces

* Added file mode

* Claude context

* Add comprehensive ChatBot system with OpenAI-like API integration

- Create ChatBotUI component with Material UI Card structure and model selection
- Implement useChatBot hook for OpenAI-compatible endpoints (/v1/models, /v1/chat/completions)
- Add pre-defined request system for fact-checking and rhetorical analysis workflows
- Integrate message parsing with <think> tag support and expandable thinking sections
- Add markdown-like formatting for message content with left-aligned text
- Implement chat flow restrictions requiring pre-request selection before use
- Include clear functionality and comprehensive error handling
- Integrate ChatBot into Assistant section with consistent Grid layout

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>

* Enable stream support for chatbot

* optimize with react-query

* Enhance ChatBot with Redux state management and improved UX

- Migrate ChatBot state from local to Redux for better state management
- Add persistent pre-request selection throughout chat sessions
- Implement auto-scroll functionality for better chat experience
- Add clipboard paste and clear input buttons for enhanced usability
- Integrate completions endpoint for continued generation on length limits
- Improve session management with clearer status indicators
- Add new chatBotReducer to handle all ChatBot state operations

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>

* v0.88

* add space to links

* refactor chatbot as a tool.
Support multilangue label

* addd model fr

* add temperature configuration field

* Bump vite from 6.3.4 to 6.3.6

Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 6.3.4 to 6.3.6.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v6.3.6/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v6.3.6/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 6.3.6
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

* Upgrade chatbot context message and style improvement

* add chatbot labels

* fix error loading

* add header and description

* add headings format

* refactor to prompts

* use token undefined to avoid prompt request.

* use extra_features for chatboat assistant

* add local chatbot traduction

* fix quiz style image

* add claim prompt and tooltips

* merged DBKF and FCSS results when necessary

* added correct keywords

* correctlt merging results

* added scrolling to recommended media tools

* removed unnecessary array

* added gdi warning for broken links

* added broken link warning to extracted urls

* moved warning to end of evidence list

* Improved variable names and added jsdoc

* Wip

* Refactoring, added pure API functions

* Refactoring, fixed warning

* Refactoring

* Refactored error catching

* Hiya UI cleanup

* Refactored Loccus references to Hiya

* Added missing imports, deprecated voice recording

* More refactoring

* More refactoring

* More refactoring

* Fixed warnings, added missing file

* Fixed namings

* Fixed warning

* Fixed warning

* Bumped Axios

* Fixed Footer.jsx

* text position set to start correctly

* Fixed local file redux state

* Fixed errors

* warning in italics

* simplified fcss more details keyword

* added acronym and explanation to chip with tooltip

* adding tooltip to chip and left align

* organised logic of loading and completed prev fact checks with dbkf, and specified cases for dbkf final divider

* updated dbkf media results

* removed console.log

* corrected keyword

* Fixed OCR display box

* Assistant/update credibility signals colours (#787)

* adding sentence highlights

* changing category list

* removed machine generated text from credibility signals card

* adding colours

* categories displaying correctly

* gauge ui

* machine generated text spans all text

* making two separate api calls

* dark mode fixes

* more dark mode fixes and beta user for mgt

* mgt fail state if either api call fails

* moved previous fact checks to warning section

* reorganised overall score

* remove credibility signals component

* moved tooltips for categories

* edited default config colours

* add in commented out code for restricting users

* iimprove ui for previous fact checks inside warnings

* fixed accordion not being full width on loading

* remove machine generated text code fom GaugeChartResult.jsx

* previous fact checks only appear if there are results

* small fixes

* MUI anchorEL error fix

* removing displayExpanded

* changed expandMinimise to IconButton

* Added a small padding to bottom of highlighted sentences so that tails of letters don't overflow

* fixed DBKF media result bug

* fixed display for prevfactchecks in warnings

* removed console.log

* changed the text colour for likely_machine

* changed wrong title to dbkf_media_title

* removed beta_tester role from saga

* needleColor for dark mode

* soften colours for dark mode

* added padding to highlighted text in tooltips

* added message for no detected persuasion techniques

* card header text sized made consistent

* added traffic light colours to credibility signals

* added colours for each of the 6 persuasion categories

* added colours to backend config

* fixed mistake with threshold being ignored

* force changed colours and UI for experimenting

* added summary page, persuasion list appears like buttons

* add return to summary button

* changed colours for chip and corners for buttons in persuasion

* moved slider to utils

* moved primary colour to utils and tidied

* added colour scale for genre and topic categories and tidied

* tidied summary page logic

* small fontSize for slider and colour scale

* added importantSentenceKey const

* fixed mgt gauge text position

* add overall subjective percentage

* added consistent titles and added gauge chart for subjectivity

* added gauge to subjectivity summary

* remove highlighting sentence handler

* subjecitivty tab fixes

* changed height of summary loading skeleton

* summary button as pointer

* added slider to subjectivity and tooltip for genre and topic categories

* removed toggle sentence highlighting code

* remove gauge explanation from summary

* refactored summary code

* added thresholds for subjectivity and explanations

* adding scrollbar to credibility signal tabs as well as collapse

* minimise scrolls to top of credibility signals card

* added gutter for scrollbar when box expanded

* testing gauge for subjectivity

* removed linearprogress loading and tidied code

* made gauge chart wider to match other content in RHS cards

* remove linearprogress loading from tab titles

* fixed mgt failed to load message not appearing correctly

* refactor to pass summary contents to tabs

* containing list items in a single react fragment to prevent an error

* move slider props up to prevent slider value resetting when something on the page loads

* delete unnecessary code related to gauge explanation

* moved slider threshold value to state to prevent resetting on component remounts

* correcting import paths for credibility signal files

* corrected path for GaugeChartModalExplanation

* added documentation for assistantUtils

* removed collapse to fix scrollbar disappearing at bottom of box

* adding padding to top of summary button

* text without highlights shown when currentLabel has no highlights given slider threshold change

* fixed overall subjectivity score not being collected across chunks correctly

* corrected logic around loading and fail states for mgt summary

* added keyword translations for threshold slider

* added currentLabel in persuasion techniques to state to prevent it being reset on component remounts

* fixed persuasion techqniues categories to appear in colour instead of grey at start or session

* highlight full sentences which have been split into spans

* add file extension to help with playwright tests failing

* remove @ to help with playwright tests failing

* adding relative path to help with playwright tests failing

* added mgt ordered categories to config

* added importantSentenceThreshold and currentlabel to CLEAN_STATE

* added space to divider and moved 'Detected classes:' in machine generated text

* removed colours and updated translation keywords

* add frontendVersion to persuasion API call for backwards compatibility

* add frontendVersion to subjectivity API call for backwards compatibility

* removed summary page and tidied code

* limited topic to top three

* keeping all machine generated text classes

* removed obsolete css file

* removed hardcoded primary colour

* tidied conflict and added missing sentence when no subjective sentences detected

* added correct categories for no subjectivity detection

* stop news genre from being thresholded

* bumped frontendVersion to 0.88

* added @ to import

* removed unused function getPersuasionCategoryColours

* fix no genre detected when sentences below threshold

* fix inconsistency with no sentences detected and slider disappearing

* added divider for subjectivity

* added .jsx to import path

* added export to GaugeChartModalExplanation

* remove export from GaugeChartModalExplanation

* changed GaugeChartModalExplanation to @/Shared

* correction @shared

* remove .jsx from GaugeChartModalExplanation

* remove index from GaugeChartModalExplanation

* added relative path

* added import path matching Hiya tool

* added workers and shared folders to paths in jsconfig.json

* added workers and Shared to jsconfig.json

* removed workers and Shared to jsconfig.json

* changed import path to at/components/Shared

* back to import path matching Hiya tool

* using GaugeChartModalExplanation directly as opposed to inside assistantUtils

* import back in assistantUtils with removing duplicate explanation

* moved GaugeChartModalExplanation from assistantUtils to AssistantTextClassification

---------

Co-authored-by: Michael Foster <m.foster@sheffield.ac.uk>

* assistant/add default genre (#944)

* added default genre if category with highest score below threshold

* added separate thresholds for news framing and news genre

* replace keyword() with constant name of title

* Assistant/fix trans html display (#945)

* added double break between trans components for mgt tooltip

* added trans component correctly to fact check warning triangle tooltip

* added defined styles to ul, li and a tags in trans component

* moved styles into TransComponents.jsx

* remove expand button from extracted text footer (#948)

* added boxes around tooltip and close button (#952)

* removed keyword from checks and removed duplciate titleText (#953)

* Fc semantic search fix (#954)

* Added useMutation, types, POST request, api folder with pure function

* Refactoring

* Added useMemo

* Fixed imports, added missing variant

* Added better error handling

* Improved responsiveness

* Fixed responsiveness

* Fixed spacing

* explicitly set dimensions in parent container of DataGrid (#958)

* asssitant/916 collapse youtube comments (#955)

* swapped to collapsible table for replies

* added comments and tidied

* added missing width

* center replies date

* make main table a dense table with size small

* align replies column icons center

* added reply icon to reply comments

* add pagination back

* add-beta-algorithms (#960)

* Added beta user algorithms for synthetic umage detection and forensic. Refactored code

* Fixed warnings and memoized function

* Assistant/add copy translate hover text (#959)

* added hover text for copy to clipboard on youtube comments

* added hover text for copy to clipboard on extracted urls

* swapped extracted urls copy button to CopyButton

* swapped youtube comment copy button to CopyButton

* fixed merge conflict and missing CopyButton for replies

* Hiya error messages (#961)

* Added error message, and partial error message

* Added partial errors warnings

* Fixed translation update when language changes

* Removed logs

* Fixed null values displays

* Fixed lint warnings

* Cleanup

* Hiya error messages (#965)

* Added error message, and partial error message

* Added partial errors warnings

* Fixed translation update when language changes

* Removed logs

* Fixed null values displays

* Fixed lint warnings

* Cleanup

* Fixed missing end chart values

* Cleanup

* fix blob & disable baidu (#964)

#728 #821

* chatbot i18n (#962)

* chatbot i18n

* add keys and fix ui

* remove alert onclick

* SNA disable record button when no social network are selectes
fix uncaugh exception error

* add jsdoc

* Fixed warnings, typos

* fix warnings

* mui style

* Fixed typos, changed name from ChatBot to Chatbot, organized files

---------

Co-authored-by: Valentin Porcellini <valentin.porcellini@afp.com>

* fix filter heic & heif + bug fix local image search

* fix forensic message display
add role for recording

* More KSE API integrations (#941)

* Wip

* Fixed deprecated prop

* Added KSE optional params

* Added options to query keys

* Removed sensitivity param

* Disabled params during loading

* wip

* bumped versions

* Removed audio detection call

* Open Hiya audio in a new tab

* Cleanup

* Fixed opening audio in a new tab

* Added extracted audio download, added Hiya permissions

* Added permission-based settings, fixed a bug where the cached file would be refetched

* case change

* Removed camelcasing

* Updated offline translation

* warnings-update (#968) (#969)

* Added warnings

* Updated offline translation

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Abbas Mahfouz <abbasmahfouzz@gmail.com>
Co-authored-by: Michael <jmafoster1@gmail.com>
Co-authored-by: Michael Foster <m.foster@sheffield.ac.uk>
Co-authored-by: Rosanna Milner <rosanna.milner@sheffield.ac.uk>
Co-authored-by: Rosanna Milner <44234896+rosannamilner@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Bertrand Goupil <bertrand.goupil@afp.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: AFPMedialab <40788591+AFPMedialab@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant