Where is the file implementing the logic to detect duplication in MATLAB fliles?

[Masfouf]

Hello,
I would like to know the logic you are using to detect duplication in MATLAB files.

Please can you explain to me this logic and where is the file implementing it?

Thanks in advance!

[jsotuyod]

CPD works the same way for all languages:

1. Based on a language-specific parser, we tokenize each file to be analyzed.
2. We roll over the code and compute a hash on a rolling n token window for each file's codebase. This code
3. We group together token chains that have the same hash. This code

Your main concern is really as to how the code is tokenized, and how strictly you retain the code; for instance, are you looking for exact copy-pastes (exact variable and function names), or not. Some languages (specially Java), support several flags to control these, but not all languages do this to the same extent.

Matlab itself support no additional flag, only has the built-in support to ignore comments and snippets of code within CPD-OFF / CPD-ON comments. See the docs

[adangel]

Tokenization of MATLAB files is done by javacc with this grammer file.