oleksiyrudenko / code-similarity-scoring-js Goto Github PK

• Scans files matching given RegExp
• Builds AST, extracts variable names, hash for 100% match for JS, TS, CSS, HTML
• Saves AST generalization and variables in a dedicated branch upon code merger to main
• Builds and publishes similarity indicators on open/updated PRs
• Can scan pre-existing code base
• Can scan/compare across multiple repos

Comparison:

• AST:
  • similarity of structure (number of classes/functions nesting levels)
• Variable names
  • Levenstein distance, acronyms dictionary, synonyms dictionary
• Hash-comparison
  • files are normalized by prettier before hashing for code style consistency

Reporting:

• Post top 3 closest sources per each of analysis methods

Resources:

• https://www.trickster.dev/post/javascript-ast-manipulation-with-babel-extracting-hardcoded-data/
• Read JavaScript Source Code, Using an AST