GithubHelp home page GithubHelp logo

amarcruz / perf-regexes Goto Github PK

View Code? Open in Web Editor NEW
0.0 3.0 0.0 79 KB

Optimized and powerful regexes for JavaScript

License: MIT License

JavaScript 100.00%
html javascript typescript comments regexp regexes search source

perf-regexes's Introduction

perf-regexes

Optimized and powerful regexes for JavaScript

npm Version License Build Status Bundle Size

Breaking Changes

In ES5, matching literal regexes with other regex in medium complexity code is highly risky.
In ES6 it is practically impossible.

For this reason, as of v1.0 JS_REGEX_P is deprecated and will be removed in the next minor version.

JS_REGEX will be maintained, but its use should be limited to complement other utilities, such as skip-regex, which uses a customized version of JS_REGEX to identify regular expresions reliably.

The minimum supported version of NodeJS now is 6.14 (oldest maintained LTS version w/fixes).

Install

npm install perf-regexes --save
# or
yarn add perf-regexes

In the browser, this loads perf-regexes in the global R object:

<script src="https://unpkg.com/perf-regexes/index.min.js"></script>

Included Regexes

All of these regexes recognize Win/Mac/Unix line-endings and are ready to be used, but you can customize them using the RegExp constructor and the source property of the desired regex.

HTML:

Name Flags Matches
HTML_CMNT g Valid HTML comments, according to the SGML standard.

JavaScript:

Name Flags Matches
JS_MLCMNT g Multiline JS comment, with support for embedded '/*' sequences.
JS_SLCMNT g Single-line JS comments, not including its line-ending.
JS_DQSTR g Double quoted JS string, with support for escaped quotes and line-endings.
JS_SQSTR g Single quoted JS string, with support for escaped quotes and line-endings.
JS_STRING g Combines JS_SQSTR and JS_DQSTR to match single or double quoted strings.
JS_REGEX g Regex. Note: The result must be validated.
JS_REGEX_P g Deprecated, do not use it.

Selection of lines:

Name Flags Matches
EMPTY_LINES gm Empty line or line with only whitespace within, including its line-ending, if it has one.
NON_EMPTY_LINES gm Line with at least one non-whitespace character, including its line-ending, if it has one.
TRAILING_WS gm The trailing whitespace of a line, without including its line-ending.
OPT_WS_EOL g Zero or more blank characters followed by a line-ending, or the final blanks, if the (last) line has no line-ending.
EOL g Line-ending of any type

NOTE

Because the 'g' flag, always set lastIndex or clone the regex before using it with the exec method.

Example

Using only one regex, this simple example will...

  • Remove trailing whitespace of each line.
  • Remove the empty lines.
  • Normalize the line-endings to unix style.
const R = require('perf-regexes')

const cleaner = (text) => text.split(R.OPT_WS_EOL).filter(Boolean).join('\n')

console.dir(cleaner(' \r\r\n\nAA\t\t\t\r\n\rBB\nCC  \rDD  '))
// ⇒ 'AA\nBB\nCC\nDD'

Use the previous function to cleanup HTML text:

const htmlCleaner = (html) => cleaner(html.replace(R.HTML_CMNT, ''))

console.dir(htmlCleaner(
  '\r<!--header--><h1>A</h1>\r<div>B<br>\r\nC</div> <!--end-->\n'))
// ⇒ '<h1>A</h1>\n<div>B<br>\nC</div>'

Line-endings Normalization

const R = require('perf-regexes')

const normalize = (text) => text.split(R.EOL).join('\n')

console.dir(normalize('\rAA\r\r\nBB\r\nCC \nDD\r'))
// ⇒ '\nAA\n\nBB\nCC \nDD\n'

Double-quoted to single-quoted strings

const toSingleQuotes = (text) => text.replace(R.JS_STRING, (str) => {
  return str[0] === '"'
    ? `'${str.slice(1, -1).replace(/'/g, "\\'")}'`
    : str
})

console.log(toSingleQuotes(`"A's" 'B' "C"`))
// ⇒ 'A\'s' 'B' 'C'

Matching Regexes

With the arrival of ES6TL and new keywords, finding literal regexes with another regex is not viable, you need a JS parser such as acorn or a specialized one such as skip-regex to do it correctly.

This is a very basic example that uses skip-regex:

import R from 'perf-regexes'
import skipRegex from 'skip-regex'

/**
 * Source to match quoted string, comments, and slashes.
 * Captures en $1 the slash
 */
const reStr = `${R.JS_STRING.source}|${R.JS_MLCMNT.source}|${R.JS_SLCMNT.source}|(/)`

/**
 * Search regexes in `code` and display the result to the console.
 */
const searchRegexes = (code) => {

  // Creating `re` here keeps its lastIndex private
  const re = RegExp(reStr, 'g')
  let match = re.exec(code)

  while (match) {
    if (match[1]) {
      const start = match.index
      const end = skipRegex(code, start)

      // skipRegex returns start+1 if this is not a regex
      if (end > start + 1) {
        console.log(`Found "${code.slice(start, end)}" at ${start}`)
      }
      re.lastIndex = end
    }
    match = re.exec(code)
  }
}

const code = `
const A = 2
const s = '/A/'            // must not find /A/

const re1 = /A/g           // regex
re1.lastIndex = 2 /A/ 1    // must not find /A/

/* /B/                     // must not find /B/
*/
const re2 = /B/g           // regex
re1.exec(s || "/B/")       // must not find /B/
`

searchRegexes(code)
// output:
// Found "/A/g" at 74
// Found "/B/b" at 210

The previous code does not support ES6TL, but it works quite well on ES5 files and is very fast.

For a more complete example of using perf-regexes, see js-cleanup, an advanced utility with support for ES6 that trims trailing spaces, compacts empty lines, normalizes line-endings, and removes comments conditionally.

ES6 Template Literals

ES6TLs are too complex to be identified by one single regex, do not even try.

Support my Work

I'm a full-stack developer with more than 20 year of experience and I try to share most of my work for free and help others, but this takes a significant amount of time and effort so, if you like my work, please consider...

Of course, feedback, PRs, and stars are also welcome 🙃

Thanks for your support!

License

The MIT License (MIT)

perf-regexes's People

Contributors

amarcruz avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.