This is a simple web crawler. It is a Node.js script that crawls any given urls and written in TypeScript.
- Node.js 20.x or higher
- Serverless Framework 3.x
- Clone the repository
- Install the Node.js dependencies
npm install
Run it offline by using the following command:
npm run offline
GET /crawl?url=<url>