sjdirect/abot
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Strong technical leader that can code. Yes, you can do both.
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
The Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable. This project provides an easy-to-use class, implemented in C#, to work with robots.txt files.
Code kata from http://codingdojo.org/cgi-bin/index.pl?KataGameOfLife
Implementations of common CORS policy and CORS middleware
Common libs, helpers and utilities
his is a unit testing exerciese. Pull down this repo and try to test each utility in the Ex.Core project.