Update the documentation to use the new functional options to NewCollector about site

[asciimoo]

Good point, thanks! We also have to update the examples in the colly repo.

[peterhellberg]

http://go-colly.org/docs/best_practices/debugging/

c := colly.NewCollector()
c.SetDebugger(&debug.LogDebugger{})

This can be replaced by c := colly.NewCollector(colly.Debugger(&debug.LogDebugger{}))

http://go-colly.org/docs/best_practices/crawling/

c := c.NewCollector()

// Reduce maximum response body size to 1M
c.MaxBodySize := 1024 * 1024

// Don't track visited urls automatically
c.AllowURLRevisit = true

This can be replaced by c := c.NewCollector(colly.MaxBodySize(1024 * 1024), colly.AllowURLRevisit())

[peterhellberg]

Maybe we should add option functions for WithTransport, DisableCookies, CookieJar, RequestTimeout, Proxy, ProxyFunc?

[asciimoo]

Maybe we should add option functions for WithTransport, DisableCookies, CookieJar, RequestTimeout, Proxy, ProxyFunc?

I don't think that it improves the API that much, but duplicates functionality, so I'd vote on don't add. What do you think?

[asciimoo]

Docs are updated: 8635de8 7000956 1a9052f