Prevent google crawling, or make it faster. about haxelib

[markknol]

Ah that's odd. Google reads our mail!
Since most content is static per lib version, you might just render out the stuff once (if it doesn't exist yet) to plain html, store that in cache or on disk and serve that?

[jasononeil]

Yes I think that's a suitable solution for text files, we could cache them
in the DB. Images and binaries we can perhaps block from web crawlers, as
they won't be valuable to search results and are not might be too large to
suitably cache, especially some of the ndll files etc.

On Wed, Mar 18, 2015 at 9:10 PM, Mark Knol [email protected] wrote:

Since most content is static per lib version, you might just render out
the stuff once (if it doesn't exist yet) to plain html, store that in cache
or on disk and serve that?

—
Reply to this email directly or view it on GitHub
#24 (comment).

[markknol]

What is the state of this?