Comments (4)
Thanks for your comments. This certainly looks like a good/useful feature for following use cases.
- Create Sitemap only for a "Path" specified by user
- Sitemaps must respect robots.txt
I am currently looking into this, and will come with an extention.
from pysitemaps.
great.... i will be watching your repo and feel free to contact me in case you have any questions :)
from pysitemaps.
@9967819 Can you help me with some example data so that I can finalize a new build.
For example,
- Input data for the test e.g. list of urls, or paths to exclue or sample robots.txt file.
- desired output e.g. possible sitemap.
from pysitemaps.
@9967819 Can you help me with some example data so that I can finalize a new build.
For example,
- Input data for the test e.g. list of urls, or paths to exclue or sample robots.txt file.
- desired output e.g. possible sitemap.
Sorry for the late reply. Here is my sample robots.txt file.
Also there should be a way to exclude static files (css and js) when generating the sitemap file. Note that it makes sense that the sitemap only includes urls matching the content of the robots.txt input. For testing, i suggest you make a testcase using your local development server.
from pysitemaps.
Related Issues (10)
- Add API Documentation HOT 1
- Include Minimal Tutorial HOT 1
- Read sitemap.xml Files HOT 1
- Read Sitemaps from Remote Websites HOT 1
- Several paramters are fixed. Please make them variable HOT 1
- Generated Sitemaps do not comply with nods HOT 1
- Locate a Sitemap HOT 2
- extract keywords from sitemaps
- Compare Sitemaps
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pysitemaps.