-
-
Notifications
You must be signed in to change notification settings - Fork 110
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Limit search to path instead of domain? #50
Comments
Hi, Sorry for the delay. You can do it via
But it has to be exhaustive. You wan't something generic for all subfolders? |
Well, actually it is an include logic which is not yet implemented in https://github.com/c4software/python-sitemap/blob/master/main.py |
I agree that it would be cool to have an "include" function in the crawler. |
@davidcx89 yeap, sorry for bad phrasing, I maybe should have put more effort on describing the issue. If I'll find the time there might be a pull request somewhen soon. |
Hi, An include pattern is indeed a great idea. Something with reggex would be really great. I will try to doing this quickly. Maybe this weekend. |
Could it be possible to restrict the search to a certain path?
A bad example would be to restrict a search to
http://google.com/maps/
and ignore results which are in other "subdirectories" ofhttp://google.com/
.Using "domain" for this purpose does not work.
The text was updated successfully, but these errors were encountered: