From be9079700e2d31c9283c15fa4be37c6f1348bd9e Mon Sep 17 00:00:00 2001 From: Akash Mahanty Date: Sat, 3 Oct 2020 00:24:50 +0530 Subject: [PATCH] bash example for known urls --- README.md | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) diff --git a/README.md b/README.md index b15c2c8..2f4e695 100644 --- a/README.md +++ b/README.md @@ -304,6 +304,36 @@ waybackpy --url google.com --user_agent "my-unique-user-agent" --get save # Save Try this out in your browser @ +#### Fetch all the URLs that the Wayback Machine knows for a domain +1) You can add the '--alive' flag to only fetch alive links. +2) You can add the '--subdomain' flag to add subdomains. +3) '--alive' and '--subdomain' flags can be used simultaneously. +4) All links will be saved in a file, and the file will be created in the current working directory. + +```bash +pip install waybackpy + +# Ignore the above installation line. + +waybackpy --url akamhy.github.io --user_agent "my-user-agent" --known_urls +# Prints all known URLs under akamhy.github.io + + +waybackpy --url akamhy.github.io --user_agent "my-user-agent" --known_urls --alive +# Prints all known URLs under akamhy.github.io which are still working and not dead links. + + +waybackpy --url akamhy.github.io --user_agent "my-user-agent" --known_urls --subdomain +# Prints all known URLs under akamhy.github.io inclusing subdomain + + +waybackpy --url akamhy.github.io --user_agent "my-user-agent" --known_urls --subdomain --alive +# Prints all known URLs under akamhy.github.io including subdomain which are not dead links and still alive. + +``` + +Try this out in your browser @ + ## Tests [Here](https://github.com/akamhy/waybackpy/tree/master/tests)