Benjamin_Loison/waybackpy
1
0
Fork 0
Code Issues 1 Pull Requests Packages Projects Releases Wiki Activity
486 Commits 1 Branch 37 Tags
d6341aa710d7f38e0a1c2099605f7e62e44d34b5
Commit Graph

486 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akash Mahanty
31b1056217 fix typo in CI 2022-01-23 02:03:30 +05:30
Akash Mahanty
97712b2c1e add CI unit_test.yml 2022-01-23 02:00:15 +05:30
Akash Mahanty
a8acc4c4d8 Fix Incomplete URL substring sanitization in the last commit. 2022-01-23 01:42:48 +05:30
Akash Mahanty
1bacd73002 created pytest.ini, added test for waybackpy/availability_api.py, new exceptions all of which inherit from the main WaybackError and created requirements-dev.txt 2022-01-23 01:29:07 +05:30
Akash Mahanty
79901ba968 updated README.md 2022-01-22 03:08:26 +05:30
Akash Mahanty
df64e839d7 added trove classifiers for python 3.10 2022-01-22 00:57:10 +05:30
Akash Mahanty
405e9a2a79 waybackpy/save_api.py : Added doc strings and also lint with black. 2022-01-22 00:41:10 +05:30
Akash Mahanty
db551abbf6 lint waybackpy/cdx_api.py and added some doc strings 2022-01-22 00:11:35 +05:30
Akash Mahanty
d13dd4db1a added notice on waybackpy/wrapper.py that the Url class will cease to exist after 2024-01-01 and also removed unused imports. 2022-01-21 23:14:20 +05:30
Akash Mahanty
d3bb8337a1 make setup.py smarter, now no need to update the URL again and also added more keywords. And in __version__.py updated the __author__ 2022-01-21 23:01:09 +05:30
Akash Mahanty
fd5e85420c waybackpy/availability_api.py : removed unused imports, added doc strings, removed redundant function. 2022-01-21 22:47:44 +05:30
Akash Mahanty
5c685ef5d7 upload logo and make p path not text 
I was dumb to forget to convert the p to path.
 2022-01-21 21:11:42 +05:30
Akash Mahanty
6a3d96b453 Logo (#113) 
* Create logo.txt

* Delete waybackpy_logo.svg

* Add files via upload

* Delete logo.txt
 2022-01-21 21:02:38 +05:30
Akash Mahanty
afe1b15a5f Add files via upload 2022-01-21 20:58:53 +05:30
Akash Mahanty
4fd9d142e7 Merge pull request #112 from akamhy/fix 
escape '.' before 'archive.org'
 2022-01-21 19:52:55 +05:30
Akash Mahanty
5e9fdb40ce escape '.' before 'archive.org' 
escape '.' before 'archive.org' on line 88 so it does not match more hosts than expected.
 2022-01-21 19:51:08 +05:30
Akash Mahanty
fa72098270 _get_response is not used anymore 
- datashaman (<https://stackoverflow.com/users/401467/datashaman>) for <https://stackoverflow.com/a/35504626>. _get_response is based on this amazing answer.
 2022-01-21 19:43:35 +05:30
Akash Mahanty
d18f955044 date year range 2020-2022 2022-01-21 11:55:42 +05:30
Akash Mahanty
9c340d6967 Create codeql-analysis.yml 2022-01-21 11:12:59 +05:30
Akash Mahanty
78d0e0c126 Update README.md 2022-01-21 09:54:04 +05:30
Akash Mahanty
564101e6f5 🐳 for docker image 2022-01-21 01:23:05 +05:30
Akash Mahanty
de5a3e1561 improve usage code 3.0.0 2022-01-18 21:18:17 +05:30
Akash Mahanty
52e46fecc2 more usage example 2022-01-18 20:58:39 +05:30
Akash Mahanty
3b6415abc7 updating examples 2022-01-18 20:44:47 +05:30
Akash Mahanty
66e16d6d89 define __repr__ for the Availability API class 2022-01-18 20:34:21 +05:30
Akash Mahanty
16b9bdd7f9 output the file name if known_url and file flag are passed. 2022-01-18 20:14:44 +05:30
Akash Mahanty
7adc01bff2 implement known_urls for cli from the newer interface. Although use of CDX is recommended but backward-compatibility matters. 2022-01-18 20:07:12 +05:30
Akash Mahanty
9bbd056268 Update README.md 2022-01-17 02:15:38 +05:30
Akash Mahanty
2ab44391cf close #107, added link to SecSI/Docker image 2022-01-16 23:01:31 +05:30
Akash Mahanty
cc3628ae18 define __str__ for objects of WaybackMachineAvailabilityAPI class, the check for self.JSON ensures that the API was atleast called. 2022-01-16 22:28:12 +05:30
Akash Mahanty
1d751b942b invoke json, was a bad idea removing it the earlier commit as the end user should not have to call it 2022-01-16 22:15:25 +05:30
Akash Mahanty
261a867a21 near() method of WaybackMachineAvailabilityAPI return self to preserve past behaviour 2022-01-16 21:53:54 +05:30
Akash Mahanty
2e487e88d3 define __len__ on Url objects, if any method not used prior to len op then default to len of oldest archive. 2022-01-16 21:29:43 +05:30
Akash Mahanty
c8d0ad493a defined __str__ for Url objects, print func should print the url. 2022-01-16 21:22:43 +05:30
Akash Mahanty
ce869177fd Merge pull request #103 from akamhy/whitesource/configure 
Configure WhiteSource Bolt for GitHub
 2022-01-02 16:04:15 +05:30
whitesource-bolt-for-github[bot]
58616fb986 Add .whitesource configuration file 2022-01-02 08:45:07 +00:00
Akash Mahanty
4e68cd5743 Create separate module for the 3 different APIs also CDX is now CLI supported. 2022-01-02 14:14:45 +05:30
akamhy
a7b805292d changes made for v2.4.4 (update download_url) (#100) 
* v2.4.4 (update download_url)

* v2.4.4 (update __version__)

* +1

add jonasjancarik
2.4.4 		2021-09-03 11:28:26 +05:30
Jonáš Jančařík
6dc6124dc4 Raise error on a 509 response (too many sessions) (#99) 
* Raise error on a 509 response (too many sessions)

When the response code is 509, raise an error with an explanation (based on the actual error message contained in the response HTML).

* Raise error on a 509 response (too many sessions) - linting
 2021-09-03 08:04:36 +05:30
Jens Finkhaeuser
5a7fc7d568 Fix typo (#95) 2021-04-13 16:58:34 +05:30
Akash Mahanty
5a9c861cad v2.4.3 (#94) 
* 2.4.3

* 2.4.3
2.4.3 		2021-04-02 10:41:59 +05:30
Akash Mahanty
dd1917c77e added RedirectSaveError - for failed saves if the URL is a permanent … (#93) 
* added RedirectSaveError - for failed saves if the URL is a permanent redirect.

* check if url is redirect before throwing exceptions, res.url is the redirect url if redirected at all

* update tests and cli errors
 2021-04-02 10:38:17 +05:30
Akash Mahanty
db8f902cff Add doc strings (#90) 
* Added some docstrings in utils.py

* renamed some func/meth to better names and added doc strings + lint

* added more docstrings

* more docstrings

* improve docstrings

* docstrings

* added more docstrings, lint

* fix import error
 2021-01-26 11:56:03 +05:30
Akash Mahanty
88cda94c0b v2.4.2 (#89) 
* v2.4.2

* v2.4.2
2.4.2 		2021-01-24 17:03:35 +05:30
Akash Mahanty
09290f88d1 fix one more error 2021-01-24 16:58:53 +05:30
Akash Mahanty
e5835091c9 import re 2021-01-24 16:56:59 +05:30
Akash Mahanty
7312ed1f4f set cached_save to True if archive older than 3 mins. 2021-01-24 16:53:36 +05:30
Akash Mahanty
6ae8f843d3 add --file to --known_urls 2021-01-24 16:15:11 +05:30
Akash Mahanty
36b936820b known urls now yileds, more reliable. And save the file in chucks wrt to response. --file arg can be used to create output file, if --file not used no output will be saved in any file. (#88) 2021-01-24 16:11:39 +05:30
Akash Mahanty
a3bc6aad2b too much API usage by duplicate tests was causing too much tests failure 2021-01-23 21:08:21 +05:30