Akash Mahanty
a65990aee3
don't use pagination API if total pages <= 2
2021-01-12 09:46:07 +05:30
Akash Mahanty
259a024eb1
joke? they changed their robots.txt
2021-01-11 23:17:01 +05:30
Akash Mahanty
91402792e6
+ Supported Features
...
tell what the package can do, many users probably do not read the full usage.
2021-01-11 23:01:18 +05:30
Akash Mahanty
eabf4dc046
don't fetch more pages if >=2 pages are empty
2021-01-11 22:43:14 +05:30
Akash Mahanty
5a7bd73565
support unix ts as an arg in near
2021-01-11 19:53:37 +05:30
Akash Mahanty
4693dbf9c1
change str repr of cdxsnapshot to cdx line
2021-01-11 09:34:37 +05:30
Akash Mahanty
f4f2e51315
V2.4.0 ( #62 )
...
* v 2.4.0
* v 2.4.0
2021-01-10 11:53:45 +05:30
Akash Mahanty
d6b7df6837
no need to de-duplicate as we are collapsing the results by urlkey
...
Same urls aren't recieved
2021-01-10 11:36:46 +05:30
Akash Mahanty
dafba5d0cb
collapses=["urlkey"] for known urls
2021-01-10 11:34:06 +05:30
Akash Mahanty
6c71dfbe41
use cdx matchtype for domain and host
2021-01-10 11:10:49 +05:30
Akash Mahanty
a6470b1036
not passing dict to cdxsnapshot
2021-01-10 10:40:32 +05:30
Akash Mahanty
04cda4558e
fix test
2021-01-10 03:18:09 +05:30
Akash Mahanty
625ed63482
remove asserts stmnts
2021-01-10 03:05:48 +05:30
Akash Mahanty
a03813315f
full cdx api support
2021-01-10 02:23:53 +05:30
Akash Mahanty
a2550f17d7
retries support for get requests
2021-01-06 01:58:38 +05:30
Akash Mahanty
15ef5816db
Always cast url to string, avoid passing waybackpy objects to _get_response
2021-01-05 19:46:17 +05:30
Akash Mahanty
93b52bd0fe
FIX : don't use self.user_agent if user_agent passed in get()
2021-01-05 19:31:27 +05:30
Akash Mahanty
28ff877081
Update README.md
2021-01-05 19:08:35 +05:30
Akash Mahanty
3e3ecff9df
l2 heading and lint
2021-01-05 01:59:29 +05:30
Akash Mahanty
ce64135ba8
ce
2021-01-05 01:52:35 +05:30
Akash Mahanty
2af6580ffb
docs link
2021-01-05 01:51:53 +05:30
Akash Mahanty
8a3c515176
v2.3.3
2021-01-05 01:49:26 +05:30
Akash Mahanty
d98c4f32ad
v2.3.3
2021-01-05 01:48:54 +05:30
Akash Mahanty
e0a4b007d5
improve docs
2021-01-05 01:46:12 +05:30
Akash Mahanty
6fb6b2deee
Update readme + new file CONTRIBUTORS.md ( #59 )
...
* remove some badges
* remove made with python button, obvious
* - maintained badge, we already have latest commit badge
- [](https://github.com/akamhy/waybackpy/graphs/commit-activity )
* re arranged order of badges
* a bit more re odering
* - release badge
* - license section
* center h1
* try once more'
* removed the TOC
* move the hr
* Update README.md
* + hr
* h1 --> h2
* remove tests and pacakging info from here to docs/wiki
* Update README.md
* example inspired by psf/requests
* CLI tool example gist
* Update README.md
* Update README.md
* + license
* Update README.md
* authors list
* Update CONTRIBUTORS.md
* fix code
* Update README.md
* Update README.md
* center the button
2021-01-05 00:30:07 +05:30
Akash Mahanty
1882862992
now using cdx Pagination API
2021-01-04 20:46:54 +05:30
Akash Mahanty
0c6107e675
increase coverage
2021-01-04 01:54:40 +05:30
Akash Mahanty
bd079978bf
inc coverage
2021-01-04 00:44:55 +05:30
Akash Mahanty
5dec4927cd
refactoring, try to code complexity
2021-01-04 00:14:38 +05:30
Akash Mahanty
62e5217b9e
reduce code complexity: refactoring, less flow breaking structures
2021-01-03 19:38:25 +05:30
Akash Mahanty
9823c809e9
Added doc strings in wrapper.py, documenting code and improving docs.
2021-01-03 17:11:32 +05:30
Akash Mahanty
db5737a857
JSON is now available for near and other other methods that call it
2021-01-02 18:52:46 +05:30
Akash Mahanty
ca0821a466
Wiki docs ( #58 )
...
* move docs to wiki
* Update README.md
* Update setup.py
2021-01-02 12:20:43 +05:30
Akash Mahanty
bb4dbc7d3c
rm url = obj.url
2021-01-02 11:19:09 +05:30
Akash Mahanty
7c7fd75376
No need to fetch archive_url and timestamp from availability API on init ( #55 )
...
* No need to fetch archive_url and timestamp from availability API on init.
Not useful if all I want is to archive a page
* Update test_wrapper.py
* Update wrapper.py
* Update test_wrapper.py
* Update wrapper.py
* Update cli.py
* Update wrapper.py
* Update __version__.py
* Update __version__.py
* Update __version__.py
* Update __version__.py
* Update setup.py
* Update README.md
2021-01-02 11:10:23 +05:30
Akash Mahanty
0b71433667
v2.3.1 ( #54 )
...
* 2.3.1
* 2.3.1
2021-01-01 19:15:23 +05:30
Akash Mahanty
1b499a7594
removed JSON from init, this was resulting in too much unnecessary taffic. Some users who are thousands of URLs were blocked by IA ( #53 )
...
closes #52
2021-01-01 16:38:57 +05:30
Akash Mahanty
da390ee8a3
improve maintainability and reduce code cognitive complexity ( #49 )
2020-12-15 10:24:13 +05:30
Akash Mahanty
d3e68d0e70
code formated with black ( #47 )
2020-12-14 01:18:04 +05:30
Akash Mahanty
fde28d57aa
Update CONTRIBUTING.md
2020-12-14 00:16:29 +05:30
Akash Mahanty
6092e504c8
Update CONTRIBUTING.md
2020-12-14 00:15:51 +05:30
Akash Mahanty
93ef60ecd2
v2.3.0 ( #46 )
...
* v2.3.0
* v2.3.0
* decrease line length
2020-12-14 00:14:54 +05:30
Akash Mahanty
461b3f74c9
UPDATE header image url
2020-12-13 23:09:59 +05:30
Akash Mahanty
3c53b411b0
Improve the appearance of readme ( #45 )
...
* replaced text header wth image
* svg
* Update README.md
* Update README.md
* Update README.md
* level 2
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Create CONTRIBUTING.md
* Update README.md
* Add files via upload
* Update README.md
* Delete waybackpy-colored 284.png
* Delete waybackpy colored.png
* Update README.md
* Update index.rst
* Update index.rst
* Update index.rst
* Update setup.py
* Delete index.rst
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
2020-12-13 23:08:16 +05:30
pyup.io bot
8125526061
create pyup.io config file ( #44 )
2020-12-13 22:31:49 +05:30
Akash Mahanty
2dc81569a8
Create .pep8speaks.yml
2020-12-13 17:58:09 +05:30
Akash Mahanty
fd163f3d36
Update wrapper.py
2020-12-13 17:12:32 +05:30
Akash Mahanty
a0a918cf0d
.
2020-12-13 17:10:28 +05:30
Akash Mahanty
4943cf6873
remove print stmnt, update ci
2020-12-13 16:37:35 +05:30
Akash Mahanty
bc3efc7d63
now using requests lib as it handles errors nicely ( #42 )
...
* now using requests lib as it handles errors nicely
* remove unused import (urllib)
* FIX : replaced full_url with endpoint (not using urlib)
* LINT : Found in waybackpy\wrapper.py:88 Unnecessary else after return
2020-12-13 15:44:37 +05:30
