55 Commits

Author SHA1 Message Date
Anton Gunov
b2cc5934db Fix adding useless properties 2017-12-08 17:09:09 +07:00
Anton Gunov
5ead82cef0 Fix empty href value of links 2017-12-06 15:06:26 +07:00
Anton Gunov
3438dc48c5 Exclude the check of a response status code because it is not matter in this case 2017-11-22 15:47:58 +07:00
Anton Gunov
b3ba1655d2 Exclude the root scope for cheerio: there are websites with problematic <head> tag or without one 2017-11-22 15:26:40 +07:00
Anton Gunov
20c2f4006c Disable stripWWW option 2017-11-09 21:19:37 +07:00
Anton Gunov
84dfd3b60b Fix: check /favicon.ico size 2017-11-09 20:57:33 +07:00
Anton Gunov
86d3476db2 Add jar option and update user-agent header 2017-11-09 20:40:11 +07:00
Anton Gunov
b218cc29d3 Fix: the href of an icon equals # 2017-11-08 17:36:08 +07:00
Anton Gunov
0750436294 Fix typos 2017-11-07 18:55:40 +07:00
Anton Gunov
677efc5a06 Fix undefined value 2017-11-07 18:47:16 +07:00
Anton Gunov
e34d199db4 Created docs directory 2017-09-07 15:27:16 +07:00
Anton Gunov
5b72129d09 Added status endpoint for Uptime Robot 2017-08-17 13:36:03 +07:00
Anton Gunov
8415b9127c Validate domain name 2017-08-16 13:23:17 +07:00
Anton Gunov
7647c0429e Support for normalize URL by default 2017-08-15 15:48:08 +07:00
Anton Gunov
55de3ab063 Updated User-Agent header 2017-08-15 14:38:51 +07:00
Anton Gunov
88cb220c13 Fixed making URL lowercase 2017-08-13 18:30:23 +07:00
Anton Gunov
12215debab Implementation of grabbing /favicon.ico 2017-08-13 18:04:24 +07:00
Anton Gunov
077d762bd1 Ignore case for parsing page 2017-08-11 17:26:32 +07:00
Anton Gunov
27b1d9161e Fixed to resolve icon.src property 2017-08-07 19:15:18 +07:00
Anton Gunov
f7d9b7ff21 Updated error messages 2017-08-04 17:56:06 +07:00
Anton Gunov
b8d0b0a811 Prevent to reset a connection 2017-08-02 17:04:48 +07:00
Anton Gunov
825e44f553 More correct text 2017-08-02 12:02:50 +07:00
Anton Gunov
e55f17aba9 Fixed error of connection timeout 2017-08-01 15:59:44 +07:00
Anton Gunov
4b48272d87 Fixed an invalid domain name 2017-08-01 15:13:23 +07:00
Anton Gunov
7ecb9eedbb Updating nginx conf 2017-07-27 16:22:07 +07:00
Anton Gunov
7c7adfc945 Updating readme 2017-07-21 15:00:45 +07:00
Anton Gunov
f42fe24ac4 Support for CORS 2017-07-19 18:43:31 +07:00
Anton Gunov
26a968c22c Support for JSONP 2017-07-19 16:29:33 +07:00
Anton Gunov
b7917a2ad7 Updated some things 2017-07-19 15:53:58 +07:00
Anton Gunov
6145b4d527 Updating API readme 2017-07-18 19:51:43 +07:00
Anton Gunov
308556ebdc Added variables.scss 2017-07-16 18:50:49 +07:00
Anton Gunov
8b0b640fbf Fixed typo 2017-07-15 19:09:50 +07:00
Anton Gunov
a6d730d19d Added markdown-it-prism pug filter 2017-07-14 16:43:41 +07:00
Anton Gunov
200b926459 Renamed API reference page 2017-07-13 19:14:24 +07:00
Anton Gunov
8b398f49c2 Moved pretty route to API router 2017-07-13 16:07:00 +07:00
Anton Gunov
2ede2b30a6 JSON in a pretty way 2017-07-12 19:05:16 +07:00
Anton Gunov
71054c5846 Added api.pug 2017-07-11 16:35:33 +07:00
Anton Gunov
e408f5884a Added API.md 2017-07-11 13:59:51 +07:00
Anton Gunov
92d2dd754e Updated error messages 2017-07-11 13:36:42 +07:00
Anton Gunov
e42671d4e3 Check a status code 2017-07-08 17:29:30 +07:00
Anton Gunov
98b7bdc4c1 Server timeout 2017-07-08 16:01:27 +07:00
Anton Gunov
6d610f9918 Prevent to redirect to mobile version of a site 2017-07-08 14:48:25 +07:00
Anton Gunov
9e7885421c Support for unresolved domain name 2017-07-07 20:11:28 +07:00
Anton Gunov
a5c3f234fa Support for grabbing TileImage 2017-07-07 19:35:57 +07:00
Anton Gunov
fe62f094f1 Fixed grab manifest 2017-07-07 19:29:26 +07:00
Anton Gunov
dd2b72adb8 Updated grabber 2017-07-07 18:19:53 +07:00
Anton Gunov
1232be5112 Fixed unknown endpoint 2017-07-07 14:36:28 +07:00
Anton Gunov
fd32480d6b Added headers 2017-07-07 11:53:47 +07:00
Anton Gunov
e992774088 Refactored API grabber 2017-07-06 19:58:46 +07:00
Anton Gunov
8b2b35896b Added selectors.json 2017-07-06 17:55:41 +07:00