v2.3.1

Bug Fixes

• canonical and url fix for non-ascii urls (5600e68)
• -m alias for --max-requests (b744d04)
• add ppt, pptx to docs extensions (ab21e61)
• change validation colors, background in place of font color (4e4df1a)
• errors while doc request (ignore docs in 'request' handler) (dc0f4b6)
• exception while trying docs validate (0e71bf1)
• fix images_outer for src like "images/img.jpg", "data:..." (dd84e51)

Features

• --csv, only convert csv to xlsx (59449b1)
• --delay between requests (cc15ea8)
• --ignore-robots-txt (33535b2)
• console output of non-200 http codes (009dedb)
• images_outer (007995d)
• text_ratio validate (<10% warning) (db47575)
• validation results in console, --no-console-validate (ee63716)

v2.3.0

Bug Fixes

• --skip-static and --concurrency fix (086eabd)
• better width fitting (0942833)
• h1 warning validation (9aabfc7)
• message when max requests reached (6693528)
• retry save xls after 10 seconds when file busy (7b54273)

Features

• --no-limit-domain (b765ce7)
• add --docs-extensions (4903598)

v2.2.0

Bug Fixes

• switch to @popstas/xlsx-style package until author package update (b26ec76)
• not show is_canonical: 0 when canonical is empty (31d0271)

Features

• style and validation of xlsx (eb99928)

v2.1.0

Bug Fixes

• https schema.org replace (3c643b6)

Features

• custom fields in command (c0c42cd)
• export to xlsx (21406fb)
• parse preset (3330a60)
• schema_types (schema.org) (bdde095)

v2.0.1

Features

• console colors (a78d9cb)

v2.0.0

Bug Fixes

• add filters /?catalog_view=, /?SORT=, /filter/clear/apply/ (802635f)
• ignore http scan while first page was https (be62808)

Features

• command line interface (5b62d72)
• images_alt_empty (f953b96)
• images, images_without_alt (2431b53)
• links, links_inner, links_outer, text_ratio_percent (14cb3fa)
• log robots.txt disallow to console (4ef6a8e)
• mixed_content_url (e058452)

v1.0.0

Bug Fixes

• fix freeze when exception while pageEvaluate (collect page data), add html_size (5b2541e)
• h1 trim (67fbc0d)
• ignore /?display= (2b08a55)
• ignore bitrix redirects (b310334)
• ignore case on extension check (be5407e)
• move basic options to index.js (f7e1d6b)
• move canonical after url (3c74a10)
• remove url duplicates (110b379)
• save csv for Excel (c9e3004)

Features

• add referer page (572411f)
• add skip_static to options (7981e9b)
• fields presets (0577b39)
• ignore css and js (a203275)
• is_canonical (e6b0377)
• move sites list to data/sites.conf (68f16ca)
• optional encode csv to win1251 (f025b7f)
• progress, show page count, time per page (b6aa6f4)
• progress: more verbose output, queue size, events (a115e7c)
• request_time, h1, h1-h4 count, dom_count (29c2f86)
• scrap site list (de18f1e)