Web Scraper version history - 8 versions
Web Scraper by webscraper.io
Web Scraper version history - 8 versions
Be careful with old versions! These versions are displayed for testing and reference purposes.You should always use the latest version of an add-on.
Latest version
Version 1.89.8
Released Aug 15, 2024 - 1.97 MBWorks with firefox 113.0 and later[Feature] added Website state setup configuration to prepare target site before scraping. For example Sign-in/Login, change currency, change location. For example if an element that indicated that you are logged into the website perform these actions:
* Navigate to url (Login page)
* type text into an input field
* click a button
[Breaking] regex extraction has been deprecated. If already configured, it will continue to work, but there won't be an option to add a new regex filter.
[Fix] Improved performance in start url editing view when a lot of urls are added
[Fix] Excessive memory usage in Pagination selector when large amounts of contents is accessed.Source code released under All Rights Reserved
Download Firefox and get the extensionYou'll need Firefox to use this extensionOlder versions
Version 1.79.3
Released Apr 18, 2024 - 1.94 MBWorks with firefox 113.0 and later[Feature] improved link from any script data extraction to handle some edge cases
[Feature] added sitemap sync button within the sitemap editing view
[Fix] Fixed issues in page load detection where the scraper could think that page has loaded while it is still loading ajax data.
[Fix] Improved scraped data export. Should fix issues regarding slow data export.
[Refactor] We completed input validation refactoring. Congrats to our team!Source code released under All Rights Reserved
Version 1.75.8
Released Feb 5, 2024 - 2.1 MBWorks with firefox 113.0 and later[Feature] a mis-configuration modal will shop up in scenario when multiple selectors with multiple option enabled have been created. The modal will offer to group the selectors under one element selector.
[Feature] new link type and pagination type - Link from any script. This type will extract links in scenarios when a link can only be determined after clicking on the target element. The extractor will perform the click and monitor network traffic to see where the page is navigating. Handles window.open() and window.location=
[Refactor] Improved scrolling. Now scrolling will not skip frames in case when the target page is doing heavy rendering.Source code released under All Rights Reserved
Version 1.72.9
Released Nov 30, 2023 - 2.03 MBWorks with firefox 69.0 and later[Feature] confirmation popup will show up when deleting a selector.
[Feature] link selector will now allow to select elements that are not html links but contain links.
[Feature] when selecting html code of the hovered element will be shown.
[Feature] Link selector can now extract links from other attributes, attributes with scripts and text
[Feature] When deleting a sitemap a confirmation popup will be shown
[Feature] Selectors now can be sorted.
[Feature] During data extraction process some CSS selector will be optimized for better performance.
[Breaking] Popup link selector has been removed due to chrome MV3 javascript execution limitation. use link selector with custom link type
[Breaking] Removed popup link type from element click selector due of chrome MV3 javascript execution limitation
[Change] Improved mouse click simulation.
[Change] We completely removed integration with external CouchDB database.
[Change] Internal PouchDB database will be replaced with a simpler local storage database engine. All sitemaps will be migrated to new engine on first extension start.
[Change] This release includes an updated validation engine. Some validation rules will be stricter to prevent unexpected issues.
[Change] When during data extraction process a data element wasn't found a "null" value was stored. Now an empty value "" will be stored.
[Fix] scraper could get stuck on a bad page load.
[Refactor] We are refactoring UI code. Currently these changes should be invisible.
[Refactor] A lot of code was refactored to work with the new Chrome manifest V3 APISource code released under All Rights Reserved
Version 0.6.5
Released Sep 8, 2022 - 1.77 MBWorks with firefox 69.0 and later[Fix] Varios edge case issues with page load detection
[Feature] Sitemap sync for Firefox
[Refactor] Completely reimplemented validation.
[Feature] Exported data will be in sorted the order it was scraped
[Feature] Added limit option for scroll down selector
[Fix] Element click selector data extraction within shadow root
[Refactor] Chrome is migrationg to a new manifest version which change interal APIs. We put a lot of work into this.
[Fix] Some special chars where incorrectly exported in XLSX exporter
[Fix] Data extractors will strip invalid utf-8 characters from text
[Change] Removed delay options from most of the selectorsSource code released under All Rights Reserved
Version 0.6.4
Released Oct 28, 2021 - 1.57 MBWorks with firefox 69.0 and later[Feature] XLSX export
[Change] Data extraction will be limited to 120 min from a single URL.
[Fix] Ignore elements created by google translate
[Feature] image selector will extract image URL from srcset attribute
[Feature] pagination selector
[Fix] element selection when page has zoomed elements
[Feature] element attribute selector now has attribute suggestion drop-down
[Feature] element preview shows found element count
[Feature] sitemap search in sitemap list
[Fix] lots of improvements in page load detection for edge cases
[Fix] overall lots of small fixes and updatesSource code released under All Rights Reserved
Version 0.5.4
Released Sep 22, 2020 - 1.03 MBWorks with firefox 69.0 and laterFixed element selection in websites that were blocking it with CSP.Source code released under All Rights Reserved
Version 0.5.3
Released Aug 18, 2020 - 1.14 MBWorks with firefox 69.0 and later* New data selection UI engine. It is faster and more resilient to websites having CSS rules that break the UI.
* A new page load detection engine has been added. The new page load detection system will handle a lot of edge cases:
* immediate redirect after page load
* service workers
* hash tag changes
* quicker load when there is a slowly loading asset
* won't fail on an error page if there is an immediate redirect to a successful page
* data extraction will be retried if a redirect occurs during data extraction
* improved content type checking
* window.history.push changes
* CouchDB has been deprecated. Users that were using it will be able to continue to use it but new users won't be able to change data storage. We plan to replace the current data storage engine (PouchDB) with simpler one to reduce problems with sitemap and data storage.
* privacy policy page and an option to opt-out of extension metric gathering via options page.
* new users will see a welcome page with a quick startup guide
* reduced extensions permission requirements.
* Overall code quality improvementsSource code released under All Rights Reserved