(1) Open the ScrapeStorm official website, download and install the latest version.

(2) Click Register/Login to register a new account and then log in to ScrapeStorm.

Tips: You can use this web scraping software directly, you don’t need to register, but the tasks under the anonymous account will be lost when you switch to the registered user, so it is recommended that you use it after registration.

Add or remove fields as needed, and rename the fields. The results of the field settings are as follows:

(2) Use the “Scrape into” to scrape the detail page data

There is only partial data on the list page, you can use the “scrape into” function to enter the detail page to scrape the data.

Click here to learn how to extract the list page plus the detail page.

Then we add the required fields: Author, Key text

4. Set up and start the scraping task

(1) Running and Anti-block settings

Once the rules are configured, we can start the acquisition task. Click “Start” and then jump out of the taskbar. The taskbar interface has a “More Settings” button, which we can click to set up to improve stability and success rate.

Click “Setting”, set waiting time based on web page open speed. The anti-block settings follow the system default settings. Then click “Save”.

(2) Start scraping data

Premium Plan and above users can use “Scheduled job“ and “Sync to Database”. If you want to download images, you can check “Download images while running”.Then click “Start”.

LINKS

Scrapestorm uses cookies to enhance your experience, analyze our website traffic, and share
information with our analytics partners. By using this website you consent to our use of cookies.
For more information, please refer to our
Cookie Policy