Web Scraping Feature Study | Scraping from multi-pages: pagination with "Next" button

Wednesday, September 28, 2016 7:54 AM

What it is?

Pagination action is used when the content we want to scrape spans over different pages of a website. Octoparse mimics human browsing behaviors, so just as you would click to the next page as you browse through a website, Octoparse does the same when you use pagination feature.

Particularly, pagination with a "Next" button is a more common way for you to flip through pages.


When do you want to use it?

If you would be extracting data from more than one page, then use pagination to enable page flipping.

One common method for pagination with a “Next page” button is shown below, we can loop click next page to scrape.



How to use it?


Step 1. Click the "Next" button used for turning pages.


Step 2. When prompted, select "Loop click the element" to tell Octoparse to click each page in the Cycle Pages.


Step 3. Now, we could check if we have set up pagination successfully by click "Click to Paginate" action.                                 


Step 4. We can observe that the first page has flipped to the next one.




Now, let's look into how pagination works. Learn more about pagination related topics:


Author: The Octoparse Team


Download Octoparse Today

 For more information about Octoparse, please click hereSign up today!


30 Free Web Scraping Software

Collect Data from Amazon

Top 30 Free Web Scraping Software

- See more at: http://www.octoparse.com/tutorial/pagination-scrape-data-from-websites-with-query-strings-2/#sthash.gDCJJmOQ.dpuf

We use cookies to enhance your browsing experience. Read about how we use cookies and how you can control them by clicking cookie settings. If you continue to use this site, you consent to our use of cookies.
Accept decline