How do you scrape never ending pages (like Pinterest)

[webpro 31]

Guys, what's the trick to scrape pages which never ends ?  Like Pinterest for instance ?

 

Right now i'm working on a site which loads new images when you scroll down and it never stops. Well it does if you stop scrolling down.

 

I have setup the keyword search feature and it goes to work alright but it scrapes 60 pics only. There's no "NEXT PAGE" or anything like it ?

 

I know there's a twist as i saw some guys doing it so.....

Can someone spare a little trick for the old musician....lol

[luis carlos 94]

My trick for the old musician =)  Use this code to scroll to the bottom of the page:

    window.scrollTo(0, document.body.scrollHeight);

[dmbfan 9]

In a Pinterest Autopinner/Autofillower that I created, I was actually able to avoid the scrolling issue by manipulating the URLs to go directly to the pages.  There was pretty clean logic as to how the pages were organized and it was just a matter of cycling through them.

[webpro 31]

I see, well it's not for Pinterest as you all may know, lots of sites are using this kind of display.

 

I'll try your ideas guys thanks a lot.

 

If you got other ideas, shoot please. This can't hurt !

[webpro 31]

Ok it's working guys

 

Thanks