BeerNut 25 Posted May 18, 2015 Report Share Posted May 18, 2015 One of my bots focuses on scraping details from google maps. I have always had a working google maps scraper for the last few years but the "new" google maps has me worried. Last week they disabled the "classic" option and forced users to use the new versions. I have found a temporary work around but it still depends on Google not forcing the change for good. Because the new version relies heavily on javascript I have found it difficult to find a good way to scrape it. If you just try to use the browser and navigate to the new maps you are forced into the lite version because the ubot browser does not support the full version. The lite version in the ubot browser has no next page of results. So the listings to the right are only limited to 10 results plus ads. So scraping in browser is out. If you use your normal browser you can use the full mode which has next and previous page buttons. Next button loads more listings as you would expect. But again this will not show up in ubot. If you disable JavaScript absolutely nothing loads so that isn't a work around. This next button uses ajax so you can't gleam out a next page url to load. Http post of the site returns the 10 results in the source but no way to load the next page of results without a url to go to. Is anyone else working on a Google Maps bot and would like to brainstorm or share methods in regards to the new google maps? Quote Link to post Share on other sites
BeerNut 25 Posted June 3, 2015 Author Report Share Posted June 3, 2015 Maps updated today and they killed the last few working links to the classic version of Google Maps. The uBot browser can only support the 'lite' version of the new maps and this only provides 10 results and no next/previous page buttons. Has anyone been working on this? Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.