Jump to content
UBot Underground

Scrape Attribute Stops At Null Record And Does Not Continue


Recommended Posts

I am trying to scrape the number of photos for each record on this page:

 

http://v3.torontomls.net/Live/Pages/Public/Link.aspx?Key=145177a42bc64537b568ad2e71c157da&App=TREB

 

As you will see, there are a total of 31 records on this page, and all but one of them have photos available.  If you scroll down to record #26 you will see that it says "Photo Not Available".    This means that there are photos available for 30 of 31 records.

 

The problem I am having is that when I use this command:

clear list(%num_pics)
set(#num_pics, $scrape attribute(<class="info">, "innertext"), "Global")

This returns only 25 items instead of 30 items.  

%num_pics: 25 items

It only grabs the innertext from the first 25 records before it reaches record #26 where it says "Photo Not Available".  For some reason, the scrape command does not grab the innertext from the remaining records after the null record #26.

 

Any ideas of what I can do so that I can scrape all 30 of the innertext entries, 25 before the null record, and then 5 after the null record.  I should also add that this page is one of many and the others will be similarly formatted with one or more null records.  

Thanks.

Edited by APTS
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...