Jump to content
UBot Underground

How To Scrape Table Like This


Recommended Posts

Hello everyone,

 

I have question about scraping table,

 

How you scrape tabel like this:

 

http://oi57.tinypic.com/oiafpy.jpg

 

This is an online link checker which is:

 

there 6 column where column "Found" "Acnhor" Follow" and "Pinged" is created by image how we scrape table like this?

 

Thanks

Link to post
Share on other sites

Hi.

 

I would scrape the urls of the images (green checkbox and red cross)

set(#xx$scrape attribute(<tagname="img">"src"), "Global")

 

Add them to a list, loop through the list and identify the different images via their URL.

They come in groups of 3. So for each URL you get 3 graphics.

Hope that gives you an idea where to start.

 

Dan

 

Link to post
Share on other sites

Hi Dan,

 

What the exact method, scrape table or scrape by attribute?

 

navigate("http://www.linkcheckpro.com/","Wait")
wait(2)
type text(<name="domain">,"budiharyono.name","Standard")
wait(1)
ui block text("Website to scan",#Website to scan)
wait(2)
type text(<name="urls">,#Website to scan,"Standard")
click(<value="SCAN URLS!">,"Left Click","No")
wait for element(<innertext="Download: Dofollow | Nofollow | Links Found | Links Not Found">,"","Appear")

Link to post
Share on other sites

Here's how I would do it (urls removed from code!)

 

 

navigate("http://www.linkcheckpro.com/index.php""Wait")
wait for browser event("Everything Loaded""")
type text(<name="domain">"www.google.com""Standard")
type text(<name="urls">"xxx""Standard")
click(<value="SCAN URLS!">"Left Click""No")
wait for browser event("Everything Loaded""")
wait for element(<innertext="Links Not Found">"""Appear")
set(#dofollow$scrape attribute(<innertext="Dofollow">"fullhref"), "Global")
set(#nofollow$scrape attribute(<innertext="Nofollow">"fullhref"), "Global")
set(#linksfound$scrape attribute(<innertext="Links Found">"fullhref"), "Global")
set(#linksnotfound$scrape attribute(<innertext="Links Not Found">"fullhref"), "Global")
download file(#dofollow"d:\\dofollow.txt")
download file(#nofollow"d:\\nofollow.txt")
download file(#linksfound"d:\\linksfound.txt")
download file(#linksnotfound"d:\\linksnotfound.txt")
alert("Done")

  • Like 1
Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...