Jump to content
UBot Underground

Finding your page in google automation possible?


Recommended Posts

Hello! I am working with a company who wants to be able to see where they rank for every keyword they choose without having to manually go through google and click on every page one by one. So far I have been able to make my bot go to google and type in a keyword then press search, but I don't have a clue now how to get it to begin searching through all the results pages to find the specific site I'm looking for.

 

Have you ever tried to find out what page of google you were on for a given keyword? I have had to do this manually in the past and it's annoying! I believe there are other ways by just putting in site:yoursite.com or whatever but I need this bot to look through the pages not to just go to a link. In other words to go 1 by 1 through all the pages until it finds my site. I have much more to add to this script but I am stumped at this part, sadly.

 

Any help would be greatly appreciated! Thanks all!

 

=)

Link to post
Share on other sites
  • Replies 63
  • Created
  • Last Reply

Top Posters In This Topic

Yes it can be done in ubot, or there are firefox plugins that can do the same task. If using ubot, You have to scrape for your site using if then statement. Make sure you add delays in your scripting to avoid problems with google.

Link to post
Share on other sites

Thank you! That helps me in the right direction for sure! I'm still learning how to use ubot, so I have to continue to study before I fully understand what to do with the info. Any more elaboration on the process will help me greatly in my studies and work, but I already appreciate the help you have given me. :)

Link to post
Share on other sites

Thank you John!!! This sample directory has a lot of helpful things! I am very grateful :)

 

 

 

You'll find a sample script that does just that at:

 

http://support.ubotstudio.com/index.php?/Knowledgebase/Article/View/65/11/sample-codes-and-scripts

 

Hope that helps.

 

John

Link to post
Share on other sites

Hmm that script no longer works, the loop fails. Could it be outdated? Anyway I'm working on trying to understand stuff like what <CITE> is, and how exactly this finds the site so I can tailor it to my needs. Thanks for all the help on this!

Link to post
Share on other sites

It works fine...you need to enter the number of loops you want (the equivalent of how many pages deep you want to search). I just ran it.

 

John

Link to post
Share on other sites

Imhotep. What you want to do is really simple. I will find a site about 7-8 pages deep and throw together the script for you so you can see how it works.

 

John

Link to post
Share on other sites

John thank you so much! I'm looking at it now and trying to dissect it, it will sure take me some time. It ran perfect and amazing! I will augment it to meet my needs once I fully understand it's operation. From what I have seen it is a lot simpler than it looks at first. I'm just at a loss as to how to create the commands, so I will do some more of the tutorials and tackle this again with more knowledge.

Link to post
Share on other sites

Thanks John, I'm going to do study before asking anything further. Your site is great! I'm watching a random vid now, they are all good so far! I have a lot to learn before I can get my bot made, but thanks again for all your help! Why the rolleyes? lol :P

 

 

Anything you need, just ask! http://ubotstudio.com/forum/public/style_emoticons/default/rolleyes.gif

Link to post
Share on other sites

lol...I thought it was a regular smiley...I need to get my eyes checked! http://ubotstudio.com/forum/public/style_emoticons/default/blink.gif

Link to post
Share on other sites

Ha ha, no doubt, it's all good john! I am making progress, the default tutorials are almost unbearable to watch and confuse more than teach imo (at least for me). So I dug right in and messed with the code you did up. I am up to the "if" function where it states search page the code

href="http://learnubot.com/" b="9">Learn <EM>UBot</EM> - Free <EM>UBot</EM> tutorials</A>

 

I am trying to figure out what part this is. so far I get that the other two entries were google searches of the keyword and the exact site and I understand why. But I don't know what this part is or why it is there. Could you shed some light?

 

So far am I getting the idea of how this works right? :)

 

Thanks!

Link to post
Share on other sites

I made that sample to search for a specific website which is embedded in the code. You can change that by adding a UI Text box and entering your own url to search for. In the case of the sample I had it search for the title text and not the url, but you can change all that to work with a url instead.

 

If you do that, however, you will have to change the appropriate nodes to reflect that.

 

John

Link to post
Share on other sites

Darn, that actually confuses me more now. I had planned to use this as a base, I was editing the navigate and search pages within your example to see how the script worked. I will have to learn more from it and make it up from scratch then. I do want it to use a ui text box to enter the url to search for as well as the keyword to search for, if that is at all possible. Where would I put them in the code exactly? I bet this is a lot easier than I'm making it out to be, it's the hardest hurdle to overcome when thinking of programming! ;)

 

 

 

I made that sample to search for a specific website which is embedded in the code. You can change that by adding a UI Text box and entering your own url to search for. In the case of the sample I had it search for the title text and not the url, but you can change all that to work with a url instead.

 

If you do that, however, you will have to change the appropriate nodes to reflect that.

 

John

Link to post
Share on other sites

Sweet! thank you John. I just made a mini bot that goes to google loads a variable keyword from the ui and puts it in and clicks search... so far so good! I'm stoked!!! I really am in love with ubot! It still has a learning curve but for people like me who can't think with a coders brain it really is Amazing! Eventually when I get better at this I will want to buy the developer edition so I can modify the UI and make my own looking programs to sell! The dev license will pay for itself the first week!!!

 

:D

 

 

I'll re-code that script a little so you have a more flexible base to work with.

Link to post
Share on other sites

Great! here is a fully functional version. The only limitation is it only checks the first 12 serps for the url, but you can easily change that to whatever number you want in the loop cycles (11 cycles=12 pages, 24 cycles=25 pages, etc). You can then edit the final alert to reflect that number.

 

find site in serps.ubot

 

 

John

Link to post
Share on other sites

So far so good, I have been able to make my own version of the script! However I'm having a hard time making my script click on the site when it finds it, in stead of just stopping on the page or posting a javascript message. I am pretty sure this is possible but don't know which action command to use.

 

I plan to also alter which place the link is searched from, but I want to tackle this problem first. Sadly it's had me up all night lol!

Link to post
Share on other sites

Wouldn't using nav negate the fact it was found on google? I could just write a bot with the action navigate and make it go anywhere. what I want to create is a bot that can search something out and then click on the link provided by the search so as to refer to it. Like affiliate links on a page to alter CTR. Just using nav will be a direct refer.

 

Any other options to do what I want it to do?

 

 

You have to scrape your link using if then statement and then nav

Link to post
Share on other sites

Yes you can find all your links on one page(incase you have multiple) and scrape and do I chose by attribute on one of the links . I can create a example if you wish

Link to post
Share on other sites

Yes please, I'm a bit confused by what you said. How would it be able to click through? Thank you for helping! :)

 

 

Yes you can find all your links on one page(incase you have multiple) and scrape and do I chose by attribute on one of the links . I can create a example if you wish

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...

×
×
  • Create New...