Jump to content
UBot Underground

change browser setting, difficult page to scrape


Recommended Posts

this is actually a continuation to an early topic that was not responded, hoping to see if i can get some responses or insight ..

 

the website: in.honda.com uses a network interactive diagnostic that only allows use of IE 11, then requires you to lower security, make itself a trusted site, allow activex init. and then i believe is "scraping" or gathering information of clients trying to access its resources.

 

while in IE11 i can access the site using the above mentioned method, then i run a javascript in the browser which prints out the user agent :

 

Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; .NET4.0E; .NET4.0C; Media Center PC 6.0; .NET CLR 3.5.30729; .NET CLR 2.0.50727; .NET CLR 3.0.30729; MALNJS; rv:11.0) like Gecko

 

thus in ubot i create the following

 

set user agent("Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; .NET4.0E; .NET4.0C; Media Center PC 6.0; .NET CLR 3.5.30729; .NET CLR 2.0.50727; .NET CLR 3.0.30729; MALNJS; rv:11.0) like Gecko")

 

In IE 11, once these settings are manually done, through changes in the settings, it is permanent.  so, i was thinking by setting the useragent as it is in IE, i could access the site.  but all to no avail

 

does anyone have a clue which way I could proceed with this

 

i even tried a php curl function and nothing returned..   

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...