This is a migrated thread and some comments may be shown as answers.

How to get all background http requests?

1 Answer 1467 Views
Windows
This is a migrated thread and some comments may be shown as answers.
卓峰
Top achievements
Rank 1
卓峰 asked on 28 Apr 2015, 07:12 AM

Hi all,

If we visit a website home page(eg. yahoo.com) with F12 mode from chrome, we can see a bunch of requests activated. These requests are for some pics, css files, js files. My question is: given a url(http://yahoo.com), how can I get all the http requests using maybe shell, python or tools like fiddler? I mean get all request urls as a list. eg. "Request URL:http://source/site/images/wns/1600x336_2015041.jpg"

Thanks in advance.

1 Answer, 1 is accepted

Sort by
0
Eric Lawrence
Telerik team
answered on 28 Apr 2015, 09:42 PM
Hello--

Fiddler will show you all HTTP/HTTPS requests made by a page, so the best way to get the full list is to:

  1. Clear your cache
  2. Enable Fiddler
  3. Load the page

You will then get a full list of all requests made by the browser in loading the page.

To do this without actually watching a browser, you'd need to write a HTML Parser, run the JavaScript in the page, and do all of the other operations that a browser does, so in most cases it makes much more sense to just capture the traffic from a real browser.

Regards,
Eric Lawrence
Telerik
 

See What's Next in App Development. Register for TelerikNEXT.

 
Tags
Windows
Asked by
卓峰
Top achievements
Rank 1
Answers by
Eric Lawrence
Telerik team
Share this question
or