How to get all background http requests?

2 posts, 0 answers
  1. 卓峰
    卓峰 avatar
    1 posts
    Member since:
    Apr 2015

    Posted 28 Apr 2015 Link to this post

    Hi all,

    If we visit a website home page(eg. yahoo.com) with F12 mode from chrome, we can see a bunch of requests activated. These requests are for some pics, css files, js files. My question is: given a url(http://yahoo.com), how can I get all the http requests using maybe shell, python or tools like fiddler? I mean get all request urls as a list. eg. "Request URL:http://source/site/images/wns/1600x336_2015041.jpg"

    Thanks in advance.

  2. Eric Lawrence
    Admin
    Eric Lawrence avatar
    833 posts

    Posted 28 Apr 2015 Link to this post

    Hello--

    Fiddler will show you all HTTP/HTTPS requests made by a page, so the best way to get the full list is to:

    1. Clear your cache
    2. Enable Fiddler
    3. Load the page

    You will then get a full list of all requests made by the browser in loading the page.

    To do this without actually watching a browser, you'd need to write a HTML Parser, run the JavaScript in the page, and do all of the other operations that a browser does, so in most cases it makes much more sense to just capture the traffic from a real browser.

    Regards,
    Eric Lawrence
    Telerik
     

    See What's Next in App Development. Register for TelerikNEXT.

     
Back to Top