This is a migrated thread and some comments may be shown as answers.

Fiddler and FiddlerCore missing specific HTTP traffic

13 Answers 726 Views

Windows

This is a migrated thread and some comments may be shown as answers.

Anthony asked on 12 Jan 2015, 09:48 PM

Hello, I'm having an issue where Fiddler and FiddlerCore are missing specific HTTP traffic.

I'm using both to determine where video players keep their video files by tracing the HTTP requests and issue takedowns on those locations. Problem is starting from at least last week, I am not seeing the requests/responses for these video files from a single website that I was once able to see in Fiddler or using FiddlerCore in my C# applications. I am seeing all other HTTP traffic, I have no filters on, and the missing requests are not HTTPS.

An example URL is: http://megashare.im/watch-bhaag-milkha-bhaag-2013-online-free-megashare.html

The video player on this page will make a HTTP request once clicked:

GET /sec/QG3_yEC-vQTki3g6EJ14cw/1421136000/hls-vod-s3/flv/api/files/videos/2014/08/13/140787548142f4e.mp4.m3u8?socke.ts= HTTP/1.1\r\n

Both Fiddler and FiddlerCore do not capture this request or its response. I was able to get the missing request by using WireShark:

01.Hypertext Transfer Protocol

02.

Expert Info (Chat/Sequence): GET /sec/QG3_yEC-vQTki3g6EJ14cw/1421136000/hls-vod-s3/flv/api/files/videos/2014/08/13/140787548142f4e.mp4.m3u8?socke.ts= HTTP/1.1\r\n

03.

GET /sec/QG3_yEC-vQTki3g6EJ14cw/1421136000/hls-vod-s3/flv/api/files/videos/2014/08/13/140787548142f4e.mp4.m3u8?socke.ts= HTTP/1.1\r\n

04. Severity level: Chat

05. Group: Sequence

06. Request Method: GET

07.

Request URI: /sec/QG3_yEC-vQTki3g6EJ14cw/1421136000/hls-vod-s3/flv/api/files/videos/2014/08/13/140787548142f4e.mp4.m3u8?socke.ts=

08. Request Version: HTTP/1.1

09. Host: c3.vkcache.com\r\n

10. Connection: close\r\n

11.

12.

Full request URI: http://c3.vkcache.com/sec/QG3_yEC-vQTki3g6EJ14cw/1421136000/hls-vod-s3/flv/api/files/videos/2014/08/13/140787548142f4e.mp4.m3u8?socke.ts=

13. HTTP request 1/1

I have noticed that when navigating to the example URL the Fiddler GUI logs many errors in this format:

1.11:15:33:3909 [Fiddler] No HTTP request was received from (chrome:5372) new client socket, port 61461.

2.11:15:33:3909 [Fiddler] No HTTP request was received from (chrome:5372) new client socket, port 61462.

And FiddlerCore is also returning errors when I'm attempting to parse the Sessions when navigating to the example URL using Selenium in my C# application:

1.The client failed to send a complete request before the timeout period elapsed.

I'm not exactly sure why Fiddler isn't able to fully capture these video source URLs, but any help would be appreciated.

Thanks,
Anthony

13 Answers, 1 is accepted

answered on 13 Jan 2015, 03:47 PM

Unfortunately, our overzealous corporate firewall blocks access to the target site, so I can't see it from here. There are three possibilities:

1> The target video is already in your cache, so it's not being downloaded again.
2> The target video is playing back through some other application which doesn't (by default) respect the system's proxy settings and thus it must be manually configured to do so.
3> The target video is actually downloading over some other protocol (Flash has a way to stream video directly on TCP/IP) and thus it doesn't run through a proxy.

Based on the description alone, #1 or #2 seem most likely.

Regards,
Eric Lawrence
Telerik

Check out the Telerik Platform - the only platform that combines a rich set of UI tools with powerful cloud services to develop web, hybrid and native mobile apps.