Archive for gymmultimedia.myfastforum.org Gymnastics Videos to share
 

The free forums are now under new ownership, a full announcement will be made shortly

       gymmultimedia.myfastforum.org Forum Index -> NCAA Competition 2017
CGA

a brief tutorial on getting e$pn streams

This is for anyone interested in getting them themselves this season and not overburdening NastiaFan or Adela or anybody else w/ requests. This is good to know, bc ESPN is horrible at archiving their vids - as in, they don't. After a week or a month or two, you start getting error messages. The vids are just not there. So if you see one you want...

Ok, so, this assumes some knowledge of stuff.

1. Download IDM and install it in Chrome or Firefox or whichever you use. IDM is a 30 day free trial. After that, there's registry stuff you can do to keep it indefinitely but that's a tutorial for another day.

2. Play your ESPN video. It'll show up in the pop up box and eventually start playing. Before it quite does, the IDM tag will show up - choose the highest quality IDM download option for the vid and download it - it'll be 720p. When the vid starts, pause it a few seconds in.

3. IDM will refuse to download the .TS file you chose, out of cowardice. They'll give you an error message explaining that the file is copy protected so they are morally prohibited from downloading it. This will be discouraging, but IDM still shows you the way to the file. Click on the chosen file/project in the list on IDM. You'll get a box for the download/file called 'File Properties'. In that, there's a section called "address" and you'll find - the URL of the video. Its real URL, complete with permissions. This is very tricky to find normally, but IDM just hands it to you.

4. Did I mention you have to have FFMPEG installed? Cause you do. Like I said, this isn't for people who don't normally do this stuff or try this stuff. This is for people who have FFMPEG installed and know what IDM is.

5. In the command prompt, go like so:

ffmpeg -i “entire long url from IDM, going well past the m3u8 and including all the permissions” -map 0:0 -map 0:1 -c copy -bsf:a aac_adtstoasc “FILENAMEofyourchoice.mp4”


Hope that helps somebody. Thanks to the guy on here last year who helped me figure ESPN out, that info still holds with a couple minor tweaks (switching the m3u8 from g to i now seems to screw everything up).


edited to add
Assuming that all works and you get that far, ignore any weird error messages involving DTS or timestamps during the download via ffmpeg. As long as it keeps moving forward, it'll eventually right itself and your video at the end will be fine. If you get an error message at the beginning and nothing moves forward and it's over and out, that's different and something went wrong.
FootGurlie

The highest quality m3u8 stream on the ESPN site is "J" or "K".
Both seem to work with using livestreamer.

getting the "g" stream is a lower quality.
You can now get the 720p stream (or even 1080p, if they have it) from ESPN.
JoeBob

Actually i is the highest quality.  Will be 1152x648.  The first commercial will be lower quality.  VLC plays back the best.  Some players crash if you try to fast forward (MPC-HC).  MPC-BE also works great.
CGA

I downloaded videos last night using g and they were 720p. Which makes sense since the stream I tried to d/l with IDM was the 720 stream, meaning that's the address they'd give me.

No idea on the i, j, k stuff other than trying to use 'i' last night screwed up the download. But yea g was shooting out the 720 stream. So. Who knows.


edited to add
After checking, 2 of the vids are 610p, another is 720p. All were gotten using the g address. So the 720p is inexplicable, but it's there, I just checked. I'll retry the other two using the other letters, starting at k - is that 1080?
CGA

csportslive tutorial:

Try to download with IDM. This used to just work, but it no longer is for me. Now it throws up a failed message. Check the file info on IDM same as with the ESPN thing. They'll give you the m3u8 address. Change the "/z/" to "/i/", and delete the last bit past the final /, replacing it with "master.m3u8." Use this address in http://osmfhls.kutu.ru, and you can now download it from there in the highest available quality with IDM, albeit as a .TS file.
illyria

My cable subscription log in gave me access to the Florida vs NC State meet, which is from the ACC Network. I downloaded it in 720p using the Firefox extension video downloadhelper (https://addons.mozilla.org/en-US/firefox/addon/video-downloadhelper/) and it worked.

I can't get access to any of the SEC replays or streams though because it says it isn't included in my cable package. I don't know if the extension would work on those videos too.
CGA

Woah if there's a Firefox extension that can just take them down that's way easier. Thanks for the heads up. I didn't think the big browsers had extensions that could catch RTMP/HLS streams etc.

Your post brings up a point I forgot, which is you have to have a way in with your cable log in to begin with. The real mystery is how the hell NastiaFan got that ALA/OK meet, which as far as I can tell, is premium content on Oklahoma's site. My guess is he (she?) has one of those set-ups to stream TV thru the computer and just got a streaming TV broadcast. Clever if so.
JoeBob

I captured it in ~ 720p @ 60fps off my TV service.  NF already posted it so I didn't bother.
NastiaFan101

JoeBob wrote:
I captured it in ~ 720p @ 60fps off my TV service.  NF already posted it so I didn't bother.


Is yours true HD? If so, please upload it. All of my OU vids are from the SD channel but cropped and upscaled.
JoeBob

NastiaFan101 wrote:
JoeBob wrote:
I captured it in ~ 720p @ 60fps off my TV service.  NF already posted it so I didn't bother.


Is yours true HD? If so, please upload it. All of my OU vids are from the SD channel but cropped and upscaled.


I think it is but I'll let you make that decision.  Once it's uploaded I'll send a link but looks like it'll be tomorrow.
boguinskaia

Thanks for this - Adela Dazeem here. I'm currently travelling abroad in Tokyo with only a tiny notebook laptop and won't be able to capture anything myself until I'm back Sad I'm grateful for everyone's efforts to keep me in the loop this season!
CGA

Final tutorial (everything else is pretty self-explanatory, IDM just eats up every other site's stuff no problem) - BTN as of last season was just working straight up with youtube-dl, as I recall. I don't remember if there was a little trick to it or not, as far as the URL - ie, don't remember if you could just paste the browser URL and youtube-dl would find the source from it, or if you had to give them a source URL. But i'll revisit when/if they start posting free vids again this year. Also, haven't checked in a bit, but in a positive development, all of last year's BTN vids remained on the site even after this school year began. Would be a welcome change, their habit of just deleting everything every year is a crime.
JoeBob

JoeBob wrote:

I think it is but I'll let you make that decision.  Once it's uploaded I'll send a link but looks like it'll be tomorrow.


Here ya go.  I did run this trough handbrake and no longer have original.  Do this with everything I capture.   https://mega.nz/#!UsAz2B4J!dacD3JvG_rNpulcucwFPIwugUPFoPHRYhIJXoBGtx9U

Code:

General
Format                         : MPEG-4
Format profile                 : Base Media / Version 2
Codec ID                       : mp42 (isom/iso2/avc1/mp41)
File size                      : 4.15 GiB
Duration                       : 1 h 26 min
Overall bit rate mode          : Variable
Overall bit rate               : 6 841 kb/s
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Writing application            : HandBrake 1.0.0 2016122400

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L3.2
Format settings, CABAC         : Yes
Format settings, ReFrames      : 5 frames
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 1 h 26 min
Bit rate                       : 6 759 kb/s
Width                          : 1 280 pixels
Height                         : 704 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Variable
Frame rate                     : 59.940 (60000/1001) FPS
Minimum frame rate             : 59.920 FPS
Maximum frame rate             : 59.960 FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.125
Stream size                    : 4.10 GiB (99%)
Writing library                : x264 core 148 r2708 86b7198
Encoding settings              : cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=8 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=12 / lookahead_threads=2 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=600 / keyint_min=60 / scenecut=40 / intra_refresh=0 / rc_lookahead=50 / rc=crf / mbtree=1 / crf=20.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Color range                    : Limited
Color primaries                : BT.709
Transfer characteristics       : BT.709
Matrix coefficients            : BT.709

Audio
ID                             : 2
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 h 26 min
Bit rate mode                  : Variable
Bit rate                       : 64.2 kb/s
Channel(s)                     : 2 channels
Channel(s)_Original            : 1 channel
Channel positions              : Front: C
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 spf)
Compression mode               : Lossy
Stream size                    : 39.9 MiB (1%)
Title                          : Mono / Mono
Default                        : Yes
Alternate group                : 1
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
NastiaFan101

JoeBob wrote:
JoeBob wrote:

I think it is but I'll let you make that decision.  Once it's uploaded I'll send a link but looks like it'll be tomorrow.


Here ya go.  I did run this trough handbrake and no longer have original.  Do this with everything I capture.   https://mega.nz/#!UsAz2B4J!dacD3JvG_rNpulcucwFPIwugUPFoPHRYhIJXoBGtx9U

Code:

General
Format                         : MPEG-4
Format profile                 : Base Media / Version 2
Codec ID                       : mp42 (isom/iso2/avc1/mp41)
File size                      : 4.15 GiB
Duration                       : 1 h 26 min
Overall bit rate mode          : Variable
Overall bit rate               : 6 841 kb/s
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Writing application            : HandBrake 1.0.0 2016122400

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L3.2
Format settings, CABAC         : Yes
Format settings, ReFrames      : 5 frames
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 1 h 26 min
Bit rate                       : 6 759 kb/s
Width                          : 1 280 pixels
Height                         : 704 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Variable
Frame rate                     : 59.940 (60000/1001) FPS
Minimum frame rate             : 59.920 FPS
Maximum frame rate             : 59.960 FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.125
Stream size                    : 4.10 GiB (99%)
Writing library                : x264 core 148 r2708 86b7198
Encoding settings              : cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=8 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=12 / lookahead_threads=2 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=600 / keyint_min=60 / scenecut=40 / intra_refresh=0 / rc_lookahead=50 / rc=crf / mbtree=1 / crf=20.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Color range                    : Limited
Color primaries                : BT.709
Transfer characteristics       : BT.709
Matrix coefficients            : BT.709

Audio
ID                             : 2
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 h 26 min
Bit rate mode                  : Variable
Bit rate                       : 64.2 kb/s
Channel(s)                     : 2 channels
Channel(s)_Original            : 1 channel
Channel positions              : Front: C
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 spf)
Compression mode               : Lossy
Stream size                    : 39.9 MiB (1%)
Title                          : Mono / Mono
Default                        : Yes
Alternate group                : 1
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43


This is true HD, way better than my copy!
Thor was here

JoeBob wrote:
JoeBob wrote:

I think it is but I'll let you make that decision.  Once it's uploaded I'll send a link but looks like it'll be tomorrow.


Here ya go.  I did run this trough handbrake and no longer have original.  Do this with everything I capture.   https://mega.nz/#!UsAz2B4J!dacD3JvG_rNpulcucwFPIwugUPFoPHRYhIJXoBGtx9U

Code:

General
Format                         : MPEG-4
Format profile                 : Base Media / Version 2
Codec ID                       : mp42 (isom/iso2/avc1/mp41)
File size                      : 4.15 GiB
Duration                       : 1 h 26 min
Overall bit rate mode          : Variable
Overall bit rate               : 6 841 kb/s
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Writing application            : HandBrake 1.0.0 2016122400

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L3.2
Format settings, CABAC         : Yes
Format settings, ReFrames      : 5 frames
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 1 h 26 min
Bit rate                       : 6 759 kb/s
Width                          : 1 280 pixels
Height                         : 704 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Variable
Frame rate                     : 59.940 (60000/1001) FPS
Minimum frame rate             : 59.920 FPS
Maximum frame rate             : 59.960 FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.125
Stream size                    : 4.10 GiB (99%)
Writing library                : x264 core 148 r2708 86b7198
Encoding settings              : cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=8 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=12 / lookahead_threads=2 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=600 / keyint_min=60 / scenecut=40 / intra_refresh=0 / rc_lookahead=50 / rc=crf / mbtree=1 / crf=20.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Color range                    : Limited
Color primaries                : BT.709
Transfer characteristics       : BT.709
Matrix coefficients            : BT.709

Audio
ID                             : 2
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 h 26 min
Bit rate mode                  : Variable
Bit rate                       : 64.2 kb/s
Channel(s)                     : 2 channels
Channel(s)_Original            : 1 channel
Channel positions              : Front: C
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 spf)
Compression mode               : Lossy
Stream size                    : 39.9 MiB (1%)
Title                          : Mono / Mono
Default                        : Yes
Alternate group                : 1
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43


this is awesome, thanks!
GymFanatic

JoeBob wrote:
JoeBob wrote:

I think it is but I'll let you make that decision.  Once it's uploaded I'll send a link but looks like it'll be tomorrow.


Here ya go.  I did run this trough handbrake and no longer have original.  Do this with everything I capture.   https://mega.nz/#!UsAz2B4J!dacD3JvG_rNpulcucwFPIwugUPFoPHRYhIJXoBGtx9U

Code:

General
Format                         : MPEG-4
Format profile                 : Base Media / Version 2
Codec ID                       : mp42 (isom/iso2/avc1/mp41)
File size                      : 4.15 GiB
Duration                       : 1 h 26 min
Overall bit rate mode          : Variable
Overall bit rate               : 6 841 kb/s
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Writing application            : HandBrake 1.0.0 2016122400

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L3.2
Format settings, CABAC         : Yes
Format settings, ReFrames      : 5 frames
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 1 h 26 min
Bit rate                       : 6 759 kb/s
Width                          : 1 280 pixels
Height                         : 704 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Variable
Frame rate                     : 59.940 (60000/1001) FPS
Minimum frame rate             : 59.920 FPS
Maximum frame rate             : 59.960 FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.125
Stream size                    : 4.10 GiB (99%)
Writing library                : x264 core 148 r2708 86b7198
Encoding settings              : cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=8 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=12 / lookahead_threads=2 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=600 / keyint_min=60 / scenecut=40 / intra_refresh=0 / rc_lookahead=50 / rc=crf / mbtree=1 / crf=20.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43
Color range                    : Limited
Color primaries                : BT.709
Transfer characteristics       : BT.709
Matrix coefficients            : BT.709

Audio
ID                             : 2
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 h 26 min
Bit rate mode                  : Variable
Bit rate                       : 64.2 kb/s
Channel(s)                     : 2 channels
Channel(s)_Original            : 1 channel
Channel positions              : Front: C
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 spf)
Compression mode               : Lossy
Stream size                    : 39.9 MiB (1%)
Title                          : Mono / Mono
Default                        : Yes
Alternate group                : 1
Encoded date                   : UTC 2017-01-07 20:59:43
Tagged date                    : UTC 2017-01-07 20:59:43

Looks great! Keep it up!
RockTheGym

CGA wrote:
Final tutorial (everything else is pretty self-explanatory, IDM just eats up every other site's stuff no problem) - BTN as of last season was just working straight up with youtube-dl, as I recall. I don't remember if there was a little trick to it or not, as far as the URL - ie, don't remember if you could just paste the browser URL and youtube-dl would find the source from it, or if you had to give them a source URL. But i'll revisit when/if they start posting free vids again this year. Also, haven't checked in a bit, but in a positive development, all of last year's BTN vids remained on the site even after this school year began. Would be a welcome change, their habit of just deleting everything every year is a crime.


I've tried to download BTN meets with Youtube-dl but have not been able to get it to work. Nothing else seems to work either... I've resorted to screen capping which generates enormous files. Sad
6CA7

Working on soaking everything in here. So after reading through this thread a few times and downloading IDM I tried downloading a small video to start with (2m 40sec) and IDM produced 37 .ts files. I downloaded a few other of the programs mentioned here as well.

I am able to open the first .ts file in VLC and it looks sharp. Do I still need to combine all of those .ts files into one?
vinace

IDM should combine all the files together for you as long as everything is working properly.
6CA7

Ok,Thank you - I'll revisit it. Maybe there is something in IDM I have not setup right...or it's user error  Very Happy
CGA

BTN is really, really easy with youtube-dl. You get the address from your cache (it'll have mp4 in it somewhere), you cut off the very last bit, then after mp4 you add .m3u8. you plug this mp4.m3u8 address into youtube-dl and use the number 0 for the download. i think 3000 is the best quality on there so change that if need be.
CGA

Also, an update on this now that I'm a bit more informed on it. As stated, k is the top quality download. Not g. All the rest is correct, ffmpeg and IDM handle this beautifully, EXCEPT the odd time when the url has "multiple" in it - then FFMPEG errors itself into oblivion and you often don't get the full download, even if it's listed at full size. Haven't solved that yet.
RockTheGym

Thanks so much for the advice on the BTN streams. They have stumped me for 2 years!

Would you happen to have an example of the address that you're referring to? I'm not sure I'm finding it.
RockTheGym

Actually, I'm also not really sure what you mean by use the number 0 for the download...

Thanks again for your posting this solution!

       gymmultimedia.myfastforum.org Forum Index -> NCAA Competition 2017
Page 1 of 1
Create your own free forum | Buy a domain to use with your forum