LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 09-14-2013, 09:24 AM   #1
schneidz
LQ Guru
 
Registered: May 2005
Location: boston, usa
Distribution: fedora-35
Posts: 5,313

Rep: Reputation: 918Reputation: 918Reputation: 918Reputation: 918Reputation: 918Reputation: 918Reputation: 918Reputation: 918
python: xbmc youtube parser


i wrote a youtube video parser for an xbmc addon that i am proud of. here is the relevent code snippit that i would like to share:
Code:
[liveuser@localhost ~]$ python
Python 2.7.5 (default, May 16 2013, 13:44:12) 
[GCC 4.8.0 20130412 (Red Hat 4.8.0-2)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import urllib,urllib2,sys,re#,xbmcplugin,xbmcgui,xbmcaddon,xbmc
>>> #def playvid(url):
>>> html=urllib2.urlopen('http://www.youtube.com/watch?v=0vf0Z_zPN1c').read().replace(",","\\\n")
>>> for line in html.split("\n"):
...      if "itag=22" in line:
...      #print " line = " + line
...        print " line = " + line
...        s2 = line
... 
 line = sig=A5EBC54AE15DE4035A4BB549BFFB67F963CDF9CF.4B7CA8CF0AEA0B1B6210AB470EDB3CF0D2CF81CD\u0026itag=22\u0026type=video%2Fmp4%3B+codecs%3D%22avc1.64001F%2C+mp4a.40.2%22\u0026url=http%3A%2F%2Fr11---sn-ab5e6ner.c.youtube.com%2Fvideoplayback%3Fitag%3D22%26ratebypass%3Dyes%26expire%3D1379189671%26id%3Dd2f7f467fccf3757%26sver%3D3%26fexp%3D906399%252C901480%252C932245%252C910207%252C921076%252C916626%252C924606%252C929117%252C929121%252C929906%252C929907%252C929922%252C929923%252C929127%252C929129%252C929131%252C929930%252C936403%252C925726%252C936310%252C925720%252C925722%252C925718%252C925714%252C929917%252C906945%252C929933%252C920302%252C906842%252C913428%252C920605%252C919811%252C935020%252C935021%252C913563%252C919373%252C930803%252C908536%252C938701%252C931924%252C934005%252C936308%252C909549%252C935006%252C901608%252C900816%252C912711%252C934507%252C912714%252C907231%252C936312%252C906001%26ipbits%3D8%26mt%3D1379166992%26key%3Dyt1%26upn%3DMzz04v0wJvA%26source%3Dyoutube%26sparams%3Dcp%252Cid%252Cip%252Cipbits%252Citag%252Cratebypass%252Csource%252Cupn%252Cexpire%26mv%3Dm%26ms%3Dau%26ip%3D173.167.210.137%26cp%3DU0hWTlFTV19MS0NONl9JTUFHOjc4b3ZoY1JLVnd0\u0026fallback_host=tc.v4.cache1.c.youtube.com\u0026quality=hd720\
>>> s1 = re.search('url=(http.+?)\\\\', s2)
>>> sig = re.search('sig=(.+?)\\\\', s2)
>>> yturl = s1.groups() + sig.groups()
>>> yturl = str(tuple(yturl))
>>> print "\n ----- yturl = " + yturl

 ----- yturl = ('http%3A%2F%2Fr11---sn-ab5e6ner.c.youtube.com%2Fvideoplayback%3Fitag%3D22%26ratebypass%3Dyes%26expire%3D1379189671%26id%3Dd2f7f467fccf3757%26sver%3D3%26fexp%3D906399%252C901480%252C932245%252C910207%252C921076%252C916626%252C924606%252C929117%252C929121%252C929906%252C929907%252C929922%252C929923%252C929127%252C929129%252C929131%252C929930%252C936403%252C925726%252C936310%252C925720%252C925722%252C925718%252C925714%252C929917%252C906945%252C929933%252C920302%252C906842%252C913428%252C920605%252C919811%252C935020%252C935021%252C913563%252C919373%252C930803%252C908536%252C938701%252C931924%252C934005%252C936308%252C909549%252C935006%252C901608%252C900816%252C912711%252C934507%252C912714%252C907231%252C936312%252C906001%26ipbits%3D8%26mt%3D1379166992%26key%3Dyt1%26upn%3DMzz04v0wJvA%26source%3Dyoutube%26sparams%3Dcp%252Cid%252Cip%252Cipbits%252Citag%252Cratebypass%252Csource%252Cupn%252Cexpire%26mv%3Dm%26ms%3Dau%26ip%3D173.167.210.137%26cp%3DU0hWTlFTV19MS0NONl9JTUFHOjc4b3ZoY1JLVnd0', 'A5EBC54AE15DE4035A4BB549BFFB67F963CDF9CF.4B7CA8CF0AEA0B1B6210AB470EDB3CF0D2CF81CD')
>>> yturl = yturl.replace("', '","&signature=")
>>> yturl = yturl.replace("%3A",":")
>>> yturl = yturl.replace("%2F","/")
>>> yturl = yturl.replace("%3F","?")
>>> yturl = yturl.replace("%3D","=")
>>> yturl = yturl.replace("%252C","%2C")
>>> yturl = yturl.replace("%26","&")
>>> yturl = yturl.replace("%253A",":")
>>> yturl = yturl.replace("('","\"")
>>> yturl = yturl.replace("')","\"")
>>> yturl = yturl.replace('"','')
>>> print "\n yturl.replace = " + yturl

 yturl.replace = http://r11---sn-ab5e6ner.c.youtube.com/videoplayback?itag=22&ratebypass=yes&expire=1379189671&id=d2f7f467fccf3757&sver=3&fexp=906399%2C901480%2C932245%2C910207%2C921076%2C916626%2C924606%2C929117%2C929121%2C929906%2C929907%2C929922%2C929923%2C929127%2C929129%2C929131%2C929930%2C936403%2C925726%2C936310%2C925720%2C925722%2C925718%2C925714%2C929917%2C906945%2C929933%2C920302%2C906842%2C913428%2C920605%2C919811%2C935020%2C935021%2C913563%2C919373%2C930803%2C908536%2C938701%2C931924%2C934005%2C936308%2C909549%2C935006%2C901608%2C900816%2C912711%2C934507%2C912714%2C907231%2C936312%2C906001&ipbits=8&mt=1379166992&key=yt1&upn=Mzz04v0wJvA&source=youtube&sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&mv=m&ms=au&ip=173.167.210.137&cp=U0hWTlFTV19MS0NONl9JTUFHOjc4b3ZoY1JLVnd0&signature=A5EBC54AE15DE4035A4BB549BFFB67F963CDF9CF.4B7CA8CF0AEA0B1B6210AB470EDB3CF0D2CF81CD
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Using XBMC 10.0 slackbuild to compile XBMC 11.0 almost works farmerdave Slackware 20 06-11-2012 01:05 PM
LXer: XBMC 10.0 "Dharma" Beta 2 Released, How to Install Latest XBMC Beta in Ubuntu LXer Syndicated Linux News 0 09-15-2010 10:20 PM
lilypond parser for python eantoranz Programming 1 02-04-2010 06:13 PM
Python web page parser snowman81 Programming 5 01-11-2009 07:18 PM
checking for XML::Parser... configure: error: XML::Parser perl module is required for kornerr Linux - General 11 11-16-2008 07:24 AM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 06:29 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration