LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Networking (https://www.linuxquestions.org/questions/linux-networking-3/)
-   -   How to download mp3 file's from a webpage which are hidden or not visible. (https://www.linuxquestions.org/questions/linux-networking-3/how-to-download-mp3-files-from-a-webpage-which-are-hidden-or-not-visible-4175618086/)

rupeshforu3 11-21-2017 11:27 AM

How to download mp3 file's from a webpage which are hidden or not visible.
 
Hi I am Rupesh from India and I visited a web page which consists of 200 + of mp3 files and I want to download all the files automatically not through manual I mean right click on the link and select option save link as.

Previously I have downloaded mp3 files from a web page by first saving it to htm file and then copied all the links containing .mp3 to a text file. After that I have downloaded files using download manager by importing the above text file.

The interesting fact about the current page I want to download is that I saved the page as .htm and opened it in a text editor but unfortunately I found only single line containing .mp3. I have visited that webpage in Firefox browser and clicked on some links then Firefox is playing those files using it's player.

I can definitely say that the current webpage consists of more than 200 mp3 files but I can't find lines containing .mp3 in the webpage which is saved as text file.

The author's of webpage kept these files freely I mean anyone can download at free of cost but with above drawbacks.

I want to download mp3 files from the current webpage only I mean without web spidering.

Previously I have downloaded mp3 or other media files from a similar webpage in Firefox browser using an add-on called download helper but at present it is not working.

I am providing the webpage address and so please try to examine it and suggest a method to download all mp3 files contained in the page. Are there any specific tools for downloading files from such pages.

The link is https://andhra-telugu.com/bhakti/


Regards,
Rupesh.

TB0ne 11-21-2017 11:49 AM

Quote:

Originally Posted by rupeshforu3 (Post 5783468)
Hi I am Rupesh from India and I visited a web page which consists of 200 + of mp3 files and I want to download all the files automatically not through manual I mean right click on the link and select option save link as.

Previously I have downloaded mp3 files from a web page by first saving it to htm file and then copied all the links containing .mp3 to a text file. After that I have downloaded files using download manager by importing the above text file. The interesting fact about the current page I want to download is that I saved the page as .htm and opened it in a text editor but unfortunately I found only single line containing .mp3. I have visited that webpage in Firefox browser and clicked on some links then Firefox is playing those files using it's player.

I can definitely say that the current webpage consists of more than 200 mp3 files but I can't find lines containing .mp3 in the webpage which is saved as text file. The author's of webpage kept these files freely I mean anyone can download at free of cost but with above drawbacks. I want to download mp3 files from the current webpage only I mean without web spidering. Previously I have downloaded mp3 or other media files from a similar webpage in Firefox browser using an add-on called download helper but at present it is not working. I am providing the webpage address and so please try to examine it and suggest a method to download all mp3 files contained in the page. Are there any specific tools for downloading files from such pages.

This is the EXACT same thing you've been asking about for months now:
https://www.linuxquestions.org/quest...te-4175614825/
https://www.linuxquestions.org/quest...es-4175614922/
https://www.linuxquestions.org/quest...ts-4175610839/
https://www.linuxquestions.org/quest...eg-4175605139/
https://www.linuxquestions.org/quest...es-4175615323/

You spend more time asking for handouts and trying to justify your behavior, than you do actually trying to get a solution on your own, or apply ANY of the many, MANY things you've been told/suggested in the past. Once again, you post a thread where you show ZERO effort of your own, show us any scripts, etc., and just want someone here to write a script for you.

Want help? Then post what efforts you have put forth so far.

teckk 11-21-2017 05:14 PM

I was bored so I looked up the first 8 for you. Just so that you can
see that it is possible to retrieve the info you want. Plus you have been
asking for the same thing for months.

http://www.andhra-telugu.com/files/Bhakti/Ganesh/sri Ganastakam.mp3
http://www.andhra-telugu.com/files/gananayakaya.mp3
http://www.andhra-telugu.com/files/2/SriVinayaka PoojaVidhanam.mp3
http://www.andhra-telugu.com/files/B...h/sanganst.mp3
https://www.andhra-telugu.com/files/...Ganesh/Ganesha Bhujanga Sthotram.mp3
http://www.andhra-telugu.com/files/B...Ganesh/Ganesha Ashtakam.mp3
http://www.andhra-telugu.com/files/B...Ganesh/Ganesha Pancharatnam Stotram_MS.mp3
http://www.andhra-telugu.com/files/B...anesh/Ganapati Atharvashirsha - Lata Mangeshkar.mp3

Header check examples:

Sri Ganastakam (Ekadantam)
Code:

agent="Mozilla/5.0 (Windows NT 6.2; WOW_64; rv:56.0) Gecko/20100101 Firefox/56.0"

wget -U "$agent" --spider "http://www.andhra-telugu.com/files/Bhakti/Ganesh/sri Ganastakam.mp3"

Gananayaka…
Code:

curl -A "$agent" -LI http://www.andhra-telugu.com/files/gananayakaya.mp3
Vinayaka chavithi pooja
Code:

HEAD "http://www.andhra-telugu.com/files/2/SriVinayaka PoojaVidhanam.mp3"
Sankatahara Ganesha stotram
Code:

w3m -dump_head http://www.andhra-telugu.com/files/Bhakti/Ganesh/sanganst.mp3

lynx -head -dump ...

A little Python3 script with qt5webkit and PyQt5, or webkit2gtk and
python-gobject, dumping the web page requests to standard out.

You could also use beautiful soup, although it's slow I think.

Then there is phantomjs and nodejs.

You can also follow scripts with a bash and friends script after you find
out what the page is doing. (harder)

You could also follow each one with webkit web inspector,
webengine remote debugging, or firefox firebug etc. (slow)

Now there is some incentive for you to do a little studying.
Good luck. Post back when you have made a little effort to it.

TB0ne 11-22-2017 06:48 AM

Quote:

Originally Posted by teckk (Post 5783603)
I was bored so I looked up the first 8 for you. Just so that you can see that it is possible to retrieve the info you want. Plus you have been asking for the same thing for months.

A little Python3 script with qt5webkit and PyQt5, or webkit2gtk and python-gobject, dumping the web page requests to standard out. You could also use beautiful soup, although it's slow I think. Then there is phantomjs and nodejs. You can also follow scripts with a bash and friends script after you find out what the page is doing. (harder)

You could also follow each one with webkit web inspector, webengine remote debugging, or firefox firebug etc. (slow)

Now there is some incentive for you to do a little studying. Good luck. Post back when you have made a little effort to it.

Teckk, I truly hope this works; but based on the OP's posting history, it will not. For years the OP has posted threads like this, and has flat-out stated they are NOT interested in learning, but want a handout. Everything you said is totally true; this isn't a difficult task, and can be done in several ways. But please, see the OP's posting history.

jeremy 11-22-2017 02:45 PM

rupeshforu3, if you'd like to continue participating here at LQ, please read https://www.linuxquestions.org/quest...#faq_lqwelcome and let me know if you have any questions. Failure to do so may result in your posting privileges being suspended.

--jeremy

rupeshforu3 12-02-2017 09:17 PM

Quote:

Originally Posted by jeremy (Post 5784027)
rupeshforu3, if you'd like to continue participating here at LQ, please read https://www.linuxquestions.org/quest...#faq_lqwelcome and let me know if you have any questions. Failure to do so may result in your posting privileges being suspended.

--jeremy

I have read the link specified by you and I don't have any questions.

Is this a serious warning if it is may I know why you have given such warning.

In Linux forums I have asked why Jeremy has given serious warning then segfault in that forum replied "Must be a case of severe masochism".

May I know what I have done harm to other people in Linux questions. Please specify the words which I posted and harmed them.

taylorkh 12-03-2017 10:31 AM

If you are using Firefox as your web browser, look at the addon "DownloadThemAll!"

Ken

rupeshforu3 12-03-2017 12:02 PM

Quote:

Originally Posted by taylorkh (Post 5788151)
If you are using Firefox as your web browser, look at the addon "DownloadThemAll!"

Ken

yes I have used the addon specified by you and it is unable to detect mp3 files but showing pdf files. I am requesting you to try it and find why its failing.

Someone suggested that those files are created for streaming and so it's not possible to download them and if we want to download we must try using recording software such as VSO recorder. Is it true.

Regards,
Rupesh.

TB0ne 12-03-2017 01:15 PM

Quote:

Originally Posted by rupeshforu3 (Post 5787978)
I have read the link specified by you and I don't have any questions.
Is this a serious warning if it is may I know why you have given such warning.

In Linux forums I have asked why Jeremy has given serious warning then segfault in that forum replied "Must be a case of severe masochism".

May I know what I have done harm to other people in Linux questions. Please specify the words which I posted and harmed them.

?

Rupesh, there are three things you really need to know:
  • It is a serious warning; and you have been told the reasons many times. In short, you refuse to show any effort of your own, and post the same questions over and over. Myself, many others, and other moderators have told you this point-blank dozens of times over the years.
  • Jeremy has nothing to do with Linux Forums (to my knowledge).
  • How you have 'harmed' us is by continuing your bad behavior.
Thread reported.

rupeshforu3 12-03-2017 10:47 PM

I have joined this forum on 2013 and from that time I have created a number of threads and upto 2015 there was positive response from all of you. After that tbone started giving response to my threads worsely.

Actually tbone intention is to fight with me and gather all to fight with me. If I say yes he will say no and if I say no he will say yes. He always reply to me starting with " you are not doing any work and simply ask others how to ".

The above statement is completely false. Suppose take the current thread taylorkh suggested to try downthemall and I have tried it but failed and even I have used a number of tool's like flareget etc., but even no use. I have specified in many ways that I have tried on my own but failed and after that I am requesting help from you.

As tbone want to make all fight with me he tries to deviate the current subject and says rupeshforu3 is worse than worst. He specifies many reasons to hate me. As he deviates the subject and specifies that I am worst no one is going to see what's the actual subject and whether I am working on the current subject or not.

Tbone has given many warnings to me from past two years. Everyone on seeing these warnings try to give even more warnings like " please read the guidelines of the current forum and let me know whether you understood those otherwise you will be banned from this forum " etc.,.

Many people even from other site's are watching tbones replies and warnings and day to day my character is becoming worse in others view.

Tbone has almost succeeded because in many site's on seeing the word rupeshforu3 they're starting with "As many people suggested in Linux questions ...".

As tbone is taking revenge on me I don't what harm I have done to him.

Finally I am requesting all of you not to believe the opinions of tbone about me because all those are to make all of you enemies to me.

I don't know whether he behaves with me only or behave with all the same. I am requesting all others to be careful with him. I think that no one has revealed these types of characters but I done.

Regards,
Rupesh.

TB0ne 12-04-2017 07:34 AM

Quote:

Originally Posted by rupeshforu3 (Post 5788415)
I have joined this forum on 2013 and from that time I have created a number of threads and upto 2015 there was positive response from all of you. After that tbone started giving response to my threads worsely.

Actually tbone intention is to fight with me and gather all to fight with me. If I say yes he will say no and if I say no he will say yes. He always reply to me starting with " you are not doing any work and simply ask others how to ".

The above statement is completely false. Suppose take the current thread taylorkh suggested to try downthemall and I have tried it but failed and even I have used a number of tool's like flareget etc., but even no use. I have specified in many ways that I have tried on my own but failed and after that I am requesting help from you.

As tbone want to make all fight with me he tries to deviate the current subject and says rupeshforu3 is worse than worst. He specifies many reasons to hate me. As he deviates the subject and specifies that I am worst no one is going to see what's the actual subject and whether I am working on the current subject or not.

Tbone has given many warnings to me from past two years. Everyone on seeing these warnings try to give even more warnings like " please read the guidelines of the current forum and let me know whether you understood those otherwise you will be banned from this forum " etc.,.

Many people even from other site's are watching tbones replies and warnings and day to day my character is becoming worse in others view.

Tbone has almost succeeded because in many site's on seeing the word rupeshforu3 they're starting with "As many people suggested in Linux questions ...". As tbone is taking revenge on me I don't what harm I have done to him. Finally I am requesting all of you not to believe the opinions of tbone about me because all those are to make all of you enemies to me. I don't know whether he behaves with me only or behave with all the same. I am requesting all others to be careful with him. I think that no one has revealed these types of characters but I done.

Rupesh, do not try to change the subject here, and somehow make this about me. The plain facts are:
  • You have posted NUMEROUS threads about the same subject
  • You have shown NO EFFORT of your own to resolve your issues
  • When pointed out, you complain that no one helps you.
...which you have JUST DONE here. Do not blame everything on someone else. Not sure what you mean by "warnings", but I am not a moderator so I can't give ANYTHING related to a warning, and believe me if I was a moderator, you'd have been banned a LONG time ago. Your character is becoming worse day by day, because of one thing only: your behavior, and nothing else.

rupeshforu3 12-04-2017 09:56 AM

Quote:

Originally Posted by TB0ne (Post 5788571)
Rupesh, do not try to change the subject here, and somehow make this about me. The plain facts are:
  • You have posted NUMEROUS threads about the same subject
  • You have shown NO EFFORT of your own to resolve your issues
  • When pointed out, you complain that no one helps you.
...which you have JUST DONE here. Do not blame everything on someone else. Not sure what you mean by "warnings", but I am not a moderator so I can't give ANYTHING related to a warning, and believe me if I was a moderator, you'd have been banned a LONG time ago. Your character is becoming worse day by day, because of one thing only: your behavior, and nothing else.

I am not trying to change the subject here but in fact you are trying to deviate the subject always.

You are pointing out that I have created so many threads on the same subject then according to can you point out 10 threads which have same subject.

You are pointing out that I have done no work on my own how can you say that. I want proof for each and every point. Show me proof that I have not done any work.

As you pointed I am not going to complain that others have not helped me because I know the fact how much analysis has to be done in order to reply to any thread. Other people except you studies and analyzes what the author of the current thread has posted and finally gives his suggestion in two to maximum 10 lines that to which are not copied and posted but you are actually doing quite reversely every time. You don't read anything about what others posted but instead you will point upto two to five links.

Please don't try to simply post all the thread's which are created by me. According to you one has to lot of analysis and study on what he want to talk so go and analyse each and every point I have posted in Linux questions and finally point out what's wrong I have done.

Due to the replies I mean warnings given by you many people in internet are discussing that rupeshforu3 is spam, troll etc.,.

Upto now I kept calm but in some other site they have given serious warning that you are spam etc only due to you and another person named habit in Linux forums.

TB0ne 12-04-2017 11:33 AM

Quote:

Originally Posted by rupeshforu3 (Post 5788643)
I am not trying to change the subject here but in fact you are trying to deviate the subject always.

This very reply 'deviates the subject', as you say. You started this thread about "How to download mp3 files...", yet spend a good amount of time complaining about me, rather than actually posting any efforts of your own.
Quote:

You are pointing out that I have created so many threads on the same subject then according to can you point out 10 threads which have same subject. You are pointing out that I have done no work on my own how can you say that. I want proof for each and every point. Show me proof that I have not done any work.
Easily, but they hardly ever get to ten. But we'll start here:
  • Need a script to process thousands of MP3 files. You won't actually work on it and had two moderators even tell you to read the "Question Guidelines", along with several others tell you that no, we wouldn't write your scripts for you: https://www.linuxquestions.org/quest...eg-4175605139/
  • ..which brings us to yet another request for a script. Again, you need to handle thousands of MP3's, showed no effort again: https://www.linuxquestions.org/quest...ts-4175610839/
  • ..and leads us to wanting to again manipulate thousands of MP3 files, again with no effort on your part. This one is particularly entertaining, because it even links to Linux Forums, where you explicitly say you're just going to continue to create threads with different wording, until someone gives you a script: https://www.linuxquestions.org/quest...te-4175614825/
  • ..taking us to here; again, thousands of MP3 files, no script/effort of your own: https://www.linuxquestions.org/quest...es-4175614922/
  • ..and the 'wording change' you threatened happened. I'm sure it's a total coincidence that the file names are .opus instead of .mp3? With a link to numerous other forums where you've done this, including one on the openSUSE forums where you flat-out said you are not interested in doing research in any subject: https://www.linuxquestions.org/quest...es-4175615323/
  • Leading us here.
And no, we don't believe these are all about different things. They are FAR too similar, especially given the fact that you, yourself, said you were just going to change wording until someone gave you a script.
Quote:

As you pointed I am not going to complain that others have not helped me because I know the fact how much analysis has to be done in order to reply to any thread. Other people except you studies and analyzes what the author of the current thread has posted and finally gives his suggestion in two to maximum 10 lines that to which are not copied and posted but you are actually doing quite reversely every time. You don't read anything about what others posted but instead you will point upto two to five links.

Please don't try to simply post all the thread's which are created by me. According to you one has to lot of analysis and study on what he want to talk so go and analyse each and every point I have posted in Linux questions and finally point out what's wrong I have done. Due to the replies I mean warnings given by you many people in internet are discussing that rupeshforu3 is spam, troll etc.,. Upto now I kept calm but in some other site they have given serious warning that you are spam etc only due to you and another person named habit in Linux forums.
No idea what happens anywhere else except for what you post about. But everywhere else I've looked many, MANY others have said all these same things...but in your estimation they're all wrong and/or only say this because of ME? Really?

You need to take responsibility for your own actions. As you have been told many times, post YOUR EFFORTS and we will all (myself included) be happy to assist you.

jeremy 12-04-2017 11:59 AM

All subsequent posts in the thread need to be on-topic. The sidebar has gone on for far too long (long time members should really know better).

--jeremy

rupeshforu3 12-04-2017 08:50 PM

Quote:

Originally Posted by TB0ne (Post 5788700)
This very reply 'deviates the subject', as you say. You started this thread about "How to download mp3 files...", yet spend a good amount of time complaining about me, rather than actually posting any efforts of your own.

Easily, but they hardly ever get to ten. But we'll start here:
  • Need a script to process thousands of MP3 files. You won't actually work on it and had two moderators even tell you to read the "Question Guidelines", along with several others tell you that no, we wouldn't write your scripts for you: https://www.linuxquestions.org/quest...eg-4175605139/
  • ..which brings us to yet another request for a script. Again, you need to handle thousands of MP3's, showed no effort again: https://www.linuxquestions.org/quest...ts-4175610839/
  • ..and leads us to wanting to again manipulate thousands of MP3 files, again with no effort on your part. This one is particularly entertaining, because it even links to Linux Forums, where you explicitly say you're just going to continue to create threads with different wording, until someone gives you a script: https://www.linuxquestions.org/quest...te-4175614825/
  • ..taking us to here; again, thousands of MP3 files, no script/effort of your own: https://www.linuxquestions.org/quest...es-4175614922/
  • ..and the 'wording change' you threatened happened. I'm sure it's a total coincidence that the file names are .opus instead of .mp3? With a link to numerous other forums where you've done this, including one on the openSUSE forums where you flat-out said you are not interested in doing research in any subject: https://www.linuxquestions.org/quest...es-4175615323/
  • Leading us here.
And no, we don't believe these are all about different things. They are FAR too similar, especially given the fact that you, yourself, said you were just going to change wording until someone gave you a script.

No idea what happens anywhere else except for what you post about. But everywhere else I've looked many, MANY others have said all these same things...but in your estimation they're all wrong and/or only say this because of ME? Really?

You need to take responsibility for your own actions. As you have been told many times, post YOUR EFFORTS and we will all (myself included) be happy to assist you.

The subject of all the links specified by you is not same but small relationship exists. For example I have created the thread with title "how to create files with sub directories". I can post the contents of that thread in the previous thread created by me but if I create a thread with specific title it will grab the attention of a number of people and they may give proper reply.

Downloading files from internet is totally different subject than compressing mp3 files using ffmpeg.

According to you what ever I want to post I must do in a single thread but it is not smart and if you think it is reasonable then I will try to do so.


All times are GMT -5. The time now is 03:24 AM.