LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 10-07-2015, 02:43 PM   #1
metallica1973
Senior Member
 
Registered: Feb 2003
Location: Washington D.C
Posts: 2,190

Rep: Reputation: 60
Popular Plugins && SVN


Forgive me if this question is rather stupid but I am writing some code using Python for a project at work and was wondering if there was a way to download the entire "Popular" plugins directory in a single shot? I currently have to to look at 34 pages:

https://wordpress.org/plugins/browse/popular/
https://wordpress.org/plugins/browse/popular/2
...

and parse data that way but is really inefficient. I see that I can check stuff out via svn

https://wordpress.org/plugins/about/svn/

and I can see all the plugins as a whole via:

https://plugins.svn.wordpress.org/

But is there a better way that I can accomplish my goal?

Thank you in advance!
 
Old 10-08-2015, 08:43 AM   #2
HMW
Member
 
Registered: Aug 2013
Location: Sweden
Distribution: Debian, Arch, Red Hat, CentOS
Posts: 773
Blog Entries: 3

Rep: Reputation: 369Reputation: 369Reputation: 369Reputation: 369
Hi there!

You don't really say what it is you want to do. But handling urls in Python is fairly straight forward with requests:
http://docs.python-requests.org/en/l...make-a-request

Best regards,
HMW
 
Old 10-08-2015, 09:02 AM   #3
metallica1973
Senior Member
 
Registered: Feb 2003
Location: Washington D.C
Posts: 2,190

Original Poster
Rep: Reputation: 60
Thank you for the reply. I guess I should clarify what I am asking. I have already written my python code to scrape what I need from the plugins sites and works great but at my job they think that its inefficient to send many HTTP GET requests to the site and would prefer that I obtain all the plugin information another way, then simply searching through the results, parse the data that I need. So I can download all the plugins via SVN:

svn co https://plugins.svn.wordpress.org/

but I would prefer to just download plugins that are considered popular like what you see from the url:

https://wordpress.org/plugins/browse/popular/
etc...

Can I do an svn check of just the popular directory? Ex.

svn co https://popular.plugins.svn.wordpress.org

I know the about url doesnt exist but if it does what is it?

Thank you in advance!

Last edited by metallica1973; 10-08-2015 at 10:22 AM.
 
Old 10-08-2015, 09:21 AM   #4
grail
LQ Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 10,008

Rep: Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193Reputation: 3193
Could you not use the list option for svn? I am not overly familiar with the command but might be worth a look.
 
1 members found this post helpful.
Old 10-08-2015, 11:09 AM   #5
Habitual
LQ Veteran
 
Registered: Jan 2011
Location: Abingdon, VA
Distribution: Catalina
Posts: 9,374
Blog Entries: 37

Rep: Reputation: Disabled
If you could just parse the plugin names you are interested in, you could manipulate that into
Code:
svn co https://plugins.svn.wordpress.org/your-plugin-name my-local-dir
Have you read https://wordpress.org/plugins/about/svn/ ?
 
1 members found this post helpful.
Old 10-08-2015, 12:11 PM   #6
metallica1973
Senior Member
 
Registered: Feb 2003
Location: Washington D.C
Posts: 2,190

Original Poster
Rep: Reputation: 60
Many thank you's,

the list option is helpful which is essentially the same as clicking the url(grail) I didnt see any popular directory of the sort or maybe I missed it. Habitual suggestion is also helpful but ultimately after I did the math would require 1000(total popular plugins) svn co requests in the initial beginning and looking for diffs therefor-after which inst as efficient as just scraping the 34 popular plugin sites for this project. The holy grail of where the popular plugins reside would be best.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: RDO Kilo Set up for three F22 VM Nodes Controller&Network&Compute (ML2&OVS&VXLAN) LXer Syndicated Linux News 0 05-31-2015 07:22 AM
AOL UK && BT Voyager 100 && Slackware 10.2 && RP-PPPoE pitt0071 Linux - Networking 3 01-17-2006 06:10 AM
KDevelop & CVS/SVN Plugins G.Bloke Mandriva 1 07-12-2005 03:35 PM
Japanese canna won't work : Warning: かな漢字変&am OrganicOrange84 Debian 3 06-30-2005 02:28 PM
Phục hồi dữ liệu bị mất???, cứ pollsite General 1 06-27-2005 12:39 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 07:04 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration