LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices

Reply
 
LinkBack Search this Thread
Old 12-21-2006, 09:54 PM   #1
corbintechboy
Member
 
Registered: Sep 2003
Location: Kentucky
Posts: 480
Blog Entries: 1

Rep: Reputation: 51
Brainstorm


Hello,

I was sitting here while downloading programs on a PcLinux system. At current with the 70kbs download it's gonna take 1.5 hours. I came up with an idea while sitting here that if I knew howto program I would release a linux distro and use my idea. Now the idea:

Why not have when you install and option to donate like 2kbs upload to help the community? Like you get 5000 users of this distro who are interested in this, thats 10,000kbs upload speed to help the main servers. This could be something like torrents(?) but updates. I don't really know how it would work because I don't know howto program. The people I told about this thought it would be great.

I see alot of people coming on here looking for a project, here's one.

Last edited by corbintechboy; 12-21-2006 at 09:56 PM.
 
Old 12-21-2006, 10:36 PM   #2
indienick
Senior Member
 
Registered: Dec 2005
Location: London, ON, Canada
Distribution: Arch, Ubuntu, Slackware, OpenBSD, FreeBSD
Posts: 1,853

Rep: Reputation: 65
I've gotta say, I really like this idea, too!
It's almost identical to a P2P network (like torrents, Limewire, KaZaA, etc.), but the only things that would be a cause for concern, is that getting the distro widely distributed enough to make the update sharing worthwhile is a pro-bono marketing task on its own.

Aside from that, it's still an amazing idea.

EDIT: Instead of creating an entirely new distro, why not assemble a small programmers group, and see if you can present an alpha-version of a product to present to an already widely-distributed distro (or several).
 
Old 12-21-2006, 11:15 PM   #3
tuxdev
Senior Member
 
Registered: Jul 2005
Distribution: Slackware
Posts: 2,008

Rep: Reputation: 110Reputation: 110
I'm not sure what you mean, but it sounds exactly like BitTorrent to me.
 
Old 12-21-2006, 11:53 PM   #4
corbintechboy
Member
 
Registered: Sep 2003
Location: Kentucky
Posts: 480
Blog Entries: 1

Original Poster
Rep: Reputation: 51
Quote:
Originally Posted by tuxdev
I'm not sure what you mean, but it sounds exactly like BitTorrent to me.

Might work like that don't really know. This idea is for updates. Like lets use debian for example. You do an apt-get install ???, apt looks at the server site for references to people who have ??? file. site says these people at this ip have it, apt turnes around and downloades the file via what the debian tells it. The server does help with the download but the end-users that help contribute do as well. Kinda got a philosophy like bittorent but not really. This would be done for updates and software installs. This would make end-users seeders in a sorts for the updates. Like I said 2kb is a small amount to donate and would give great amounts of upload speeds the server never could give.

I'll put it in perspective:

You install this GNU/Linux. I am also interested in this distro so I download the .iso. After I install the distro I decide to update all the software.So I plug in the command to update. My machine contacts update server and server reports you have the updates I require, so my machine recieves the info needed to locate you and download from you and the server at the same time. Now put this in bigger perspective server has 5000 people who have the files I need but the server is swamped today because this distro just announced a whole bunch of security updates. So this server can serve me up a whooping 35kbs of download rate. My idea would also use the 2kbs the 5000 people are sharing to get the files I need easly increasing my download rates to max my isp can handle. Like I said thats 10,000kbs upload rate! Thats a very awsome number and would greatly reduce stress on servers.
 
Old 12-22-2006, 12:09 AM   #5
IBall
Senior Member
 
Registered: Nov 2003
Location: Perth, Western Australia
Distribution: Ubuntu, Debian, Various using VMWare
Posts: 2,088

Rep: Reputation: 61
It does sound like bittorrent, but as far as I know Bittorrent is only used at the moment for distributing ISOs and illegal movies.

I like the idea of bittorent being used somehow for downloading updates. Basically, once you have installed the updates then you can start sharing the updated packages. Instead of sources.list (for Debian) pointing to an official mirror, it could point to a torrent tracker, that tells the package manager what updates are required and which torrent to get them from. (something like this anyway)

--Ian
 
Old 12-22-2006, 03:32 AM   #6
raskin
Senior Member
 
Registered: Sep 2005
Location: Russia
Distribution: NixOS (http://nixos.org)
Posts: 1,893

Rep: Reputation: 68
Bittorrent is not as good for updates as donkey - there is built-in search in Donkey and no need to explicitly think about everything - just put to sharde dir. BT is for ISO's. You've got me on your side - I've shared my distributed-in-source folder..
 
Old 12-22-2006, 04:07 PM   #7
raskin
Senior Member
 
Registered: Sep 2005
Location: Russia
Distribution: NixOS (http://nixos.org)
Posts: 1,893

Rep: Reputation: 68
Wow, someone even downloaded bzip2, and grub has 142% upratio. A bit strange - I don't understand 1 request and >100% UpRatio, but nevertheless the idea is viable here and now. Everybody using any P2P, share all fresh packages you have!
 
Old 12-23-2006, 04:27 AM   #8
Ynot Irucrem
Member
 
Registered: Apr 2005
Location: Perth, Western Australia
Distribution: Debian
Posts: 233

Rep: Reputation: 30
I think it sounds cool, and I reckon the thread title would be a kickass name for it, too.
 
Old 12-23-2006, 10:06 AM   #9
indienick
Senior Member
 
Registered: Dec 2005
Location: London, ON, Canada
Distribution: Arch, Ubuntu, Slackware, OpenBSD, FreeBSD
Posts: 1,853

Rep: Reputation: 65
Ynot Irucrem:
I completely agree.
 
Old 12-23-2006, 10:31 AM   #10
Ha1f
Member
 
Registered: Jun 2005
Location: University of Maryland
Distribution: FreeBSD
Posts: 268

Rep: Reputation: 30
i get the whole 'sounds like bittorrent' thing, but i dont get whether or not you want a package manager that uses means similar to bittorrent to download files, or if you just want a stand alone client that downloads things, a la bittorrent...?

btw: if youre aiming towards the bittorrenty package manager, libtorrent is a good place to start (to anyone looking at this as a project). if i was working on my own package manager, i'd definately take this idea on...

Last edited by Ha1f; 12-23-2006 at 10:32 AM.
 
Old 12-23-2006, 10:50 AM   #11
f76
LQ Newbie
 
Registered: Jul 2004
Location: Sweden
Distribution: Ubuntu Breezy
Posts: 20

Rep: Reputation: 0
My newbie 2 cents:

Bittorrent is only fast when you have a lot of piers, right? And perhaps not that fast when u get to small files. Maybe u need an update manager/package manager that will try ftp if bittorent is to slow. Or another distributed p2p that works with small files? Then u need some kind of checksum check for each file? right? maybe u can get these of the main repositry. Maybe u can use Par2 that also can repair files.
 
Old 12-23-2006, 10:57 AM   #12
Ha1f
Member
 
Registered: Jun 2005
Location: University of Maryland
Distribution: FreeBSD
Posts: 268

Rep: Reputation: 30
Quote:
Originally Posted by f76
My newbie 2 cents:

Bittorrent is only fast when you have a lot of piers, right? And perhaps not that fast when u get to small files. Maybe u need an update manager/package manager that will try ftp if bittorent is to slow. Or another distributed p2p that works with small files? Then u need some kind of checksum check for each file? right? maybe u can get these of the main repositry. Maybe u can use Par2 that also can repair files.
here's the thing though: i linux community would undoubtedly yeild a significant amount of peers (forced seeding might have to implemented on the manager). plus, there could be seed servers, whose sole purpose is to seed packages. i get where your coming though. an alternative within the manager would definately be needed. as per checksums, that could be done/downloaded when the repo listing are updated.
 
Old 12-23-2006, 11:19 AM   #13
vharishankar
Senior Member
 
Registered: Dec 2003
Posts: 3,142
Blog Entries: 4

Rep: Reputation: 120Reputation: 120
I think that's why mirrors exist though - to help spread out the load on the main server and placing mirrors geographically closer to its audience while maintaining the integrity of the files being downloaded.

Bittorrent is great, but in reality I find it much slower than using mirrors that are closer to me PLUS I feel guilty about using somebody else's personal bandwidth without being able to contribute much with my own slow connection. And obviously being in a region of the world with slow internet connectivity, I personally haven't experienced any speed advantages of torrents over mirrors either because the bottleneck is at my ISP's end. Bittorrents are very slow where I live... because I probably have to connect to a guy who's living half a world away, whereas I'm much better off connecting to a Singapore or Korean mirror.

Last edited by vharishankar; 12-23-2006 at 11:20 AM.
 
Old 12-23-2006, 11:24 AM   #14
Ha1f
Member
 
Registered: Jun 2005
Location: University of Maryland
Distribution: FreeBSD
Posts: 268

Rep: Reputation: 30
Quote:
Originally Posted by harishankar
I think that's why mirrors exist though - to help spread out the load on the main server while maintaining the integrity of the files being downloaded.

Bittorrent is great, but in reality I find it much slower than using mirrors that are closer to me PLUS I would feel guilty about using somebody else's personal bandwidth without being able to contribute much with my own slow connection. And obviously being in a region of the world with slow internet connectivity, I personally haven't experienced any speed advantages of torrents over mirrors either because the bottleneck is at my ISP's end. Bittorrents are very slow where I live... because I probably have to connect to a guy who's living half a world away, whereas I'm much better off connecting to a Singapore or Korean mirror.
well, ideally there could be seeding mirrors at location. plus, youd be getting seeders near you aswell. ofcourse, an idea like this might not benefit everyone. dialup users arent going to see that huge increase in speed that others might, but its a great idea none the less for people who want to speed up mass package distribution. mirrors get slow when alot of people want to use them, torrents get faster...
 
Old 12-23-2006, 12:31 PM   #15
f76
LQ Newbie
 
Registered: Jul 2004
Location: Sweden
Distribution: Ubuntu Breezy
Posts: 20

Rep: Reputation: 0
Maybe it could be good alternative to use distrubuted p2p for "servicepacks" - a compilation of all updates since a distro release up to say last month for example. That would work for anyone updating a brand new install. And then the update program would find the updates necesary since that update.

And maybe only parts that are popular downloads would be included in files shared via torrent. The rest might as well run of the server, right?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is 03:36 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration