LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 09-22-2005, 04:43 AM   #1
mndar
Member
 
Registered: Feb 2005
Posts: 34

Rep: Reputation: 16
any 'emerge' trick in gentoo....


I have a weird problem. I can utilize my full bandwidth only if I keep 3-4 downloads running simultaneously. Therefore I want emerge to download 3-4 pacakges simultaneously. Anyway here is my question in a simple form.
How do I force emerge to fetch a particular package without caring about its dependencies? I tried emerge -f =<package name> but that doesn't help. It still tries to download the dependencies. As a result it gets stuck on waiting for lock on <package-name> where <package-name> is being downloaded.
 
Old 09-22-2005, 09:04 PM   #2
MasterC
LQ Guru
 
Registered: Mar 2002
Location: Salt Lake City, UT - USA
Distribution: Gentoo ; LFS ; Kubuntu ; CentOS ; Raspbian
Posts: 12,613

Rep: Reputation: 69
I don't know about setting up serial downloads, which is probably what you are looking for. However, it seems that your problem is that you can't actually use your bandwidth at all unless you are downloading several files at once, which is just wierd.

Anyway, another option.

Run emerge -pv <package-name> to see the dependencies. Then, open up 4 terminal and enter a dependency in each terminal:
emerge -f foo1
emerge -f foo2
emerge -f foo3
emerge package-name

And then hit enter in each one and watch the 4 dependencies download simultaneously. You could even script it.

Good Luck!

Cool
 
Old 09-23-2005, 03:00 AM   #3
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
As I mentioned in the previous post, I have already tried that but it gets stuck on the Waiting for lock on ..... thing. Here is a sample output of the process

root@mndar[~]# emerge -p azureus-bin

These are the packages that I would merge, in order:

Calculating dependencies ...done!
[ebuild N ] dev-java/antlr-2.7.3
[ebuild N ] dev-java/ant-tasks-1.6.2-r9
[ebuild N ] dev-java/ant-1.6.2-r6
[ebuild N ] dev-java/commons-lang-2.0-r1
[ebuild N ] dev-java/commons-cli-1.0-r4
[ebuild N ] net-libs/linc-1.0.3
[ebuild N ] dev-java/systray4j-2.4
[ebuild N ] net-p2p/azureus-bin-2.1.0.4


root@mndar[~]# emerge -f =dev-java/commons-cli-1.0-r4
Calculating dependencies ...done!
>>> emerge (1 of 5) dev-java/antlr-2.7.3 to /
waiting for lock on /usr/portage/distfiles/.locks/antlr-2.7.3.tar.gz.portage_lockfile


where antlr-2.7.3.tar.gz is currently being downloaded
 
Old 09-23-2005, 03:37 AM   #4
MasterC
LQ Guru
 
Registered: Mar 2002
Location: Salt Lake City, UT - USA
Distribution: Gentoo ; LFS ; Kubuntu ; CentOS ; Raspbian
Posts: 12,613

Rep: Reputation: 69
Is this an NFS mounted directory? It seems a bit odd it's waiting for the lock and just sits there. You can clean out your distfiles directory, this may 'free up' the problem (possibly from a previous downloading error?).

Does emerge sync finish without errors?

Cool
 
Old 09-24-2005, 12:35 PM   #5
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
Its my hard drive itself.
I tested the emerge -f =<package-name> on different packages having many dependencies and I noticed that it doesn't always get stuck on waiting for lock..., sometimes it downloads the file. I tried clearing /usr/portage/distfiles and fetching the same files again but it still got stuck on waiting for lock....
Right now I am refraining for doing emerge sync for the reason that I download the latest portage snapshot on the 21st and am trying to stick to that.
I guess emerge uses wget to fetch files. Is it possible to tell wget to make multiple simultaneous connections ?
Is there some other download utility available that can make multiple simultaneous connections to accelerate the download ?

Last edited by mndar; 09-24-2005 at 12:41 PM.
 
Old 09-24-2005, 01:00 PM   #6
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
I found one, prozilla. Is there any method by which I can use this with emerge.
 
Old 09-24-2005, 01:01 PM   #7
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
I found one, prozilla. Is there any method by which I can use this with emerge. Presently I start the download with emerge -f =<package-name> check the URL there, copy it then download the file using prozilla and then move the file to /usr/portage/distfiles. Phew!!
 
Old 09-24-2005, 05:03 PM   #8
MasterC
LQ Guru
 
Registered: Mar 2002
Location: Salt Lake City, UT - USA
Distribution: Gentoo ; LFS ; Kubuntu ; CentOS ; Raspbian
Posts: 12,613

Rep: Reputation: 69
I do recall that you can set your download preference tool in make.conf. Right now I can't find it, but will search a bit. (At work I can't easily check the make.conf man page).

Cool
 
Old 09-24-2005, 05:08 PM   #9
MasterC
LQ Guru
 
Registered: Mar 2002
Location: Salt Lake City, UT - USA
Distribution: Gentoo ; LFS ; Kubuntu ; CentOS ; Raspbian
Posts: 12,613

Rep: Reputation: 69
Cool, found it (putty rocks):
The FETCHCOMMAND option in your make.conf file defines what tool you use to download with. So, using something other than wget as an example (grabbed this from google):
#FETCHCOMMAND="/usr/bin/lukemftp -s -a -o \${DISTDIR}/\${FILE} \${URI}"

And here's a wget example:
#FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp --limit-rate=200k \${URI} -P \${DISTDIR}"

And of course, Prozilla:
#FETCHCOMMAND='/usr/bin/proz --no-getch -s ${URI} -P ${DISTDIR}'



Cool

Last edited by MasterC; 09-24-2005 at 05:09 PM.
 
Old 09-26-2005, 06:47 AM   #10
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
I inserted
FETCHCOMMAND='/usr/bin/proz --no-getch -s ${URI} -P ${DISTDIR}'
in /etc/make.conf but it doesn't seem to make any difference
 
Old 09-26-2005, 08:13 AM   #11
sam_vde
LQ Newbie
 
Registered: Mar 2005
Posts: 19

Rep: Reputation: 0
--limit-rate

And here's a wget example:
#FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp --limit-rate=200k \${URI} -P \${DISTDIR}"


Are you sure it is not the --limit-rate setting that limits your bandwidth in the first place?


Rgds
Sam
 
Old 09-26-2005, 12:07 PM   #12
mndar
Member
 
Registered: Feb 2005
Posts: 34

Original Poster
Rep: Reputation: 16
I never had and "FETCHCOMMAND..." line in my make.conf
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
gentoo + emerge kurrupt Linux - General 5 06-02-2005 03:56 PM
Gentoo/Emerge CrazyYoyimbo Linux - Newbie 4 02-15-2005 06:21 PM
pkg-config error with emerge -aD gnome-python on Gentoo 2.6.9-gentoo-r6 ghrellin Linux - Software 2 12-22-2004 06:37 PM
Please help. Gentoo: Emerge gentoo-dev-sources fails sendas4 Linux - Newbie 3 07-19-2004 11:44 AM
gentoo emerge elektrohirn Linux - Distributions 2 06-02-2003 03:39 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 02:03 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration