[SOLVED] [Errno 14] Could not open/read

malak33 · 08-22-2012, 02:15 AM

ok I'm trying to install a local repo.
I added a new .repo in /etc/yum.repos.d/
it is called Cloudera-local.repo
here it is
[cloudera-local]
name=Cloudera's Distribution for Hadoop, Version 4
###baseurl=http://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/4/
baseurl=http://127.0.0.1/HadoopRPMS/
###gpgkey = http://archive.cloudera.com/cdh4/red...G-KEY-cloudera
####gpgcheck =1
enabled =1

I'm doint it this way because when i try to download the packages i need using yum i get an error saying Metadata does not match checksum
couldn't find an solution online that worked so i thought i would make my own repo and solve it.

I have downloaded all the repos from the server and they are in /var/www/html/HadoopRPMS/
the repomd.xml and primary.xml.gz are in /var/www/html/Hadoop/repodata

this is what happens, I'm stuck and not sure what to do to solve this issue.
edit: also i can navigate to http://127.0.0.1/HadoopRPMS/repodata/ on my browser and open repomd.xml in the browser....

[root@example /]# yum clean all
Loaded plugins: fastestmirror, refresh-packagekit
Cleaning repos: base cloudera-local extras updates
Cleaning up Everything
Cleaning up list of fastest mirrors
[root@example /]# yum update
Loaded plugins: fastestmirror, refresh-packagekit
Determining fastest mirrors
* base: centos.mirror.lstn.net
* extras: centos-distro.cavecreek.net
* updates: centos.digitalcompass.net
base | 3.7 kB 00:00
base/primary_db | 4.5 MB 00:11
http://127.0.0.1/HadoopRPMS/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 502"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cloudera-local. Please verify its path and try again

evo2 · 08-22-2012, 03:02 AM

Hi,

Quote:

Originally Posted by malak33

http:///127.0.0.1/HadoopRPMS/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 502"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cloudera-local. Please verify its path and try again

The three slashes in "http:///" look suspicious.

Evo2.

malak33 · 08-22-2012, 03:19 AM

You are correct, sorry i copied from the wrong terminal window i had open. It is now correct. It's late here where i am...

evo2 · 08-22-2012, 03:39 AM

Hi,

ok, have you checked your web server logs to see what is going on? Also, I know you already said that that url works with your browser, but have you also tried with something simple like wget? Eg

Code:

wget http://127.0.0.1/HadoopRPMS/repodata/repomd.xml

Evo2.

malak33 · 08-22-2012, 03:52 AM

Code:

[root@example /]# wget http://127.0.0.1/HadoopRPMS/repodata/repomd.xml
--2012-08-21 14:08:20--  http://127.0.0.1/HadoopRPMS/repodata/repomd.xml
Connecting to 10.16.0.25:8080... connected.
Proxy request sent, awaiting response... 502 Proxy Error ( An internal error occurred.  )
2012-08-21 14:08:20 ERROR 502: Proxy Error ( An internal error occurred.  ).

in the access log and error log there is nothing relevent in there.

I see proxy error, I'm behind proxy at my work and have put in the appropiate IP settings following this guide here http://wiki.centos.org/TipsAndTricks...7ebae9cc4fcb5a

Maybe relevent information i am on a VM sitting on a windows machine.

evo2 · 08-22-2012, 05:46 AM

It looks like you need to disable the proxy for localhost.

Evo2.

evo2 · 08-22-2012, 07:06 PM

Hi,

I checked the rpm.conf man page and it seems you can set a different proxy for each repository, and that you can use the value '_none_' if you want to disable it.
So please try adding the following to Cloudera-local.repo

Code:

proxy=_none_

Evo2.

malak33 · 08-23-2012, 01:30 AM

i will try that out tomorrow, not at wirk today. ill let u kbow if it works. thanks

malak33 · 08-23-2012, 07:25 PM

ok, i have taken your advice and it worked. Kinda i'm not getting the same error now. Now I'm getting the meta data one again...sigh

Code:

[root@example /]# yum clean all
Loaded plugins: fastestmirror, refresh-packagekit
Cleaning repos: base cloudera-local extras updates
Cleaning up Everything
Cleaning up list of fastest mirrors
[root@example /]# yum update
Loaded plugins: fastestmirror, refresh-packagekit
Determining fastest mirrors
 * base: centos-distro.cavecreek.net
 * extras: centos.mirror.nac.net
 * updates: centos.aol.com
base                                                     | 3.7 kB     00:00     
base/primary_db                                          | 4.5 MB     00:08     
cloudera-local                                           |  951 B     00:00     
cloudera-local/primary                                   |  22 kB     00:00     
http://127.0.0.1/HadoopRPMS/repodata/primary.xml.gz: [Errno -1] Metadata file does not match checksum
Trying other mirror.
cloudera-local/primary                                   |  22 kB     00:00     
http://127.0.0.1/HadoopRPMS/repodata/primary.xml.gz: [Errno -1] Metadata file does not match checksum
Trying other mirror.
Error: failure: repodata/primary.xml.gz from cloudera-local: [Errno 256] No more mirrors to try.
[root@example /]#

evo2 · 08-23-2012, 07:43 PM

Hi,

Quote:

Originally Posted by malak33

ok, i have taken your advice and it worked.

Ok so your problem is solved.

Quote:

Kinda i'm not getting the same error now. Now I'm getting the meta data one again...sigh

And you have a new problem. This problem is very much specific to yum repositories (the previous one was an http proxy issue), so I suggest you start a new thread with a descriptive title.

Cheers,

Evo2.