LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Server (https://www.linuxquestions.org/questions/linux-server-73/)
-   -   I bricked my NAS? :( aptitude, apt-get, apt-cache segfaults immediately (https://www.linuxquestions.org/questions/linux-server-73/i-bricked-my-nas-aptitude-apt-get-apt-cache-segfaults-immediately-764489/)

omegaworks 10-26-2009 05:47 AM

I bricked my NAS? :( aptitude, apt-get, apt-cache segfaults immediately
 
Hi. I'll admit, I did a terrible thing.

I have a now-defunct Anthology Solutions Yellow Machine, and I felt like I could be the Ultimate Sysadmin if I could get apt-get working on it again.

It originally ran a modified version of Debian Woody (old!), and apt kept complaining about unresolved dependencies. Changing the sources to sarge, I managed to get the dependencies resolved, and could use apt to install stuff again!

Silly me, installed aptitude and ran aptitude upgrade. Here's what it did:
(From /var/log/aptitude:)
Code:

Will install 157 packages, and remove 0 packages.
21900288 bytes of disk space will be used
===============================================================================
<HOLDs omitted>
[UPGRADE] adduser 3.47 -> 3.63
[UPGRADE] adjtimex 1.13-1 -> 1.20-3
[UPGRADE] argus-client 2.0.2.alpha.9-2 -> 2.0.6.fixes.1-2
[UPGRADE] autofs 3.9.99-4.0.0pre10-1 -> 4.1.3+4.1.4beta2-10
[UPGRADE] base[UPGRADE] base-passwd 3.4.1 -> 3.5.9
[UPGRADE] bash 2.05a-11 -> 2.05b-26
[UPGRADE] bc 1.06-8 -> 1.06-15
[UPGRADE] bchunk 1.1.1-2 -> 1.2.0-1
[UPGRADE] biew 5.2.0-3 -> 5.6.2-1
[UPGRADE] bind9-doc 1:9.2.1-2.woody.1 -> 1:9.2.4-1sarge3
[UPGRADE] binstats 1.08-5 -> 1.08-8
[UPGRADE] bison 1:1.35-3 -> 1:1.875d-1
[UPGRADE] bsdmainutils 5.20020211-4.99 -> 6.0.17
[UPGRADE] busybox-static 1:0.60.2-3.1 -> 1:0.60.5-2.2
[UPGRADE] byacc 1.9-13.1 -> 1.9.1-1.1
[UPGRADE] bzip2 1.0.2-1 -> 1.0.2-7
[UPGRADE] catsboot 0.2.2 -> 0.2.3
[UPGRADE] cdbackup 0.6.2-2 -> 0.7.0-1
[UPGRADE] cdrecord 4:1.10-7 -> 4:2.01+01a01-2
[UPGRADE] cfs 1.4.1-7 -> 1.4.1-15sarge1
[UPGRADE] console-data 1999.08.29-24 -> 2002.12.04dbs-49
-files 3.0.2 -> 3.1.2
[UPGRADE] cramfsprogs 1.1-3 -> 1.1-6
[UPGRADE] cron 3.0pl1-72 -> 3.0pl1-86
[UPGRADE] cvs 1.11.1p1debian-8 -> 1:1.12.9-13
[UPGRADE] dc 1.06-8 -> 1.06-15
[UPGRADE] dhcpdump 1.4-1 -> 1.6-1
[UPGRADE] dhcping 1.2-1 -> 1.2-2
[UPGRADE] dialog 0.9a-20020309a-1 -> 1.0-20050306-1
[UPGRADE] diff 2.7-29 -> 2.8.1-11
[UPGRADE] dnstracer 1.4-2 -> 1.8-1
[UPGRADE] doc-debian 3.0 -> 3.1
[UPGRADE] doc-linux-text 2002.04-2 -> 2005.04-1
[UPGRADE] dosfstools 2.8-1 -> 2.11-2
[UPGRADE] ed 0.2-19 -> 0.2-20
[UPGRADE] eject 2.0.3-1 -> 2.0.13deb-8sarge2
[UPGRADE] fbset 2.1-6.1 -> 2.1-16
[UPGRADE] findutils 4.1.7-2 -> 4.1.20-6
[UPGRADE] finger 0.17-6 -> 0.17-7
[UPGRADE] flex 2.5.4a-24 -> 2.5.31-31sarge1
[UPGRADE] ftp 0.17-9 -> 0.17-12
[UPGRADE] ftp-proxy 1.8-2 -> 1.9.2.4-1
[UPGRADE] gawk 1:3.1.0-3 -> 1:3.1.4-2
[UPGRADE] gdb 5.2.cvs20020401-6 -> 6.3-6
[UPGRADE] gettext 0.10.40-5 -> 0.14.4-2
[UPGRADE] gettext-base 0.10.40-5 -> 0.14.4-2
[UPGRADE] gnupg-doc 2000.10.01-1 -> 2003.04.06-4
[UPGRADE] grep 2.4.2-3 -> 2.5.1.ds1-4
[UPGRADE] gzip 1.3.2-3woody3 -> 1.3.5-10sarge2
[UPGRADE] hdparm 4.5-1.2 -> 6.1-2
[UPGRADE] hlfl 0.60.0-1 -> 0.60.1-1
[UPGRADE] hostname 2.09 -> 2.13
[UPGRADE] icmpinfo 1.11-1 -> 1.11-5
[UPGRADE] info 4.1-2 -> 4.7-2.2sarge2
[UPGRADE] iptables 1.2.6a-5 -> 1.2.11-10
[UPGRADE] klogd 1.4.1-10 -> 1.4.1-17
[UPGRADE] krb4-config 1.4 -> 1.6
[UPGRADE] krb5-config 1.4 -> 1.6
[UPGRADE] less 374-4 -> 382-1
[UPGRADE] lftp 2.4.9-1 -> 3.1.3-1
[UPGRADE] libbz2-1.0 1.0.2-1 -> 1.0.2-7
[UPGRADE] libcap1 1:1.10-12 -> 1:1.10-14
[UPGRADE] libdb2 2:2.7.7.0-7 -> 2:2.7.7.0-9
[UPGRADE] libdb3 3.2.9-16 -> 3.2.[UPGRADE] libgpmg1 1.19.6-12 -> 1.19.6-19sarge1
[UPGRADE] libhesiod0 3.0.2-11 -> 3.0.2-15.1
[UPGRADE] libjpeg62 6b-5 -> 6b-10
[UPGRADE] liblockfile1 1.03 -> 1.06
[UPGRADE] liblwres1 1:9.2.1-2.woody.1 -> 1:9.2.4-1sarge3
[UPGRADE] liblzo1 1.07-1 -> 1.08-1.2
[UPGRADE] libncurses5 5.2.20020112a-7 -> 5.4-4
[UPGRADE] libpam-modules 0.72-35 -> 0.76-22
[UPGRADE] libpam-runtime 0.72-35 -> 0.76-22
[UPGRADE] libpopt0 1.6.2-7 -> 1.7-5
[UPGRADE] libreadline4 4.2a-5 -> 4.3-11
[UPGRADE] libsnmp-base 4.2.3-2 -> 5.1.2-6.2
[UPGRADE] libssl0.9.6 0.9.6c-2 -> 0.9.6m-1sarge5
[UPGRADE] libstdc++2.10-glibc2.2 1:2.95.4-7 -> 1:2.95.4-22
[UPGRADE] libwrap0 7.6-9 -> 7.6.dbs-8
[UPGRADE] libwww0 5.3.2-9 -> 5.4.0-9
[UPGRADE] linuxinfo 1.1.7-2.1 -> 1.1.8-12
[UPGRADE] logcheck-database 1.1.1-13.1 -> 1.2.39
[UPGRADE] logrotate 3.5.9-8 -> 3.7-5
[UPGRADE] logtool 1.0.6-7 -> 1.2.7-5
[UPGRADE] lpr 1:2000.05.07-4.2 -> 1:2003.09.23-7
[UPGRADE] lsb-release 1.4-6 -> 1.4-8
[UPGRADE] lsof 4.57-1 -> 4.74.dfsg.3-29-22
[UPGRADE] libdb3-util 3.2.9-16 -> 3.2.9-22
[UPGRADE] libexpat1 1.95.2-6 -> 1.95.8-3
[UPGRADE] libgdbmg1 1.7.3-27 -> 1.7.3-28
[UPGRADE] libglib1.2 1.2.10-4 -> 1.2.10-9
[UPGRADE] m4 1.4-14 -> 1.4.2-1
[UPGRADE] macutils 2.0b3-12 -> 2.0b3-13
[UPGRADE] make 3.79.1-14 -> 3.80-9
[UPGRADE] makedev 2.3.1-58 -> 2.3.1-77
[UPGRADE] manpages 1.39-1.1 -> 1.70-1
[UPGRADE] manpages-dev 1.39-1.1 -> 1.70-1
[UPGRADE] mawk 1.3.3-8 -> 1.3.3-11
[UPGRADE] mdadm 0.7.2-2 -> 1.9.0-4sarge1
[UPGRADE] mime-support 3.18-1 -> 3.28-1
[UPGRADE] mingetty 0.9.4-8 -> 1.07-1
[UPGRADE] mkisofs 4:1.10-7 -> 4:2.01+01a01-2
[UPGRADE] mpack 1.5-7 -> 1.6-1
[UPGRADE] mtools 3.9.8-7 -> 3.9.9-2.1
[UPGRADE] nano 1.0.6-2 -> 1.2.4-5
[UPGRADE] ncurses-base 5.2.20020112a-7 -> 5.4-4
[UPGRADE] ncurses-bin 5.2.20020112a-7 -> 5.4-4
[UPGRADE] ncurses-term 5.2.20020112a-7 -> 5.4-4
[UPGRADE] net-tools 1.60-4 -> 1.60-10
[UPGRADE] netcat 1.10-21 -> 1.10-27
[UPGRADE] netkit-inetd 0.10-9 -> 0.10-10
[UPGRADE] netkit-ping 0.10-9 -> 0.10-10
[UPGRADE] netmask 2.3.5 -> 2.3.7
[UPGRADE] netsed 0.01b-5 -> 0.01c-2
[UPGRADE] netselect 0.3-4 -> 0.3.ds1-4
[UPGRADE] nfs-common 1:1.0-2 -> 1:1.0.6-3.1
[UPGRADE] nfs-kernel-server 1:1.0-2 -> 1:1.0.6-3.1
[UPGRADE] nictools-pci 1.3.2-2 -> 1.3.6-1
[UPGRADE] noflushd 2.6.1-2 -> 2.7.5-2
[UPGRADE] patch 2.5.4-11 -> 2.5.9-2
[UPGRADE] pciutils 1:2.1.9-4 -> 1:2.1.11-15
[UPGRADE] pdnsd 1.1.7-4 -> 1.1.11par-1
[UPGRADE] poppassd 1.8.1-1 -> 1.8.5-1
[UPGRADE] portmap 5-2.0.1 -> 5-9
[UPGRADE] pppconfig 2.0.14 -> 2.3.11
[UPGRADE] pppoe 3.3-1.1 -> 3.5-4
[UPGRADE] pppstatus 0.4.2-2 -> 0.4.2-8
[UPGRADE] procmail 3.22-4 -> 3.22-11
[UPGRADE] procps 1:2.0.7-8 -> 1:3.2.1-2
[UPGRADE] psmisc 20.2-2.1 -> 21.5-1
[UPGRADE] rdate 1.4-1 -> 1.4-6
[UPGRADE] recover 1.3b-1 -> 1.3c-8
[UPGRADE] reiserfsprogs 3.x.1b-1 -> 1:3.6.19-1
[UPGRADE] scsitools 0.3-2 -> 0.8-1sarge1
[UPGRADE] sed 3.02-8 -> 4.1.2-8
[UPGRADE] setserial 2.17-24 -> 2.17-40
[UPGRADE] sformat 3.4-3.2 -> 3.5-1.1
[UPGRADE] sharutils 1:4.2.1-9 -> 1:4.2.1-13
[UPGRADE] shorewall 1.2.12-1 -> 2.2.3-2
[UPGRADE] slang1 1.4.4-7.2 -> 1.4.9dbs-8
[UPGRADE] strace 4.4-1.2 -> 4.5.8-1.2
[UPGRADE] sudo 1.6.6-1.1 -> 1.6.8p7-1.4
[UPGRADE] super 3.16.1-1 -> 3.26.0-2
[UPGRADE] sysklogd 1.4.1-10 -> 1.4.1-17
[UPGRADE] sysstat 4.0.4-1 -> 5.0.6-5
[UPGRADE] tcpd 7.6-9 -> 7.6.dbs-8
[UPGRADE] tcputils 0.6.2-4 -> 0.6.2-6
[UPGRADE] tcsh 6.11.00-2.1 -> 6.13.00-1
[UPGRADE] telnetd 0.17-18 -> 0.17-29
[UPGRADE] texinfo 4.1-2 -> 4.7-2.2sarge2
[UPGRADE] time 1.7-11 -> 1.7-21
[UPGRADE] timezoneconf 0.5 -> 0.10
[UPGRADE] traceroute 1.4a12-9 -> 1.4a12-18
[UPGRADE] vcdtools 0.4-1 -> 0.4-2
[UPGRADE] vlan 1.5-2 -> 1.8-1sarge1
[UPGRADE] wu-ftpd 2.6.2-3 -> 2.6.2-20
[UPGRADE] zlib1g 1:1.1.4-1 -> 1:1.2.2-4.sarge.2
===============================================================================


And now aptitude, apt-get and apt-cache all segfault immediately after running them (literally right after I press Enter). apt-get help doesnt even work.

I ran rm -rf /var/cache/apt/*.bin and rm -rf /var/cache/apt/archives/* to no avail.

strace apt-get gives me this:
Code:

strace apt-get
execve("/usr/bin/apt-get", ["apt-get"], [/* 13 vars */]) = 0
uname({sys="Linux", node="tdxdata.mit.edu", ...}) = 0
brk(0)                                  = 0x36794
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/etc/ld.so.preload", O_RDONLY)    = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY)      = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=12387, ...}) = 0
old_mmap(NULL, 12387, PROT_READ, MAP_PRIVATE, 3, 0) = 0x40015000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libapt-pkg-libc6.2-3-2.so.3.2", O_RDONLY) = 3
read(3, "\177ELF\1\1\1a\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0\260\264\1"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=883248, ...}) = 0
old_mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x40019000
old_mmap(NULL, 915620, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x4001d000
mprotect(0x400f3000, 39076, PROT_NONE)  = 0
old_mmap(0x400f5000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0xd0000) = 0x400f5000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libstdc++-libc6.2-2.so.3", O_RDONLY) = 3
read(3, "\177ELF\1\1\1a\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0$a\1\0004"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=256336, ...}) = 0
old_mmap(NULL, 297452, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x400fd000
mprotect(0x4013a000, 47596, PROT_NONE)  = 0
old_mmap(0x4013d000, 28672, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0x38000) = 0x4013d000
old_mmap(0x40144000, 6636, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x40144000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libm.so.6", O_RDONLY)        = 3
read(3, "\177ELF\1\1\1a\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0\2644\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=465492, ...}) = 0
old_mmap(NULL, 496736, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x40146000
mprotect(0x401b8000, 29792, PROT_NONE)  = 0
old_mmap(0x401be000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0x70000) = 0x401be000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libc.so.6", O_RDONLY)        = 3
read(3, "\177ELF\1\1\1a\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0\350[\1\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=1159708, ...}) = 0
old_mmap(NULL, 1196844, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x401c0000
old_mmap(0x402d8000, 40960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0x110000) = 0x402d8000
old_mmap(0x402e2000, 9004, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x402e2000
close(3)                                = 0
--- SIGSEGV (Segmentation fault) @ 0 (0) ---
+++ killed by SIGSEGV +++


Running apt-get in gdb, results in this:
Code:

Program received signal SIGSEGV, Segmentation fault.
0x40009734 in ?? ()

I'm deathly afraid of restarting this machine, because the only way I can get access to it easily is via ssh, and if that's broken Im out of luck.

Help :(

dracuss 10-26-2009 10:48 AM

Well, in my opinion the single thing you could do is remove using dpkg all the packages that don't work.
And after that maybe you would be able to reinstall apt and all the other dependencies.
If that doesn't work, i would suggest you to read the mans for dd and hard-copy an OS, or learn how to install gentoo :)

omegaworks 10-28-2009 02:18 PM

How do I judge the ones that dont work? apt does not appear in the list of updated packages, so it could be any one of those that broke it. Im worried other apps might not work, but so far only apt is broken.

dracuss 10-28-2009 05:00 PM

omegaworks, try dpkg-reconfigure <package>, for all the packages that you think are broken... It may work...
Well, if it doesn't I would suggest you to delete the majority of packages (also by using dpkg), download the apt DEB package and install it with dpkg, and afterwards rebuild your system.
Or, as I previously said, for example gentoo can be installed over ssh.

AlucardZero 10-28-2009 05:55 PM

.. woody .. to sarge ...?

Reinstall with Lenny, honestly.

omegaworks 11-07-2009 09:21 AM

The issue, I think, is finding a kernel that supports the yellow machine hardware. Anthology solutions has unfortunately gone out of business, and what little information I drummed up through google has me believing that the builtin linux kernel (v2.4) has custom modules for supporting a lesser-known raid controller.

I can't even find a more specific hardware list. lspci wont tell me anything :(

EDIT: https://forum.openwrt.org/viewtopic.php?id=18325 is where I found out about the harddrive controller.


All times are GMT -5. The time now is 04:34 AM.