Mirroring slackware-current

bifferos · 06-16-2015, 03:09 AM

Hi,

I'd like to make an ISO from slackware-current on a fairly regular basis. I don't have access to rsync, so need to use HTTP/FTP. I am looking for the script that tells me I have a good, consistent set of files, e.g. scanning PACKAGES.TXT, MANIFEST.bz2, CHECKSUMS.md5 and checking that everything matches, in case I happen to be downloading when someone is updating the source, and to verify the downloads.

Does such a script exist?

many thanks,
Biff.

ponce · 06-16-2015, 04:05 AM

to sync and create my isos I personally use mirror-slackware-current.sh from Alien Bob but by default it uses rsync.

you can also use it with the -i option (that creates the iso without downloading anything) if you have an up-to-date local mirror.

read it to see configurable variables and switches.

to check the hashes maybe the best option for you is to use directly the file CHECKSUMS.md5 in the root directory of your mirror: read that too for instructions.

bifferos · 06-16-2015, 04:32 AM

OK, so let me get this right - I still run the risk that CHECKSUMS.md5 is still being updating when I read it, and/or it doesn't include files that have been referenced in PACKAGES.TXT, which I presume drives the install, and is the important one. Is that right?

I guess most people just assume the updates don't occur very often and that they won't hit one and hope for the best!

regards,
Biff.

ruario · 06-16-2015, 05:42 AM

Use CHECKSUMS.md5.asc to check that CHECKSUMS.md5 is OK.

bifferos · 06-16-2015, 06:54 AM

I saw that, but how do I know that PACKAGES.TXT is consistent with it? And does it matter?

Alien Bob · 06-16-2015, 07:18 AM

Quote:

Originally Posted by bifferos

OK, so let me get this right - I still run the risk that CHECKSUMS.md5 is still being updating when I read it, and/or it doesn't include files that have been referenced in PACKAGES.TXT, which I presume drives the install, and is the important one. Is that right?

I guess most people just assume the updates don't occur very often and that they won't hit one and hope for the best!

regards,
Biff.

You could check the timestamp of the most recent entry in ChangeLog.txt? Usually the mirrors synchronize within a day of an update on the master server.

Also, the mirror-slackware-current script does two rsync-s in a row, if the first rsync runs while the remote server is still being updated, the second rsync should show activity (it will sync the files that got added or changed after the first rsync started).
If you really want to know what happens you add a "-v" parameter and watch what the script does.

Lastly, you can check if you have mirrored everything correctly by following the instructions from the header of the CHECKSUMS.md5 file:

Code:

These are the MD5 message digests for the files in this directory.
If you want to test your files, use 'md5sum' and compare the values to
the ones listed here.

To test all these files, use this command:

tail +13 CHECKSUMS.md5 | md5sum -c --quiet - | less

ttk · 06-16-2015, 08:09 PM

Quote:

Originally Posted by bifferos

I don't have access to rsync

If all you have is Windows, you can install cygwin and that will install rsync.

https://cygwin.com/

https://cygwin.com/cgi-bin2/package-...Frsync-3.1.1-1

bifferos · 06-17-2015, 02:36 AM

Quote:

Originally Posted by ttk

you can install cygwin and that will install rsync.

rsync is blocked by the firewall, I do have the binaries.

I came to the conclusion I should roll my own mirror script that does exactly what I want.

Thanks for all the replies.

Biff.

bassmadrigal · 06-22-2015, 02:38 PM

Depending on how often you need/want to make it, you could just use Eric's pre-built ISO if it falls within the dates/updates needed.

http://taper.alienbase.nl/mirrors/slackware/