[SOLVED] slackpkg+ did not list all the packages

chrisretusn · 09-30-2020, 10:02 AM

Please post the results of 'grep "PRIORITY=" /etc/slackpkg/slackpkg.conf'

chrisretusn · 09-30-2020, 10:19 AM

Quote:

Originally Posted by sbabaro1

Could be the awk script the did not work correctly parsing PACKAGES.TXT?

I doubt it.

I have a clean Slackware64-14.2 virtual machine with slackpkg version 2.82.1 and slackpkg+ version 1.7.0 installed using your slackpkgplus.conf and do not see this issue. There are boat loads of alienbob packages using 'slackpkg search alienbob'

Is this a full install of Slackware64-14.2?

phenixia2003 · 09-30-2020, 10:48 AM

Hello,

pkglist is built from the file CHECKSUMS.md5 (which is a concantenation of the CHECKSUMS.md5 from each repository) as below :

Code:

$ grep "\.t[blxg]z$" /var/lib/slackpkg/CHECKSUMS.md5 | awk -f /usr/libexec/slackpkg/pkglist.awk | sed -e "s/^M//g" > pkglist

I doubt that pkglist.awk is the issue. The generated pkglist is ok on my side with your slackpkgplus configuration. So, the issue can come from the CHECKSUMS.md5 file. You can run the command below to list the alienbob packages referenced in this file (on my side, 345 are found):

Code:

$ grep "SLACKPKGPLUS_alienbob/.*t[bglx]z$" /var/lib/slackpkg/CHECKSUMS.md5

--
SeB

chrisretusn · 09-30-2020, 11:01 AM

Quote:

Originally Posted by sbabaro1

I didn't see anything wrong

Code:

$ ls -l /var/lib/slackpkg/
totale 8124
-rw-r--r-- 1 root root 1003560 set 30 13:31 CHECKSUMS.md5
-rw-r--r-- 1 root root     163 set 30 13:31 CHECKSUMS.md5.asc
-rw-r--r-- 1 root root  610230 set 30 13:29 ChangeLog.txt
drwxr-xr-x 2 root root    4096 set 30 13:31 ChangeLogs/
-rw-r--r-- 1 root root 1211591 set 30 13:31 PACKAGES.TXT
-rw-r--r-- 1 root root 1533212 set 30 13:31 SLACKPKGPLUS_alienbob-filelist.gz
-rw-r--r-- 1 root root  161129 set 30 13:31 SLACKPKGPLUS_multilib-filelist.gz
-rw-r--r-- 1 root root   23775 set 30 13:31 SLACKPKGPLUS_restricted-filelist.gz
-rw-r--r-- 1 root root     311 set 30 13:31 SLACKPKGPLUS_slackpkgplus-filelist.gz
-rw-r--r-- 1 root root   47819 set 30 13:31 extra-filelist.gz
drwxr-xr-x 2 root root    4096 set 30 13:29 gpg/
-rw-r--r-- 1 root root       0 set 30 13:29 install.log
-rw-r--r-- 1 root root   20847 set 30 13:31 pasture-filelist.gz
-rw-r--r-- 1 root root  952817 set 30 13:31 patches-filelist.gz
-rw-r--r-- 1 root root  137323 set 30 13:30 pkglist
-rw-r--r-- 1 root root 2574645 set 30 13:31 slackware64-filelist.gz
-rw-r--r-- 1 root root     344 set 30 13:31 testing-filelist.gz

You look to be missing a few files. Plus your CHECKSUMS.md5 file seem a bit small

Code:

total 9296
-rw-r--r-- 1 root root 1380064 Sep 30 23:52 CHECKSUMS.md5
-rw-r--r-- 1 root root     163 Sep 30 23:52 CHECKSUMS.md5.asc
-rw-r--r-- 1 root root  610230 Sep 30 23:51 ChangeLog.txt
-rw-r--r-- 1 root root  609984 Sep 30 23:23 ChangeLog.txt.tmp
drwxr-xr-x 2 root root    4096 Sep 30 23:52 ChangeLogs/
-rw-r--r-- 1 root root      11 Sep 30 23:23 LASTUPDATE
-rw-r--r-- 1 root root 1211591 Sep 30 23:52 PACKAGES.TXT
-rw-r--r-- 1 root root 1533212 Sep 30 23:52 SLACKPKGPLUS_alienbob-filelist.gz
-rw-r--r-- 1 root root  161129 Sep 30 23:52 SLACKPKGPLUS_multilib-filelist.gz
-rw-r--r-- 1 root root   23775 Sep 30 23:52 SLACKPKGPLUS_restricted-filelist.gz
-rw-r--r-- 1 root root     311 Sep 30 23:52 SLACKPKGPLUS_slackpkgplus-filelist.gz
-rw-r--r-- 1 root root   47819 Sep 30 23:52 extra-filelist.gz
drwxr-xr-x 2 root root    4096 Sep 30 23:26 gpg/
-rw-r--r-- 1 root root     355 Sep 30 23:04 install.log
-rw-r--r-- 1 root root   20847 Sep 30 23:52 pasture-filelist.gz
-rw-r--r-- 1 root root  952817 Sep 30 23:52 patches-filelist.gz
-rw-r--r-- 1 root root  211610 Sep 30 23:51 pkglist
-rw-r--r-- 1 root root  134797 Sep 30 23:23 pkglist.tmp
-rw-r--r-- 1 root root 2574645 Sep 30 23:52 slackware64-filelist.gz
-rw-r--r-- 1 root root     344 Sep 30 23:52 testing-filelist.gz

sbabaro1 · 09-30-2020, 01:15 PM

Quote:

Originally Posted by chrisretusn

Please post the results of 'grep "PRIORITY=" /etc/slackpkg/slackpkg.conf'

PRIORITY=( patches %PKGMAIN extra pasture testing )

sbabaro1 · 09-30-2020, 01:16 PM

Quote:

Originally Posted by chrisretusn

I doubt it. .....
Is this a full install of Slackware64-14.2?

yes

sbabaro1 · 09-30-2020, 01:18 PM

Quote:

Originally Posted by phenixia2003

Hello,

pkglist is built from the file CHECKSUMS.md5 (which is a concantenation of the CHECKSUMS.md5 from each repository) as below :

Code:

$ grep "\.t[blxg]z$" /var/lib/slackpkg/CHECKSUMS.md5 | awk -f /usr/libexec/slackpkg/pkglist.awk | sed -e "s/^M//g" > pkglist

I doubt that pkglist.awk is the issue. The generated pkglist is ok on my side with your slackpkgplus configuration. So, the issue can come from the CHECKSUMS.md5 file. You can run the command below to list the alienbob packages referenced in this file (on my side, 345 are found):

Code:

$ grep "SLACKPKGPLUS_alienbob/.*t[bglx]z$" /var/lib/slackpkg/CHECKSUMS.md5

--
SeB

you were right: there are just a few (the ones shown up by search)

phenixia2003 · 09-30-2020, 01:41 PM

Hello,

Quote:

Originally Posted by sbabaro1

you were right: there are just a few (the ones shown up by search)

Reconfigure slackpkgplus with only the alienbob repository, run slackpkg update, and search for alienbob packages in the CHECKSUMS.md5 again.

--
SeB

sbabaro1 · 10-01-2020, 02:00 AM

Curiously it's complain if I remove the other repository

I've tried to remove by comment out with # at the beginning the others MIRROPLUS repos, removing them also from REPOPLUS directive

Until I haven't reenabled them I cannot run slackpkg

Even if I left

Code:

REPOPLUS=( alienbob )

it has downloaded the info from every repo (perhaps is the correct behavior)

So the test was unsuccessful

phenixia2003 · 10-01-2020, 02:52 AM

Hello,

Quote:

Originally Posted by sbabaro1

Curiously it's complain if I remove the other repository

I've tried to remove by comment out with # at the beginning the others MIRROPLUS repos, removing them also from REPOPLUS directive

Until I haven't reenabled them I cannot run slackpkg

Even if I left

Code:

REPOPLUS=( alienbob )

it has downloaded the info from every repo (perhaps is the correct behavior)

So the test was unsuccessful

Try with this configuration :

Code:

SLACKPKGPLUS=on
VERBOSE=1
ALLOW32BIT=on
USEBL=1
WGETOPTS="--timeout=20 --tries=2"
SEARCH_CLOG_INPARENT=on
CACHEUPDATE=off
GREYLIST=on
SENSITIVE_SEARCH=on
WW_FILE_SEARCH=on
SHOWORDER=package
DETAILED_INFO=none
STRICTGPG=on

#PKGS_PRIORITY=( multilib restricted alienbob)

TAG_PRIORITY=off

#REPOPLUS=( slackpkgplus restricted alienbob multilib )

REPOPLUS=( alienbob )


#MIRRORPLUS['multilib']=http://bear.alienbase.nl/mirrors/people/alien/multilib/14.2/

MIRRORPLUS['alienbob']=http://bear.alienbase.nl/mirrors/people/alien/sbrepos/14.2/x86_64/

#MIRRORPLUS['restricted']=http://bear.alienbase.nl/mirrors/people/alien/restricted_sbrepos/14.2/x86_64/
#MIRRORPLUS['slackpkgplus']=http://slakfinder.org/slackpkg+/

Then, post the output of :

Code:

$ slackpkg update
$ slackpkg search alien
$ grep "SLACKPKGPLUS_alienbob/.*t[bglx]z$" /var/lib/slackpkg/CHECKSUMS.md5

--
SeB

sbabaro1 · 10-01-2020, 06:15 AM

I have the same result, just the few noarch packages

P.S.
thanks to your config I've noticed that I was missing to comment out PKGS_PRIORITY for the test, thanks for that

Quote:

Originally Posted by phenixia2003

Hello,

Try with this configuration :

Code:

SLACKPKGPLUS=on
VERBOSE=1
ALLOW32BIT=on
USEBL=1
WGETOPTS="--timeout=20 --tries=2"
SEARCH_CLOG_INPARENT=on
CACHEUPDATE=off
GREYLIST=on
SENSITIVE_SEARCH=on
WW_FILE_SEARCH=on
SHOWORDER=package
DETAILED_INFO=none
STRICTGPG=on

#PKGS_PRIORITY=( multilib restricted alienbob)

TAG_PRIORITY=off

#REPOPLUS=( slackpkgplus restricted alienbob multilib )

REPOPLUS=( alienbob )


#MIRRORPLUS['multilib']=http://bear.alienbase.nl/mirrors/people/alien/multilib/14.2/

MIRRORPLUS['alienbob']=http://bear.alienbase.nl/mirrors/people/alien/sbrepos/14.2/x86_64/

#MIRRORPLUS['restricted']=http://bear.alienbase.nl/mirrors/people/alien/restricted_sbrepos/14.2/x86_64/
#MIRRORPLUS['slackpkgplus']=http://slakfinder.org/slackpkg+/

Then, post the output of :

Code:

$ slackpkg update
$ slackpkg search alien
$ grep "SLACKPKGPLUS_alienbob/.*t[bglx]z$" /var/lib/slackpkg/CHECKSUMS.md5

--
SeB

phenixia2003 · 10-01-2020, 08:41 AM

Hello,

Quote:

Originally Posted by sbabaro1

I have the same result, just the few noarch
packages

P.S.
thanks to your config I've noticed that I was missing to comment out PKGS_PRIORITY for the test, thanks for that

I Think I found the cause of that issue. It seems the package aaa_base-14.2-x86_64-2 is missing on your system. It is used by slackpkgplus to check the system is 64-bit. Seems to be done this way in case slackpkg is run in a 32-bit environment (started with linux32 for instance), in which case uname -m returns i686...:

Code:

      X86_64=$(ls $ROOT/var/log/packages/aaa_base*x86_64* 2>/dev/null|head -1)
      for PREPO in ${REPOPLUS[*]};do
        if [ -z "$X86_64" ];then
          FILTEREXCLUDE="-(x86_64|arm)-"
        elif [ "$ALLOW32BIT" == "on" ];then
          FILTEREXCLUDE="-(arm)-"
        else
          FILTEREXCLUDE="-(x86|i[3456]86|arm)-"
        fi

How to reproduce the issue, then fix it :

Code:

$ mv /var/log/packages/aaa_base-14.2-x86_64-2 /var/log/packages/aaa_base-14.2-X86_64-2
$ slackpkg update
$ slackpkg search alienbob

Looking for alienbob in package list. Please wait...

The list below shows all packages with name matching "alienbob".

[ Status           ] [ Repository               ] [ Package                                  ]
  uninstalled              alienbob                     acpilight-1.0-noarch-1alien               
  uninstalled              alienbob                     apache-ant-1.9.7-noarch-1alien            
  uninstalled              alienbob                     google-caladea-font-ttf-20130214-noarch-1alien  
  uninstalled              alienbob                     google-carlito-font-ttf-20130920-noarch-1alien  
  uninstalled              alienbob                     libreoffice-sdkdoc-6.4.6-noarch-1alien    
  uninstalled              alienbob                     logwatch-7.4.3-noarch-1alien              
  uninstalled              alienbob                     lxqt-common-0.11.0-noarch-1alien          
  uninstalled              alienbob                     lynis-1.3.4-noarch-1alien                 
  uninstalled              alienbob                     minecraft-latest-noarch-3alien            
  uninstalled              alienbob                     opendyslexic-font-ttf-3-noarch-1alien     
  uninstalled              alienbob                     pastebinit-1.3.1-noarch-2alien            
  uninstalled              alienbob                     rhino-1.7.7.1-noarch-1alien               
  uninstalled              alienbob                     sabnzb-0.6.7-noarch-1alien                
  uninstalled              alienbob                     sendxmpp-1.23-noarch-1alien               
  uninstalled              alienbob                     webcore-fonts-installer-3.0-noarch-2alien  
  uninstalled              alienbob                     xalan-2.7.1-noarch-1alien                 
  uninstalled              alienbob                     xerces-2.11.0-noarch-1alien               
  upgrade                  alienbob                     lxmenu-data-0.1.5-x86_64-1_SBo --> lxmenu-data-0.1.5-noarch-1alien  

You can search specific files using "slackpkg file-search file".

$ mv /var/log/packages/aaa_base-14.2-X86_64-2 /var/log/packages/aaa_base-14.2-x86_64-2
$ slackpkg update
$ slackpkg search alienbob
Looking for alienbob in package list. Please wait... DONE

The list below shows all packages with name matching "alienbob".

[ Status           ] [ Repository               ] [ Package                                  ]
  uninstalled              alienbob                     BeautifulSoup-4.1.1-x86_64-1alien         
  uninstalled              alienbob                     MinGW-w64-v7.0.0_gcc9.3.0-x86_64-1alien   
  uninstalled              alienbob                     NetworkManager-openconnect-1.2.4-x86_64-1alien  
  uninstalled              alienbob                     OpenAL-1.18.1-x86_64-1alien               
  uninstalled              alienbob                     SDL_sound-1.0.3-x86_64-2alien             
  uninstalled              alienbob                     acpilight-1.0-noarch-1alien               
  uninstalled              alienbob                     aften-0.0.8-x86_64-3alien                 
  uninstalled              alienbob                     apache-ant-1.9.7-noarch-1alien            
  uninstalled              alienbob                     apache-websocket-20130724-x86_64-1alien   
  uninstalled              alienbob                     appmenu-qt-0.2.6-x86_64-1alien            
  uninstalled              alienbob                     armory-0.91_dev_20140317-x86_64-1alien    
  uninstalled              alienbob                     bitcoin-0.9.1-x86_64-1alien               
  uninstalled              alienbob                     broadcom-sta-6.30.223.271_4.4.14-x86_64-1_SBo  
  uninstalled              alienbob                     cabextract-1.4-x86_64-1alien              
  uninstalled              alienbob                     calibre-4.15.0-x86_64-1alien              
  uninstalled              alienbob                     calibre2-2.85.1-x86_64-1alien             
  uninstalled              alienbob                     chromium-pepperflash-plugin-32.0.0.403-x86_64-1alien  
  uninstalled              alienbob                     clamav-0.100.2-x86_64-1alien              
  uninstalled              alienbob                     cmark-0.29-x86_64-1alien                  
  uninstalled              alienbob                     compton-conf-0.2.0-x86_64-1alien          
  uninstalled              alienbob                     configobj-4.7.2-x86_64-3alien             
  uninstalled              alienbob                     cryptopp-5.6.2-x86_64-1alien              
  uninstalled              alienbob                     ctorrent-dnh3.3.2-x86_64-2alien           
  uninstalled              alienbob                     cuetools-1.4.1-x86_64-1alien              
....

So, to fix your issue you can just create a fake (ie empty) aaa_base-14.2-x86_64-2 file in /var/log/packages.

Hope this helps.

--
SeB

sbabaro1 · 10-01-2020, 09:04 AM

Awesome: I don't know why aaa_base-14.2-x86_64-2 file wasn't listed in /var/log/packages

Now I can see all the packages

Really thanks

chrisretusn · 10-01-2020, 11:14 AM

Interesting issue, even more interesting solution.