crlf-cr conversion

eublade · 08-16-2007, 12:46 PM

i downloaded some program source (cvscedega) from windows and then copied to my root folder.
when i try and execute the install scripts, it tells:
/bin/bash^M unknown interpreter
i guess this should be caused by having saved the files from windows, using crlf as carriage return
i kind of remember there should be some command to do this windows-to-linux conversion for ascii files, can someone tell me please?

MasterC · 08-16-2007, 01:00 PM

dos2unix, but that's probably not your problem. Check the execution parameters:
ls -l install-script

If it doesn't have an exec bit set (no x in the xwrxwrxwr area) then you need to do something like:
chmod a+x install-script
OR
chmod 750 install-script

-Chad

sudhach · 08-16-2007, 02:05 PM

Won't work, bash won't honor ^M.

run a onle liner

dos2unix < install-script > install-script.sh
or
perl -ne 's/\s+$//g; print $_."\n"' < install-script > install-script.sh

then run the script like this

sh install-script.sh

pixellany · 08-16-2007, 02:05 PM

I don't have the answer, but I would not think that the error message ("/bin/bash^M unknown interpreter") would be caused by the execute permission being off.

syg00 · 08-16-2007, 02:22 PM

Quote:

Originally Posted by sudhach

perl -ne 's/\s+$//g; print $_."\n"' < install-script > install-script.sh

Wouldn't that cause a double-spaced output ???.
Each line will still have the LF after deleting the CR, so why add \n ???.

No harm probably ...

I use sed to do similar.

sudhach · 08-16-2007, 02:33 PM

Nope.

As \s+$ removes any white space at the end of the line(meaning removes all of CR, LF, Tab, Vertical Tab...).

the "\n" adds just the LF

syg00 · 08-16-2007, 06:47 PM

Ahh - yeah, I just lop off the last char rather than al the whitespace.

cheers ...

maroonbaboon · 08-16-2007, 07:07 PM

Minimal unix solution:

$ tr -d '\015' < infile > outfile

(\015 = octal 13 = ascii ^M).

eublade · 08-17-2007, 12:19 PM

thanks for the answers, i'll try and see
this is not very comfortable though cause i don't know how many scripts there are, if too many i better just redownload anything from linux...

i was trying with another thing:
i copied the cvs folder to my shared fat partition, then i mounted it with:
mount -t vfat -o conv=a /dev/sda3 /shared_fat
in the mount man page, it says that conv=a for (v)fat enables the crlf<->lf conversion at driver level for ascii files. then i cp -r the folder to my home but they're all still dos-encoded.
i even tried conv=t which should translate every file, but neither did anything, strangely enough...

syg00 · 08-17-2007, 06:21 PM

Presuming you want to change every line of everything called .sh in the current directory, something like the following should work

Code:

for i in `ls *.sh` ; do sed -i 's/.$//' $i ; done

Substitute any of the options offered above depending on taste. Likewise the glob can be modified to suit.

eublade · 08-17-2007, 06:27 PM

if they had .sh extension it'd be easy
instead there're a lot of scripts without any extension, that's why i tried with the vfat auto conversion, if it worked like it's supposed to do

well i'll try and convert every file recursively, they should be all ascii files so no harm

syg00 · 08-17-2007, 06:49 PM

"for i in `ls *`" ???
If it's going to hit things I don't want hit I just create a test directory with the things that need fixing, and splat that. Then move them back.

There's usually a way.

eublade · 08-18-2007, 11:03 AM

ok i've done it
i've written this script to change only text files and to reset the x attribute for the rewritten files:

Code:

#!/bin/bash
#copies every file recursively from $FROM_DIR to $TO_DIR
#converts all text files from DOS convention to UNIX convention (CRLF->LF)
#by Eugenio

FROM_DIR="/root/bin/winex_dos/"
TO_DIR="/root/bin/winex/" #previous content will be deleted before conversion

# returns OK if $1 contains $2
strstr() {
  [ "${1#*$2*}" = "$1" ] && return 1
  return 0
}

convert() {
  test -d "$2" || mkdir "$2" || ! echo "Unable to create destination folder $2" || exit 1
  for entry in $(ls -Ap "$1"); do
    if [ -f "$1$entry" ]; then
      $(strstr "$(file "$1$entry")" "text") && $(perl -ne 's/\s+$//g; print $_."\n"' < "$1$entry" > "$2$entry")
      $(strstr "$(file "$1$entry")" "executable") && $(chmod +x "$2$entry")
    elif [ -d "$1$entry" ]; then
      $(convert "$1$entry" "$2$entry")
    fi
  done
}

test -d $TO_DIR || mkdir $TO_DIR || ! echo "Unable to create destination folder $TO_DIR" || exit 1
test -r $FROM_DIR || ! echo "Unable to read from source folder $FROM_DIR" || exit 1
test -w $TO_DIR || ! echo "Unable to write to destination folder $TO_DIR" || exit 1

rm -fr $TO_DIR
cp -r $FROM_DIR $TO_DIR
convert $FROM_DIR $TO_DIR

exit 0

thanks to everybody for the help