LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices



Reply
 
Search this Thread
Old 10-08-2010, 06:21 AM   #1
Lovelyhard
LQ Newbie
 
Registered: Oct 2010
Location: Vienna/Austria/Europe
Posts: 5

Rep: Reputation: 0
Multiple scp/ssh in one bash script


for updating several devices connected via IP I want to write a little bash script doing several scp and ssh commands, like

<pseudocode>
read -s -p "enter master pwd for devices:" inputline
devpwd=$inputline

scp $2 up@$1/tmp/
ssh up@$1 '/tmp/makeup.sh && reboot'

</pseudocode>

Unfortunately I have to enter the device's pwd for each scp/ssh call.
Is there a way to read the pwd ONCE via script and then distributing it via $devpwd ???

Yes, I know about key authentication, and, no, there is no way using this :-( All I found are well-meant ideas how to install key authentication. Yes, I know about possible security risks and, no, I do NOT want to store pwds in files ;-)

Any ideas how I can avoid entering the pwd again and again?
TIA,
Heinz
 
Old 10-08-2010, 06:33 AM   #2
angel115
Member
 
Registered: Jul 2005
Location: France / Ireland
Distribution: Debian mainly, and Ubuntu
Posts: 494

Rep: Reputation: 75
Please discard the post below I miss read you post...

Have you try a key exchange?
From the server that will run the script, like this:
Code:
ssh-copy-id -i ~/.ssh/id_rsa.pub username@remote-server
this will copy your key to the remote server and grant you access without password in a relatively secure way

Last edited by angel115; 10-08-2010 at 06:40 AM.
 
Old 10-08-2010, 06:39 AM   #3
GrapefruiTgirl
Guru
 
Registered: Dec 2006
Location: underground
Distribution: Slackware64
Posts: 7,594

Rep: Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550
I like the above idea, but given that the OP says he/she doesn't want to use key authentication, I think it would be a good job for `expect`.
Since I'm not good at writing `expect` scripts from scratch, if it were me I would use `autoexpect` to generate a working `expect` script that logs into one device and performs the needed tasks; then I would expand the script (mostly just copy & paste) to make it repeat the operations for the remaining machines.
Assuming the password is the same for all machines (hence the name "master password") you would just need to input the password one time to the script, and the script would re-use it to log into the second and subsequent machines.

If OP wants to investigate this route, check the manpage for `autoexpect` (and for `expect` also) - it's pretty complete as manpages go, and should give you an idea if it's the tool for this job.

Best regards.
 
Old 10-08-2010, 12:34 PM   #4
ntubski
Senior Member
 
Registered: Nov 2005
Distribution: Debian
Posts: 2,543

Rep: Reputation: 880Reputation: 880Reputation: 880Reputation: 880Reputation: 880Reputation: 880Reputation: 880
Expect isn't needed, use the ControlPath and ControlMaster options:
Code:
# will ask for password here
ssh -NfM -o 'ControlPath=~/.ssh/%r@%h:%p.conn' "$HOST"

# uses existing connection, doesn't ask for password
scp -o 'ControlPath=~/.ssh/%r@%h:%p.conn' $2 up@$HOST/tmp/
ssh -o 'ControlPath=~/.ssh/%r@%h:%p.conn' up@$HOST '/tmp/makeup.sh && reboot'

# close the connection
ssh -o 'ControlPath=~/.ssh/%r@%h:%p.conn' -O exit "$HOST"
 
Old 10-12-2010, 06:59 AM   #5
Lovelyhard
LQ Newbie
 
Registered: Oct 2010
Location: Vienna/Austria/Europe
Posts: 5

Original Poster
Rep: Reputation: 0
I thought I would come around using expect and similar, anyway, it was exact what finally did the trick.

Thanks to all for your hints and input!

Heinz
 
Old 10-14-2010, 06:03 AM   #6
GrapefruiTgirl
Guru
 
Registered: Dec 2006
Location: underground
Distribution: Slackware64
Posts: 7,594

Rep: Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550
Hello Heinz,

glad you got a working solution! Did you write it in `expect` or use `autoexpect` or both?

If perchance you get a few minutes sometime, maybe you would show us the code you came up with - someone else might find it handy one day.

Thanks, and best regards!
 
Old 10-15-2010, 05:30 AM   #7
Lovelyhard
LQ Newbie
 
Registered: Oct 2010
Location: Vienna/Austria/Europe
Posts: 5

Original Poster
Rep: Reputation: 0
I've done with a mixture of bash/expect.

What I've been searching for is the possibility to do the exact same procedure to a set of IP devices, e.g. reconfiguring by changing a config file and restarting a deamon, uploading a new flash image and calling an internal reflash procedure, ...

With a little help I got this, I've stripped all unneeded for better understanding what I did:
Code:
#!/bin/bash

read -s -p "Enter device password: " inputline
devpwd="$inputline\n"
filetomove=$1
devip=$2

echo -n "Startinf file transfer..."
res=$(expect -c "
   spawn scp $filetomove root@$devip:/control
   expect *password: { send $devpwd }
   expect *100%* { }
   exit
")
echo "Done. " 
echo -n "Starting reconfigure..."
res=$(expect -d -c "
   spawn ssh root@$devip reconfigure
   expect *password: { send $devpwd }
   exit
")
I thougt it WOULD work like a charm, but only the first part did. The second failed, I've tricked myself by switching between two configs for testing... :-(. The command passed along ssh had never been executed.
But when I' echoing the ssh line to console ( using expect's -d parameter), and execiting it from the prompt it does exact what I'm expecting :-s

So I've changed the second part to:
Code:
res=$(expect -d -c "
   spawn ssh root@$devip 
   expect *password: { send $devpwd }
   expect *dev>? { send reconfigure }
   exit
")
And this one is nagging cause of a pile of lines after successful login before the prompt appears.

The "most pretty" way for me would be to get the first attempt running; but, if second would make it - is there a simple possibility to "loop" thru an unknown number of incoming lines, just waiting/watching for the prompt?

BTW, I've used the notation given above cause doing it this way it's much easier using $variable from script without chinning the bar.

Any ideas?

heinz
 
Old 10-15-2010, 11:44 AM   #8
Lovelyhard
LQ Newbie
 
Registered: Oct 2010
Location: Vienna/Austria/Europe
Posts: 5

Original Poster
Rep: Reputation: 0
*ARGL*

Double booboo!

First I've forgotten to add a "\n" at the end of my command strings, and second the prompt isn't "dev>" but "dev> " - which of course has never been found due to the trailing space... :-%

Add'lly I've changed the syntax a little bit, still using embedded expect code in the bash script (due to much easier access to script variables.
Code:
/usr/bin/expect - << EndMark
  ...
  ...
  ...
EndMark
This gives me the benefit to be able to use standard "..." string notation for send and expect which was a debacle in the previous version, too.

Heinz
 
Old 02-14-2011, 07:03 AM   #9
johnc10
LQ Newbie
 
Registered: Apr 2004
Location: UK
Distribution: Fedora
Posts: 7

Rep: Reputation: 0
scp and ssh using expect within a bash script

I couldn't get the EndMark syle to work. Used this instead :-

Code:
#!/bin/bash

ssh1()
{
# ssh1 user server password command
# password is read in using $sshpassword
# e.g. ssh user1 test.server.com $sshpassword uname -a

# Use the following before calling scp1 and/or the server loop if have same password
#stty -echo
#echo "Enter password: "
#read sshpassword
#stty echo

expect -c "
   set timeout 1
   spawn ssh $1@$2 $4 $5 $6 $7 $8
   expect yes/no { send yes\r ; exp_continue }
   expect password: { send $3\r }
   expect .* {}
   exit
"
}

scp1()
{
# scp1 user server password file dir filecopy
# password is read in using $sshpassword
# e.g. scp1 user1 test.server.com $sshpassword myfile /tmp myfilecopy


# Use the following before calling scp1 and/or the server loop if have same password
#stty -echo
#echo "Enter password: "
#read sshpassword
#stty echo


expect -c "
   set timeout 1
   spawn scp $4 $1@$2:$5/$6
   expect yes/no { send yes\r ; exp_continue }
   expect password: { send $3\r }
   expect 100%
   sleep 1
   exit
"
}


stty -echo
echo "Enter password: "
read sshpassword
stty echo

scp1 user1 localhost $sshpassword file1 /tmp filecopy1
ssh1 user1 localhost $sshpassword uname -a

Last edited by johnc10; 02-16-2011 at 11:36 AM. Reason: bash missing. scp needs sleep after expect 100%.
 
Old 02-15-2011, 02:55 AM   #10
Reuti
Senior Member
 
Registered: Dec 2004
Location: Marburg, Germany
Distribution: openSUSE 13.1
Posts: 1,320

Rep: Reputation: 252Reputation: 252Reputation: 252
The thread is some months old - I wonder about the OP's statement not to use an ssh-key. A passphrase protected ssh-key can be added to the ssh-agent at the start, and removed again when you are done.

Another option could be hostbased authentication.
 
Old 02-15-2011, 03:49 AM   #11
johnc10
LQ Newbie
 
Registered: Apr 2004
Location: UK
Distribution: Fedora
Posts: 7

Rep: Reputation: 0
Yes key exchange is the best way, but this is not always possible as everyone logging on needs to have a key setup, so this is a alternative without storing the password in a script (and assumes all the servers have the same password).
 
Old 02-16-2011, 11:40 AM   #12
johnc10
LQ Newbie
 
Registered: Apr 2004
Location: UK
Distribution: Fedora
Posts: 7

Rep: Reputation: 0
expect 100% needs sleep

Updated code above to add a sleep 1 after expect 100% . This is because the file transfer was being ended before all the file had actually transferred, therefore the 100% is being displayed prematurely (probably milliseconds).

Code:
expect -c "
   set timeout 1
   spawn scp $4 $1@$2:$5/$6
   expect yes/no { send yes\r ; exp_continue }
   expect password: { send $3\r }
   expect 100%
   sleep 1
   exit
"
 
Old 07-31-2012, 10:33 AM   #13
ksdeiva
LQ Newbie
 
Registered: Oct 2011
Posts: 14

Rep: Reputation: Disabled
need your help

Hi, I have tried the script. its working good for local host i tried change the localhost and gave IP its not working...

please help me....





Quote:
Originally Posted by johnc10 View Post
I couldn't get the EndMark syle to work. Used this instead :-

Code:
#!/bin/bash

ssh1()
{
# ssh1 user server password command
# password is read in using $sshpassword
# e.g. ssh user1 test.server.com $sshpassword uname -a

# Use the following before calling scp1 and/or the server loop if have same password
#stty -echo
#echo "Enter password: "
#read sshpassword
#stty echo

expect -c "
   set timeout 1
   spawn ssh $1@$2 $4 $5 $6 $7 $8
   expect yes/no { send yes\r ; exp_continue }
   expect password: { send $3\r }
   expect .* {}
   exit
"
}

scp1()
{
# scp1 user server password file dir filecopy
# password is read in using $sshpassword
# e.g. scp1 user1 test.server.com $sshpassword myfile /tmp myfilecopy


# Use the following before calling scp1 and/or the server loop if have same password
#stty -echo
#echo "Enter password: "
#read sshpassword
#stty echo


expect -c "
   set timeout 1
   spawn scp $4 $1@$2:$5/$6
   expect yes/no { send yes\r ; exp_continue }
   expect password: { send $3\r }
   expect 100%
   sleep 1
   exit
"
}


stty -echo
echo "Enter password: "
read sshpassword
stty echo

scp1 user1 localhost $sshpassword file1 /tmp filecopy1
ssh1 user1 localhost $sshpassword uname -a
 
Old 07-31-2012, 10:37 AM   #14
ksdeiva
LQ Newbie
 
Registered: Oct 2011
Posts: 14

Rep: Reputation: Disabled
Multiple scp/ssh in one bash script using Spawn

Can anyone help me to execute multiple command using spawn like

1) first I have to copy file through SCP
2) Second, I have to execute a command (service restart)

Using Spawn ..
 
  


Reply

Tags
expect, ssh


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Bash backup script with scp, multiple processes mky Programming 8 09-29-2010 07:28 PM
bash script using sed/scp/ssh has issues with delimited file ScottThornley Programming 5 03-18-2009 04:45 PM
scp in bash script only getting to 11% just_me_then Linux - General 5 04-27-2008 04:02 AM
bash script problems: scp/ssh from the node of a cluster to the other server frankie_DJ Programming 2 01-27-2007 07:29 PM
scp/ssh tail(multiple file) remote copy tpreitano Linux - General 1 08-22-2005 03:17 PM


All times are GMT -5. The time now is 07:27 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration