how to disconnect from HPC without disturbing processing

summit · 02-01-2018, 05:23 AM

Dear Friends,

I am running a program on HPC and I want to shut down my laptop without disturbing the processing running on HPC.
So, I am looking for a command to disconnect and connect the laptop to further look into the processing running on HPC.

Thanks.
regards,
SK

pan64 · 02-01-2018, 05:37 AM

that highly depends on:
1. what is that HPC
2. how do you use it (=how do you connect to it, what are you executing ...)
probably you need screen, but I'm not really sure about that.

summit · 02-01-2018, 07:05 AM

Hi

Thanks.
Connect means connect with ssh

pan64 · 02-01-2018, 07:08 AM

https://www.howtoforge.com/linux_screen

Reuti · 02-01-2018, 11:02 AM

Quote:

Originally Posted by summit

I am running a program on HPC and I want to shut down my laptop without disturbing the processing running on HPC.
So, I am looking for a command to disconnect and connect the laptop to further look into the processing running on HPC.

Is there no queuing system running on the HPC? Even if it’s only a single machine, it makes nowadays much sense to install a queuingsystem due to the many cores which are available. The advantages are:

serialize your workflow (instead of starting many jobs at once, it’s better that one after the other is executed if they are for example submitted on Friday afternoon and you check back in on Monday)
a mix of serial an parallel jobs can completely fill the machine, without overloading it
no need to have any session or terminal open (or be left open like with screen)
one can get an email once a job finishes

There are several (even free ones) available:

SLURM
PBSPro
GridEngine

Personally I would stay away from OpenPBS/Torque.

-- Reuti

scasey · 02-01-2018, 11:37 AM

Assumption: HPC is some kind of linux host/server. Hewlett-Packard, perhaps?

When necessary, I've always used nohup to prevent a job from ending on disconnect.
Running in background may also have that same effect.