From: Steven Truong (midair77_at_[hidden])
Date: 2007-05-18 20:01:34
Hi, Jeff. Thanks so very much for all your helps so far. I decided
that I needed to go back and check whether openmpi even works for
simple cases, so here I am.
So my shell might have exited when it detect that I ran
non-interactively. But then again, how this parameter
MCA pls: parameter "pls_rsh_agent" (current value: "ssh :rsh")
affect my outcome? How am I going to set PATH and LD_LIBRARY_PATH to
be like those in .bash_profile in my Torque job files?
Could you give me some tips here?
Below is my current bash shell's settings.
Thanks,
Steven.
[struong_at_neptune ~]$ echo $SHELL
/bin/bash
[struong_at_neptune ~]$ cat .bash_profile | grep -v ^#
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
umask 027
PATH=/opt/intel/fce/9.1.043/bin:/usr/local/openmpi-1.2.1/bin:/opt/c3-4:/opt/bin:/usr/local/torque/bin:/usr/local/torque/sbin:/usr/local/maui/bin:/usr/local/maui/sbin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/X11R6/bin:/usr/local/rrdtool-1.2.12/bin:~/bin
BASH_ENV=$HOME/.bashrc
FC=/opt/intel/fce/9.1.043/bin/ifort
F90=$FC
F77=$FC
F77_GETARGDECL=" "
LD_LIBRARY_PATH=/usr/local/openmpi-1.2.1/lib
RSHCOMMAND=/usr/bin/ssh
PBS_DEFAULT="neptune"
PBSLOGLEVEL=7
BUILD_DIR=/tmp/rrdbuil
INSTALL_DIR=/usr/local/rrdtool-1.2.12
source /usr/local/ecce/scripts/runtime_setup.sh
export F77 USERNAME BASH_ENV PATH RSHCOMMAND FC F90 PBS_DEFAULT
BUILD_DIR INSTALL_DIR LD_LIBRARY_PATH
[struong_at_neptune ~]$ ssh node07 which orted
which: no orted in (/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin)
[struong_at_neptune ~]$ /usr/local/openmpi-1.2.1/bin/mpirun --host node07
node07 hostname
--------------------------------------------------------------------------
Failed to find the following executable:
Host: node07.nanostellar.com
Executable: node07
Cannot continue.
--------------------------------------------------------------------------
On 5/18/07, Jeff Squyres <jsquyres_at_[hidden]> wrote:
> On May 18, 2007, at 4:38 PM, Steven Truong wrote:
>
> > [struong_at_neptune 4cpu4npar10nsim]$ mpirun --mca btl tcp,self -np 1
> > --host node07 hostname
> > bash: orted: command not found
>
> As you noted later in your mail, this is the key problem: orted is
> not found on the remote node.
>
> Notice that you are currently using the rsh launcher, not the Torque
> launcher (presumably because you are not inside a Torque job). What
> you want to check is:
>
> rsh node07 which orted
>
> (or use ssh -- whatever is correct for your cluster)
>
> I suspect that orted will not be found, and that you'll need to
> modify your shell startup files to set PATH / LD_LIBRARY_PATH
> properly. Note that some shell startup files will exit early if they
> detect that they are running on a non-interactive login. See http://
> www.open-mpi.org/faq/?category=running#adding-ompi-to-path for more
> details.
>
> Alternatively, you can simply use the absolute pathname to mpirun,
> which Open MPI will interpret to mean that you want OMPI to set the
> PATH/LD_LIBRARY_PATH on the remote node for you. Something like this:
>
> /usr/local/openmpi-1.2.1/bin/mpirun --host node07 hostname
>
> (note that the "btl" MCA parameter is only relevant for MPI executables)
>
> --
> Jeff Squyres
> Cisco Systems
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>