'UNSW - Science

UNSW - Science - HPC

Installing Software for Yourself

If you want to try software that has not yet been installed on the cluster you can install it in your cluster home drive for yourself. Once you have tried the software and it has proven to be useful you can then request for the software to be installed and available by the module command.

Irrespective of the actual method of installation, at core the installation process involves putting the installed software in a directory in your $HOME directory and telling it where it can find all the software and libraries that it depends on.

Using a RPM or DEB package

Unfortunately there is no easy way to install a RPM or DEB package for yourself in your cluster home drive. You will need to obtain the software in a different format before using it.

Using an installer

This is probably the best installation option if it is available. After downloading and unpacking the software package you can then run a script that will, depending on how it was written, either search for required files or prompt you for their location.

Below are some examples of installing applications for yourself using an installer.

Installing Anaconda For Yourself

We have multiple versions of Python installed but you may want to use Anaconda instead so here is what is required to install Anaconda for yourself. We start by setting up a directory in scratch that we will keep installers in and then we work through the installation process.

[z1234567@katana ~]$ cd /srv/scratch/z1234567/
[z1234567@katana z1234567]$ mkdir installers
[z1234567@katana z1234567]$ cd pyinstallers
[z1234567@katana installers]$ curl -LOk http://repo.continuum.io/archive/Anaconda3-4.1.1-Linux-x86_64.sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  406M  100  406M    0     0  9631k      0  0:00:43  0:00:43 --:--:-- 12.6M
[z1234567@katana installers]$ chmod u+x Anaconda3-4.1.1-Linux-x86_64.sh 
[z1234567@katana installers]$ ./Anaconda3-4.1.1-Linux-x86_64.sh 
Welcome to Anaconda3 4.1.1 (by Continuum Analytics, Inc.)
In order to continue the installation process, please review the license
Please, press ENTER to continue
Anaconda License
***** License appears here. *****
Do you approve the license terms? [yes|no]
>>> yes
Anaconda3 will now be installed into this location:
  - Press ENTER to confirm the location
  - Press CTRL-C to abort the installation
  - Or specify a different location below
[/home/z1234567/anaconda3] >>> /srv/scratch/z1234567/anaconda3
installing: python-3.5.2-0 ...
installing: _nb_ext_conf-0.2.0-py35_0 ...
installing: alabaster-0.7.8-py35_0 ...
installing: anaconda-client-1.4.0-py35_0 ...
installing: anaconda-navigator-1.2.1-py35_0 ...
installing: argcomplete-1.0.0-py35_1 ...
installing: astropy-1.2.1-np111py35_0 ...
installing: babel-2.3.3-py35_0 ...
installing: backports-1.0-py35_0 ...
installing: beautifulsoup4-4.4.1-py35_0 ...
installing: bitarray-0.8.1-py35_0 ...
installing: blaze-0.10.1-py35_0 ...
installing: bokeh-0.12.0-py35_0 ...
***** Lots of missing lines *****
installing: conda-build-1.21.3-py35_0 ...
installing: conda-env-2.5.1-py35_0 ...
Python 3.5.2 :: Continuum Analytics, Inc.
creating default environment...
installation finished.
Do you wish the installer to prepend the Anaconda3 install location
to PATH in your /home/z1234567/.bashrc ? [yes|no]
[no] >>> no
You may wish to edit your .bashrc or prepend the Anaconda3 install location:
$ export PATH=/srv/scratch/z1234567/anaconda3/bin:$PATH
Thank you for installing Anaconda3!
Share your notebooks and packages on Anaconda Cloud!
Sign up for free: https://anaconda.org
[z1234567@katana installers]$ 

Then when you wish to use Anaconda (Python) then you just need to type the following line and then you will have access to it.

NOTE: After you have typed the following line the system will look in the Anaconda directory before it looks anywhere else so some software may behave differently to how you would expect.

[z1234567@katana installers]$ export PATH=/srv/scratch/z1234567/anaconda3/bin:$PATH

Compiling from source code