Upload and download files from and to HORNET cluster

From Storrs HPC Wiki
Revision as of 11:03, 5 May 2014 by Tix11001 (talk | contribs) (SCP)
Jump to: navigation, search


This page provides instructions on how to copy files to and from the Hornet cluster

SCP

Secure Copy or SCP is a means of securely transferring computer files between a local host and a remote host or between two remote hosts. It is based on the Secure Shell (SSH) protocol.

How to SCP (Secure Copy) with FileZilla on Windows

You can easily transfer files from a server that has SSH (Secure Shell) running but not FTP (File Transfer Protocol) using Filezilla on Windows. When using Filezilla it will be called SFTP (Secure File Transfer Protocol) and will allow you to copy files from a server to your local Windows computer with ease. Follow the simple steps below to securely copy files from a server that is running SSH.

1 Open Filezilla: First you will need to launch Filezilla. If you do not have Filezilla you can obtain it for free from this link. Then please install it on your system.

2 Open Site Manager: Click on File in the top navigation menu and then select “Site Manager”:

Error creating thumbnail: File missing

This will open Filezilla’s Site Manager, as shown below, where you can add, delete, and modify sites that you visit often.Now you can follow the operations in the figure below.

Operation on site manager.png

Now Filezilla will give you a response as below, it means you connect successfully. Then, you click "ok" button on the pop window.

Error creating thumbnail: File missing

Finally, Filezilla shows the information below. You can now upload or download files.

Error creating thumbnail: File missing

3 upload or download file Assume you want to upload file "1.png" under file folder "C:\Users\boh10002\Desktop\" in your computer to the file folder "/home/boh10002" in the server, as shown below. Then you choose the file want to upload and right click your Mouse button. A window pop up, you choose the upload option and file begins uploading. You can also change the folder in your computer or server as shown in below.

Error creating thumbnail: File missing

It is similar for download operation.

Alternative SCP client for Windows: WinSCP

An alternative SCP client WinSCP could be downloaded from http://ninite.com/ or http://winscp.net/eng/download.php.

Check this video if you don't know how to use WinSCP: http://www.youtube.com/embed/AJdG5W7RZcc

SCP under linux platform

The SCP program is a software tool implementing the SCP protocol as a service daemon or client. It is a program to perform secure copying. The SCP server program is typically the same program as the SCP client.

Perhaps the most widely used SCP program is the command line scp program, which is provided in most SSH implementations. The scp program is the secure analog of the rcp command. The scp program must be part of all SSH servers that want to provide SCP service, as scp functions as SCP server too.

Typically, a syntax of scp program is like the syntax of cp:

Copying file to Hornet cluster:

scp SourceFile user@hornet.engr.uconn.edu:directory/TargetFile

Copying file from Hornet cluster:

scp user@hornet.engr.uconn.edu:directory/SourceFile TargetFile
scp -r user@hornet.engr.uconn.edu:directory/SourceFolder TargetFolder

Note that if the remote host uses a port other than the default of 22, you can specify it in the command. For example, copying a file from host:

scp -P 2222 user@host:directory/SourceFile TargetFile

Other methods

We only allow the users to run the compilers and the data transferring tools on the login nodes without bsub. If your jobs like that kind but is not ftp or scp commands are killed on the login node, please notice us via [1]. We will add the exclusion of the software after verifying the function of your software.