| 20 | | }}} |
| 21 | | |
| 22 | | === Tulane Box Accounts === |
| 23 | | In your Cypress session, you can transfer files between your [https://tulane.box.com Tulane Box account] and Cypress on the command line using the '''rclone''' command, which is available via the module '''rclone'''. (See Option 1 of 2 below and [[cypress/ModuleCommand|Module command]]). |
| 24 | | |
| 25 | | In order to use rclone on Cypress, you must first create the config file ''~/.config/rclone/rclone.conf'' on your Cypress account. You can generate your ''rclone.conf'' file either directly in your Cypress session or by creating it on your local machine and then copying it to your Cypress account via one of the following options. |
| 26 | | |
| 27 | | ==== Option 1 of 2: Generating Your rclone.conf File In Your Cypress Session ==== |
| 28 | | 1. Login to Cypress from your local machine with X11 forwarding. (See [[cypress/SshUsage#TunnelingXWindowsSessionviaSSH|X11 Forwarding]].) |
| 29 | | 2. In your Cypress session enter the following commands. |
| 30 | | {{{ |
| 31 | | [tulaneID@cypress1 ~]$ module load rclone |
| 32 | | [tulaneID@cypress1 ~]$ rclone config |
| 33 | | }}} |
| 34 | | 3. At the prompt '''...No remotes found - make a new one...''', enter {{{n}}} for '''New remote'''. |
| 35 | | 4. At the prompt '''name>''', choose a meaningful name, e.g, {{{TU-Box}}}, to be used for future connection to your Tulane Box account from your Cypress command line session. |
| 36 | | 5. At the prompt '''Type of storage to configure...''', enter {{{6}}} for '''Box'''. |
| 37 | | 6. At the prompt '''...Box App Client Id...''', respond by pressing {{{Enter}}} for the default. |
| 38 | | 7. At the prompt '''...Box App Client Secret...''', respond by pressing {{{Enter}}} for the default. |
| 39 | | 8. At the prompt '''Edit advanced config? (y/n)nnn''', enter {{{n}}} for '''No'''. |
| 40 | | 9. At the prompt '''Remote config - Use auto config?...''', enter {{{y}}} for '''Yes'''. |
| 41 | | 10. Observe the message ending in '''Waiting for code ...''', and wait for a separate browser window to open on your local machine with a Box web page. Depending on your network latency, you may experience a delay of 1 minute or more. |
| 42 | | In the Box web page, click on the link '''Use Single Sign On (SSO)'''. |
| 43 | | 11. In the next Box web page, enter your full Tulane email address and click on '''Authorize'''. |
| 44 | | 12. This will take you to the Tulane login web page, wherein you can complete your Tulane login information and click on '''Sign in'''. |
| 45 | | 13. This final web page should show the message '''Success! - All done. Please go back to rclone''', at which point you can close the browser window and return to your Cypress session command line window. |
| 46 | | 14. Back in the command line window, observe the new message '''Got code''' followed by your new token information ending with a prompt to which you can respond {{{y}}} for '''Yes this is OK'''. |
| 47 | | 15. The resulting response shows the list '''Current remotes:''', including your new Box remote, e.g., '''TU-Box''' followed by a prompt to which you can respond {{{q}}} for '''Quit config'''. |
| 48 | | 16. Observe the newly created config file '''~/.config/rclone/rclone.conf''' |
| 49 | | {{{ |
| 50 | | [tulaneID@cypress1 ~]$ ls -l ~/.config/rclone/ |
| 51 | | total 8 |
| 52 | | -rw------- 1 tulaneID group 233 Jun 29 20:00 rclone.conf |
| 53 | | [tulaneID@cypress1 ~]$ cat ~/.config/rclone/rclone.conf |
| 54 | | [TU-Box] |
| 55 | | type = box |
| 56 | | token = {"access_token":"ABCDEFGHIJKLMNOPQRSTUVWXYZ1234567","token_type":"bearer","refresh_token":"ABCDEFGHIJKLMNOPQRSTUVWXYZ1234567890abcdefghijklmnopqrstuvwxyz12","expiry":"2020-06-29T21:03:28.009439309-05:00"} |
| 57 | | |
| 58 | | }}} |
| 59 | | at which point you're ready to run rclone on Cypress. (See '''Running rclone on Cypress''' below.) |
| 60 | | |
| 61 | | |
| 62 | | ==== Option 2 of 2: Generating Your rclone.conf File Using Your Local Machine ==== |
| 63 | | 1. Download, install, and configure rclone on your local machine by following the instructions for Windows, Mac, or Linux as appropriate starting from the [https://rclone.org/install/ rclone installation site.] |
| 64 | | a. During the above configuration, you will be prompted for a name for the Box remote system, e.g. '''TU-Box'''. |
| 65 | | b. Make note of your response for the name of the Box remote system for future reference to be used in your invocations of the rclone command. |
| 66 | | 2. Once you've configured rclone on your local machine, locate the resulting file '''rclone.conf''' on your local machine. |
| 67 | | a. On Mac and Linux, e.g., look for the file '''~/.config/rclone/rclone.conf''' |
| 68 | | b. On Windows 8 (or under) , e.g., look for the file '''%userprofile%\.config\rclone\rclone.conf''' |
| 69 | | 3. Create as needed the directory '''~/.config/rclone''' on your Cypress account. |
| 70 | | 4. Copy the resulting file '''rclone.conf''' from your local machine to your Cypress directory '''~/.config/rclone'''. See [[cypress/FileTransfer|File Transfer]]. |
| 71 | | 5. For security purposes, be sure to confirm that only you have ''exclusive'' read/write privileges to the resulting file '''~/.config/rclone/rclone.conf''' on Cypress. See the ''ls'' and ''chmod'' commands under [[cypress/BasicLinuxComands|Linux Commands]] |
| 72 | | |
| 73 | | Once you have created the config file '''~/.config/rclone/rclone.conf''' on Cypress, you can run rclone via the following. |
| 74 | | |
| 75 | | ==== Running rclone on Cypress ==== |
| 76 | | |
| 77 | | The following examples assume that you've already performed the configuration as above using the remote name '''TU-Box''' for your Tulane Box account. |
| 78 | | |
| 79 | | 1. If you haven't done so already from the above, load the module rclone. |
| 80 | | {{{ |
| 81 | | [tulaneID@cypress1 ~]$ module load rclone |
| 82 | | }}} |
| 83 | | 2. To list the entire contents in your Tulane Box account... |
| 84 | | {{{ |
| 85 | | [tulaneID@cypress1 ~]$ rclone ls TU-Box: |
| 86 | | }}} |
| 87 | | 3. To list the contents of a top-level folder in your Tulane Box account... |
| 88 | | {{{ |
| 89 | | [tulaneID@cypress1 ~]$ rclone ls TU-Box:<top-level-folder> |
| 90 | | }}} |
| 91 | | 4. To copy the contents of a top-level folder in your Tulane Box account to your current Cypress working directory... |
| 92 | | {{{ |
| 93 | | [tulaneID@cypress1 ~]$ rclone copy TU-Box:<top-level-folder> . |
| 94 | | }}} |
| 95 | | 5. To show progress using the '''-P''' option while copying the (~5GB) file bigFile.txt in your current Cypress working directory to a top-level folder in your Tulane Box account... |
| 96 | | {{{ |
| 97 | | [tulaneID@cypress1 ~]$ ls -l bigFile.txt |
| 98 | | -rw-r--r-- 1 tulaneID group 5000000000 Oct 25 2019 bigFile.txt |
| 99 | | [tulaneID@cypress1 ~]$ rclone -P copy bigFile.txt TU-Box:<top-level-folder> |
| 100 | | Transferred: 475.586M / 4.657 GBytes, 10%, 37.208 MBytes/s, ETA 1m55s |
| 101 | | Errors: 0 |
| 102 | | Checks: 0 / 0, - |
| 103 | | Transferred: 0 / 1, 0% |
| 104 | | Elapsed time: 12.7s |
| 105 | | Transferring: |
| 106 | | * bigFile.txt: 9% /4.657G, 35.761M/s, 2m0s |
| 107 | | }}} |
| 108 | | 6. To simply list the available subcommands under rclone. |
| 109 | | {{{ |
| 110 | | [tulaneID@cypress1 ~]$ rclone --help |
