Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UNICORE (Uniform Interface to Computing Resources) offers a ready-to-run Job submission system including client and server software. UNICORE makes distributed computing and data resources available in a seamless and secure way in intranets and the internet (https://www.unicore.eu/).

UCC (Unicore Command Line Client)

The UNICORE Commandline Client (UCC) is a full-featured client for accessing UNICORE services. It requires a Java runtime environment, version 8 11 or later. We recommend using the OpenJDK.

UCC offers * :

  • Job submission and management
*
  • Data movement (upload, download, server-to-server copy, etc) using the UNICORE storage management functions and the available data transfer protocols
*
  • Storage functions (ls, mkdir, ...) including creation of storage instances via storage factories
*
  • UNICORE Workflow service support and much more
.

https://sourceforge.net/projects/unicore/files/Clients/

https://unicore-docs.readthedocs
  • .
io/en/latest/user-docs/ucc/manual.html

Installation and Startup

The following instructions were taken from the UNICORE Command Line Client User guide, for more info please refer to the UNICORE official documentation.

Prerequisites

  • Operating Systems: currently Linux and Microsoft Windows are supported;
  • To run UCC, you need a Java runtime version 11 or later (OpenJDK preferred).

Procedure

  1. Download the installation archive
https://sourceforge.net/projects/unicore/files/Clients/Commandline%20Client/
  1. Untar the tar.gz file and copy it in your home directory
  • Configure your UCC preferences file:
    • michele@nmcarpene205872:~$ ls -ltrh ~/.ucc/preferences 
      -rw------- 1 michele michele 2,4K nov  8 14:40 /home/michele/.ucc/preferences
    1. or in the folder you prefer.
    2. Download the CA certificates by clicking on "Package with individual certs from CAcerts file in gz format" at this page. Copy in the folder ~/.unicore/certificates/ and untar it.
    3. Download the following certificate file unicore.hpc.cineca.it.CA.pem and add it to the certificate folder (not mandatory, but avoids "Add exception" requests at each ucc command launch).
    4. Login to UserDB using OpenID credentials and copy your OIDC token bearer visualized at this page.
    5. Configure your UCC preferences file (~/.ucc/preferences) adding
    Add
    1. a few lines as information into the file,
    including
    1. and insert your OIDC/OAuth2 token bearer.
      When finished, the file should appear as follows:


    #################################################################
    UI Text Box

    # User preferences for UCC
    authentication-method=bearer-token
    token=eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwi.....FkyV3pVSUFzc0RwaVprRURZV1U4Ukh3In0.eyJqdGkiOiJiMDBmNTkyMS01YjkxLTQzMGQtOTBjZC05ZDY4OTc4ODY4MTciLCJleHAiOjE2Njc5MzY0MTEsIm5iZiI6MCw.......cLXA

    # configure truststore containing trusted CA certs
    truststore.type=directory

    # if type is 'directory'
    truststore.directoryLocations.1=/home/<user>/

    user

    .unicore/certificates/*.pem
    truststore.directoryEncoding=PEM

    # do not check the SSL cert contains correct hostname
    client.serverHostnameChecking=NONE

    #


    #

    The address(es) of the registries to contact
    # (space separated list)

    registry=https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry

    #


    # default directory for output



    output=.
    protocols=UFTP BFT

    #################################################################

    The token bearer can be visualized from UserDB:

    https://userdb.hpc.cineca.it/node/32904

    Finally copy CA certificates inside the certificate folder (not mandatory to use the service) from:

    https://winnetou.surfsara.nl/prace/certs/

    from the link: Package with individual certs from CAcerts file in gz format (SHA1) (PGP)

    if you do not do it you can use the UCC client anyway but it will be asked you to accept the CA



    # User preferences for UCC
    authentication-method=bearer-token
    token=eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwi.....FkyV3pVSUFzc0RwaVprRURZV1U4Ukh3In0.eyJqdGkiOiJiMDBmNTkyMS01YjkxLTQzMGQtOTBjZC05ZDY4OTc4ODY4MTciLCJleHAiOjE2Njc5MzY0MTEsIm5iZiI6MCw.......cLXA

    # configure truststore containing trusted CA certs
    truststore.type=directory

    # if type is 'directory'
    truststore.directoryLocations.1=/home/<user>/.unicore/certificates/*.pem
    truststore.directoryEncoding=PEM

    # do not check the SSL cert contains correct hostname
    client.serverHostnameChecking=NONE

    # The address(es) of the registries to contact
    # (space separated list)

    registry=https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
    # default directory for output
    output=.
    protocols=UFTP BFT

    #################################################################


    After after these simple steps you can use the UCC


    michele@nmcarpene205872:~/UNICORE/ucc/unicore-ucc-9.0.0$ $ ./bin/ucc connect -v
    [ucc connect] UCC 9.0.0, https://www.unicore.eu
    [ucc connect] Reading properties file </home/michele/.ucc/preferences>
    [ucc connect] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
    [ucc connect] Output goes to <.>
    [ucc connect] Registry = https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
    [ucc connect] Using converted Registry URL https://unicore.hpc.cineca.it:9111/PRACE/rest/registries/default_registry
    [ucc connect] Checking registry connection.
    VALIDATION ERROR : No trusted CA certificate was found for the certificate chain
    Accept issuer <CN=Sectigo RSA Organization Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB> [Y/n/a]Y
    [ucc connect] Registry connection status: OK
    [ucc connect] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
    [ucc connect] Output goes to <.>
    [ucc connect] Using site default for TSS lifetime.
    [ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/factories/default_target_system_factory
    [ucc connect] TSS at address https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
    [ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-M100/rest/core/factories/default_target_system_factory
    [ucc connect] TSS at address https://unicore.hpc.cineca.it:9111/CINECA-M100/rest/core/sites/d96ec76d-215d-45b4-958b-be19333d6c73
    [ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-MARCONI/rest/core/factories/default_target_system_factory

    ...