In this page:
This is a base guide to learn using UNICORE Services and tools. In case of troubles please report any problem to superc@cineca.it
Introduction
UNICORE (Uniform Interface to Computing Resources) offers a ready-to-run Job submission system including client and server software. UNICORE makes distributed computing and data resources available in a seamless and secure way in intranets and the internet (https://www.unicore.eu/).
UCC (Unicore Command Line Client)
The UNICORE Commandline Client (UCC) is a full-featured client for accessing UNICORE services. It requires a Java runtime environment, version 8 or later. We recommend using the OpenJDK. UCC offers * Job submission and management * Data movement (upload, download, server-to-server copy, etc) using the UNICORE storage management functions and the available data transfer protocols * Storage functions (ls, mkdir, ...) including creation of storage instances via storage factories * UNICORE Workflow service support and much more.
https://sourceforge.net/projects/unicore/files/Clients/
https://unicore-docs.readthedocs.io/en/latest/user-docs/ucc/manual.html#
Installation and Startup
The following instructions were taken from the UNICORE Command Line Client User guide, for more info please refer to the UNICORE official documentation (http://www.unicore.eu/documentation/).
Prerequisites
- Operating Systems: currently Linux and Microsoft Windows are supported;
- To run UCC, you need a Java runtime version 11 or later (OpenJDK preferred).
Procedure
- Download the installation archive https://sourceforge.net/projects/unicore/files/Clients/Commandline%20Client/
- Untar the tar.gz file and copy it in your home directory
- Configure your UCC preferences file:
- michele@nmcarpene205872:~$ ls -ltrh ~/.ucc/preferences
-rw------- 1 michele michele 2,4K nov 8 14:40 /home/michele/.ucc/preferences
- michele@nmcarpene205872:~$ ls -ltrh ~/.ucc/preferences
- Add a few lines as information into the file, including your OIDC/OAuth2 token bearer:
#################################################################
# User preferences for UCC
authentication-method=bearer-token
token=eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwi.....FkyV3pVSUFzc0RwaVprRURZV1U4Ukh3In0.eyJqdGkiOiJiMDBmNTkyMS01YjkxLTQzMGQtOTBjZC05ZDY4OTc4ODY4MTciLCJleHAiOjE2Njc5MzY0MTEsIm5iZiI6MCw.......cLXA
# configure truststore containing trusted CA certs
truststore.type=directory
# if type is 'directory'
truststore.directoryLocations.1=/home/user/certificates/*.pem
truststore.directoryEncoding=PEM
# do not check the SSL cert contains correct hostname
client.serverHostnameChecking=NONE
#
# The address(es) of the registries to contact
# (space separated list)
registry=https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
#
# default directory for output
#
output=.
protocols=UFTP BFT
#################################################################
than copy CA certificates inside the certificate folder (not mandatory to use the service) from:
https://winnetou.surfsara.nl/prace/certs/
from the link: Package with individual certs from CAcerts file in gz format (SHA1) (PGP)
if you do not do it you can use the UCC client anyway but it will be asked you to accept the CA
after these simple steps you can use the UCC
michele@nmcarpene205872:~/UNICORE/ucc/unicore-ucc-9.0.0$ ./bin/ucc connect -v
[ucc connect] UCC 9.0.0, https://www.unicore.eu
[ucc connect] Reading properties file </home/michele/.ucc/preferences>
[ucc connect] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc connect] Output goes to <.>
[ucc connect] Registry = https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
[ucc connect] Using converted Registry URL https://unicore.hpc.cineca.it:9111/PRACE/rest/registries/default_registry
[ucc connect] Checking registry connection.
VALIDATION ERROR : No trusted CA certificate was found for the certificate chain
Accept issuer <CN=Sectigo RSA Organization Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB> [Y/n/a]Y
[ucc connect] Registry connection status: OK
[ucc connect] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc connect] Output goes to <.>
[ucc connect] Using site default for TSS lifetime.
[ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/factories/default_target_system_factory
[ucc connect] TSS at address https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
[ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-M100/rest/core/factories/default_target_system_factory
[ucc connect] TSS at address https://unicore.hpc.cineca.it:9111/CINECA-M100/rest/core/sites/d96ec76d-215d-45b4-958b-be19333d6c73
[ucc connect] Connecting to https://unicore.hpc.cineca.it:9111/CINECA-MARCONI/rest/core/factories/default_target_system_factory
michele@nmcarpene205872:~/UNICORE/ucc/unicore-ucc-9.0.0$ ./bin/ucc list-sites -v
[ucc list-sites] UCC 9.0.0, https://www.unicore.eu
[ucc list-sites] Reading properties file </home/michele/.ucc/preferences>
[ucc list-sites] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc list-sites] Output goes to <.>
[ucc list-sites] Registry = https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
[ucc list-sites] Using converted Registry URL https://unicore.hpc.cineca.it:9111/PRACE/rest/registries/default_registry
[ucc list-sites] Checking registry connection.
VALIDATION ERROR : No trusted CA certificate was found for the certificate chain
Accept issuer <CN=Sectigo RSA Organization Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB> [Y/n/a]Y
[ucc list-sites] Registry connection status: OK
[ucc list-sites] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc list-sites] Output goes to <.>
[ucc list-sites] Filtering = false
[ucc list-sites] Detailed listing = false
CINECA-G100 https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
CINECA-M100 https://unicore.hpc.cineca.it:9111/CINECA-M100/rest/core/sites/d96ec76d-215d-45b4-958b-be19333d6c73
and of course start remote jobs via SluRM on the HPC infrastructure, also specifying the HPC cluster
michele@nmcarpene205872:~/UNICORE/ucc/unicore-ucc-9.0.0$ ./bin/ucc run -v samples/date.u -s CINECA-G100
[ucc run] UCC 9.0.0, https://www.unicore.eu
[ucc run] Reading properties file </home/michele/.ucc/preferences>
[ucc run] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc run] Output goes to <.>
[ucc run] Registry = https://unicore.hpc.cineca.it:9111/PRACE/services/Registry?res=default_registry
[ucc run] Using converted Registry URL https://unicore.hpc.cineca.it:9111/PRACE/rest/registries/default_registry
[ucc run] Checking registry connection.
VALIDATION ERROR : No trusted CA certificate was found for the certificate chain
Accept issuer <CN=Sectigo RSA Organization Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB> [Y/n/a]Y
[ucc run] Registry connection status: OK
[ucc run] Current directory is </home/michele/UNICORE/ucc/unicore-ucc-9.0.0>
[ucc run] Output goes to <.>
[ucc run] Synchronous processing = true
[ucc run] Adding job id to output file names = true
[ucc run] Dry run = false
[ucc run] Quiet mode = false
[ucc run] Read job from <samples/date.u>
[ucc run] Using broker LOCAL
[ucc run] Job is NEW
[ucc run] Checking https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
[ucc run] Check requirement: Application: Date
[ucc run] Have <1> candidate resource(s)
[ucc run] https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
[ucc run] Selected TSS at https://unicore.hpc.cineca.it:9111/CINECA-G100/rest/core/sites/eb3d2edc-2912-469a-889a-cdcc5642d39e
To request for new features or customization to be added users should contact the service manager (superc@cineca.it).
Outgoing links: