Sep 25 – 29, 2023
Centro de Ciencias de Benasque
Europe/Madrid timezone

A deep dive on BigHPC platform delivery into HPC clusters

Sep 25, 2023, 1:30 PM
20m
Centro de Ciencias de Benasque

Centro de Ciencias de Benasque

Av. de Francia, 17, 22440   Benasque Huesca, Spain   42.603194, 0.523222
Presentation (15' + 5' for questions) Development of innovative software and services IBERGRID

Speaker

Samuel Bernardo (LIP)

Description

The BigHPC project is bringing together innovative solutions to improve the monitoring of  heterogeneous HPC infrastructures and applications, the deployment of applications and the management of HPC computational and storage resources. It aims as well to alleviate the current storage performance bottleneck of HPC services when dealing with data intensive applications growth among the major workload in HPC environments.
Largest companies, government research centers and academic computing centers aggregate the computing power to answer the Big Data buzzword. The typical jobs pretend to extract value from data having four Vs characteristics (volume, variety, velocity and veracity). But to use those resources there are several different implementations that make it difficult for a user to use those infrastructures. BigHPC platform gives a way to start using those resources with a common job definition (BigHPC job) and adapted to the requirements of the largest BigHPC infrastructures, making life easier for system administrators.
In this presentation we will show the involved services, how they can be deployed in any infrastructure and the jobs workflow supported over the Gitlab platform.

Primary authors

Miguel Viana (LIP Minho) Samuel Bernardo (LIP)

Co-author

Jorge Gomes (LIP)

Presentation materials