HPC Workload Migration and Optimization to AWS

Deeplife

AWS Migration Cloud Industry & Services

Publié le 23 mai 2024

Context

DeepLife develops novel approaches to drug discovery based on state-of art multi-omics data, machine learning, and system engineering.

Their growing computational needs were held back by outdated orchestration paradigms running on-premises resources.

Aneo was mandated to analyze their HPC workloads and propose and execute a plan to migrate them to AWS.

Objectives

Aneo has accompanied DeepLife on a journey that has brought them from executing Snakemake workflows on an on-premises Slurm cluster, to functionally equivalent Nextflow workflows executed on a tailor-designed architecture on AWS.

Production workload continuity has been ensured during development with a custom-made AWS-Snakemake executor that allows to run Snakemake workloads on AWS without the need of third-party software.
The now legacy workflows did not have fast and reliable access to genomic data sources. As part of the new orchestration design, Aneo has implemented the means to reliably procure genonic data from DeepLife selected providers.

Results

A new scalable, secure, reliable, optimized and available architecture on AWS designed for big genomics computing pipelines.
Reduced workload orchestration overhead leading to a significant reduction of computing times.
A secure, fast and easy to use system to download genomic data from remote archives.

Ready to change how you work?

In the spotlight

cas client - migration-symphony-to-armonik-gmd-journey

Migration from Symphony to ArmoniK: GMD's Journey

17 September 2024 ArmoniK

Banking & Financial Services

GMD (Global Markets Division) at Crédit Agricole Corporate and Investment Bank (CA-CIB) relied heavily on IBM Symphony for their grid computing needs.

cas client - migration-datasynapse-to-armonik-equity-journey

Migration from DataSynapse to ArmoniK: Equity IT's Journey

17 September 2024 ArmoniK

Banking & Financial Services

Equity IT at Crédit Agricole Corporate and Investment Bank (CA-CIB) faced significant challenges with their existing grid computing infrastructure, which relied on TibCo DataSynapse.

strategie-migration-cfm-aws-puissance-calcul-scalable

CFM's strategic migration to AWS for scalable quantitative trading operations

29 July 2024 AWS Migration

Banking & Financial Services

CFM's strategy to reinforce their leadership in the markets by increasing drastically the size of its activities and geographical presence has led to a saturation of their on-premises HPC clusters.

HPC Workload Migration and Optimization to AWS

Context

Objectives

Results

Ready to change how you work?

In the spotlight

Newsletter