Enable the use of private S3 gateway endpoint for AWS compute environments
complete
Mattia
Summary
An important impact on users' costs is that the Platform does not use private S3 gateway endpoints for data transfer, even within the same region. As a result, users are charged with data transfer costs because the data is sent via the public internet. This also affects performance because the speed is lower than within the AWS network.
Currently, it is possible to enable S3 endpont by maually creating an gateway endpoint so that AWS can ferry data directly between the instances doing the work and the bucket holding their data without that data moving via the external internet.
Intended outcome
Enable Seqera Platform to configure AWS compute environments to use S3 gateway endpoint as a standard configuration option. This should be possible both for manual and forge compute environments.
Outcomes
Improved performance and reduced costs when using AWS compute environments in Seqera Platform
This post was marked as
complete
Mattia
acknowledged