Skip to content

System architecture

This page describes the architecture of the RS-Python system as a whole. The architecture of each component is described in its own repository, e.g. rs-server or rs-dpr-service.

Main components

Main components

Layer Components Repositories
RS-Python Web services (frontend, catalog, external data sources, staging, OSAM), STAC browsers rs-server, rs-helm, rs-server-deployment
Python libraries and Prefect flows rs-client-libraries, rs-workflow-deployment
DPR service and processors rs-dpr-service, rs-workflow-env (Docker images of the processors)
Virtual environment: JupyterHub, Prefect, Dask Gateway, API Key Manager rs-workflow-env
Infrastructure Core: Kubernetes, Envoy Gateway, cert-manager, Keycloak, CloudNativePG, Velero... rs-infra-core
Monitoring: Grafana, Prometheus, Loki, Tempo, Alloy rs-infra-monitoring
Security: Wazuh, NeuVector non-public repository
Physical infrastructure Cloud provider (OpenStack virtual machines, S3 object storage), provisioned with Terraform and Ansible rs-infra-core

The detailed list of the third-party components and their licenses is given in the Third-party components annexes.

Collaboration between the components

Functional overview

The Python modules depend on each other as follows:

Python modules

Each kind of data follows a lifecycle, from its staging or generation to its deletion, described in Catalog data model and lifecycle.

Deployment

The deployment on a Kubernetes cluster, in several layers and node pools, is described in Deploy RS-Python. The local mode, used for the development, is described in Local mode.

Local mode and cluster mode

Actors

Actors

All the actors are RS users, with specific access rights: end users, operators, administrators and security officers. The external data sources provide the raw data and auxiliary data needed by the processing chains. The DPR processors and the settings of the Dask clusters that run them are delivered by the EOPF project. Two targets are supported to deploy RS-Python: a local machine and a Kubernetes cluster.

Use cases

Access control

Access control use cases

External data sources and staging

External data sources use cases

Catalog

Catalog use cases

Processing

Processing use cases

Workflow management

Workflow management use cases

Dask clusters

Dask cluster use cases

Infrastructure

Infrastructure use cases

Deployment

Deployment use cases