Posts

post

Projects

project

Videos

video

Podcasts

podcast

People

person

Events

event

Publications

publication

Solutions

solution

Services

service

Pages

page

Partners

partner

Case Studies

case-study

Quotes

quote

Tabs

Default Confirmation

test

Core DTE Modules

Configuration artefacts 

Ansible playbooks and roles and any other artefacts needed in the deployment of the selected Big Data Analytics tools. 

<ul>
<li>Users of the Component TOSCA template</li>
<li>Ansible playbooks developers.</li>
</ul>

Target Audience

License

<ul>
<li><a href="https://github.com/grycap/tosca/tree/main/artifacts">https://github.com/grycap/tosca/tree/main/artifacts</a></li>
</ul>

Source Code

Created by

These ansible playbooks are used by the TOSCA templates defined in <a href="#_Big_Data_Analytics">section 2.4.2</a> in order to perform the actual deployments on cloud nodes.
TOSCA templates refer to these artefacts to enable the configuration of the Big Data Analytics tools using the Ansible tool.
&nbsp;

Description

More details (full deliverable download)

These are the artefacts created to configure the templates defined in the previous section:
In the previous release:
<ul>
<li><a href="https://github.com/grycap/tosca/blob/main/artifacts/kubeflow.yml">KubeFlow</a>, <a href="https://github.com/grycap/tosca/blob/main/artifacts/kafka_compose.yml">Kafka on docker compose</a>, <a href="https://github.com/grycap/tosca/blob/main/artifacts/kafka_k8s.yml">Kafka on Kubernetes</a>, <a href="https://github.com/grycap/tosca/blob/main/artifacts/cernvmfs.yml">CernVMFS</a> and <a href="https://github.com/grycap/tosca/blob/main/artifacts/mlflow_compose.yml">MLFlow</a>, see <a href="https://docs.google.com/document/d/1rjpo9nyrS3rBOMP7wZX6O3nhUttqOSMV/edit#heading=h.1t3h5sf">section 2.4.2.1</a> for the description of the components.</li>
</ul>
Added in this last release:
<ul>
<li><a href="https://github.com/grycap/tosca/blob/main/artifacts/openeo_k8s.yml">openEO Kubernetes Backend</a>, <a href="https://github.com/grycap/tosca/blob/main/artifacts/stac_compose.yml">STAC with docker-compose</a>, <a href="https://github.com/grycap/tosca/tree/main/artifacts/horovod">Horovod Cluster</a> (two artefacts, one for the front-end and another for the working nodes) <a href="https://github.com/grycap/tosca/blob/main/artifacts/ades_k8s.yml">EOEPCA ADES</a> and <a href="https://github.com/grycap/tosca/blob/main/artifacts/enes/ophidia_intertwin.yml">Ophidia</a>; see <a href="#_heading=h.1t3h5sf">section 2.4.2.1</a> for the description of the components.</li>
</ul>

Release Notes 

Some of the templates are in an early stage (STAC and openEO) and need to be correctly tested by users with experience, using these tools to validate the functionality of the deployed infrastructure. Other templates are more mature but may need some additions to improve them. Finally, further templates need to be created (e.g. for the ENES system).

and Future Plans

Core DTE Module: Configuration artefacts

<a href="/terms-of-use">terms of use</a>  |  <a href="/privacy-notice">data protection</a>