Data Engineer Spark/Scala

¡Hola!

Desde ToBeIT estamos buscando un Data Engineer Spark/Scala, para trabajar en una de las principales compañías de consultoría tecnológica 100% remoto.

Funciones:

Ingesta y procesamiento de datos con Spark y Scala.

Requisitos obligatorios:

At least 2 years experience working with big data (spark, hadoop, hive, kafka).

At least 2 year experience programming with Spark/Scala.

Experience with different database structures, including SQL (postgres, mysql, …)

Experience working in agile continuos integration/devops paradigm and tool set (git, jenkins, sonar, nexus, jira, splunk).

Experience and expertise across data integration and data management with high data volumes.

Requisitos deseables:

Experience with AWS ecosystem (AWS, EMR, s3, redshift, lambda, glue, athena)

NOSQL (cassandra, redis, elastic search).

Experience with data warehousing and visualisation tools.

Experience with NRT applications: Flink, spark streaming, hbase.

Experience with cloudera. (++ desirable)

Experience with machine learning. (++ desirable)"

•

Última actualización el 26 abr 2024