Data Engineer – Big Data & AI Solutions

About the role

We are looking for an experienced Data Engineer to join our technology team. You will design, develop, and implement data engineering solutions that leverage big‑data platforms and AI‑driven tools to improve data processing and analytics.

Key responsibilities

• Design and build scalable data pipelines and ETL processes.
• Implement real‑time streaming solutions using Kafka.
• Manage containerized workloads with Kubernetes and OpenShift.
• Maintain and optimise big‑data ecosystems such as Hadoop, Vertica, and Elasticsearch.
• Administer cloud infrastructure on AWS and GCP, including S3, EC2, BigQuery, and Cloud Functions.
• Integrate AI models (e.g., kero, Claude code, MCP) into data workflows for predictive analytics.
• Support relational and NoSQL databases like Oracle and Redis.

Required profile

• Minimum 3 years of experience in data engineering or related roles.
• Strong programming skills in Python and Java.
• Hands‑on experience with Kafka, Kubernetes, and OpenShift.
• Familiarity with Hadoop, Vertica, Elasticsearch, Oracle, and Redis.
• Proficiency with AWS and GCP services.
• Experience using AI‑driven tools to enhance data pipelines.

Required skills

• Python
• Java
• Kafka
• Kubernetes
• OpenShift
• Hadoop
• Vertica
• Elasticsearch
• Oracle
• Redis
• AWS
• GCP
• S3
• EC2
• BigQuery
• Cloud Functions
• kero
• Claude code
• MCP