Senior Big Data Engineer – Data Pipelines & Cloud

About the role

Placer.ai is seeking a Senior Big Data Engineer to join its Mobility Group. You will design, build, and maintain the data infrastructure that powers the company’s location analytics platform, enabling customers to gain deep insights into consumer behavior and market dynamics.

Key responsibilities

• Design, develop, and optimise scalable data pipelines that ingest, transform, and integrate large volumes of data from diverse sources.
• Implement data validation, cleansing, and enrichment processes to ensure high‑quality, consistent data.
• Identify performance bottlenecks and optimise processing and storage to reduce latency.
• Architect and manage cloud‑based data infrastructure on GCP and AWS.
• Collaborate with data analysts, data scientists, product managers, and software engineers to deliver data solutions that meet business needs.
• Enforce data governance practices and ensure compliance with privacy and security regulations.
• Monitor pipeline health, troubleshoot issues, and maintain high availability.
• Mentor junior engineers and promote a culture of continuous learning.

Required profile

• Proven experience building and operating production‑grade Apache Spark pipelines.
• Strong proficiency in PySpark or Scala for Spark development.
• Demonstrated success delivering large‑scale ETL pipelines and data integration projects.
• Hands‑on experience with cloud platforms, specifically GCP and AWS.
• Ability to work cross‑functionally and translate technical concepts for non‑technical stakeholders.

Required skills

• Apache Spark
• PySpark
• Scala
• ETL pipeline development
• Data integration
• GCP (Google Cloud Platform)
• AWS (Amazon Web Services)
• Data validation and cleansing
• Data enrichment
• Data governance
• Monitoring and performance optimisation