Data Engineer – Data Platforms (AWS)

About the role

IBM Consulting is looking for a Data Engineer specialized in Data Platforms on AWS. You will advise, design, develop, and maintain data engineering solutions that support hybrid‑cloud and AI initiatives for leading enterprises.

Key responsibilities

• Design, build, and operate batch and real‑time data pipelines using AWS services such as EMR, Glue, Glue Catalog, and Kinesis.
• Create and manage data layers on RedShift, Aurora, and DynamoDB, and perform migrations with AWS DMS.
• Develop pipelines for data warehouses and data lakes leveraging Managed Streaming for Apache Kafka and Kinesis.
• Schedule, monitor, and manage data services on the AWS platform to ensure reliability and performance.
• Apply open‑source technologies like Apache Airflow, dbt, Spark (Python or Scala) to enhance data engineering workflows.

Required profile

• Master’s degree (preferred).
• Proven experience with the AWS toolset for data engineering.
• Hands‑on exposure to building batch and real‑time pipelines for warehouses and lakes.
• Experience creating data layers and migrating data using AWS services.
• Familiarity with open‑source orchestration and transformation tools.

Required skills

• AWS EMR
• AWS Glue & Glue Catalog
• AWS Kinesis
• AWS RedShift
• AWS Aurora
• AWS DynamoDB
• AWS DMS
• Managed Streaming for Apache Kafka
• Apache Airflow
• dbt
• Spark (Python or Scala)
• Python
• Scala
• AWS Glue Databrew