Data Engineer – Business Intelligence

About the role

IBM Consulting is seeking a Data Engineer specialized in Business Intelligence to design, build and operate data platforms on Azure. You will work with leading clients, helping them modernize their data pipelines and enable real‑time analytics across industries.

Key responsibilities

• Design, develop and maintain batch and real‑time data pipelines using Azure Synapse Analytics, Azure Data Factory, Azure Databricks and Event Hub.
• Build and manage the data layer on Azure Synapse, SQL Data Warehouse and Cosmos DB.
• Apply Azure Data Platform components such as ADLS2, Blob Storage, Azure Functions (Python), Azure Purview and Cosmos DB.
• Implement open‑source tools like Apache Airflow, dbt, Spark (Python/Scala) to support data engineering solutions.
• Operate streaming services including Azure Event Hub, Azure Streaming Analytics, Managed Streaming for Apache Kafka and Azure Databricks.

Required profile

• Master’s degree in Computer Science, Engineering or a related field.
• Proven experience developing data pipelines on Azure services.
• Familiarity with both batch and real‑time processing concepts.
• Exposure to open‑source data engineering technologies.

Required skills

• Azure Synapse Analytics
• Azure Data Factory
• Azure Databricks
• Azure Event Hub
• Azure Data Lake Storage Gen2 (ADLS2) & Blob Storage
• SQL Data Warehouse / Azure SQL DW
• Azure Functions (Python)
• Azure Purview
• Cosmos DB
• Apache Airflow
• dbt
• Apache Spark (Python, Scala)
• Managed Streaming for Apache Kafka
• Azure Streaming Analytics
• Python
• Scala