Data Engineer - Web Scraping (3 Months Contract)

About the role

CXG, a global customer experience company founded in 2006 and working with more than 200 luxury brands, is hiring a Data Engineer specializing in web scraping for a 3-month remote contract. The role covers maintaining scraping configurations, monitoring them for errors, ingesting data into a data lake and reporting on scraping activity.

Key responsibilities

• Maintain and manage website scraping configurations using Python.
• Monitor scraping configurations for errors and potential crashes, and oversee retrieved data to detect issues and blockages.
• Coordinate with stakeholders to understand scraping task requirements and report issues.
• Prepare and share periodic reports on scraping activities with stakeholders.
• Develop pipelines to ingest data into the data lake and perform the required transformations.

Required profile

• Proven experience in data engineering, including designing and implementing scalable data architectures.
• Minimum 2 years of experience in a similar role.
• Strong academic background in a relevant field.
• Fluent English (French is a plus).

Required skills

• ETL processes, data modeling and data warehousing (Airflow and DBT preferred).
• Relational (SQL) and NoSQL databases.
• Cloud platforms, particularly Azure.
• Data security and compliance knowledge.
• Excellent Python for data engineering and automation.
• Version control such as Git, and hands-on experience with Airflow and/or DBT.
• Terraform for infrastructure management.