Senior Python Data Scraping Engineer – Freelance

About the role

Mindrift is seeking a Senior Python Data Scraping Engineer to support the Tendem project on a freelance basis. You will design, implement, and maintain end‑to‑end web‑scraping workflows that deliver high‑quality, structured data for real‑world applications.

Key responsibilities

• Develop and own complete data extraction pipelines for complex, dynamic websites.
• Utilize tools such as Apify, OpenRouter, Selenium, and custom Python scripts to collect and validate data.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll, and proxy management.
• Enforce data quality through validation checks, cross‑source consistency, and formatting standards.
• Scale scraping operations using batching, parallelization, and monitoring to ensure stability against site changes.

Required profile

• 5+ years of experience in data engineering, web scraping, or software development.
• Bachelor’s or Master’s degree in Computer Science, Engineering, Applied Mathematics, or a related field (optional but a plus).
• Strong problem‑solving skills and ability to work independently.

Required skills

• Python
• BeautifulSoup
• Selenium (or similar browser automation)
• Apify
• OpenRouter
• Proxy handling
• API integration
• JavaScript, AJAX
• Data validation techniques
• Batch processing and parallelization