Python Developer

Role Overview

The organization is seeking Python Web Scraping Engineers to design, build, and operate reliable web data collection systems. This role focuses on production-ready Python scrapers and browser automation, particularly across dynamic and JavaScript-heavy websites. The successful candidate will contribute to the reliability, scalability, and quality of Deep Future’s data pipelines.

· Design, develop, and maintain Python-based web scrapers.

· Build and maintain browser automation workflows using Playwright and Selenium.

· Extract data from dynamic, JavaScript-heavy websites.

· Maintain and improve scraping systems to handle routine target-site changes.

· Containerise scraping services using Docker.

· Deploy and operate scraping workloads on AWS.

· Monitor scraper performance, reliability, and data quality.

· Troubleshoot common failures, performance issues, and data collection inconsistencies.

· Working knowledge of AWS services such as EC2, ECS, Lambda, S3, and SQS.

· Commercial experience using Python in production environments.

· Experience building, maintaining, and improving web scrapers.

· Practical experience with Playwright and/or Selenium.

· Experience containerising applications with Docker.

· Ability to write clear documentation and communicate effectively within a team.

· Experience collaborating using tools such as Slack, Google Workspace, Jira, and Confluence.

· Exposure to sites protected by Cloudflare or similar web application firewalls.

· Familiarity with CAPTCHA and bot-detection challenges.

· Basic understanding of browser fingerprinting concepts.

· Experience with higher-volume or distributed scraping systems.

· Familiarity with monitoring and logging using AWS CloudWatch.

· Ownership of meaningful parts of core data acquisition systems.

· Opportunity to work on real-world data intelligence problems.

· Support and mentorship from experienced engineers.

· Flexible working arrangements.

· Competitive remuneration aligned with experience.

The ideal candidate is a hands-on Python engineer with strong experience in production scraping, browser automation, AWS-based deployment, and reliable data pipeline operations. They should be comfortable working with changing web targets, debugging failures, documenting technical decisions, and collaborating closely with engineering teams to maintain high-quality data acquisition systems