Back to all jobs
P
Data Engineer
Partao
WorldwideRemote1mo ago
- Employment
- Full-time
About the role
- Design, build, and maintain scalable ETL/ELT pipelines using orchestration tools such as Apache Airflow, dbt, or equivalent frameworks.
- Extract data from diverse sources (APIs, databases, streaming systems) into our AWS-based data lake.
- Transform raw, unstructured data into clean, well-modelled datasets ready for analytics and reporting.
- Own and evolve our data lake architecture, including multi-zone S3 storage and AWS Glue cataloguing.
- Manage relational and non-relational databases, ensuring optimal schema design, indexing, and query performance.
- Leverage AWS services (S3, Redshift, Glue, Lambda, EMR) to build scalable, cost-efficient data solutions.
- Process and analyse large-scale datasets using big data technologies such as Apache Spark.
- Collaborate with analysts and business stakeholders to translate reporting requirements into reliable data models.
- Contribute to the design and evolution of our overall data architecture, data governance, and quality standards.
- Document systems, data flows, and architectural decisions to a high standard.
- Proven experience as a Data Engineer or in a similar data-focused engineering role.
- Strong proficiency in Python for data engineering tasks; experience with Rust is a significant advantage.
- Hands-on experience building and maintaining ETL/ELT pipelines, ideally using Apache Airflow
- Deep knowledge of database management - both relational and non-relational.
- Solid experience with AWS cloud services relevant to data engineering (S3, Glue, Redshift, EMR, Lambda, IAM).
- Experience working with big data platforms and distributed computing frameworks (e.g. Apache Spark).
- Strong understanding of data lake architecture, including storage layers, partitioning, and data cataloguing.
- Excellent analytical thinking and problem-solving ability - you enjoy digging into complex data challenges.
- Ability to communicate technical concepts clearly to non-technical stakeholders.
- Experience with Rust for performance-critical data processing.
- Shape the data backbone of a fast-scaling platform.
- Work with real-world data that matters to customers every day.
- Join a small, sharp, and globally distributed team.
- Own critical decisions and make an impact from Day 1.
- Opportunity to shape the data architecture of a growing organisation from an early stage.
- Opportunity to be a thought leader with a wide span of control in a fast-growing startup with experienced mentors
- A challenging and rewarding environment where you can directly impact the future of the company and the industry
Perks & benefits
- Distributed Team
764,000+ hidden jobs like this
Partao and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.
Everything Pro unlocks:
- Unlimited applications — free stops at 5
- Track every application in one place
- Apply straight to the source, one click
- Save & organize roles you love
- Roles pulled from company boards before the big sites
