Lead Data Engineer - 6-Month Contract
Location: Manchester (2 days on-site per week)
Inside IR35
We're seeking an experienced Lead Data Engineer for a 6-month contract role. The ideal candidate will have:
Extensive experience with Apache Airflow
Proficiency in dbt (data build tool)
Strong AWS expertise (crucial), including: • Amazon S3 • Amazon Redshift • AWS Glue • Amazon EMR • AWS Lambda • Amazon EC2 • Amazon RDS • Amazon Athena
Experience with Python and SQL
Ability to lead and mentor a data engineering team
Excellent problem-solving and communication skillsResponsibilities include:
Designing, implementing, and maintaining scalable data pipelines using Airflow and AWS services
Developing and optimizing ETL processes to handle large volumes of data efficiently
Implementing data modeling and transformation logic using dbt
Architecting and managing cloud-based data infrastructure on AWS
Ensuring data quality, reliability, and security across all data systems
Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions
Leading code reviews and implementing best practices for data engineering
Optimizing database performance and query efficiency
Troubleshooting and resolving complex data issues
Staying current with the latest data engineering technologies and methodologiesIf you're a skilled data engineer looking for a challenging contract role that leverages your expertise in Airflow, dbt, and AWS, apply now