Lead Data Engineer
London, remote, hybrid
Up to £90,000 per annum + Bonus
An excellent opportunity has arisen for an experienced and engaging Lead Data Engineer, to join a well-known organisation within the legal/tech sector.
The successful applicant will join a well established team as the go-to Data Lead. They will drive performance, share expertise, and inspire the team to excel. They will manage a skilled team of data engineers, fostering a culture of best practices and continuous improvement. A good balance of soft and hard skills are required, as the role is 50% Leadership focussed and 50% hands on/technical.
Main duties:
- Lead a team of data engineers to effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain.
- Coordinate engineering resources ensuring adherence to standards and effective delivery. Provide mentorship and guidance where required.
- Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications
- Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner
- Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain
- Data Analyse, profile and plan work, aligned with project priorities
- Perform reviews of code, refactoring where necessary
- Deploy code in a structured, trackable and safe manner
- Document your data developments and operational procedures
- Ensure adherence to data/software delivery standards and effective delivery.
- Help monitor, troubleshoot and resolve production data issues when they occur
- Contribute to the continuous improvement of the team
Required skills:
- Proven experience within a Lead Data Engineering role
- Excellent understanding of Databricks and Pyspark
- Strong knowledge of Azure Cloud Services
- Excellent understanding of SQL
- Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse
- Good knowledge of Data Governance, Data Catalog, Master Data Management
- Excellent communication and stakeholder management skills
Experience within a media, publishing, research, or a similar consumer focused industry is desirable but not essential.
This represents the chance to drive your own technical and professional development within a highly innovative and growth focussed environment.
This role is based in London, but can be worked as a hybrid model with 2 office days per week as the preference.
If you are interested, please apply for full details.