Azure Data Engineer - (2 days per week onsite in london / 1 day in derby)
£45K - £55K DOE (Up to 10% bonus)
Exciting opportunity to be part of a new and growing team for a London / Derby based organisation.
As an Azure Data Engineer, you will support the delivery and development of the organisations Digital Portfolio. Taking advantage of the data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner.
Expedience needed:
Microsoft Azure Experience
Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
Strong Python and SQL skills for manipulating data
Apache Spark and/or Databricks experience
Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
Experience in root-cause analysis and post-incident reporting in a production environment
Responsibilities
As a Data Engineer you will be responsible for:
Monitoring and recovery of Azure Data Factory and Databricks jobs
Proactive monitoring of data quality
Understanding data sources, ingestion methods and data quality levels
Developing data governance policies and internal processes
Develop and maintain digital services data quality KPIs
Maintaining and monitoring of user facing dashboards and other internal Digital products
Documenting root cause analysis outputsPlease apply asap for more information.
This role will not offer sponsorship
Azure Data Engineer
At Gleeson Recruitment Group, we embrace inclusivity and welcome applicants of all backgrounds, experiences, and abilities. We are proud to be a disability confident employer.
By applying you will be registered as a candidate with Gleeson Recruitment Limited. Our Privacy Policy is available on our website and explains how we will use your data