SC Cleared AWS Infrastructure/Data Engineer - Up to £100,000 DOE
Hybrid: Remote + 1 day a week in West midland office location
Company Overview
My client helps organisations transform complex, multi-modal datasets into insightful geo-spatial data subscriptions. Their primary focus is on delivering high-fidelity data solutions for defense intelligence professionals, enabling them to derive insights swiftly.
Position Overview
They're are looking for a skilled AWS Infrastructure/Data Engineer specialising in (IaC) and data engineering. In this role, you will design, implement, and maintain scalable, secure AWS cloud infrastructure and create data pipelines and storage solutions. You will ensure the reliability and availability of infrastructure for data processing and collaborate closely with our infrastructure engineers and data engineers to automate and streamline data processes.
Main areas
- IaC
- Golang, Python
- Pulumi
- AWS
- Edge Compute
- Secure Environment
Responsibilities
- Design, implement, and maintain scalable and secure AWS infrastructure, with a strong emphasis on IaC.
- Design, develop, and maintain scalable data pipelines using Spark, Python, and Java; familiarity with Scala and Golang is advantageous.
- Implement and manage Iceberg tables to ensure efficient data storage and retrieval.
- Optimise data storage solutions, including hot, cold, and glacier storage tiers.
- Develop and enforce data retention policies, ensuring compliance with data governance standards.
Desired Qualifications
- 3+ years of experience in AWS Infrastructure and/or SRE roles, with applicable Associate or Professional AWS certificates being a plus.
- Strong background in Infrastructure as Code (IaC) using tools such as Pulumi, Terraform, or CloudFormation.
- Experience with data orchestration tools such as Airflow, Prefect, Dagster, or Temporal.
- Proficiency in Spark, Java, and Python. Nice to have: Scala, Golang
- Experience with Postgres, GraphQL, and other data manipulation tools.
- Knowledge of big data tools and environments, including Apache Iceberg and other datalake concepts.
- Familiarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles.
- Experience with DevOps tools such as Git, Docker, Jenkins, etc.
Compensation and Benefits
- Competitive salary
- Comprehensive health, dental, and vision insurance plans
- Flexible hybrid work environment
- Additional benefits like flexible hours, work travel opportunities, competitive vacation time and parental leave
MUST HOLD BRITISH CITIZENSHIP OR ILR
Interested in the role? Please apply directly to this advert, you can also schedule a call with me by emailing your CV to h.shemmings@jeffersonfrank.com, calling me on 0191 223 5303 or reach out on LinkedIn “Harry Shemmings”.