Senior Python Data Engineer (Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London.
You MUST have the following:
- Advanced ability as a Senior Python Data Engineer/Data Architect
- AWS (EC2, ECS, EKS, Glue)
- Excellent Python ability
- PySpark
- MWAA/Airflow/Dagster
- At least one of the following:
- Apache Iceberg
- DBT
- Dremio
- Snowflake
The following is DESIRABLE, not essential:
- Experience with data mesh architectures
Role: Senior Python Data Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required by my asset management client in London. You will join a number of teams that are responsible for the core engineering of a large amount of financial trading data. The data is currently ingested into, and stored in, an AWS data lake. This is being migrated to a data mesh architecture though. You will work within a team of 4-5 engineers that will contribute towards this migration, working with AWS Glue, Athena, Python, Java, Iceberg, DBT, Arrow and Dremio.
They have a very flexible hybrid working set up of 1-2 days/month in the office.
Salary: £90k - £125k + 15% Guaranteed Bonus + 10% Pension
