Senior Data Engineer - #2162787

Senior Data Engineer

Location: Sheffield or Birmingham

A leading global financial services organisation is seeking a Senior Data Engineer to join its

Cybersecurity Science & Analytics function.

The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for

delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.

The role combines data engineering, cloud infrastructure, automation, platform operations and

production support responsibilities.

Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.

• Ingest data from internal and external sources into enterprise data platforms.

• Create and maintain curated datasets and reusable data assets.

• Improve reliability, automation and operational resilience of data services.

• Support Azure cloud infrastructure and data platform operations.

• Work closely with engineering teams to onboard new data sources and define schemas.

• Contribute to exploratory data analysis and platform enhancement initiatives.

• Support real-time analytics and data availability improvements.

Essential Skills

• Strong Data Engineering experience.

• Azure cloud platform expertise.

• Enterprise ETL and data pipeline development.

• Python or equivalent scripting experience.

• SQL and/or Kusto Query Language (KQL).

• GitHub and CI/CD practices.

• Linux administration and scripting.

• Infrastructure as Code, ideally Terraform.

• Azure DevOps.

• SRE / production support experience.

Desirable Skills

• Azure Data Factory

• Databricks

• Unity Catalog

• Synapse Analytics

• Kubernetes• Azure Functions

• Logic Apps

• Kafka or Azure Event Hubs

• Spark Streaming

• Prometheus

• Grafana

• Elasticsearch

• Cosmos DB

• Power BI

• SIEM and SOAR platforms

Experience

• Large enterprise environments

• Cloud-based data platforms

• Data lake architecture and delivery

• Regulated industries advantageous

• Cybersecurity experience beneficial but not essential

Working Environment

• Collaborative global engineering team

• Multi-disciplinary technology environment

• Strong learning and development culture

• Exposure to cybersecurity, cloud platform engineering and advanced analytics