Secure Data Engineer - #2198743

Capgemini


Date: 5 hours ago
City: Birmingham
Contract type: Full time
Capgemini
Data Engineer Role At Capgemini

As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that power analytics, AI, GenAI and increasingly agentic systems. You'll work hands-on with modern data engineering tooling and cloud services to ingest, transform and serve data, and you'll prepare and govern the datasets that AI models and AI agents depend on to behave safely and correctly. You'll also use AI-assisted engineering to accelerate your own delivery, while keeping clear human ownership of every outcome.

You'll be part of the Data Platforms team within the Insights and Data Global Practice, which has seen strong, sustained growth across a wide range of sectors. Data Platforms is home to Data Engineers, Platform Engineers, Solution Architects and Business Analysts driving our customers' digital and data transformation on modern cloud platforms. We specialise in the latest frameworks, reference architectures and technologies across AWS, Azure and GCP, and data platforms such as Databricks and Snowflake.

Security Clearance: To be successfully appointed to this role, must be eligible to obtain Security Check (SC)clearance or DV (Developed Vetting clearance). To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements. Throughout the recruitment process, you will be asked questions about your security clearance eligibility such as, but not limited to, country of residence and nationality. Some posts are restricted to sole UK Nationals for security reasons; therefore, you may be asked about your citizenship in the application process.

The Focus Of Your Role

We're looking for a code-first Data Engineer to design and build scalable, resilient data applications for Defence customers. This role sits at the intersection of software engineering and data engineering, working on mission-critical systems where reliability, security and auditability are essential.

You'll build data applications that process high-volume, high-velocity data, orchestrate complex workflows, and deploy your own solutions into secure containerised environments. You'll work across the full lifecycle, from development through to production, shaping architectures that support operational users, analytics and AI-enabled capabilities. Increasingly that includes GenAI and agentic systems that must run inside secure, and sometimes disconnected, environments, which is a genuinely hard problem and a distinctive part of what makes this role interesting.

This role is hands-on and engineering-led. You'll write production-grade code, contribute to secure platform patterns, and make sure your data services run predictably in tightly governed Defence environments.

What You Will Be Doing

Building data applications Developing modular, maintainable software components that process, transform and expose data for analytical, operational or AI-driven use cases, with testing and observability built in from the start.

Streaming and real-time architecture Designing and implementing data ingestion and event-driven patterns that support real-time or near-real-time flows, keeping them reliable under demanding operational conditions.

Workflow orchestration Defining data workflows programmatically and managing complex dependencies, scheduling and error-recovery behaviour within secure, assured environments.

Operationalising Data flows for AI in secure environments Packaging, deploying and monitoring ML and, increasingly, GenAI and agentic data workloads inside assured environments. This can include self-hosted or open-weight models, retrieval (RAG) and vector search over governed data, and the guardrails, evaluation and human oversight that non-deterministic systems demand. Running these patterns where internet-connected AI services are not available is a core part of the role's future.

Deployment and ownership Containerising your own services and deploying them into secure Kubernetes or cloud environments, using CI/CD principles adapted for Defence delivery. You'll own your applications in production and contribute to secure deployment patterns.

Resilience, observability and compliance Implementing health monitoring, structured logging, metrics and lineage to meet Defence requirements for auditability, security and operational assurance, including observability for non-deterministic and agentic behaviour. You'll design systems that can self-heal or fail gracefully when needed.

Infrastructure as Code Provisioning the resources your services depend on using Infrastructure as Code, working closely with platform teams to stay aligned with accredited Defence architectures

What You Will Bring

You'll be a strong, code-first data engineer who takes ownership of what you build and is energised by hard constraints rather than put off by them. You don't need to have shipped GenAI or agentic systems in secure environments already, but you should be genuinely interested in the problem and have the engineering foundations to take it on.

  • Core engineering. Expert-level Python and strong software engineering foundations: object-oriented design, automated testing and version control.
  • Data engineering stack. Building pipelines with streaming frameworks, distributed processing engines and relational or analytical storage (for example Kafka, Spark, PostgreSQL).
  • Orchestration. Defining and running data workflows with modern orchestration frameworks (for example Airflow, Dagster or Prefect).
  • Data quality and lineage. Tools and techniques for data testing, documentation and lineage (for example Great Expectations or dbt).
  • AI, MLOps and emerging LLMOps. Operationalising ML in production (model packaging, monitoring, controlled deployment), and an understanding of how serving GenAI and agentic systems differs, including evaluation, guardrails and observability for non-deterministic outputs.
  • Containerisation and Kubernetes. Confidence deploying applications in containerised environments, including defining services, pods and deployment configurations (for example Docker and Kubernetes).
  • DevOps mindset. Hands-on CI/CD experience and a belief in owning the services you build (for example GitLab CI, GitHub Actions or Argo).Hands-on experience delivering data pipelines and data platforms in production environments.
About Capgemini

Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

If you are successfully offered this position, you will go through a series of pre-employment checks, including: identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent...

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Azure Fabric Architect

Capgemini,
5 hours ago
Data Solution Architect As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data driven decision making at scale. You will translate business strategy into robust,...

AI Adoption and Solutions Lead

Capgemini,
5 hours ago
AI Adoption And Solutions Lead As our AI Adoption and Solutions Lead, your core purpose is to embed artificial intelligence and agentic solutions into the way we work in Sales and Solutions within Cloud Infrastructure Services. You will bring extensive...

School Administrator

Hays Specialist Recruitment Limited,
6 hours ago
Your new company Are you an experienced school administrator looking for your next opportunity? Hays Education is working in partnership with a welcoming and well-organised school in South Birmingham, B45 who are seeking an experienced School Administrator to join their...
Hays Specialist Recruitment Limited