Experian is recruiting a Lead Data Platform Engineer to work in its Credit Services and Verifications team in Nottingham. This is a hybrid role with 40% of time spent in the office. You would lead a technical team building a new fraud data capability that connects fraud-related data assets into Experian's Data Analytics Platform.
In this role you would:
- Lead an agile team delivering data platform solutions for fraud-related data.
- Guide the delivery of AWS-based data pipelines, data lake components and producer-side platform capability.
- Take on ownership, maintenance and enhancement of pipelines and cloud components first built by the central Data Analytics Platform team.
- Lead the building, testing and upkeep of high-quality pipelines from sources such as Snowflake and internal product platforms.
- Make sure metadata is accurate so assets can be shown in the DAP catalogue.
- Champion DevSecOps, CI/CD, Infrastructure as Code and cloud-native tooling.
- Mentor senior and junior engineers, and promote automation and AI-assisted development where appropriate.
What they are looking for:
- Strong experience building data pipelines, data lake solutions or data platform capabilities.
- Strong experience with AWS data services such as Glue, S3, Step Functions, IAM, Lake Formation, Lambda and SQS.
- Strong experience with Terraform, CI/CD pipelines, Git and Jenkins.
- Strong experience with Apache Spark or Hadoop.
- Significant programming experience in Scala or Python.
- Experience with Configuration as Code and API integration.
- A strong understanding of cloud security, data privacy, access control and governance.
Desirable: an AWS certification, Terraform or CloudFormation expertise, OpenShift or Kubernetes experience, automated testing with pytest or Scalatest, code quality tools such as SonarQube, RESTful API and microservice knowledge, and experience with regulated data or data catalogue concepts.
Pay and benefits: the page describes a great compensation package and a discretionary bonus plan. It also lists 25 days annual leave plus 8 bank holidays, 3 volunteering days (with the option to buy additional leave), a pension, Bupa healthcare and a sharesave scheme.
Apply directly on Experian's website using the button on this page.