We are hiring a Big Data / Platform Engineer to support and extend the clients Hadoop-based Big Data platform, and to bring AI-enabled tooling into platform operations. The role covers platform build-out, reliability, and automation, working closely with engineering and data teams.

Big Data & Platform Engineering Support and extend the Hadoop-based Big Data platform, including Spark and ETL workloads. Add new platform engineering capability into the Big Data environment as requirements evolve. Test and troubleshoot the platform on an ongoing basis to maintain reliability. Monitor platform health, resource utilisation, and job performance, escalating and resolving issues as they arise. Support capacity planning for the platform as data volumes and workloads grow. Contribute to platform documentation, including configuration standards and operational runbooks. AI Tooling & Automation Implement AI technologies to support and automate platform operations. Evaluate and apply opensource technologies where they improve efficiency or reduce cost. Automate recurring operational tasks using AI-enabled tooling. Research and benchmark new tools and techniques against the existing platform to identify improvement opportunities. Collaboration & Delivery Work closely with data engineers, architects, and business stakeholders to understand platform requirements. Contribute technical input into design discussions for new platform capability. Support other engineers on the team with platform-related questions and troubleshooting

Technical Skills Experience with Big Data ecosystems — Hadoop, Spark, ETL pipelines. Scripting/automation experience (e.g. Python, Bash, or similar) for operational tooling. Working knowledge of Linux systems administration. Experience with monitoring and alerting tools in a production data platform environment. Familiarity with applying AI/automation tools in a platform or data operations context. Understanding of opensource technology evaluation and adoption in an enterprise setting. Functional Skills Experience working within Agile delivery methodology. Able to research and benchmark technology against best-in-class alternatives. Comfortable operating as a platform engineering profile focused on Big Data infrastructure. Banking, financial services, or other regulated enterprise environment experience preferred. Self-motivated, able to own and drive platform improvements with minimal supervision.