Lead Data Platform Engineer | Remote | £85k + 4 day week (JSDP03) Glasgow, Scotland

Salary: GBP75000 - GBP85000 per annum + Condensed hours, Flexible, Bonus

Lead Data Platform Specialist – Up to £85k + c.15% Bonus

Fully Remote - Condensed & flexible hours available (4 day working week available - 9 out of 10, etc.)

My client, a nation-wide organisation with a reputation for excellence and a supportive, inclusive culture, is seeking a Lead Data Platform Engineer to join their Data Engineering and Machine Learning team. This is a high-impact, senior role, ideal for someone with deep experience in modern cloud data platforms, looking to shape and deliver a scalable, secure, and innovative data platform. 

**You need to have strong experience working with Databricks**

You’ll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn’t just about coding – you’ll also provide architectural guidance, mentor engineers, and ensure solutions are scalable, secure, and aligned with business needs. Hands-on experience with CI/CD, automation, and infrastructure-as-code (Terraform, ARM templates) is essential. Experience in machine learning platforms or ML engineering is a bonus.

Key Responsibilities:

  • Build and maintain the Data Lakehouse platform in a secure Azure environment

  • Develop automation for cluster management, integration runtimes, and networking

  • Lead architectural design and ensure platform scalability, reliability, and governance

  • Write efficient, maintainable code in PySpark, Python, and SQL

  • Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM

  • Collaborate with data engineers, architects, and business stakeholders

  • Mentor and coach engineers, fostering a culture of learning and excellence

Essential Skills:

  • Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture

  • Strong solution architecture and data platform engineering skills

  • DevOps and automation expertise, including CI/CD, monitoring, and code quality

  • Infrastructure-as-code (Terraform or ARM templates) for cloud resource provisioning

  • Excellent communication and mentoring skills

It's not often a role comes along in a team like this, where you get the chance to flex or condense hours, receive a strong salary with a bonus, potential for growth, independence and autonomy, and a clear pathway of progression. You'll get Private medical options, 25 days holiday, plus bank holiday, and the chance to buy/sell holiday.

This is a rare opportunity to join a forward-thinking team at a leading organisation, working fully remotely with flexibility and excellent benefits. You’ll be shaping the future of their data platform while collaborating with a talented and diverse team.

To apply, please submit your CV as we are looking to move quickly on this role.