Lead Data Platform Engineer | Remote | £85k + 4 day week (JSDP03) Glasgow, Scotland
| Salary: | GBP75000 - GBP85000 per annum + Condensed hours, Flexible, Bonus |
Lead Data Platform Specialist – Up to £85k + c.15% Bonus
Fully Remote - Condensed & flexible hours available (4 day working week available - 9 out of 10, etc.)
My client, a nation-wide organisation with a reputation for excellence and a supportive, inclusive culture, is seeking a Lead Data Platform Engineer to join their Data Engineering and Machine Learning team. This is a high-impact, senior role, ideal for someone with deep experience in modern cloud data platforms, looking to shape and deliver a scalable, secure, and innovative data platform.
**You need to have strong experience working with Databricks**
You’ll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn’t just about coding – you’ll also provide architectural guidance, mentor engineers, and ensure solutions are scalable, secure, and aligned with business needs. Hands-on experience with CI/CD, automation, and infrastructure-as-code (Terraform, ARM templates) is essential. Experience in machine learning platforms or ML engineering is a bonus.
Key Responsibilities:
-
Build and maintain the Data Lakehouse platform in a secure Azure environment
-
Develop automation for cluster management, integration runtimes, and networking
-
Lead architectural design and ensure platform scalability, reliability, and governance
-
Write efficient, maintainable code in PySpark, Python, and SQL
-
Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM
-
Collaborate with data engineers, architects, and business stakeholders
-
Mentor and coach engineers, fostering a culture of learning and excellence
Essential Skills:
-
Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture
-
Strong solution architecture and data platform engineering skills
-
DevOps and automation expertise, including CI/CD, monitoring, and code quality
-
Infrastructure-as-code (Terraform or ARM templates) for cloud resource provisioning
-
Excellent communication and mentoring skills
It's not often a role comes along in a team like this, where you get the chance to flex or condense hours, receive a strong salary with a bonus, potential for growth, independence and autonomy, and a clear pathway of progression. You'll get Private medical options, 25 days holiday, plus bank holiday, and the chance to buy/sell holiday.
This is a rare opportunity to join a forward-thinking team at a leading organisation, working fully remotely with flexibility and excellent benefits. You’ll be shaping the future of their data platform while collaborating with a talented and diverse team.
To apply, please submit your CV as we are looking to move quickly on this role.