Data Engineer (BBBH2145) Surry Hills, Sydney, Australia
Big Data Engineer
- Surry Hills location
- 6-month contract, high chance of renewal
- Cutting edge technology
About the company:
One of Australia’s leading retail organisations based in Surry Hills is looking for a Big Data Engineer to lay the platform for their huge BI transformation project.
About the Role:
Swift execution of Big Data Engineering, Machine Learning and DevOps best practice on Terabytes of data from the largest Australian retail is what this role is about. Working as part of data engineering team, hand in hand with data scientists, be prepared to build cutting edge pipelines and experiment with best data engineering and ML tech available on the market. The team has a culture of its own, which involves an innate desire to do things differently with high quality and push tech to its limits. No matter how experienced you are, be prepared to learn a lot!
It will be your job to:
- Assist the Data Scientists and lay the platform in the design, implementation and testing of customer data products such as personalisation engine, decision engine et.
- Ensure quality control and oversight of model outputs within the customer product
- Being the single point of contact for all stakeholders to ensure outcomes are delivered and that we deliver value
What you need to succeed:
- Strong software engineering background and passion for high quality design and code
- 2-5 years of commercial experience with Scala, Spark, SQL and Python
- Total automation mentality (CI/CD)
- Very good command of Linux
- Exceptional communication skills
- Created production pipelines for ML algorithms
- Autonomy
Ideal candidate will also have:
- 2-5 years of end to end delivery of Terabytes size Data Engineering pipelines
- 1-3 years of DevOps experience (GCP/AWS, Kubernetes, Terraform)
We have already launched a headhunt drive for this role – if you feel that this is the next step in your career, apply now!!