fb pixel


Senior Data Engineer - Big Data

Job Title: Senior Data Engineer - Big Data
Contract Type: Contract
Location: Sydney CBD, New South Wales
Reference: BBBH64201_1574643965
Contact Name: Rowena Simbulan
Contact Email: Rowena.Simbulan@clicks.com.au
Job Published: November 25, 2019 12:06

Job Description

Senior Data Engineer| Apache Spark | Python |Git | Initial 7 months Fixed Term Contract | Western Sydney

Duties and Responsibilities:

  • Participate in delivering Agile based methodologies. Get involved in sprint planning; raising issues or blockers, and participating in showcases and retrospectives
  • Gather stakeholders requirements to ensure solutions meet business expectations
  • Train end users to use data products
  • Utilise DevOps practices in an Azure environment by automating build, test, and deployment. Use technologies such as Python, Git and Apache Spark.
  • Automate software delivery process using CI/CD pipelines. Get involved in unit, system and end to end testing
  • Develop an efficient ETL process, Predictive Analytics, Cubes, Visualisations and Dashboards. Follow the Software Development Life Cycle and use technologies such as SSIS, SSRS, SSAS, PowerBI (DAX, PowerQuery) and Python.

Skills and Experience Required:

  • Bachelor's Degree in IT or Industry equivalent experience
  • Minimum 5+ years' experience in Software Development or delivering Data Engineering solutions. Ideally with experience in Python, Git, Big Data solutions such as Apache Spark
  • Strong skills in SQL, SSIS, SSRS, SSAS and PowerBI (dashboard, report and designing data models)
  • Understanding or experience in CI/CD pipelines (Continuous Integration and Continuous Deployment) DevOps and Azure
  • Experience in dashboard, report, and data model design
  • Agile Development methodologies experience
  • Excellent communications skills with ability to gather business requirements from stakeholders

If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Rowena Simbulan at Clicks IT Recruitment on 02 9200 4450.