fb pixel


Senior Data Engineer - AWS

Job Title: Senior Data Engineer - AWS
Contract Type: Contract
Location: Carlton, Victoria
Start Date: ASAP
Reference: BBBH66754_1616030034
Contact Name: Ibrahim Khan
Contact Email: Ibrahim.Khan@clicks.com.au
Job Published: March 18, 2021 12:14

Job Description

The purpose of this position is to join the existing team as a Senior Data Engineer. The team is working in a predominantly agile mode.

During this engagement the AWS Data Engineer will be specifically responsible for the following:

  • Design, build and optimise IoT data pipelines, architectures and data sets including IoT sensor data.
    • Full stack development utilising AWS technologies and modern programming languages - inc. Node JS
    • Data integration design and build including real-time data analytics, ETL, data modelling and SQL.

Specific Skills Required:

  • Experience working in the agile environment with core understanding of Dev Ops & CI/CD principles.
  • Extensive experience and knowledge of using the AWS cloud platform in an enterprise environment to deliver world class services and capabilities.
  • Experience with designing, building and optimising IoT data pipelines, architectures and data sets including IoT sensor data.
  • Strong background in data integration - real-time data analytics, ETL, data modelling and SQL skills.
  • Extensive development experience in the AWS technologies with strong focus on big data & Dev Ops related technologies:
    • AWS Kinesis Data Streams & Analytics
    • AWS Cloud Formation
    • AWS Lambda
    • AWS Cloud Formation
    • AWS Code Pipeline
    • AWS Landing Zone
    • AWS S3 & DynamoDB
    • AWS IoT (Nice to have)
  • Coding proficiency in the modern programming languages - Node JS, Python.
  • Having functional programming expertise is a nice to have.
  • Experience with open source frameworks including Apache Spark/Storm, Apache Cassandra, Kafka and Nifi
  • Experience processing files in various image, audio and video media formats
  • Experience with Atlassian DevOps toolchain - Jira, Bitbucket, Bamboo, et.al
  • Knowledge and work experience using at least one of the major business intelligence reporting tools

If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Ibrahim Khan at Clicks IT Recruitment on 03 9963 4817.