Data Engineer – AWS Kinesis & Databricks - AU Citizen
Canberrahybridmid
Posted today · via Workday
About this role
We’re looking for a hands-on Data Engineer with strong experience building reliable, real-time data pipelines using Amazon Kinesis and Databricks . You’ll work with modern AWS data technologies to develop and optimise streaming pipelines, moving high-volume data from Kinesis into the Databricks Lakehouse using Spark Structured Streaming and Delta tables. What you’ll do : Build and support real-time data pipelines using Amazon Kinesis Data Streams and Kinesis Data Firehose . Develop streaming solutions in Databricks using Spark Structured Streaming . Ingest and manage streaming data within Delta tables . Optimise pipelines for performance, latency, reliability and cost. Build monitoring and alerting using AWS CloudWatch .…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, sql, databricks, aws, s3…
2
Level fit
This role is mid-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in Canberra. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonsqldatabricksawss3kinesisiamsparkkafka