Senior Data Engineer

Compare The Market

AUonsitePosted Jul 8, 2026
Posting intelligenceActively listedReposted 5×, possible evergreen/ghost posting

Skills

databrickspythonsparkcicdawsml

About the role

Who We Are

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

What You’ll Be Doing

As a Senior Data Engineer, you’ll play a key role in advancing our modern cloud data platform (Databricks/AWS). You’ll combine hands-on engineering expertise with technical leadership, helping shape architecture, uplift data capabilities, and support advanced analytics and machine learning use cases.

You’ll work across a collaborative data ecosystem, partnering with data scientists, BI teams, and architects to deliver scalable, high-quality data solutions.

You will:

Build, maintain and optimise scalable data pipelines for analytics and ML

Design data solutions and contribute to platform architecture

Develop real-time and batch data processing frameworks

Champion best practices across data modelling, quality and governance

Support and deliver against the data engineering roadmap

Collaborate with stakeholders to ensure data is accessible and reliable

What’s In It For You

At Compare the Market and iSelect, we’re all about helping people make smart choices – and joining us might just be yours. We offer an environment where your ideas are heard, your contributions are valued, and your growth genuinely matters. Collaboration is part of our DNA, and you’ll be joining a supportive, forward-thinking team where you can do meaningful work (and be recognised for it!)

We’re guided by three shared values that shape how we work, how we treat each other, and how we show up for our customers – Drive, Noble Intent and All Together.

Plus, we offer a range of great perks to help you thrive both in and out of work:

Vibrant and social community with events and celebrations

Flexible work – one day WFH or a 9-day fortnight

‘ME’ leave and ‘Volunteer Day’ leave

Option to purchase additional leave

Return to Work bonus for parents

Quarterly Award and Recognition program

What Sets You Apart

We’d love to hear from professionals who have:

5+ years’ experience building data pipelines in production environments

Strong Python and SQL skills for data engineering

Experience with cloud platforms (AWS) and modern data stacks

Knowledge of data modelling, governance, security and quality practices

Experience with CI/CD and Infrastructure as Code

Ability to provide technical guidance and mentor others

Experience with the below would be advantageous:

Databricks, Spark or PySpark experience

Experience with real-time/streaming data or ML feature stores

Metadata-driven or highly automated data solutions

Sound like a good fit? Let’s talk.

This role is available to candidates with unlimited Australian working rights only. Sponsorship is not available.

iSelect and Compare the Market, brands of iCompare Group, are committed to protecting your privacy. All applications and personal information are kept confidential and securely stored in line with Australian privacy laws, used only for recruitment purposes, and not shared with third parties outside iCompare Group without your consent.

Questions about this role

Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.

Compensation for Data Engineer roles in Australia varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our Data Engineer hub for Australia medians across recent openings.

Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.

AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, Personio, Teamtailor and other major ATS platforms. If we can submit through the platform, we do.

Want AI Applyd to auto-apply to roles like this?

We tailor your resume per posting, fill the forms, and track replies for you.