Data Engineer (Airflow)

Method Recruitment Bullhorn ·www.methodrecruitment.com.au

Location Melbourne, Victoria, Australia
Type Full time
Level Mid
Source Shazamme
1 Open
Apply direct

Data Engineer – Apache Airflow to Amazon MWAA Migration

4 months Contract Opportunity | AWS | Data Engineering | Airflow | MWAA

We are partnering with a well-established organisation undertaking a significant cloud and data platform initiative and are seeking an experienced Data Engineer to lead the migration of an existing Apache Airflow environment to Amazon Managed Workflows for Apache Airflow (MWAA).

This is a hands-on contract role suited to someone who has strong experience with Airflow in production environments and has previously worked on cloud migration or modernisation projects within AWS.

The Opportunity

You will play a key role in assessing the current Airflow environment, designing the migration approach, and delivering a successful transition to Amazon MWAA. Working closely with data engineering, cloud and platform teams, you will help ensure workflows are migrated efficiently, securely and with minimal disruption to business operations.

Key Responsibilities

• Assess and review the existing Apache Airflow environment, including DAGs, plugins, dependencies and integrations
• Design and execute the migration strategy to Amazon MWAA
• Refactor, optimise and deploy Airflow workflows where required
• Configure and manage MWAA environments across AWS
• Implement best practices around CI/CD, monitoring, logging and operational support
• Collaborate with cloud, infrastructure and security teams to ensure alignment with enterprise standards
• Conduct testing, validation and production cutover activities
• Document architecture, processes and operational procedures

About You

You will be a hands-on Data Engineer with strong workflow orchestration experience and a track record of delivering cloud-based data platform projects.

Key Skills & Experience

• Strong experience administering and developing solutions within Apache Airflow
• Experience migrating Airflow environments between platforms or cloud environments
• Hands-on experience with Amazon MWAA
• Strong AWS experience across services such as S3, IAM, CloudWatch, Secrets Manager and VPC networking
• Strong Python development skills
• Experience working with CI/CD pipelines and Infrastructure as Code
• Strong troubleshooting, performance optimisation and operational support experience
• Excellent stakeholder engagement and communication skills

Desirable

• Experience with Terraform or CloudFormation
• Experience working within modern data platforms and data lake architectures
• Exposure to Databricks, Spark or cloud-native analytics platforms
• Experience within enterprise-scale environments

What's on Offer

• Opportunity to be a part of a high-impact cloud migration initiative
• Work with modern AWS and data technologies
• Highly collaborative technical environment
• Flexible working arrangements

If you have proven experience with Apache Airflow and Amazon MWAA migrations and are looking for your next contract opportunity, we would love to hear from you.

Frequently asked questions

Who is hiring for the Data Engineer (Airflow) role?
Method Recruitment Bullhorn is hiring for the Data Engineer (Airflow) position, a Shazamme client. Apply directly on the employer's career site.
Where is the Data Engineer (Airflow) job located?
The Data Engineer (Airflow) role with Method Recruitment Bullhorn is based in Melbourne, VIC, AU.
Is the Data Engineer (Airflow) role full-time or contract?
This is a full time position at Method Recruitment Bullhorn.
What experience level is the Data Engineer (Airflow) role?
The Data Engineer (Airflow) position is aimed at mid-level candidates.
How do I apply for the Data Engineer (Airflow) role at Method Recruitment Bullhorn?
Apply directly on Method Recruitment Bullhorn's career page via the Apply button on this listing. ZammeJobs links straight through to the employer's ATS — no third-party form, no resume database.
Apply direct