CONTRACT-Lead Data Engineer(Azure Databricks) -Insurance- 60k
Argyll Scott ·www.argyllscott.com
Apply direct12 month extendable contract
Role Overview
We are seeking a Health Data Engineer Lead to drive the design and implementation of a common Health Data Model and Health Data Products to provide ready-to-use, easily consumable, trusted data set to support the AI and analytics use cases required to drive Manulife’s Health business ambition.
This role is critical in enabling business units to innovate faster, optimize operations, and deliver localized analytics and AI capabilities.
The successful candidate will participate in regional health strategic initiatives such as Provider Management Solutions, Health KPIs and Claim Driver analyses/automation, and other Regional/Local Health Analytics/AI use cases that require a common health data model.
Position Responsibilities
- Partner closely with Health business unit leaders, Health product owners, and IT stakeholders to capture business requirements, define project scopes, and establish clear delivery timelines.
- Partner and collaborate with Health Regional teams.
- Perform workload and effort estimation; break down complex data initiatives into detailed technical epics, user stories, and execution roadmaps.
- Design, build, and optimize scalable batch and real-time data pipelines, data lakehouse architectures, and data warehousing solutions.
- Provide technical leadership for enterprise data platforms, driving architecture, engineering best practices, platform optimization, and innovation across Azure Cloud and Databricks (Spark).
- Implement robust data orchestration, data ingestion, cleansing, transformation, augmentation, and data quality control processes.
- Establish and enforce technical quality standards, data governance frameworks, and best practices across data ingestion, storage, and processing.
- Conduct thorough code reviews, lead technical troubleshooting, and ensure data pipelines are secure, resilient, and cost-optimized.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information Systems, Quantitative Engineering, or a related field.
- Minimum 8+ years of IT experience, with at least 5+ years specifically in data engineering delivery leadership or technical lead roles.
- Hands-on experience with Azure Cloud Services (Azure Data Lake Storage, Azure Data Factory, Azure SQL/Synapse) and database technology (Oracle, SQL Server, or PostgreSQL).
- Strong proficiency with Azure Databricks, Apache Spark (PySpark / Spark SQL), and modern ETL/ELT pipeline design.
- Excellent verbal and written communication skills with the ability to articulate technical visions, architectural trade-offs, and project updates to non-technical stakeholders.
- Familiarity with AliCloud big data tools, specifically DataWorks, MaxCompute, OSS, and Hologres.
- Experience with FineBI, Power BI, Tableau or similar enterprise reporting tools.
Argyll Scott Asia is acting as an Employment Business in relation to this vacancy.