Senior Databricks Engineer

Are you a hands-on Data Architect with deep expertise in Databricks? Do you excel at transforming complex data environments and leading distributed teams?

We are looking for a senior technical leader to spearhead a high-impact data transformation initiative focused on automated reporting and dashboard solutions.

Location: Hybrid (Europe / Flexible)

Type: Permanent or Contract

Responsibilities:

• Design the Future: Build and evolve scalable data models within a Databricks lakehouse architecture using Bronze, Silver, and Gold medallion layers.
• Deliver Pipelines: Lead the design and deployment of robust, production-grade batch and streaming data pipelines (structured and unstructured data).
• Partner with Clients: Act as a trusted on-site architectural advisor, translating complex business needs into scalable technical designs.
• Lead & Mentor: Guide distributed (onshore/offshore) engineering teams, setting high technical standards and ensuring seamless delivery.
• Optimise & Govern: Champion best practices across data governance, lineage, quality, and platform cost/performance optimisation.

Requirements:

• Experience: 8–10+ years in data architecture and large-scale data platforms, with a heavy focus on Databricks-led environments.
• Tech Stack: Mastery of Spark-based processing, cloud-native environments (Azure preferred), and data integration tools (e.g., ADF).
• Data Modeling: Strong hands-on skills across conceptual, logical, and physical layers (ERwin, ER/Studio, PowerDesigner, etc.).
• Downstream Tech: Familiarity integrating with enterprise databases (SQL Server, Oracle) and BI tools (Power BI, Tableau).
• Industry Background: Experience in Financial Services, Insurance, or regulated sectors is highly preferred.
• Mindset: A unique blend of senior stakeholder management skills and a "hands-on" technical approach.