Location: Full Remote
Project: Azure Data Platform Migration Reporting To: Bogdan (Lead Architect) & Senior Infrastructure Lead (Infrastructure Partner)
Project Overview
We are currently in a critical phase of migrating the Client's data estate from a detailed legacy monolithic Azure subscription to a compliant, scalable, Hub-and-Spoke Azure architecture. This project is driven by the need for strict international data regulatory compliance (GDPR in Europe, USMCA in North America, and strict isolation for China) and operational scalability.
The target architecture involves:
- Consolidation: moving from factory-specific resources to Regional Hubs (Europe, North America, Brazil).
- Databricks Modernization: Transitioning to Unity Catalog and Databricks Asset Bundles (DABs) for a shared workspace model.
- Strict Networking: Implementation of a Hub-and-Spoke topology with central Firewalls, Bastions, and full Private Link isolation.
Role Description
We are seeking a Senior DevOps & Cloud Infrastructure Engineer to work directly alongside the Senior Infrastructure Lead from the Infrastructure Partner. You will act as the primary technical implementer for the "Build" and "Prep" phases of the migration.
Your primary focus is Terraform development and Azure Networking, ensuring that the infrastructure is deployed correctly to support the Data Team while adhering to the strict compliance and security governance defined by the Architect (Bogdan).
Key Responsibilities
- Terraform MVP & Infrastructure as Code (IaC):
- Develop and maintain the Terraform modules for the new Hub-and-Spoke architecture.
- Refactor existing legacy Terraform state (monolithic) into modular, region-specific deployments.
- Implement strict tagging strategies for cost tracking (Factory Code + Environment).
- Azure Networking & Security:
- Implement the VNet topology: Hub VNet (West Europe) peering with Spoke VNets (Germany, Canada, Brazil).
- Configure Azure Firewalls and Bastion Hosts in the Hub.
- Ensure all PaaS services (Storage Accounts, Key Vaults, SQL) are accessed exclusively via Private Endpoints.
- Implement network isolation for the China region (no peering).
- Databricks Platform Engineering:
- Deploy and configure Shared Databricks Workspaces per region (e.g., dbw-gwc, dbw-cacen).
- Implement Unity Catalog for logical isolation of factory data within shared workspaces.
- Assist the Data Team in migrating from legacy folder-level Git repos to Databricks Asset Bundles (DABs).
- Collaboration & Bridge Role:
- Work closely with Other DevOps Engineers to align on Landing Zone standards and naming conventions.
- Support Data Team by providing the necessary infrastructure foundations for their pipelines (ADF Integration Runtimes, Compute Clusters).
Requirements
Technical Skills
- Azure Infrastructure (Expert): Deep understanding of Landing Zones, Management Groups, and Subscription design.
- Terraform (Advanced): Proven experience with state migration, module development, and CDKTF/HCL.
- Azure Networking: Expert knowledge of VNet Peering, Azure Firewall, NSGs, and Private Link/Private Endpoints (Crucial).
- Databricks Administration: Experience with Workspace deployment, Unity Catalog setup, and Cluster policies.
- CI/CD: Proficiency with GitHub Actions for deploying infrastructure and data pipelines.
- Compliance Awareness: Understanding of data residency requirements (GDPR, China DSL) is a strong plus.
Soft Skills
- Communication: Ability to articulate complex infrastructure concepts to stakeholders.
- Teamwork: Comfortable working in a multi-vendor environment.
- Proactivity: Ability to identify architectural risks (e.g., "noisy neighbor" issues in shared integration runtimes) early.
Technical Stack Summary
Domain
Technologies
Cloud Provider
Microsoft Azure
IaC
Terraform (HashiCorp)
Compute / Data
Azure Databricks (Unity Catalog), Azure Data Factory (ADF)
Networking
Hub-Spoke, VNet, Private Endpoint, Azure Firewall
CI/CD
Azure DevOps Pipelines, Git
Documentation
Markdown, Mermaid Diagrams
Contract Type & Compensation
This role is open to both Freelance (B2B) and Permanent (Full-time) candidates. We are looking for top-tier talent capable of driving this complex migration autonomously.
1. Freelance (Contractor)
- Contract Duration: Initial 6 months with high probability of extension.
- Capacity: Full-time preferred (4-5 days/week).
- Hourly Rate (Germany Market Range): €70 - €85 / hour (Dependent on seniority and specific Unity Catalog/Networking expertise).
2. Permanent (Full-time)
- Employment: Direct contract with Infrastructure Partner.
- Salary Range (Germany): €75.000 - €92.000 gross / year (plus benefits).
- Benefits: Remote options, hardware budget, training allowance.