Consultant Software Engineer - Azure DevOps + Terraform + Databricks exposure

DevOps Engineer – Azure DevOps & Databricks

As a DevOps Engineer, you will be responsible for designing, automating, and operating cloud-native data platforms on Azure Databricks. You will work closely with Infrastructure, Data Engineering, and Security teams to deliver stable, scalable, and secure environments using Azure DevOps and Terraform-driven Infrastructure as Code.

• Provide Level 2/3 operational support for Azure Databricks environments
• Participate in on-call rotations to ensure high availability and timely incident response
• Troubleshoot platform, infrastructure, and pipeline-related issues
• Maintain platform health using monitoring, alerting, and logging tools

• Design, build, and maintain Infrastructure as Code using Terraform
• Implement and manage CI/CD pipelines using Azure DevOps
• Automate provisioning, configuration, and lifecycle management of Databricks workspaces
• Manage cloud resources, identity, access, and security controls (RBAC, IAM, policies)

• Integrate Databricks workloads into Azure DevOps pipelines
• Support version control, releases, and deployment strategies
• Collaborate with Data Engineering teams to standardize deployment approaches

• Contribute to architectural decisions for Databricks-based data platforms
• Document architectures, runbooks, and operational best practices
• Assist with onboarding users and promoting platform adoption

• Strong experience with Azure Cloud
• Hands-on expertise in Terraform and Azure DevOps
• Solid understanding of CI/CD concepts and Git-based workflows
• Experience with monitoring tools (Azure Monitor, Prometheus, Grafana)
• Knowledge of cloud security best practices

• Experience: 10+ years total experience, with 5+ years of relevant experience
• Strong experience with Azure Cloud
• Hands-on expertise in Terraform and Azure DevOps
• Solid understanding of CI/CD concepts and Git-based workflows
• Experience with monitoring tools (Azure Monitor, Prometheus, Grafana)
• Knowledge of cloud security best practices

• Databricks administration (clusters, jobs, workspaces, Unity Catalog)
• Exposure to Snowflake and data platform ecosystems
• Python or scripting experience for automation

• Databricks administration (clusters, jobs, workspaces, Unity Catalog)
• Exposure to Snowflake and data platform ecosystems
• Python or scripting experience for automation

• Strong analytical and problem-solving skills
• Ability to work independently and collaboratively
• Clear communication and documentation skills

N/A