DevOps Engineer

This is a fully remote position, open to applicants in Tennessee.

📋 Description

• Design and sustain CI/CD pipelines within Azure DevOps for deploying notebooks, jobs, and workflows to Azure Databricks.

• Integrate Databricks Repos with Azure Repos (Git) for effective source control of PySpark/R notebooks.

• Automate job execution in Databricks utilizing Databricks CLI, REST API, or DevOps tasks.

• Uphold infrastructure-as-code methodologies using tools such as Terraform.

• Monitor and resolve pipeline failures, notebook challenges, and inconsistencies in deployments.

• Collaborate with Data Engineers and Platform teams to manage development, staging, and production environments.

• Establish best practices for version control, testing, and notebook promotion across multiple environments.

• Securely store and manage Databricks secrets, tokens, and configurations within Azure Key Vault and DevOps variable groups.

• Implement DevOps methodologies within a data platform framework.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field, or an equivalent combination of education and experience.

• At least three (3) years of experience in DevOps engineering or a comparable role.

• Experience with Microsoft Azure, including other cloud-based data integration technologies and associated tools.

• Proficiency in data analytics and AI platforms.

• Experience in automating notebook execution.

• Strong scripting skills for automation and various programming tasks.

• Technical agility combined with an operations-oriented mindset.

• Excellent communication and coordination abilities.

🏝️ Benefits

• Medical, dental, and vision insurance.

• Employee assistance program.

• Employer-paid and voluntary life insurance.

• Disability insurance.

• Health and flexible spending accounts.

• Competitive compensation.

• 401k with employer match.

• Financial wellness resources.

• 20 PTO days.

• 7 paid holidays.

• 1 floating day.

• Paid parental leave.

• Work-life assistance resources.

• Physical wellness perks.

• Mental health support.

• Employee referral program.

• BenefitHub for employee discounts.