DevOps Engineer – Data Platform, Cloud Infrastructure

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, implement, and manage secure and scalable cloud infrastructure that supports enterprise data platforms, analytics workloads, and AI/ML functionalities across development, validation, and production settings.

• Create and sustain Terraform Infrastructure as Code, reusable modules, and automation patterns for AWS and Databricks resources.

• Oversee Databricks environments, which includes workspaces, Unity Catalog, metastores, credentials, clusters, jobs, secrets, and access controls.

• Handle Databricks migrations, upgrades, and architectural modifications with minimal disruption.

• Develop and execute secure AWS architectures that encompass VPC networking, private connectivity, IAM, cross-account access, S3, KMS, and least-privilege controls.

• Construct and manage GitHub Actions CI/CD pipelines for infrastructure deployments, validation, security checks, and operational workflows.

• Create automation tools using Python, Bash, and cloud APIs.

• Assist in enterprise identity and access management, covering provisioning, groups, service principals, OAuth/PAT authentication, workload identities, and permissions.

• Implement observability and audit logging for cloud and Databricks environments, including integration with Splunk.

• Design and facilitate secure data platform integrations involving Delta Lake, Unity Catalog, Delta Sharing, external locations, and data access controls.

• Enable AI/ML platform capabilities that include MLflow, Databricks AI tools, AWS Bedrock, foundational models, and GenAI workloads.

• Collaborate with data engineering, analytics, security, and application teams to resolve platform issues and set engineering standards.

• Lead technical investigations, proofs of concept, and platform enhancements focused on reliability, security, automation, and developer experience.

• Produce technical documentation, onboarding materials, architecture diagrams, runbooks, and self-service tools.

• Engage in incident response, root cause analysis, and continuous improvement for production data platform services.

⛳️ Requirements

• Bachelor's degree in a relevant technical discipline with 4+ years of experience, or equivalent professional background.

• Must be legally authorized to work in the United States.

• Bixal does not offer visa sponsorship.

• Extensive hands-on experience managing AWS cloud infrastructure in enterprise settings.

• Proficient with Terraform or similar Infrastructure as Code tools, including reusable modules and large-scale infrastructure deployments.

• Experience in administering Databricks environments, Unity Catalog, workspace management, account-level resources, permissions, service principals, and integrations.

• Strong understanding of AWS IAM, S3, VPC, Route 53, KMS, Lambda, VPC endpoints, and networking principles.

• Familiarity with the design of secure cloud architectures using least-privilege IAM, encryption, private networking, and compliance-focused controls.

• Experience in building and maintaining CI/CD pipelines utilizing GitHub Actions or comparable platforms.

• Strong skills in Python and Bash scripting for cloud, infrastructure, or platform operations.

• Experience in supporting production data platforms, distributed systems, analytics environments, or AI/ML infrastructure.

• Understanding of Delta Lake, medallion architecture, data governance, and access control models.

• Proficient in troubleshooting cloud infrastructure, networking, identity, automation, and data platform challenges.

• Excellent communication skills and the ability to collaborate with both technical and non-technical stakeholders.

• Capability to obtain and maintain a Public Trust security clearance.

• Familiarity with FedRAMP, FISMA, or other regulated cloud environments is advantageous.

• Experience with Databricks E2 architecture, migrations, AI/ML platforms, AWS Bedrock, LLM integrations, RAG architectures, Splunk, GitHub organization settings, or relevant certifications is a plus.

🏝️ Benefits

• Flexible working hours.

• 401K with matching contributions.

• Parental leave.

• Medical, dental, and vision benefits.

• Flexible Spending Account.

• Company-provided short-term disability and life insurance.

• Commuter benefits.

• Paid Time Off (PTO).

• 11 paid holidays.

• Reasonable accommodations for applicants with disabilities.