Senior Cloud Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, implement, and oversee secure, scalable cloud infrastructure that supports data, analytics, and AI/ML workloads.

• Take ownership of cloud infrastructure across development, validation, and production environments.

• Create and maintain Terraform Infrastructure as Code and reusable automation modules for AWS and Databricks resources.

• Manage Databricks workspaces, Unity Catalog, metastores, external locations, credentials, clusters, jobs, secrets, and access controls.

• Oversee Databricks migrations, upgrades, and architectural changes while ensuring minimal disruption.

• Design and establish secure AWS architectures that include VPC networking, private connectivity, VPC endpoints, IAM, cross-account access, S3, and KMS encryption.

• Develop and sustain GitHub Actions CI/CD pipelines for infrastructure deployments, validation, security checks, and operational workflows.

• Create automation tools using Python, Bash, and cloud APIs.

• Assist with identity and access management, including provisioning, groups, service principals, OAuth/PAT authentication, workload identities, and automated permissions.

• Implement observability and audit logging solutions, including integrations with Splunk.

• Design and support secure data platform integrations involving Delta Lake, Unity Catalog, Delta Sharing, external locations, and data access controls.

• Enable AI/ML capabilities through tools such as MLflow, Databricks AI tooling, AWS Bedrock, foundation model integrations, and GenAI workloads.

• Collaborate with data engineering, analytics, security, and application teams to resolve platform issues and establish engineering standards.

• Lead technical investigations, proofs of concept, and enhancements to the platform.

• Produce technical documentation, onboarding guides, architecture diagrams, runbooks, and self-service tools.

• Engage in incident response, root cause analysis, and continuous improvement for production data platform services.

• Perform other relevant tasks as assigned and qualified/trained to execute.

⛳️ Requirements

• Bachelor's degree in a relevant technical field plus 4+ years of experience, or equivalent professional background.

• Extensive hands-on experience managing AWS cloud infrastructure in enterprise settings.

• Proficient with Terraform or similar Infrastructure as Code tools, including the development of reusable modules and managing large-scale infrastructure deployments.

• Experience in administering Databricks environments, including Unity Catalog, workspace management, account-level resources, permissions, service principals, and integrations.

• Strong understanding of AWS services such as IAM, S3, VPC, Route 53, KMS, Lambda, VPC endpoints, and networking fundamentals.

• Proven experience in designing secure cloud architectures employing least privilege IAM, encryption, private networking, and compliance-focused controls.

• Demonstrated ability in building and maintaining CI/CD pipelines utilizing GitHub Actions or similar automation platforms.

• Strong scripting skills in Python and Bash with experience in automating cloud, infrastructure, or platform operations.

• Background in supporting production data platforms, distributed systems, analytics environments, or AI/ML infrastructure.

• Knowledge of data platform concepts such as Delta Lake, medallion architecture (Bronze/Silver/Gold), data governance, and access control models.

• Experience in troubleshooting complex issues across cloud infrastructure, networking, identity, automation, and data platforms.

• Excellent communication skills with the capability to collaborate with engineers, architects, security teams, and non-technical stakeholders.

• Ability to obtain and maintain a Public Trust security clearance.

• Experience working in FedRAMP, FISMA, or other regulated cloud environments.

• Familiarity with Databricks E2 architecture, workspace provisioning, and account-level platform administration.

• Proven experience leading Databricks migrations, networking redesigns, or cloud modernization initiatives.

• Involvement in supporting AI/ML platforms, AWS Bedrock, LLM integrations, RAG architectures, or GenAI workloads.

• Experience with enterprise logging and monitoring solutions such as Splunk.

• Knowledge of managing GitHub organization settings, repository automation, and developer tooling.

• Relevant certifications in Databricks, AWS, Terraform, or cloud security.

• Experience in supporting healthcare or federal government environments.

• Must be legally authorized to work in the US.

• Bixal does not offer visa sponsorship.

🏝️ Benefits

• Flexible working hours.

• 401K with matching incentive.

• Parental Leave.

• Medical, dental, and vision benefits.

• Flexible Spending Account.

• Company-provided short-term disability and life insurance.

• Commuter benefits.

• Paid Time Off (PTO).

• 11 Paid holidays.

• Reasonable accommodation for candidates with disabilities.

• Support for professional development and preparation for future opportunities.