AI Cloud Platform Engineer

This is a fully remote position, open to applicants in Texas.

📋 Description

• Design, develop, and maintain scalable, resilient, and high-performance data platforms.

• Create and enhance a Unified Data Analytics Platform utilizing cloud-native Microsoft Fabric technologies.

• Architect and implement intelligent, automated, and agentic AI-driven solutions.

• Improve security, governance, reliability, and operational excellence of the enterprise data platform.

• Collaborate effectively with analytics engineers, data architects, data scientists, and product teams.

• Engage in iteration planning, daily standups, and retrospectives.

• Assist in executing product strategy with a focus on customer needs and outcomes.

• Design scalable systems, applications, and data solutions.

• Utilize GitHub Copilot and similar coding assistants for code generation, testing, documentation, and troubleshooting while adhering to enterprise governance standards.

• Provide support for software products and platforms in both production and user environments.

• Apply paired programming, test-driven development, and contemporary software engineering practices.

• Establish and uphold CI/CD pipelines and practices.

• Design and implement AI-enabled applications, automation workflows, and enriching developer experiences.

• Share knowledge and contribute to the team’s collective expertise.

• Influence platform strategy and deliver solutions that facilitate trusted, self-service, enterprise-scale data consumption.

⛳️ Requirements

• A minimum of 3 years of experience as a Data Engineer, building and supporting enterprise-scale data platforms and pipelines.

• Advanced proficiency in Python, SQL, and contemporary data engineering methodologies.

• Strong practical experience with GitHub, Key Vault, and REST API integration and automation.

• Familiarity with Microsoft Fabric and Azure platform, or similar cloud analytics platforms.

• Experience with Terraform/Jenkins, or similar CI/CD tools.

• Experience in implementing CI/CD pipelines, source control, Infrastructure as Code (IaC), and automated testing practices.

• Knowledge of AI-powered engineering tools and agentic AI-assisted software development practices.

• Solid understanding of distributed computing, performance tuning, scalability, fault tolerance, and data reliability.

• Exceptional problem-solving, collaboration, communication, and stakeholder management skills.

• Background investigation is required.

• Allstate generally does not sponsor individuals for employment-based visas for this position.

• A dedicated, private workspace free from distractions when working from home.

• Reliable internet service with minimum speeds of 50 MB download and 5 MB upload.

• Preferred: Experience in designing and implementing enterprise data products within Microsoft Fabric.

• Preferred: Knowledge of data governance and data quality frameworks.

• Preferred: Cloud or data engineering certifications in Azure, Microsoft Fabric, Databricks, or related technologies.

• Preferred: 3 or more years of relevant experience.

🏝️ Benefits

• Comprehensive technology setup, which includes a laptop, monitors, headset, keyboard, and mouse.

• Monthly connectivity reimbursement to help offset internet costs for employees eligible to work from home.