Lead AI Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and continuously enhance Infinitive's enterprise AI Factory ecosystem.

• Facilitate swift transitions from legacy systems to modern code and automate data engineering processes.

• Create system prompts, structured project directives, rule sets, and operational frameworks for Claude Code and related AI coding agents.

• Develop, standardize, and sustain modular conversion templates tailored for technical archetypes.

• Architect automated validation frameworks and reconciliation test harnesses to ensure data integrity, schema consistency, and alignment with business logic.

• Incorporate static analysis tools, linters, and architectural pattern-checking pipelines into enterprise CI/CD workflows.

• Write production-quality Python, PySpark, and advanced SQL for data pipelines, lakehouse architectures, and distributed computing tasks.

• Design and optimize Databricks lakehouse solutions for enhanced performance, security, and cost-effectiveness.

• Set policies, risk management controls, and quality gates for code synthesis, data security, intellectual property protection, and prompt governance.

• Define, monitor, and report metrics related to engineering acceleration, developer velocity, cycle time reductions, defect rates, and return on investment.

• Mentor technical leads, data engineers, and consulting delivery teams in the adoption of AI-assisted development tools.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Systems, Software Engineering, or a related technical field.

• Databricks Certified certification is strongly preferred (Databricks Certified Data Engineer Professional, Solutions Architect, or Machine Learning Professional).

• Over 7 years of progressive experience in data architecture, software engineering, or technical delivery.

• A minimum of 2 years architecting or scaling modern AI/LLM-assisted engineering workflows.

• Expert-level proficiency in Python, PySpark, and SQL.

• Extensive hands-on experience in structuring repository instructions, system prompts, guardrails, and context windows for developer tools like Claude Code, GitHub Copilot, or similar coding environments.

• Proven success in designing scalable architectures on Databricks in conjunction with AWS or Azure environments.

• Strong background in designing CI/CD pipelines with automated testing, linting, and data reconciliation suites.

• Familiarity with GitHub Actions, GitLab CI, or Azure DevOps.

• Exceptional communication skills with the ability to articulate AI governance frameworks, architectural patterns, and productivity impact metrics to executive stakeholders and technical teams.

• Preferred: experience in architecting migration pipelines that convert legacy data platforms such as Netezza, Teradata, Oracle, Informatica, or SSIS to Databricks Lakehouse.

• Preferred: working knowledge of FinOps principles and token/compute cost attribution for large-scale AI workloads.

• Must be legally authorized to work in the US for any employer.

• Must meet eligibility criteria to be hired by Infinitive as a full-time employee without requiring Infinitive visa sponsorship at any time during employment.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Generous paid time off and flexible work arrangements.

• Opportunities for professional development and continuous learning.

• Collaborative and inclusive work environment.