Data and AI Engineer

This is a fully remote position, open to applicants in Arizona, +10 more states.

📋 Description

• Design, develop, and enhance scalable ETL/ELT pipelines utilizing Apache Spark and Delta Lake across AWS, Azure, and GCP.

• Create scalable Lakehouse architectures to accommodate both structured and unstructured enterprise data.

• Automate workflows for data ingestion, storage, and feature engineering to support analytics and real-time AI tasks.

• Optimize Spark jobs for minimal latency, maximum throughput, and efficient cloud costs.

• Collaborate with ML engineers and data scientists to implement AI models in Databricks using MLflow.

• Establish CI/CD pipelines and Infrastructure-as-Code with Terraform and Databricks CLI.

• Ensure compliance with enterprise data security, access controls, and standards such as GDPR, HIPAA, and SOC 2 within Unity Catalog and cloud environments.

• Work with client technology leaders, product managers, and engineering teams to convert AI data needs into business results.

• Create technical documentation and facilitate solution transitions to client engineering teams.

• Report to the Product Manager/Engineering Lead.

⛳️ Requirements

• Over 3 years of experience in cloud-native data engineering.

• More than 2 years of hands-on experience specifically with Databricks, Apache Spark, Delta Lake, and MLflow.

• Strong proficiency in Python, SQL, Spark frameworks, CI/CD, and Infrastructure-as-Code (Terraform or Databricks CLI).

• Current Databricks Certified Data Engineer (Associate or Professional) or Databricks ML Professional certification is highly preferred.

• Demonstrated success in fast-paced Agile/DevOps consulting settings.

• Experience in delivering cloud-agnostic architectures.

• Outstanding client communication skills.

• Must meet U.S. work authorization requirements for direct W-2 employment through E-Verify.

🏝️ Benefits

• Paid Time Off – Take the time you need to recharge and stay productive.

• Remote-First Working Environment – Collaborate from anywhere while staying connected with our global team.

• Comprehensive Health Coverage – Medical, Dental, Vision.

• 401(k) Retirement Plan – Plan for your future with access to a company-sponsored 401(k) program.

• Annual Learning & Development Stipend – Invest in your skills with conferences, certifications, or courses.

• Peer Mentorship & Coaching – Learn from experienced engineers, product managers, and architects to accelerate your growth.

• Professional Growth Opportunities – Exposure to cutting-edge AWS GenAI, data, and cloud technologies across diverse industries.

• Company Outings & Volunteer Opportunities – Build relationships and give back to the community.

• Collaborative, Innovative Culture – Work alongside top talent in a fast-paced, supportive environment that values curiosity and initiative.