Data & AI Engineer

This is a fully remote position, open to applicants in Brazil, +5 more countries.

📋 Description

• Design, construct, and enhance scalable ETL/ELT pipelines utilizing Apache Spark and Delta Lake across AWS, Azure, and GCP.

• Develop robust Lakehouse architectures that handle both structured and unstructured data at an enterprise scale.

• Automate workflows for data ingestion, storage, and feature engineering to support analytics and real-time AI tasks.

• Optimize Spark jobs to achieve low latency, high throughput, and cost efficiency in the cloud.

• Collaborate with ML engineers and data scientists to deploy AI models in Databricks using MLflow.

• Establish CI/CD pipelines and implement Infrastructure-as-Code with Terraform and Databricks CLI.

• Uphold enterprise data security, access controls, and compliance with GDPR, HIPAA, and SOC 2 standards within Unity Catalog and cloud environments.

• Work alongside client technology leaders, product managers, and engineering teams to convert AI data needs into tangible business results.

• Create technical documentation and guide solution transitions to client engineering teams.

⛳️ Requirements

• Over 3 years of experience in cloud-native data engineering, including at least 2 years of hands-on experience with Databricks, Apache Spark, Delta Lake, and MLflow.

• Strong expertise in Python, SQL, Spark frameworks, CI/CD, and Infrastructure-as-Code (Terraform or Databricks CLI).

• Current Databricks Certified Data Engineer (Associate or Professional) or Databricks ML Professional certification is highly preferred and will enhance your application.

• Demonstrated success in fast-paced Agile/DevOps consulting settings.

• Experience in delivering cloud-agnostic architectures.

• Excellent communication skills with clients.

🏝️ Benefits

• Paid Time Off – Take the time you need to recharge and stay productive.

• Remote-First Working Environment – Collaborate from anywhere while staying connected with our global team.

• Comprehensive Health Coverage – Medical, Dental, Vision

• 401(k) Retirement Plan – Plan for your future with access to a company-sponsored 401(k) program.

• Annual Learning & Development Stipend – Invest in your skills with conferences, certifications, or courses.

• Peer Mentorship & Coaching – Learn from experienced engineers, product managers, and architects to accelerate your growth.

• Professional Growth Opportunities – Exposure to cutting-edge AWS GenAI, data, and cloud technologies across diverse industries.

• Company Outings & Volunteer Opportunities – Build relationships and give back to the community.

• Collaborative, Innovative Culture – Work alongside top talent in a fast-paced, supportive environment that values curiosity and initiative.