This is a fully remote position, open to applicants in Brazil.

• Design, implement, and enhance a petabyte-scale AWS data platform.

• Develop and optimize scalable data pipelines utilizing JVM languages, Spark, Python, and cloud-native services.

• Serve as a principal-level technical leader by mentoring engineers and guiding code reviews and best practices.

• Participate in architectural and design discussions alongside architects, product owners, and engineering leadership.

• Plan and execute complex technical initiatives within agile value-stream teams.

• Ensure operational readiness through coding standards, testing, monitoring, and release processes.

• Support production deployments and uphold platform stability.

• Investigate and implement GraphQL integrations, vector databases, and AI/LLM-based methodologies.

• Facilitate data-driven marketing solutions while ensuring long-term platform scalability and reliability.

• Exceptional software and data engineering experience in large-scale data platforms.

• Extensive experience in constructing petabyte-scale systems using Java-based languages like Scala and Apache Spark.

• Comprehensive expertise in the AWS data ecosystem, including Glue, S3, Athena, Managed Airflow, and Iceberg.

• Profound understanding of distributed systems and highly parallelized workloads.

• Strong capabilities in query optimization, data partitioning, and efficient storage patterns.

• AWS experience is mandatory; Azure/GCP experience is advantageous.

• Proven ability to influence long-term architecture and platform design.

• Excellent skills in code review, mentorship, and technical leadership.

• Practical experience working in agile environments and collaborating with multiple engineering teams.

• Strong version control and multi-repo collaboration proficiency using Git, GitHub, and Bitbucket.

• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.

• Advanced English proficiency.

• Willingness to travel to São Carlos/SP as necessary.

• Experience with DBT or modern transformation frameworks is a plus.

• Familiarity with concurrent and parallel programming is desirable.

• Knowledge of Python, Angular, and TypeScript is a plus.

• Experience with vector databases is an advantage.

• Practical experience in applying AI/LLM techniques is a plus.

• Option for remote work.

• Initiatives for inclusive recruitment and professional development.

• Affinity groups supporting underrepresented communities: ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations.

Data Engineer, Specialist I

People also viewed