Mid Data Engineer, Software

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, build, and maintain extensive data pipelines utilizing Scala, Spark, and cloud-native technologies.

• Tackle intricate data engineering issues by creating resilient distributed systems and enhancing data processing workflows.

• Engage in the development of production-grade data platforms through high-quality, tested code and comprehensive feature development.

• Uphold software quality by ensuring clean, testable, and well-documented code, participating in code reviews, and adhering to engineering standards.

• Collaborate with agile value stream teams, engineers, product owners, and cross-functional stakeholders.

• Offer technical guidance through architecture discussions, code reviews, and the promotion of engineering best practices.

• Assist in deployments, monitoring, alerting, and the continuous improvement of system reliability.

• Enhance performance, cost-effectiveness, and scalability of data processing tasks.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline, or equivalent practical experience.

• Robust experience in software or data engineering.

• Practical experience with cloud-native data platforms such as AWS, GCP, or Azure.

• Familiarity with services like S3, Glue, Athena, or their equivalents.

• Strong grasp of distributed systems, resiliency patterns, data partitioning, and effective data access strategies.

• Experience in designing and managing highly parallelized data workloads.

• Proficiency in Git-based version control systems such as GitHub or Bitbucket.

• Knowledge of agile methodologies and collaborative development in multi-team settings.

• Excellent communication skills for technical discussions and peer collaboration.

• Advanced proficiency in English.

• Willingness to travel to São Carlos/SP as necessary.

• Nice to have: experience with DBT or other data transformation frameworks.

• Nice to have: understanding of concurrent and parallel programming patterns.

• Nice to have: expertise in Scala and Apache Spark data pipelines.

• Nice to have: familiarity with functional programming or languages such as Java, Python, or Rust.

• Nice to have: knowledge of modern data platform architectures and large-scale data ecosystems.

🏝️ Benefits

• Option for remote work.

• Commitment to inclusive recruitment and professional development initiatives.

• Affinity groups supporting underrepresented communities: ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations.