Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and create robust, scalable, and easily monitored data pipelines.

• Implement solutions for data ingestion, transformation, integration, and delivery.

• Engage with contemporary data architectures, including Data Lakes, Lakehouses, Data Warehouses, and Analytics platforms.

• Develop solutions utilizing Microsoft Fabric and/or AWS Databricks.

• Employ Data Engineering principles irrespective of the technology or platform utilized.

• Operate within Microsoft Azure and AWS environments.

• Contribute to decisions related to data architecture, modeling, processing, quality, security, and governance.

• Ensure the reliability, observability, performance, and maintainability of solutions.

• Collaborate with BI, Data Science, Software Engineering, and business professionals.

• Participate in and lead technical and alignment meetings with clients and stakeholders.

• Identify opportunities for automation and the integration of Artificial Intelligence.

• Document solutions, technical decisions, processes, and best practices.

• Take ownership of planning, executing, and delivering data products.

⛳️ Requirements

• Bachelor's degree in Information Technology, Computer Engineering, Computer Science, Information Systems, or a related discipline.

• Senior-level experience in Data Engineering.

• Strong understanding of data architecture.

• Knowledge of data modeling and storage techniques.

• Familiarity with batch and streaming processing.

• Experience with data integration and transformation.

• Proficiency in Data Lakes, Lakehouses, and Data Warehouses.

• Awareness of data quality, governance, security, and lineage.

• Understanding of pipeline orchestration and monitoring.

• Familiarity with development, testing, version control, and CI/CD practices.

• Practical experience with Microsoft Fabric and/or AWS Databricks.

• Capability to work across different platforms, grasping the fundamentals of Data Engineering regardless of the technology.

• Demonstrated experience in Microsoft Azure and AWS environments.

• Experience applying Artificial Intelligence in professional contexts.

• Ability to showcase tangible productivity improvements achieved through AI.

• Proficiency in technical English for understanding documentation, articles, and industry materials.

• Availability to work full-time during business hours.

• Willingness to participate in virtual meetings with cameras on.

• Knowledge of Apache Spark, SQL, and Python is preferred.

• Familiarity with AWS data services, including Amazon S3, AWS Glue, Athena, Amazon EMR, Step Functions, and Lambda, is preferred.

• Experience with DataOps, DevOps, and Infrastructure as Code (IaC) is preferred.

• Certifications in Microsoft, Databricks, Azure, AWS, or Data Engineering are preferred.

• Experience in consulting firms or on projects for diverse clients and industry sectors is preferred.

🏝️ Benefits

• Food allowance or meal allowance.

• Discounts on courses, universities, and language institutions.

• Stefanini Academy — a platform providing free, up-to-date online courses with certificates.

• Mentoring opportunities.

• Benefits club offering discounts on consultations and medical exams.

• Health insurance coverage.

• Dental insurance coverage.

• Benefits and discounts at leading establishments.

• Travel club membership.

• Pet benefits program.