Principal Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Act as the Tech Lead for the Data Platform, serving as a point of reference for both technical and architectural decisions.

• Define and enhance the architecture, prioritizing scalability, security, performance, availability, and cost efficiency.

• Assess technologies, standards, and architectural risks to support both medium- and long-term projects.

• Oversee the architecture and operation of the AWS environment, including services such as S3, EMR, Glue, Athena, Lake Formation, and IAM.

• Guarantee infrastructure security, availability, efficiency, and cost optimization.

• Progress the Data Lake/Lakehouse architecture utilizing S3, Delta Lake, Spark/PySpark, Airflow, and dbt.

• Assist with the ingestion, processing, and storage of substantial data volumes.

• Promote Data Governance practices, access management, and security policies.

• Collaborate with Lake Formation, IAM, Data Contracts, data catalogs, and OpenMetadata.

• Ensure the ongoing evolution, support, and reliability of the production platform.

• Proactively and reactively address performance, availability, and infrastructure challenges, while managing observability and monitoring.

• Support Data Engineering, Data Science, BI, Product, and other stakeholders in making platform-related decisions.

• Act as the technical link between projects and data infrastructure.

⛳️ Requirements

• Strong experience in Data Engineering, Data Platforms, or Data Architecture.

• In-depth knowledge of AWS, particularly S3, EMR, Glue, Athena, Lake Formation, and IAM.

• Experience with Data Lake/Lakehouse environments and handling large data volumes.

• Proven background in production environments, platform support, and distributed architecture.

• Ability to make decisions with consideration for performance, scalability, security, availability, and cost.

• Experience in providing technical leadership and influencing decisions without direct management responsibilities.

• Excellent communication skills with the capacity to collaborate with both technical and business teams.

• Familiarity with ClickHouse, OpenSearch/Elasticsearch, and Delta Lake is a plus.

• Knowledge of Airflow, dbt, and OpenMetadata is advantageous.

• Experience with Data Contracts and FinOps is a plus.

• Previous roles as a Tech Lead, Data Architect, or Data Platform Engineer are beneficial.

• Experience in building and scaling data platforms is an advantage.

🏝️ Benefits

• Swile Benefits Card with a monthly allowance of BRL 2,530.00 (CWB and RMC) or BRL 2,024.00 (other regions), covering meals, mobility, multi-purpose balance, and home office support.

• Unimed or Amil health insurance with nationwide coverage.

• Odontoprev dental insurance.

• MetLife life insurance.

• TotalPass.

• Starbem, a healthcare services platform dedicated to your physical, mental, and emotional well-being.

• Extended maternity and paternity leave through the Empresa Cidadã Program.

• Professional development subsidy in partnership with Unico Skill, offering various undergraduate, graduate, language, and mentoring options.

• Private English lessons for leaders and Level II specialists and above.

• Childcare assistance for children up to 8 years old.

• Fully equipped office with all necessary amenities, including daily breakfast and afternoon snacks.

• Celebrations, integration events, and team-building activities.

• Partnership with KÜK Station to ensure a great experience for our Loggers on office days.

• On-site massage services.

• Birthday day off.

• Birthday gift voucher.

• Service anniversary gift vouchers.

• Recruit Loggers referral program with a bonus.