Principal Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Provide technical direction for substantial data modernization and migration projects.

• Develop data architectures utilizing Databricks Lakehouse and Microsoft Azure.

• Evaluate legacy systems and devise optimal strategies for migrating, refactoring, or retiring workloads.

• Create contemporary data pipelines, as well as ETL/ELT processes and orchestration strategies.

• Set architecture, quality, governance standards, and engineering best practices.

• Ensure data integrity and consistency throughout the migration journey.

• Collaborate with architects, data engineers, Databricks specialists, and client teams to guarantee high-quality outcomes.

• Act as the project's technical authority, aiding in architectural choices and mentoring fellow engineers.

• Contribute to automation efforts and leverage Artificial Intelligence to expedite migration activities.

⛳️ Requirements

• Extensive experience as a Senior Data Engineer, Data Architect, or in technical leadership positions within Data Engineering.

• In-depth knowledge of SQL Server, encompassing T-SQL, SSIS, stored procedures, SQL Agent Jobs, and legacy systems.

• Practical experience with Databricks, Apache Spark, Delta Lake, and Lakehouse architectures.

• Familiarity with Microsoft Azure (ADLS Gen2, Azure SQL, AKS, and related services).

• Experience in projects focused on migration, modernization, or transformation of data platforms.

• Understanding of data modeling, ETL/ELT pipelines, and workflow orchestration.

• Capability to make architectural decisions and serve as a technical reference for cross-functional teams.

• Exceptional communication skills for engaging with clients and global teams.

• The following are advantageous:

• Experience with Apache Airflow or Databricks Workflows.

• Experience in large-scale SSIS environment migrations.

• Knowledge of Oracle, PySpark, Sqoop, or the Hadoop ecosystem.

• Experience with automated migration tools and AI applications in code conversion.

• Certifications in Databricks, Azure, or related data engineering fields.

🏝️ Benefits

• Health and dental insurance;

• Meal and grocery allowances;

• Childcare assistance;

• Extended parental leave;

• Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) and TotalPass;

• Profit-sharing (PLR);

• Life insurance;

• Continuous learning platform (CI&T University);

• Employee discount club;

• Free online platform dedicated to physical and mental health and well-being;

• Pregnancy and responsible parenting course;

• Partnerships with online course platforms;

• Language learning platform;

• And many more.