Engenheira de Dados Analytics Pleno

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Participate in the definition, evolution, and maintenance of Neogrid's data platform.

• Engage in modernization projects and the migration of legacy solutions to more scalable data architectures.

• Develop, maintain, and enhance data pipelines using Python and Spark (PySpark).

• Create solutions for the ingestion, transformation, integration, and availability of data for analytical and operational consumption.

• Process and integrate large volumes of data from various sources and formats.

• Monitor, identify, and resolve issues related to pipelines, integrations, and production data environments.

• Optimize pipelines, queries, and data processes to enhance performance, reliability, and scalability.

• Contribute to the definition and adoption of best practices in data engineering, data quality, observability, and automation.

• Collaborate with different departments to build data-driven solutions that support business decision-making.

⛳️ Requirements

• Proficiency in version control systems (Git).

• Experience in developing and maintaining data pipelines using Python and Spark (PySpark).

• Expertise in ETL, ELT tools, and building data pipelines such as Airbyte, dbt, Azure Data Factory (ADF), AWS Glue, Fivetran, Synapse Pipelines, Google Dataflow, Apache NiFi, Talend, or similar technologies.

• Experience in data projects.

• Problem-solving experience, understanding functional and non-functional requirements, and business rules to support decision-making.

• Experience in handling data sources like Parquet, JSON, CSV, TXT, relational databases, and Delta Tables.

• Experience in data modeling and managing multiple databases.

• Experience in BI, Big Data, and Analytics projects.

• Experience in integrating, processing, and storing large volumes of data.

• Experience in relational and dimensional data modeling (Data Warehouse).

• Knowledge of messaging systems (RabbitMQ, Kafka, or similar).

• Adaptable to change.

• Analytical approach with a focus on problem-solving and identifying continuous improvement opportunities.

• Preferred: experience with Databricks in production environments.

• Preferred: experience with Lakehouse architecture and Delta Lake.

• Preferred: experience with Cloud environments (Azure, AWS, or GCP).

• Preferred: experience in process automation and pipeline orchestration.

• Preferred: experience in observability, monitoring, and performance of data pipelines.

• Preferred: knowledge in DataOps and best practices in data engineering.

• Preferred: certifications in Cloud, Data, or Databricks.

🏝️ Benefits

• Remote or hybrid work options.

• Flexible working hours.

• Health insurance extendable to legal dependents.

• Dental plan extendable to legal dependents.

• Life insurance extendable to legal dependents.

• Medication assistance extendable for children.

• Transportation allowance or parking assistance.

• Flexible meal allowance.

• Wellhub (formerly Gympass).

• TotalPass.

• Day off in the birthday month, on a chosen day.

• NeoBaby parental support program.

• Unico Skill for external training and continuous development.

• Childcare assistance.

• Extended parental leave of 6 months for mothers and 30 days for fathers.

• Referral program, bonuses, and much more.