Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and implement data flows, incorporating ETL (Extract, Transform, Load), ELT (Extract, Load, Transform), and data streaming methodologies.

• Create and sustain data pipelines that facilitate efficient and dependable data transfer between systems.

• Automate and enhance both real-time and batch data processing, ensuring integrity and quality of data throughout its lifecycle.

• Guarantee effective and reliable data transfer across various systems.

• Oversee data integrity, consistency, and quality during the entire data lifecycle.

• Organize and provision data for analytics, reporting, and Business Intelligence initiatives.

• Assist in the advancement of data engineering architecture and associated processes.

⛳️ Requirements

• Bachelor's degree in IT or a related field with postgraduate qualifications in IT.

• Proficient experience with databases and SQL.

• Practical knowledge of Database Management Systems (DBMS).

• Understanding of multidimensional databases.

• Familiarity with ETL and ELT processes.

• Awareness of analytical data structures and sources such as Data Warehouse and Data Mart.

• Advanced proficiency in Python for data applications, utilizing libraries like Pandas, PyArrow, PySpark, Polars, DuckDB, and SQLAlchemy.

• Knowledge of data technologies including Airflow, Spark, Flink, Kafka, Parquet, and Iceberg.

• Understanding of Business Intelligence concepts.

🏝️ Benefits

• Meal allowance or meal voucher.

• Discounts on courses, universities, and language schools.

• Stefanini Academy — a platform offering free, up-to-date online courses with certificates.

• Mentorship opportunities.

• Benefits club for medical consultations and exams.

• Medical insurance coverage.

• Dental insurance coverage.

• Discount and benefits club available at premier establishments.

• Travel club membership.

• Pet care benefits.