This is a fully remote position, open to applicants in Brazil.

• Execute data ingestion, transformation, and provisioning within a Big Data environment.

• Conduct data cleansing and processing, evaluate data quality, and pinpoint opportunities to enhance processes.

• Develop and adjust data pipelines.

• Design data models.

• Extract, transform, and load (ETL) data from diverse sources and formats.

• Proficiency in PySpark, Python, and SQL for data preparation and manipulation.

• Familiarity with reading and writing Big Data file formats.

• Experience utilizing the Azure cloud platform.

• Knowledge of Databricks, Storage Accounts, Cosmos DB (MongoDB), Data Factory, and Azure DevOps.

• Capability to gather and analyze business and technical requirements.

• Experience with ingesting and processing structured and particularly semi-structured data.

• Background in data streaming projects (preferred).

• Experience with Confluent Kafka (preferred).

• Proficiency in optimizing data pipeline performance (preferred).

• Familiarity with Databricks cluster configuration (preferred).

• Experience mentoring colleagues and sharing best practices and technical expertise (preferred).

• Proficient in technical English.

• Meal and grocery allowance (Flash benefits card)

• Health insurance

• Dental plan

• Life insurance

• Performance-based bonus (PPR)

• TotalPass

• Childcare allowance

• Well-being program (for physical and mental health)

• Corporate university (our #SensediaAcademy)

• Cultural and educational partners with special discounts

• Extended maternity and paternity leave

• Flexible work model

Data Specialist – Senior

People also viewed