Data Engineer, Databricks – Senior

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Collaborate with data engineering teams to understand requirements and deliver efficient solutions;

• Engage in the development and maintenance of Azure technologies, Databricks (Pyspark), Python, Data Lake, and SQL;

• Utilize Python ElementTree for efficient XML data manipulation and integration of heterogeneous data;

• Create Python scripts using Pandas for the manipulation and analysis of structured data;

• Ensure the availability, stability, and continuous improvement of client systems while guaranteeing high performance;

• Handle security and compliance with business requirements through proactive management, process automation, and ongoing service enhancement;

• Focus on data quality and integrity by implementing testing and monitoring practices;

• Maintain comprehensive technical documentation for processes and implemented solutions;

• Assist with corrective actions, supporting production deliveries, and monitoring change requests;

⛳️ Requirements

• Experience with SQL (Regex), Databricks, PySpark, and Python: fundamental knowledge in these technologies;

• Proficiency in text manipulation in programming and data analysis, particularly with Regex;

• Experience in SQL data modeling and a basic understanding of distributed computing;

• Availability for on-call duty after business hours and on weekends;

• Experience with Data Lake;

🏝️ Benefits

• Competitive salary and performance bonuses;

• Opportunities for professional development and training;

• Flexible work hours and remote work options;

• Comprehensive health and wellness programs;