Senior Data Engineer – AI Focus

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and sustain data pipelines to merge information from various sources.

• Gather and consolidate data from both internal and external APIs, including OpenAI, Infobip, and other platforms.

• Integrate and unify data from LangSmith and Databricks.

• Develop and organize dependable, scalable databases for use by BI and Observability teams.

• Maintain data quality, consistency, and governance throughout the entire pipeline.

• Collaborate with AI, BI, and Observability teams to identify data consumption requirements.

• Suggest ongoing enhancements to architecture and data integration workflows.

• Assist in cost and efficiency evaluations of deployed solutions.

⛳️ Requirements

• Proven experience in integrating and utilizing REST APIs.

• Demonstrated experience in constructing data pipelines.

• Familiarity with relational databases and/or NoSQL databases.

• Experience with Databricks.

• Knowledge of LangSmith or observability tools for AI applications is advantageous.

• Understanding of data quality, modeling, and reliability principles.

• Basic comprehension of BI and data modeling for analytical use.

• Experience in monitoring and observing applications and pipelines is a plus.

🏝️ Benefits

• Meal and food allowances (Swile)

• Flexible option to allocate credits to a Home Office allowance (Swile)

• Up to 100% coverage for Health and Dental insurance

• Group life insurance

• Remote work

• Mental health coverage - online and in-person psychotherapy

• Support for certifications and courses

• Partnership for postgraduate and MBA courses (ESALQ/USP)

• Partnerships with language schools

• Partnerships with gyms and wellness apps (Wellhub)

• Internal talks and discussion sessions

• Referral bonus

• Happy hours

• Gifts on special occasions