Senior FDE, Databricks/Spark

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Establish the data foundation for AI agents.

• Ingest, process, and transform substantial amounts of data from various client systems utilizing Apache Spark.

• Design distributed and scalable data pipelines.

• Convert raw data into structured datasets tailored for business applications.

• Collaborate directly with clients to translate their business needs into dependable data flows.

• Create comprehensive end-to-end solutions and integrate them with existing infrastructures.

• Develop and utilize RESTful and GraphQL APIs.

• Retrieve data from both relational and non-relational databases.

• Deploy production-ready code within clients’ Azure cloud environments.

• Implement testing, code reviews, CI/CD, and security practices throughout iterative delivery.

• Deliver pipelines that support production AI agents.

⛳️ Requirements

• 7–10+ years of hands-on experience in delivering full-stack applications.

• Extensive expertise in Python.

• Proficient in TypeScript/JavaScript.

• Mastery of RESTful and GraphQL architectures.

• Strong understanding of SQL and NoSQL databases.

• Daily user of Cursor, GitHub Copilot, or Claude Code.

• Experience in reviewing, testing, and refactoring AI-generated code.

• Practical experience with LLM APIs, such as OpenAI, Anthropic, Azure OpenAI, or similar.

• Solid understanding of prompting, RAG-style Q&A, streaming UX, hallucination, latency, and costs.

• Familiarity with deploying code in Azure cloud environments.

• Comfortable applying testing, code reviews, CI/CD, and security practices.

• Data engineering experience with Databricks, dbt, and PySpark.

• Professional proficiency in English within a technical context, both written and verbal, is essential.

• Strong communication skills for task alignment, understanding requirements, and escalating blockers.

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowance.

• Childcare assistance.

• Extended paternity leave.

• Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass.

• Profit Sharing and Results Participation (PLR).

• Life insurance.

• Continuous learning platform (CI&T University).

• Discount club.

• Free online platform dedicated to physical, mental, and overall well-being.

• Pregnancy and responsible parenting course.

• Partnerships with online learning platforms.

• Language learning platform.

• Inclusion support and accommodations for individuals with disabilities.

• Dedicated Health and Well-being team, inclusion specialists, and affinity groups.