Senior Backend Developer – Python, PostgreSQL, Kafka

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and maintain a Python service that processes Kafka events and manages data transformations in PostgreSQL.

• Create, assess, and optimize SQL for calculations and aggregations, focusing on performance and large data table impact.

• Ensure consistent event flow, which includes managing offsets, ensuring idempotency, handling duplicates, maintaining order, and facilitating reprocessing.

• Analyze production incidents and discrepancies utilizing logs, metrics, and alerts; determine root causes and implement fixes with regression tests.

• Carry out reprocessing, recalculations, and historical data migrations using the service tools while prioritizing the integrity of the production environment.

• Review the code produced by the team, including AI-assisted code, while also partaking in code reviews of your own work.

• Document workflows, decisions, and diagnostic methodologies.

• Collaborate with the Data Tech Lead and team to provide comprehensive solutions, from initial investigation to production resolutions, always underpinned by testing.

⛳️ Requirements

• Extensive practical experience with Python in services, workers, or long-term pipeline maintenance.

• Proficient in advanced SQL within PostgreSQL: crafting complex queries utilizing CTEs, window functions, aggregations, upserts, and analyzing execution plans.

• Understanding of database transactions and concurrency, including isolation levels, locks, and the implications of simultaneous writes by multiple processes.

• Familiarity with Kafka or alternative messaging platforms (such as RabbitMQ, SQS, Pub/Sub), including insights into offsets, duplicates, and reprocessing methods.

• Competence in automated testing using pytest, encompassing tests with actual databases and messaging systems.

• Proven experience in diagnosing and rectifying production challenges.

• Proficiency in using Docker and Git within your workflow.

• Ability to read technical English proficiently.

• Clear communication of decisions, risks, and results.

• Production experience with Kafka.

• Knowledge of MongoDB.

• Experience with property-based testing (using Hypothesis or similar tools).

• Familiarity with Kubernetes, GitOps (ArgoCD), and secrets management (Vault).

• Experience with observability tools like Grafana, Loki, and Prometheus.

• Understanding of event-driven architecture.

• Experience with AI development assistants, with a critical approach to evaluating their outputs.

• Interest in or experience within the agribusiness sector.

🏝️ Benefits

• Opportunity for remote work.

• Inclusive environment welcoming individuals with disabilities.