Senior Backend Engineer, Data

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Develop and sustain Databricks and PySpark data pipelines utilizing a medallion architecture featuring Bronze, Silver, and Gold layers, alongside data quality validations, schema enforcement, and lineage tracking.

• Design and enhance ETL/ELT processes for large-scale marketing performance data.

• Partner with analytics and data science teams to create clean, well-structured, and accessible data assets.

• Construct backend services and APIs in Python, adhering to established microservices patterns, including domain boundaries, caching, and queuing.

• Execute service-to-service communication via REST, gRPC, and event-driven methodologies.

• Connect with external marketing platforms, cloud services, and internal microservices.

• Establish authentication, authorization, rate limiting, and multi-tenant access controls.

• Produce production-ready code, engage in code reviews, and provide mentorship to other engineers.

• Create and maintain CI/CD pipelines and infrastructure-as-code environments.

• Implement tracing, structured logging, metrics, and alerting systems.

• Enhance services for latency, concurrency, throughput, and cost efficiency.

• Contribute to automated testing, load testing, and resiliency practices within Site Reliability Engineering (SRE).

• Collaborate with product, data, and SRE teams on cohesive backend designs across campaign activation domains.

⛳️ Requirements

• Minimum of 5 years of experience in backend engineering, data engineering, or distributed systems.

• Significant contributions to the design of services or data pipelines.

• Strong, hands-on expertise in Python and contemporary backend frameworks such as FastAPI or Flask.

• Proficient in Databricks and PySpark.

• Practical experience with medallion-style Bronze/Silver/Gold data architecture, or a strong willingness and aptitude for rapid learning.

• Understanding of microservices, concurrency, asynchronous programming, and event-driven architectures.

• Proficient with SQL and NoSQL databases like PostgreSQL, DynamoDB, Redis, or MongoDB.

• Familiarity with lakehouse platforms.

• Practical experience with Docker, Kubernetes, and AWS.

• Familiarity with infrastructure-as-code tools such as CloudFormation.

• Strong CI/CD experience using GitHub Actions, Argo, or similar platforms.

• Knowledge of observability practices, including logs, metrics, traces, and performance analysis.

• Ability to write clean, testable, and well-organized production code.

• Fluent in English, both verbal and written.

• Familiarity with AI/LLM systems and agentic workflow integration is a plus.

• Experience with Kafka, Pub/Sub, or SQS is advantageous.

• Experience with Delta Lake, Unity Catalog, or similar lakehouse governance and optimization tools is beneficial.

• Familiarity with API gateways, caching layers, or service meshes is advantageous.

• Knowledge of marketing, advertising, or platform APIs is a plus.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health and wellness benefits.

• Opportunities for professional development and career advancement.

• Flexible work hours and remote work options.