Senior Python Engineer – Data

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and sustain reliable data pipelines using Python on AWS.

• Create and maintain backend services and APIs utilizing Django and FastAPI.

• Model, query, and optimize data across PostgreSQL and various search/NoSQL databases, such as OpenSearch, Elasticsearch, and DynamoDB.

• Deploy and manage services on Kubernetes, collaborating closely with the DevOps engineer.

• Take full ownership of assigned tasks from inception to completion, including design, testing, code reviews, releases, and production support.

• Work autonomously while partnering with the engineering team and DevOps/SRE engineer on infrastructure and release processes.

• Uphold high standards of data quality, accuracy, and testing.

• Adhere to engineering practices, including code reviews and CI/CD, while accommodating shifting priorities.

• Proactively identify issues, suggest solutions, and challenge technical decisions when warranted.

• Emphasize thoroughness, reliability, and stability in production.

⛳️ Requirements

• Over 6 years of experience in software engineering, with at least 5 years focused on commercial Python development.

• More than 5 years of experience in Python backend development.

• At least 3 years of experience in data pipelines and data engineering, including ETL/ELT processes and batch processing.

• Familiarity with Airflow, Dagster, Prefect, AWS Glue, and Step Functions.

• A minimum of 3 years of AWS experience in developing and maintaining cloud-based backend services and data pipelines.

• Strong experience in GCP or Azure may be considered on an individual basis.

• Over 3 years of experience with Python web frameworks, particularly Django or FastAPI; Flask is also an acceptable option.

• At least 3 years of PostgreSQL experience, covering data modeling, querying, and optimization.

• MySQL or SQL Server experience may be considered if strong SQL expertise is demonstrated elsewhere.

• More than 2 years of experience with non-relational or search databases, such as Elasticsearch, OpenSearch, or DynamoDB.

• Relevant alternatives include MongoDB, Redis, and Cassandra.

• Over 2 years of experience with Kubernetes, including deploying and managing services.

• Experience with Docker in conjunction with ECS or EKS may be accepted as an alternative.

• Capability to independently manage technical tasks from design to implementation, testing, release, and production support.

• A strong focus on data quality, accuracy, testing, and reliability in production.

• Ability to collaborate with engineering and infrastructure teams while independently proposing solutions and challenging decisions as needed.

• Capacity to adhere to engineering practices and adjust to changing priorities.

• Nice to have: 1+ year of experience with workflow orchestration using Airflow or similar technologies.

• Nice to have: 1+ year of experience with streaming or event-processing technologies like Kafka, Kinesis, or SQS.

• Nice to have: 1+ year of experience with Infrastructure as Code and CI/CD, including Terraform and GitHub Actions.

• Previous experience leading a technical project or fully owning a data pipeline or backend service from start to finish.

🏝️ Benefits

• Full-time, long-term position.

• Truly remote-first work arrangement.

• A supportive community focused on growth and well-being.

• Opportunity to collaborate with global teams and products.

• Support for personal and professional growth.

• Long-term, ongoing opportunity (subject to confirmation).