Senior Python Engineer – Data

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Design, construct, and maintain dependable data pipelines utilizing Python on AWS.

• Develop and sustain backend services and APIs with Django and FastAPI.

• Model, query, and optimize data across PostgreSQL and various search/NoSQL databases, including OpenSearch, Elasticsearch, and DynamoDB.

• Deploy and manage services on Kubernetes, collaborating with the DevOps engineer.

• Take full ownership of your assigned tasks, encompassing design, testing, code reviews, releases, and production support.

• Work alongside the engineering team and DevOps/SRE engineer on infrastructure and release processes.

• Uphold high standards of data quality, accuracy, and testing while recognizing how data pipelines contribute to the overarching product.

• Adhere to established engineering practices, including code reviews and CI/CD, while adjusting to evolving priorities.

• Anticipate issues, suggest solutions, and challenge technical decisions when necessary.

• Emphasize thoroughness, reliability, and production stability in the development and maintenance of data pipelines and data stores.

⛳️ Requirements

• Over 6 years of experience in software engineering, with at least 5 years in commercial Python development.

• More than 5 years of experience in backend development using Python.

• At least 3 years of experience in data pipelines and data engineering, including ETL/ELT processes and batch processing.

• Familiarity with technologies such as Airflow, Dagster, Prefect, AWS Glue, and Step Functions, or their equivalents.

• More than 3 years of AWS experience in developing and maintaining cloud-based backend services and data pipelines.

• Over 3 years of experience with Python web frameworks, especially Django or FastAPI; Flask is also acceptable.

• At least 3 years of experience with PostgreSQL, focusing on data modeling, querying, and optimization.

• More than 2 years of experience with non-relational or search databases, such as Elasticsearch, OpenSearch, or DynamoDB; alternatives include MongoDB, Redis, and Cassandra.

• At least 2 years of experience with Kubernetes, including the deployment and management of services; experience with Docker, ECS, or EKS may be considered.

• Capability to independently manage technical tasks from design through implementation, testing, release, and production support.

• Strong focus on data quality, accuracy, testing, and production reliability.

• Ability to collaborate with engineering and infrastructure teams while independently proposing solutions and questioning decisions.

• Proficient in following engineering practices and adapting to changing priorities.

🏝️ Benefits

• Full-time, long-term position.

• Fully remote work arrangement.

• A genuine community dedicated to growth and well-being.

• Remote-first working environment.

• Opportunities for both personal and professional development.