Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment.

• Create robust and fault-tolerant ETL/ELT applications for efficient data ingestion, transformation, and distribution to facilitate analytics, reporting, and AI workloads.

• Collaborate with various stakeholders and teams to provide data-related technical solutions and support their data infrastructure requirements.

• Investigate and test new use cases, frameworks, and tools to enhance AI capabilities, ensuring data integrity, quality, and reliability.

• Identify and execute infrastructure redesigns to enhance scalability, optimize data delivery, and automate manual processes.

• Work together with cross-functional teams to comprehend data requirements, develop robust data models, and deliver actionable insights.

• Monitor, troubleshoot, and optimize jobs for performance, addressing bottlenecks in data pipelines while ensuring cost efficiency.

⛳️ Requirements

• Bachelor’s or master’s degree in computer science, engineering, or a related discipline.

• Over 5 years of demonstrated experience in data engineering, delivering business-critical software solutions for large enterprises with a consistent history of success.

• Proficient in writing ETL/ELT jobs.

• Familiarity with Azure and the Databricks Platform.

• Experience with Python, SQL, and REST APIs.

• Knowledge of cloud architecture principles including compute, storage, networks, security, and cost management.

• Proficient in using open-source tools and frameworks such as FastAPI, Pydantic, Polars, Pandas, Delta Lake, Docker, and Kubernetes.

• Understanding of CI/CD, Git, or infrastructure-as-code concepts.

• Strong project management abilities, capable of prioritizing tasks and managing multiple projects simultaneously in an Agile environment.

• Awareness of how data engineering integrates with Business Intelligence and reporting tools (Power BI/Tableau).

• Excellent problem-solving and analytical skills.

• Strategic mindset with a strong focus on execution.

• Ability to collaborate effectively within cross-functional teams.

• Keen attention to detail and data quality.

🏝️ Benefits

• Healthcare Coverage: Comprehensive medical, dental, and vision plans.

• Time Off and Leave Policies: Generous paid time off (PTO), paid company holidays, and generous parental and family leave.

• Protective Insurances: Life insurance, short- and long-term disability coverage, and accident protection.

• Compensation and Rewards: Competitive salary structures, performance-based incentives, and merit-based compensation reviews.

• Retirement Plans: 401(k) plans with company matching.