Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Engage in the complete data pipeline lifecycle, emphasizing the creation of data lakes, data warehouses, and associated processes.

• Facilitate code and design reviews with junior developers and peers.

• Produce clean code to establish data pipelines and the requisite infrastructure as code.

• Work collaboratively with cross-functional teams to comprehend requirements and effectively design suitable solutions.

• Oversee and resolve performance, scalability, and security challenges, implementing enhancements as necessary.

• Take part in assessing new technologies and tools that could enhance system performance.

• Involve yourself in the data governance process.

• Aid in the design and documentation of our data lake platform.

• Skilled in test automation solutions for data and capable of optimizing performance.

• Collect technical and design requirements.

• Communicate proficiently with both technical and non-technical team members to guarantee alignment and successful project execution.

• Engage in cross-functional initiatives, fostering a culture of data-driven decision-making and continuous improvement.

• Participate in an on-call rotation.

⛳️ Requirements

• Generally requires a minimum of 5 years of relevant experience; or 3 years accompanied by an advanced degree.

• Experience in developing modern data architecture, analytics, data governance, AI/ML, or similar fields.

• Familiarity with AWS big data technologies such as EMR, Glue, S3, EKS, Lambda, Athena, RDS, and MKS/Kafka/Kinesis.

• Comprehensive understanding of the entire data engineering process (design, development, deployment).

• Experience with both relational and NoSQL databases including PostgresQL, Cassandra, DynamoDB, MongoDB, etc., and data modeling principles.

• Proficient in DevOps practices, including CI/CD pipelines, containerized deployment/Kubernetes, and infrastructure-as-code.

• Skilled in SQL (SQL Server, Postgres) and Python.

• Strong teamwork abilities with a problem-solving mindset, willing to explore a variety of approaches.

• Proven ability to mentor junior team members.

• Excellent written and verbal communication skills, with a track record of providing technical input to both technical and non-technical stakeholders.

🏝️ Benefits

• Remote-first work environment.

• Unlimited paid time off.

• 401(k) plan with employer matching.