Senior Data Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Design, develop, enhance, and maintain scalable ETL/ELT pipelines, APIs, and microservices for high-volume datasets related to regulatory and health agencies.

• Troubleshoot issues related to data quality and implement automated testing, monitoring, and validation processes.

• Participate in technical design and architectural decision-making for the data platform.

• Integrate data pipelines with downstream NLP/ML services and search technologies, such as the ELK stack.

• Assist in production deployments and address any pipeline and database issues that arise.

• Resolve intricate technical incidents.

• Collaborate with Engineering and Product teams to translate business requirements into technical solutions.

• Provide mentorship to fellow engineers.

• Engage in code reviews and offer technical guidance.

⛳️ Requirements

• Proven experience as a Senior Data Engineer.

• Proficient in designing, building, optimizing, and maintaining scalable ETL/ELT pipelines, APIs, and microservices.

• Familiarity with high-volume datasets from regulatory and health agencies.

• Strong troubleshooting skills for data quality issues.

• Experience in implementing automated testing, monitoring, and validation processes.

• Ability to contribute to technical design and architectural decisions effectively.

• Experience in building scalable and maintainable data platform solutions.

• Knowledge of integrating data pipelines with downstream NLP/ML services and search technologies.

• Proficiency with the ELK stack.

• Capability to support production deployments and troubleshoot related issues.

• Ability to resolve complex technical incidents efficiently.

• Strong collaboration skills with Engineering and Product teams.

• Capacity to anticipate and adopt innovative technologies.

• Ability to synthesize complex information and develop effective problem-solving strategies.

• Competence in making timely, high-quality decisions.

• Skills to optimize ETL processes and manage data warehousing effectively.

• Commitment to continuously improving performance and meeting data-related deliverables.

🏝️ Benefits

• Employees have the option to work remotely.

• Access to mentorship opportunities.

• Opportunities to engage in code reviews and provide technical guidance.