Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain scalable, dependable, high-performance data pipelines utilizing Python and AWS DynamoDB.

• Execute robust ETL/ELT processes for both batch and streaming data workloads.

• Work in partnership with data scientists, analysts, and backend engineers to ensure data accessibility and integrity.

• Create and enhance DynamoDB data models and indexing strategies to accommodate various access patterns and achieve high throughput.

• Utilize cloud-native data storage solutions and serverless architecture for scalable, cost-effective systems.

• Contribute to distributed data processing frameworks such as Apache Spark for extensive transformations and analytics.

• Monitor and enhance pipeline performance, scalability, and latency.

• Establish data validation, monitoring, and alerting mechanisms to ensure pipeline reliability and accuracy.

• Collaborate on data governance, compliance, and security best practices.

• Engage in architectural discussions and code reviews.

• Mentor junior team members and foster knowledge sharing.

⛳️ Requirements

• Over 5 years of professional experience in data engineering or software engineering with a focus on data-centric solutions.

• Proficient Python programming skills tailored towards data processing and pipeline development.

• Extensive AWS DynamoDB experience, including data modeling, performance optimization, and capacity planning.

• Comprehensive understanding of cloud computing fundamentals, preferably AWS.

• Experience in constructing high-scale ETL/ELT pipelines utilizing both streaming and batch data.

• Familiarity with distributed data processing frameworks.

• Experience with NoSQL databases such as DynamoDB, Cassandra, or similar technologies.

• Competence in schema design trade-offs and query pattern optimization in key-value and document stores.

• Proven experience collaborating within cross-functional teams that include product, data science, and operations.

• Excellent verbal and written communication skills.

• Ability to thrive in fast-paced and evolving environments with shifting requirements.

• Bachelor’s Degree is required, or three years of specialized training and/or progressively responsible technology work experience for each missing year of college, in addition to the required experience.

• Unable to provide sponsorship for this role.

🏝️ Benefits

• Competitive compensation.

• Professional development opportunities.

• Flexible work arrangements.

• Collaborative, creative, and continuous-learning culture.

• Tools and support for personal and professional growth.