
Senior Data Engineer
Posted 10 hours ago

Posted 10 hours ago
This is a fully remote position, open to applicants anywhere in the world.
• Design, construct, and sustain ETL/ELT pipelines that efficiently and reliably handle large-scale data.
• Develop and oversee cloud-native data pipelines utilizing AWS Glue, Python, and SQL.
• Coordinate data workflows and stateful tasks through AWS Step Functions.
• Store and manage extensive datasets in Amazon S3 by employing efficient partitioning, data formats such as Parquet, and access control measures.
• Create and enhance relational data structures in PostgreSQL.
• Implement monitoring for data quality, logging, and alert systems within pipeline operations.
• Work collaboratively with cross-functional teams to establish data requirements and ensure consistency, availability, and accessibility.
• Engage in code reviews, architectural discussions, and the continuous enhancement of engineering best practices.
• Maintain compliance with data security, privacy, and governance standards.
• Over 5 years of experience as a Data Engineer or in a comparable data-centric engineering position.
• Extensive experience in building and managing ETL/ELT pipelines in live production settings.
• Practical experience with AWS Glue and Step Functions.
• In-depth knowledge of Amazon S3 and best practices for data lakes.
• Advanced SQL skills, especially with PostgreSQL, including performance tuning and complex query handling.
• Strong programming capabilities in Python or related languages for data processing tasks.
• Experience in designing scalable data architectures and solutions for workflow orchestration.
• Familiarity with CI/CD tools, version control systems like Git, and DevOps principles.
• Experience with other AWS data services, including Athena and Lambda.
• Awareness of alternatives for workflow orchestration.
• Exposure to contemporary data modeling concepts.
• Understanding of data security and compliance frameworks, such as GDPR.
• 100% equity-based compensation structure.
• Involvement in VendueTech Ltd ESOP Trust, with share distribution based on hours worked and accomplishments.
• Flexible remote work setting with opportunities for global collaboration.
• Chance to contribute to innovative, data and AI-driven projects that are revolutionizing the real estate auction sector.
ASRC Federal
Origami Risk
The Standard
Get handpicked remote jobs straight to your inbox weekly.