Senior Data Engineer

Posted 10 hours ago

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Design, construct, and sustain ETL/ELT pipelines that efficiently and reliably handle large-scale data.

• Develop and oversee cloud-native data pipelines utilizing AWS Glue, Python, and SQL.

• Coordinate data workflows and stateful tasks through AWS Step Functions.

• Store and manage extensive datasets in Amazon S3 by employing efficient partitioning, data formats such as Parquet, and access control measures.

• Create and enhance relational data structures in PostgreSQL.

• Implement monitoring for data quality, logging, and alert systems within pipeline operations.

• Work collaboratively with cross-functional teams to establish data requirements and ensure consistency, availability, and accessibility.

• Engage in code reviews, architectural discussions, and the continuous enhancement of engineering best practices.

• Maintain compliance with data security, privacy, and governance standards.


⛳️ Requirements

• Over 5 years of experience as a Data Engineer or in a comparable data-centric engineering position.

• Extensive experience in building and managing ETL/ELT pipelines in live production settings.

• Practical experience with AWS Glue and Step Functions.

• In-depth knowledge of Amazon S3 and best practices for data lakes.

• Advanced SQL skills, especially with PostgreSQL, including performance tuning and complex query handling.

• Strong programming capabilities in Python or related languages for data processing tasks.

• Experience in designing scalable data architectures and solutions for workflow orchestration.

• Familiarity with CI/CD tools, version control systems like Git, and DevOps principles.

• Experience with other AWS data services, including Athena and Lambda.

• Awareness of alternatives for workflow orchestration.

• Exposure to contemporary data modeling concepts.

• Understanding of data security and compliance frameworks, such as GDPR.


🏝️ Benefits

• 100% equity-based compensation structure.

• Involvement in VendueTech Ltd ESOP Trust, with share distribution based on hours worked and accomplishments.

• Flexible remote work setting with opportunities for global collaboration.

• Chance to contribute to innovative, data and AI-driven projects that are revolutionizing the real estate auction sector.

People also viewed

ASRC Federal10 hours ago

Data Engineer

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Origami Risk10 hours ago

Senior Data Engineer

US flagUnited States OnlyFull-timeData Engineer$117k – $146k/year
ApplyView job
The Standard10 hours ago

Data Engineer IV

US flagOregon OnlyFull-timeData Engineer$131.8k – $223.5k/year
ApplyView job
Acxiom10 hours ago

Senior Data Engineer

US flagNew York OnlyFull-timeData Engineer
ApplyView job
qByte Labs LLC10 hours ago

Data Engineer – Databricks, Snowflake

Anywhere in the WorldFull-timeData Engineer$125k – $135k/year
ApplyView job
Empower10 hours ago

Data Architect

US flagUnited States OnlyFull-timeData Engineer$138k – $200.1k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers