
Data Engineer
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in Minnesota.
• Design, construct, and sustain dependable and scalable ETL (extract, transform, load) pipelines to gather, process, and store substantial amounts of structured and unstructured data from diverse sources.
• Develop, enhance, and uphold the data warehouse architecture, ensuring the integrity and accessibility of data.
• Collaborate with data scientists, analysts, and business stakeholders to comprehend data requirements and provide customized data solutions.
• Guarantee high-quality data by implementing comprehensive data validation, testing, and monitoring procedures.
• Deploy and manage cloud-based data platforms and databases for extensive data storage and processing.
• Create and maintain data models and database schemas to facilitate analytics, reporting, and machine learning applications.
• Optimize and supervise the performance of data pipelines and queries, ensuring prompt data delivery.
• Implement and uphold data governance, security, and privacy practices in accordance with industry standards and regulations (e.g., GDPR, CCPA).
• Automate data collection, transformation, and delivery processes, improving efficiency and reducing manual intervention.
• Document data workflows, architectures, and processes for cross-functional teams and stakeholders.
• Over 3 years of experience in data engineering, ETL/ELT development, analytics engineering, or a similar technical position.
• Strong expertise in Python, PySpark, and JavaScript.
• Advanced SQL proficiency and hands-on experience with relational and analytical databases such as PostgreSQL, MySQL, or Amazon Redshift.
• Practical experience with AWS cloud services, including AWS Lambda, Glue Jobs, and Workflows.
• Experience using version control systems like Git and working with CI/CD pipelines for automated testing and deployment.
• Comprehensive understanding of data warehousing, data modeling, database design, and best practices for performance optimization.
• Familiarity with data governance, security, privacy, and compliance standards.
• Strong analytical and problem-solving abilities, with a keen attention to detail.
• Excellent communication skills and the capability to collaborate effectively with both technical and non-technical team members.
• 200 hours of PTO annually
• 40 hours of Paid Retreat Time (PRT) annually
• Professional development opportunities
• Complimentary access to all Tergar meditation programs
• Reduced fees for retreats with Mingyur Rinpoche
Rightway
Nagarro
NABIS
Get handpicked remote jobs straight to your inbox weekly.