Full Stack Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and maintain scalable pipelines for data ingestion and curation from various sources.

• Standardize data to ensure it is of high quality and optimized for analytical purposes.

• Construct robust data pipelines utilizing Python, SQL, and DBT/Dataform.

• Contribute to the seamless end-to-end development and ensure reliable data flow from source to insight.

• Build and manage GCP data platforms using BigQuery, Dataflow, Pub/Sub, and Cloud Functions.

• Implement data governance policies, access controls, and best practices for GCP security.

• Utilize Astronomer and Terraform for managing workflows and provisioning cloud infrastructure.

• Monitor and enhance the performance, scalability, efficiency, resource utilization, and cost-effectiveness of pipelines and storage.

• Collaborate with data architects, application architects, service owners, and cross-functional teams.

• Automate processes within the data platform to bolster reliability and data quality.

• Communicate technical decisions effectively to both technical and non-technical stakeholders.

• Identify opportunities for enhancing the data platform by leveraging industry trends and emerging technologies.

• Transform business requirements into optimized designs for data assets and efficient coding.

• Create comprehensive documentation for data engineering and encourage knowledge sharing.

⛳️ Requirements

• Bachelor’s degree or foreign equivalent in Computer Engineering, Electrical Engineering, Information Technology, Electronic Engineering, or a related discipline.

• 4 years of experience in the job offered or a related occupation.

• 2 years of experience in engineering real-time streaming pipelines using Kafka, OpenShift, and Dataflow.

• 2 years of experience leveraging Java and Spring Boot to stream, decode, and ingest connected vehicle data.

• 2 years of experience architecting database solutions with Spanner, PostgreSQL, and BigQuery.

• 2 years of experience leading end-to-end GCP cloud data projects utilizing Apache Beam, Spring Boot, Airflow, BigQuery, Cloud Storage, and Cloud Build.

• 2 years of experience in developing scalable, high-volume connected vehicle data streaming platforms with OpenShift and Spring Boot.

• Candidates must possess legal authorization to work in the United States.

🏝️ Benefits

• Immediate medical, dental, and prescription drug coverage.

• Flexible family care, parental leave, new parent ramp-up programs, subsidized backup child care, and more.

• Vehicle discount program for employees and family members, along with management leases.

• Tuition assistance.

• Established and active employee resource groups.

• Paid time off for individual and team community service.

• A generous schedule of paid holidays, including the week between Christmas and New Year's Day.

• Paid time off and the option to purchase additional vacation time.