Data Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Uncover concealed insights within extensive datasets by utilizing advanced data analytics and machine learning methodologies to facilitate data-driven strategic decision-making.

• Design, construct, and sustain ETL/ELT data pipelines for large-scale datasets.

• Transition legacy data architectures to Azure and AWS using cloud-native services.

• Develop and enhance Spark-based pipelines leveraging Databricks and Synapse.

• Automate workflows for data ingestion, transformation, and delivery with Airflow.

• Create engaging dashboards to convey insights to business stakeholders.

• Design and oversee MSSQL, PostgreSQL, and MongoDB databases.

• Implement secure and compliant data pipelines alongside governance policies for sensitive information.

• Integrate various data sources utilizing REST APIs.

• Collaborate with data scientists on pipelines for the training and deployment of machine learning models.

• Gather requirements and deliver customized data solutions in partnership with cross-functional teams.

• Establish monitoring and alert systems to ensure data pipeline health and reliability.

• Build and deploy applications using Docker across both development and production environments.

• Identify inefficiencies in workflows and enact cost-reducing process enhancements.

⛳️ Requirements

• A Master’s degree or its foreign equivalent in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems, or a closely related field.

• At least 3 years of experience with Python, SQL, and ETL processes.

• A minimum of 3 years of experience with cloud platforms such as AWS and Azure.

• 3 years of experience working with distributed computing frameworks including Spark, Databricks, and Synapse.

• 2 years of experience using orchestration tools like Apache Airflow.

• 3 years of experience with data visualization tools such as Power BI and Tableau.

• 3 years of experience with both SQL and NoSQL database systems.

• 3 years of experience implementing data governance, compliance, and security practices.

• 3 years of experience with REST APIs and integration frameworks.

• 3 years of machine learning and predictive modeling experience.

• 3 years of experience using monitoring tools such as Splunk and CloudWatch.

• 2 years of experience applying DevOps practices and containerization techniques.

🏝️ Benefits

• Incentive programs and compensation linked to both business and individual performance.

• Health insurance.

• Dental insurance.

• Mental health benefits.

• Vision insurance.

• Short- and long-term disability insurance.

• Life and AD&D insurance coverage.

• Benefits for adoption and surrogacy.

• Wellness benefits.

• Employee and family assistance programs.

• Retirement savings plans, including pension and 401(k) options.

• Global share ownership plan with employer matching contributions.

• Financial education and counseling resources.

• Up to 11 paid holidays annually.

• 3 personal days each year.

• 150 hours of vacation time per year.

• 40 hours of sick leave per year, or more as mandated by law.

• Statutory leaves of absence.