Data Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Uncover valuable insights from extensive datasets by utilizing cutting-edge data analytics and machine learning methodologies.

• Design, construct, and sustain ETL/ELT data pipelines for large-scale data operations.

• Transition legacy data infrastructures to Azure and AWS by employing cloud-native solutions.

• Develop and enhance Spark-based processes using Databricks and Synapse.

• Automate the workflows for data ingestion, transformation, and delivery through Airflow.

• Create interactive dashboards tailored for business stakeholders.

• Design and oversee MSSQL, PostgreSQL, and MongoDB databases.

• Implement secure, compliant data pipelines and governance policies.

• Integrate various data sources via REST APIs.

• Collaborate with data scientists to train and deploy machine learning models.

• Gather requirements and deliver customized data solutions in partnership with cross-functional teams.

• Establish monitoring and alert systems for the health and reliability of data pipelines.

• Build and deploy applications using Docker.

• Identify inefficiencies in workflows and execute process improvements aimed at cost reduction.

⛳️ Requirements

• Master’s degree or its international equivalent in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems, or a related discipline.

• 3 years of experience with Python, SQL, and ETL processes.

• 3 years of experience with cloud platforms such as AWS and Azure.

• 3 years of experience utilizing distributed computing frameworks including Spark, Databricks, and Synapse.

• 2 years of experience with orchestration tools like Apache Airflow.

• 3 years of experience with data visualization tools such as Power BI and Tableau.

• 3 years of experience with database management systems, including both SQL and NoSQL.

• 3 years of experience implementing data governance, compliance, and security practices.

• 3 years of experience working with REST APIs and integration frameworks.

• 3 years of experience in machine learning and predictive modeling.

• 3 years of experience using monitoring tools including Splunk and CloudWatch.

• 2 years of experience applying DevOps practices and containerization techniques.

🏝️ Benefits

• Incentive programs and performance-based compensation linked to individual and business achievements.

• Health insurance coverage.

• Dental insurance coverage.

• Mental health benefits available.

• Vision insurance coverage.

• Short- and long-term disability insurance options.

• Life and AD&D insurance coverage.

• Benefits for adoption and surrogacy.

• Wellness programs available.

• Employee and family assistance plans.

• Retirement savings plans, including pension and 401(k) options.

• Global share ownership plan with employer matching contributions.

• Financial education and counseling resources provided.

• Up to 11 paid holidays annually.

• 3 personal days each year.

• 150 hours of vacation time per year.

• 40 hours of sick leave per year, or more as mandated by law.

• Statutory leaves of absence available.

• Flexible work environment.

• Opportunities for career growth and development.