Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, create, and sustain data models, transformations, and pipelines that convert raw contact center data into reliable metrics and datasets in a cloud-based data warehouse.

• Take ownership of metric logic and ensure data quality.

• Collaborate with operations and enterprise data teams.

• Hold source system owners accountable to quality standards that support Customer Solutions and Data Science initiatives.

• Implement a real-time streaming data ingestion and processing pipeline utilizing Google Dataflow (Apache Beam).

• Engage with business intelligence analysts and IT colleagues in collaborative sessions to discuss the design, implementation, and testing of data pipelines.

• Uphold data architecture standards and ETL/ELT best practices for a column-oriented data store in analytical use cases.

• Actively participate in the Scrum delivery process.

• Provide support for solutions in production.

• Report directly to the Senior Manager of EDW.

⛳️ Requirements

• Must be at least eighteen years of age.

• Must have legal authorization to work in the United States.

• Bachelor’s degree or an equivalent qualification in a relevant field.

• A minimum of 6 years of professional experience.

• Familiarity with Agile methodologies is essential.

• Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies.

• Proficient in data science technologies such as SAS, R, Matlab, or similar tools.

• Knowledge of data warehousing and dimensional modeling techniques.

• Hands-on experience in creating real-time streaming data ingestion and processing pipelines using Apache Beam, Google Dataflow, Apache Apex, Flink, Spark, or Kafka.

• Experience with data processing tools like Hadoop, Spark, and Dataflow.

• Skilled in building ETL/ELT pipelines.

• Familiarity with column-oriented databases such as Redshift, BigQuery, and Vertica.

• Ability to translate discussions from the whiteboard into code.

• Strong programming skills.

• Experience collaborating directly with subject matter experts in both business and technology domains.

• Proven experience as a team lead.

🏝️ Benefits

• Flexible remote/virtual work arrangement.

• Overnight travel typically requires less than 10% of the time.