• **Responsibilities:**

• Design, develop, and maintain scalable ETL/ELT pipelines leveraging Databricks and AWS.

• Enhance the quality, reliability, scalability, and governance of ingestion pipelines.

• Create and refine core data models and foundational data tables.

• Generate analytics-ready datasets to facilitate player insights, publishing analytics, esports analytics, and operational reporting.

• Apply data governance, data quality, lineage, and observability practices.

• Partner with product, analytics, engineering, and business stakeholders to foster data-driven decision-making.

• Optimize large-scale data processing workflows to enhance performance and cost efficiency.

• Support centralized player data models, viewer analytics, publishing activity systems, and operational metrics.

• Aid in the unification of disparate data ecosystems across various game teams and organizations.

• Develop and maintain dependable orchestration workflows and scheduling systems.

• Engage in architectural discussions concerning scalability, governance, and modernization of the data platform.

• **Basic Qualifications:**

• Bachelor’s or Master’s degree in Computer Science, a related field, or an equivalent level of experience.

• Over 5 years of experience in data-related roles and responsibilities.

• Extensive experience with Databricks.

• Proficient in SQL and Python programming.

• Proven ability to construct scalable ETL/ELT pipelines.

• Familiarity with the AWS data ecosystem and cloud-native architectures.

• Experience with DBT, Apache Airflow, or comparable orchestration tools.

• Strong grasp of data modeling and analytics engineering.

• Background in handling large-scale structured and semi-structured datasets.

• Experience in implementing data governance and data quality measures.

• Skills in optimizing pipeline performance and scalability.

• Excellent communication and collaboration abilities.

• Capacity to work autonomously within distributed engineering teams.

• **Company benefits include:**

• Paid Time Off.

• Mentored Career Development.

• U.S. Holidays.

• USD Remuneration.

• Profit Sharing.

• Maternity Coverage.

• 100% Remote.

Data Engineer – Databricks, AWS

People also viewed