Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and sustain essential data pipelines that are critical to business operations, encompassing data ingestion and AWS Glue/Spark tasks that support the data warehouse and Tableau.

• Develop and manage the data warehouse, orchestration, and BI/reporting platforms across various regions.

• Assist in assessing and refining the warehouse strategy, including lakehouse solutions such as Databricks.

• Establish and enhance batch or event-driven agreements between producer and consumer teams.

• Analyze the trade-offs between batch processing versus streaming, CDC, reprocessing, and multi-tenant/multi-region scenarios.

• Design and improve warehouse schemas and data models.

• Integrate observability into pipelines and components of the platform.

• Lead initiatives across producer and consumer teams, ensure clear communication, and take ownership of outcomes from start to finish.

• Broaden the data platform for Federal workloads and the product lineup.

⛳️ Requirements

• Strong software engineering capabilities, emphasizing clean, correct, and maintainable code along with a solid foundation in data structures and problem-solving.

• Profound knowledge of distributed systems and data architecture.

• Proficiency in SQL and robust data modeling skills.

• Experience managing production data infrastructure from start to finish.

• Familiarity with working in US Government enclaves, from FedRAMP to TS cloud environments.

• Over 7 years of professional experience in data engineering, infrastructure engineering, or backend software engineering.

• Bachelor’s degree in Computer Science or a related discipline, or equivalent practical experience.

• Experience with cloud-based data platforms and distributed data processing, such as AWS Glue, Databricks, Snowflake, or Spark-based pipelines.

• Familiarity with Tableau or a similar BI platform.

• Proficient in SQL and Python.

• Experience with workflow orchestration tools such as Apache Airflow, Dagster, or similar.

• US citizenship.

• Capability to obtain and maintain a TS Security clearance.

🏝️ Benefits

• Equity package in the form of stock options for all full-time positions.

• Health, vision, and dental insurance coverage for you and your family.

• Flexible vacation policy.

• Generous parental leave.

• Opportunities for career development.

• An inclusive and collaborative work culture.

• Remote and hybrid work options based on role and location.