Senior Data Platform Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Design and enhance medallion-layered architecture in Microsoft Fabric for Endsight and client environments.

• Assess and create reference implementations for data ingestion and API integration techniques, including incremental and change-data-capture patterns, schema-drift management, and secrets handling.

• Develop MCP servers in accordance with Endsight's internal security and reliability criteria, addressing authorization scope, fault management, and resistance to injection attacks.

• Write, publish, and sustain engineering standards through thorough documentation, review processes, and collaborative efforts.

• Engage in the team's research and evaluation initiatives and co-author the decision framework for inclusion in the central data platform.

• Work alongside existing domain owners to elevate the technical standards.

⛳️ Requirements

• A minimum of two years of hands-on production experience with Microsoft Fabric, encompassing lakehouse and warehouse design, medallion architecture, notebooks (PySpark and/or Python), ingestion pipelines, semantic models, and deployment pipelines.

• Proven experience in API integration, including REST and OAuth2, pagination, rate limiting, incremental and change-data-capture patterns, idempotent retries, and secrets management in systems running autonomously in production.

• Established background in building and deploying MCP servers, which includes tool design, authorization scoping, structured error handling, and protection against prompt injection.

• Proficient in Python and SQL, infrastructure-as-code practices, and Git-based workflows.

• A documented history of evaluating competing technical approaches, formulating standards, and facilitating their adoption among fellow engineers.

• A documented history of enhancing technical standards in collaboration with a team.

• Ability to work with partially defined requirements and provide constructive feedback on project scope.

• Required to have Pacific-hours overlap.

🏝️ Benefits

• Medical: The company covers 100% of the base plan for employees and their families.

• Dental & Vision coverage.

• 401(k) plan with employer matching contributions.

• Accrued Paid Time Off.

• Nine Paid Holidays.

• Support and programs for Career Development.