Senior Data Engineer

This is a fully remote position, open to applicants in California, +4 more states.

📋 Description

• Lead the development and implementation of data contracts that establish schema, quality, and ownership standards.

• Take full responsibility for the end-to-end creation of Delta Sharing capabilities, ensuring secure and governed data access without the need for physical duplication.

• Construct automated validation and quality checks that enforce compliance with data contracts at both ingestion and consumption stages.

• Promote the adoption of data contract and sharing standards throughout engineering teams.

• Design shared and versioned data models along with access patterns.

• Integrate these capabilities into JLL's Enterprise Data Platform and existing ingestion, storage, and API frameworks.

• Create and develop services and interfaces for dataset discovery, requests, and self-service consumption.

• Provide mentorship to junior and mid-level data engineers.

• Serve as the primary subject matter expert for the data consumption team.

• Develop automated test suites that validate contract compliance, data lineage, and reliability of sharing at scale.

• Collaborate with data producers, platform architects, and business stakeholders.

• Create technical documentation and onboarding resources.

⛳️ Requirements

• A minimum of 5 years of data engineering experience, including at least one large-scale or complex implementation completed from start to finish.

• Intermediate-to-advanced proficiency in Python and SQL.

• Practical experience in designing and optimizing data pipelines within a cloud environment; Azure is preferred.

• Direct experience with data contracts, schema governance, or enforcing data quality within a production data platform.

• Familiarity with Delta Lake, Delta Sharing, or similar data-sharing/lakehouse technologies.

• Strong experience in PySpark, including performance optimization and troubleshooting using Spark UI.

• Experience in designing and building API services for data access or integration purposes.

• Proven track record of mentoring junior engineers and serving as a technical point of contact within a team.

• Ability to work effectively across scrum teams and collaborate with engineering and business stakeholders.

• Candidates must have authorization to work in the United States without the need for sponsorship.

• Preferred: Experience with Databricks, Unity Catalog, or similar data catalog and governance tools.

• Preferred: Understanding of data mesh principles and federated data ownership models.

• Preferred: Experience with Azure Data Factory, Event Hubs, or other Azure-native data integration services.

• Preferred: Background in commercial real estate, enterprise data platforms, or B2B SaaS data products.

• Preferred: Experience contributing to CI/CD pipelines for data engineering workflows.

🏝️ Benefits

• 401(k) plan with company matching contributions.

• Comprehensive medical, dental, and vision care.

• Paid parental leave at 100% of salary.

• Paid time off and company holidays.

• Early access to earned wages through Daily Pay.

• Supportive culture and a comprehensive benefits package that prioritizes mental, physical, and emotional health.

• Reasonable accommodations for individuals with disabilities.