Lead Data Engineer

This is a fully remote position, open to applicants in Florida.

📋 Description

• Provide architectural oversight for the organization's data platform and associated initiatives, ensuring they align with company standards and industry best practices.

• Assist development projects through design reviews, offering insights on architecture and data modeling.

• Lead design evaluations for proposed solutions, encompassing data sourcing, data pipelines, data models, and ontology resources, delivering actionable feedback to enhance design scalability.

• Aid in the creation of architectural artifacts, conduct requirements decomposition, and produce other documentation to support the software development lifecycle (SDLC).

• Contribute to the SDLC process by engaging in data architecture review sessions, assessing proposed solutions for adherence to architectural standards.

• Supervise and provide direction for data pipelines, ensuring they are scalable, reusable, and high-performing.

• Utilize Palantir Foundry for data integration and ontology management to facilitate large-scale big data analytics.

• Collaborate with cross-functional teams to establish data governance, metadata, and ontology standards, ensuring consistency and clarity throughout the data platform and the enterprise.

• Stay updated with emerging data technologies and frameworks to recommend enhancements to the data platform architecture.

⛳️ Requirements

• Bachelor's Degree with a minimum of 9 years of prior Palantir experience, or a Graduate Degree with at least 7 years of prior Palantir experience.

• Alternatively, a minimum of 13 years of prior Palantir experience without a degree.

• At least 4 years of experience in Data Pipeline development or ETL tools such as Palantir Foundry, Azure Data Factory, SSIS, or Python.

• A minimum of 4 years of experience in Data Integration.

• Preferred Additional Skills: Experience in supporting or implementing solutions that utilize Generative AI capabilities, including Retrieval-Augmented Generation (RAG), semantic search, and LLM integration.

• Familiarity with Palantir Foundry tools like Ontology Manager, Compass, Code Repository, Solution Designer, OSDK, AI FDE, and AIP Analyst.

• Understanding of Business Intelligence (BI) and Data Warehouse (DW) development methodologies.

• Experience with programming languages such as Python, Pandas, Databricks, JavaScript, TypeScript, or other scripting languages.

• Experience with AI tools like OpenAI, Palantir AIP, Snowflake Cortex, or similar technologies.

• Hands-on experience in designing and developing Data Pipelines using Palantir Foundry Pipeline Builder or Code Repository, or similar technologies utilizing PySpark and Spark SQL.

• Familiarity with SDLC processes and architecture review or data governance board processes.

🏝️ Benefits

• Health insurance

• Disability insurance

• 401(k) match

• Flexible spending accounts

• Employee Assistance Program (EAP)

• Education assistance

• Parental leave

• Paid time off

• Company-paid holidays