Data Platform Engineer – Clearance Required

This is a fully remote position, open to applicants in Pennsylvania.

📋 Description

• Design and create enterprise applications utilizing Microsoft Power Platform, Dataverse, Power Apps, Power Automate, JavaScript, HTML, CSS, and Power Query.

• Enhance Dataverse solutions by working with tables, data types, data mapping, and entity relationship diagrams.

• Co-manage data engineering initiatives within Palantir Foundry (Vantage), focusing on ontology design, pipeline creation, and data integration for Army AI2C mission applications.

• Construct, sustain, and refine Foundry pipelines employing Python-based transformations, PySpark/Pipeline Builder, Code Repositories, and Foundry’s data connection framework.

• Design and oversee Databricks workflows, which include notebooks, Delta Lake tables, and Spark jobs.

• Provide guidance on and execute efficient, reusable, and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript.

• Convert data science and analytics outputs into governed, reusable data products within Foundry and Databricks.

• Spearhead the integration of AI/ML capabilities into Foundry and Databricks applications.

• Advocate for AI-centric, platform-first development practices and steer the implementation of AI/ML features.

• Offer technical leadership and mentorship across Foundry (Vantage) and Databricks.

• Identify potential opportunities to broaden development efforts with Army stakeholders.

• Collaborate with data scientists, UX designers, and software developers using Git, code reviews, and Agile methodologies.

• Engage with Army managers and representatives to determine data platform requirements, investigate data-driven and AI solutions, and forge strategic relationships.

• Operate independently and collaboratively in strategic and consultancy-oriented settings.

• Convey technical concepts to non-technical stakeholders and influence strategic decision-making.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related discipline, or equivalent professional experience.

• 3–5 years of experience in data engineering.

• Practical experience in building and managing applications on the Palantir Foundry (Vantage) platform.

• Proven experience with Microsoft Power Platform, Dataverse, Power Apps, and Power Automate for a Defense client/customer.

• Basic experience with Databricks, encompassing notebooks, Delta Lake, and Spark-based data processing.

• Intermediate skills in Python and SQL for data manipulation and pipeline development, including pandas, PySpark, numpy, or similar tools.

• Understanding of data visualization techniques such as Power BI, D3.js, Plotly, Recharts, or Foundry-native Workshop widgets.

• Experience in planning, analyzing, designing, implementing, testing, and maintaining data pipelines and applications for enterprise-level systems.

• Familiarity with Git, Agile methodologies, CI/CD, and automated deployments.

• Experience in leadership roles, providing technical mentorship, or managing client relationships.

• Active Secret Clearance or the ability to obtain one is mandatory.

• Applicants must fulfill eligibility criteria for a U.S. Government security clearance.

• Only U.S. Citizens are eligible for a security clearance.

• Preferred: experience in integrating AI/ML capabilities into Foundry or Databricks applications.

• Preferred: familiarity with AI frameworks and APIs such as OpenAI, Anthropic Claude, LangChain, or similar, as well as Foundry AIP.

• Preferred: knowledge of statistical analysis and machine learning concepts.

• Preferred: experience with Storybook.

• Preferred: deployment experience across diverse environments and platforms, including classified/air-gapped Foundry instances.

• Preferred: understanding of the Army software development process and its technologies or experience in developing applications for classified data.

• Preferred: background in supporting government or DoD clients in strategic planning or consultancy settings.

• Preferred: a proven track record of expanding technical scope or footprint with government customers.

• Preferred: 7+ years of directly related experience.

• Preferred: Master’s degree in a relevant field.

• Candidates who can be on-site in Pittsburgh are preferred.

• 10% travel is required.

🏝️ Benefits

• Remote work flexibility.

• Opportunity to offer technical leadership and strategically expand the development footprint with customers.

• Technical mentorship and growth of team capabilities.

• 10% travel requirement.

• Equal employment opportunities.

• Disability accommodations during the application process.