Director, Software Engineering

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Collaborate with the core Databricks team to strategize and implement the migration of current data pipelines to the designated enterprise data platform.

• Develop repeatable engineering methodologies for data ingestion, transformation, testing, deployment, and monitoring across integrated datasets.

• Spearhead the adoption of AI-driven development tools such as Claude, GitHub CoPilot, and LLMs.

• Create context engineering methodologies and reusable context packages.

• Mentor offshore teams in establishing and operationalizing asset-agnostic onboarding frameworks for data assets, domains, and source systems.

• Set up reusable ingestion and processing methodologies for both batch and streaming scenarios.

• Connect platform pipelines and datasets with the enterprise data mastering solution.

• Implement data quality controls, reconciliation measures, and metadata synchronization.

• Promote consistent business definitions, reusable data concepts, and governed consumption practices.

• Act as a senior technical authority for offshore data platform engineering.

• Shape architectural choices and provide technical direction to engineers and partner teams.

• Participate in design and code evaluations for intricate data platform projects.

⛳️ Requirements

• Over 10 years of experience in data engineering, data platforms, cloud data architecture, software engineering, or comparable engineering fields.

• Proven experience as a senior Individual Contributor, technical lead, principal engineer, staff engineer, distinguished engineer, architect, or similar role.

• Extensive hands-on experience with contemporary data engineering and pipeline development.

• Familiarity with batch and/or streaming data workflows.

• Experience working with Databricks-based data platforms and lakehouse-oriented architectures.

• Practical knowledge of AI-assisted engineering tools such as Claude, GitHub CoPilot, LLMs, or similar technologies.

• Experience utilizing LLMs for engineering applications like code generation and optimization.

• External candidates who reach the final interview stage are required to attend at least one in-person interview.

• Understanding of enterprise data cataloging, metadata management, business glossaries, lineage, operational metadata platforms, or semantic data layers.

• Experience with NeoXam DataHub or NeoXam-style mastering workflows.

• Knowledge of semantic modeling principles.

• Strong leadership abilities, including mentoring, empowering others, and fostering consensus.

🏝️ Benefits

• Eligibility for an annual incentive plan.

• Comprehensive health care coverage.

• Generous vacation time.

• Resources for continuous learning and career advancement.

• Retirement planning options.

• Continuing education initiatives.

• Company-matched contributions for student loans.

• Financial wellness programs.

• Family-oriented benefits and perks.

• Discounts at retail partners.

• Incentives for employee referrals.