Lead Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and implement a scalable and secure cloud-based data platform for operational data, reporting, and analytics.

• Engineer multi-tenant cloud environments that support hybrid/on-premises systems and a variety of database technologies.

• Design and implement auditable data integration patterns across Judiciary systems and external platforms.

• Build, test, deploy, and maintain data ingestion and ETL/ELT pipelines for both batch and near-real-time workloads.

• Implement data quality controls, validation rules, governance-aligned structures, and error-handling mechanisms.

• Monitor and optimize database and query performance, pipeline scalability, and cost efficiency.

• Lead data management solutions, including operational databases, document storage, data models, schemas, APIs, and data marts/gold layers.

• Provide technical direction and daily oversight to Data Engineers (ETL/ELT Pipelines).

• Implement Infrastructure as Code for database provisioning, configuration, and management.

• Collaborate with architecture, governance, migration, DevSecOps/CI-CD, DBA, business analysis, and QA teams.

• Configure metadata structures, workflows, automation, security settings, catalog ingestion processes, and attribute definitions.

• Support data classification standards through workshops, security controls, metadata requirements, system design, procurement, and training.

• Create training materials, job aids, communications, technical documentation, runbooks, and workflows.

• Support CI/CD deployments, automated testing, incident resolution, and root cause analysis.

• Execute data migration, archival, disaster recovery, failover testing, and disaster recovery drills.

• Escalate technical risks, defects, and dependencies while supporting the Data and Technology Enabler Roadmap.

• Operate within an Agile federal delivery environment, remaining accountable for code quality, performance, timelines, and audit-ready artifacts.

⛳️ Requirements

• MA/MS degree with over 7 years of general experience and at least 7 years of specialized experience, or a BS/BA degree with more than 9 years of general experience and 7 years of specialized experience.

• Experience may substitute for education: high school diploma with 16+ years, AA/AS with 14+ years, BA/BS with 12+ years, or Doctorate/Ph.D. with 9+ years.

• Minimum of 7 years of specialized experience in data engineering and data architecture design.

• Familiarity with system security best practices.

• Experience in researching advanced technologies and applying IT solutions to meet business needs.

• Proficiency with AWS data and compute services.

• Experience with data orchestration tools.

• Proven background in software and data engineering.

• Hands-on experience in building enterprise-scale data pipelines.

• Strong skills in SQL, Python, and data transformation techniques.

• Experience developing on cloud-based data platforms.

• Familiarity with Agile/Scrum delivery environments.

• Hands-on experience with data platforms, analytics, and AI/ML solutions.

• Proficiency in ETL/ELT frameworks.

• Experience with streaming or near-real-time data ingestion.

• Familiarity with data governance, metadata, and classification standards.

• Experience in leading and mentoring data engineers.

• Excellent oral and written presentation and communication skills.

• Ability to work with senior customer stakeholders and build strong customer relationships.

• Experience applying industry tools, solutions, methods, best practices, and emerging technologies.

• Strong analytical and problem-solving abilities.

• Capability to work effectively both independently and as part of a team.

• Preferred certifications include CDMP, Snowflake SnowPro Core, Databricks Certified Data Professional, AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Professional, and AWS Certified Data Engineer.

• No security clearance, public trust, or certification is currently required.

• U.S. citizenship is not a requirement.

🏝️ Benefits

• Medical plan options, including some with Health Savings Accounts.

• Dental plan options available.

• Vision plan options offered.

• 401(k) plan with pre-tax and post-tax contributions up to IRS annual limits.

• Company 401(k) matching.

• Full flexible work weeks when possible.

• Vacation, sick, and personal time off.

• Paid holidays.

• Paid parental leave.

• Military leave.

• Bereavement leave.

• Jury duty leave.

• New employees receive 15 days of paid leave per calendar year, prorated based on hire date.

• Additional 10 paid holidays per year, prorated based on hire date.

• Up to 160 hours of paid family leave in a rolling 12-month period for eligible employees.

• Short- and long-term disability benefits.

• Life insurance coverage.

• Accidental death and dismemberment insurance.

• Personal accident insurance.

• Critical illness insurance coverage.

• Business travel and accident insurance.

• Remote work opportunities available.