Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain scalable, production-ready data pipelines utilizing Spark, Python, and SQL within a Databricks environment.

• Integrate and transform a variety of health, financial, and operational datasets into dependable, reusable data products.

• Create data models and analytics datasets to support enterprise reporting and operational decision-making.

• Construct and uphold API-based integrations for the ingestion and exchange of data across various systems.

• Oversee, troubleshoot, and enhance scheduled workflows and production pipelines to ensure optimal performance, reliability, and scalability.

• Execute data validation, quality checks, lineage, and governance practices.

• Contribute to automated testing, code reviews, technical documentation, and reusable engineering patterns.

• Collaborate with engineers, architects, analysts, and customer stakeholders to convert data requirements into technical solutions.

⛳️ Requirements

• Over 3 years of experience in data engineering, software engineering, or a related technical field.

• Strong expertise in Python and SQL.

• Experience with Apache Spark or comparable distributed data-processing frameworks.

• Familiarity with Databricks or a similar contemporary data platform.

• Proven experience in building and maintaining production data pipelines and ETL/ELT processes.

• Working knowledge of data modeling and transforming raw data into reusable analytics datasets or data products.

• Experience in integrating or consuming data through REST APIs.

• Proficiency in troubleshooting and optimizing data pipelines for enhanced performance and reliability.

• Familiarity with data validation, quality, governance, security, privacy, and compliance aspects.

• Experience with Git-based development workflows and contemporary software engineering practices.

• Comfort in working within terminal and command-line environments.

• Strong communication skills with experience in collaborating with customers or stakeholders to comprehend and address data needs.

• Ability to navigate ambiguity, learn new systems quickly, and independently advance assigned tasks toward resolution.

• U.S. Citizenship is required.

• Active Department of Workforce (DoW) Secret clearance or higher is required.

🏝️ Benefits

• Flexible PTO plus all Federal holidays off.

• Health, dental, and vision insurance plans.

• Flexible Spending Account (FSA).

• 401k plan with employer matching.

• Company-sponsored life insurance, as well as short- and long-term disability coverage.

• Opportunities for professional development including training, certifications, and conferences.

• Paid cloud developer accounts.

• Referral bonuses.

• Headquarters office perks such as parking/metro reimbursement and complimentary nitro coffee & lunches.

• Annual social events including 540 Week, hackathons, and charity golf tournaments.

• Access to tickets for the Washington Capitals & Nationals through 540.