
Senior Data Engineer
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Maryland.
• Assist government clients by designing, constructing, and enhancing scalable cloud-based solutions and data pipelines.
• Establish connections to various knowledge and data sources.
• Aid in the modernization of legacy systems and their transition to modern infrastructure.
• Collect requirements, document business rules, and grasp business objectives.
• Configure and maintain connections from analytic tools to Databricks, repositories, platforms, and APIs.
• Manage and oversee the population and administration of the Databricks Unity Catalog.
• Define and document technical and coding standards.
• Create secure, scalable, and cost-effective data solutions.
• Design, build, and sustain ETL/ELT pipelines utilizing AWS and Databricks.
• Develop conceptual and physical data models for analytics, reporting, and operational purposes.
• Implement frameworks for data quality, validation, monitoring, alerting, and automated recovery.
• Perform advanced data analysis using Python and SQL.
• Create data models, data dictionaries, and guides for data usage.
• Enhance the performance of end-to-end data workflows.
• Construct and manage GitHub CI/CD pipelines for automated testing, deployments, and continuous integration.
• Deliver high-quality work within established timelines.
• Collaborate with cross-functional teams in an Agile environment to provide iterative value.
• Must be a U.S. Citizen or authorized to work in the United States.
• Must have resided in the U.S. for a minimum of three of the past five years.
• Must be eligible to obtain a federal government client badge.
• Must successfully pass a government background investigation.
• Bachelor's degree and at least 10 years of professional experience, including a minimum of 4 years in designing, developing, and implementing BI, data management, analytics, or similar enterprise IT solutions.
• Four years of specialized experience may replace the requirement for a bachelor's degree.
• Proficiency in data engineering, data integration, and the development of enterprise data platforms.
• Practical experience in designing and implementing scalable data pipelines, data warehouses, data lakes, and cloud-based data solutions.
• Advanced skills in SQL and Python.
• Strong familiarity with AWS cloud services and Databricks.
• Experience with artificial intelligence, machine learning, or generative AI technologies is highly preferred.
• Demonstrated experience using GitHub for source control, branching, code reviews, versioning, and collaborative software development.
• Knowledge of ETL/ELT frameworks, data modeling, data governance, data integration patterns, relational and non-relational databases, and enterprise data warehousing.
• Experience with object-oriented programming, design patterns, code quality, testing, documentation, and developing maintainable solutions.
• Familiarity with DevOps methodologies and CI/CD pipelines.
• Strong analytical, problem-solving, and communication abilities.
• Excellent skills in both written and verbal communication.
• Working knowledge of Agile frameworks and Scrum methodologies.
• Experience with CMS enterprise repositories, including the Integrated Data Repository (IDR), is preferred.
• Previous experience supporting federal government agencies, healthcare programs, or large-scale public sector data environments is preferred.
• Opportunities to reach your potential.
• Join a community of great minds with national impact.
Tech Minds Agency
Agility Robotics
Get handpicked remote jobs straight to your inbox weekly.