
Development Engineer
Posted 5 hours ago

Posted 5 hours ago
This is a fully remote position, open to applicants in United States.
β’ Assist in the modernization initiative of the Centers for Medicare & Medicaid Services (CMS).
β’ Create, develop, and sustain efficient ETL/ELT pipelines for analytics and reporting purposes.
β’ Construct effective data processing workflows utilizing Python, SQL, and PySpark within Databricks and Delta Lake settings.
β’ Establish scalable data lakehouse architectures for intricate healthcare datasets and enterprise-level analytics.
β’ Work in conjunction with Data Architects, Automation Test Engineers, QA Analysts, and Business Analysts to outline data transformation logic and data integration standards.
β’ Develop reusable code and frameworks for data ingestion, data quality validation, and exception management.
β’ Enhance data processing tasks for optimal performance, reliability, scalability, and cost-effectiveness in AWS and Databricks.
β’ Engage in schema design, data modeling, and version-controlled data pipeline development.
β’ Support data governance, metadata management, and documentation of data lineage for audit, compliance, and FISMA reporting.
β’ Collaborate with DevOps teams to incorporate data pipelines into CI/CD workflows using GitHub, Databricks Repos, and associated tools.
β’ Conduct root cause analysis and troubleshoot data issues across staging, integration, and production environments.
β’ An experienced Development Engineer.
β’ Proven experience in developing data ingestion, transformation, and processing pipelines within AWS and Databricks-based environments.
β’ Familiarity with Delta Lake lakehouse architectures.
β’ Strong proficiency in Python, SQL, and PySpark.
β’ Understanding of scalable data lakehouse architectures.
β’ Experience in schema design and data modeling.
β’ Background in version-controlled data pipeline development.
β’ Knowledge of data governance, metadata management, and documentation of data lineage.
β’ Experience in integrating data pipelines into CI/CD workflows using GitHub, Databricks Repos, and related technologies.
β’ Proficient in performing root cause analysis and addressing data issues across staging, integration, and production environments.
β’ Comprehensive medical, dental, and vision insurance, along with telehealth services and a confidential Employee Assistance Program.
β’ Paid time off beginning at 3.5 weeks per year, increasing with tenure, plus 11 paid holidays.
β’ 401(k) retirement plan with employer matching up to 4% of eligible compensation after six months of employment.
β’ Company-sponsored basic life, accidental death and dismemberment, and short- and long-term disability insurance.
β’ Opportunities for professional development and tuition reimbursement programs, each providing up to $1,500 annually for eligible employees after six months of service, subject to approval.
NICE
KLA
Caterpillar Inc.
Caterpillar Inc.
Get handpicked remote jobs straight to your inbox weekly.