
Data Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Maryland.
• Create, develop, and sustain ETL/ELT pipelines utilizing structured and semi-structured data from relational databases, flat files, APIs, and cloud data sources.
• Work collaboratively with backend and architecture teams to establish data transformation processes that meet the requirements of dashboard and reporting applications.
• Design and enhance data schemas to guarantee performance, integrity, and compatibility with reporting needs.
• Generate and maintain efficient, testable, and reusable data processing scripts utilizing Python, SQL, and cloud-native tools.
• Partner with DevOps, analysts, and application developers to ensure pipelines align with system architecture, storage strategies, and reporting requirements.
• Implement data quality and validation checks, while also documenting data lineage and pipeline logic for audit purposes and future reuse.
• Diagnose performance issues in data jobs and provide support for data pipeline operations across various environments (DEV, VAL, PROD).
• Contribute to CI/CD workflows and automation strategies to facilitate rapid iteration and secure deployment of data services.
• Aid in the creation or maintenance of data documentation, which includes metadata, data dictionaries, and technical user guides.
• Keep abreast of emerging technologies, techniques, and trends to guide product development and decision-making.
• Bachelor’s degree in computer science, engineering, statistics, or a related field.
• Over 4 years of experience in a data engineering, data pipeline, or ETL/ELT development position.
• Strong expertise in SQL, data transformation logic, and performance optimization for large datasets.
• Proficient in Python and familiar with libraries such as Pandas, PySpark, or Numpy.
• Experience with modern version control and CI/CD practices (e.g., GitHub Actions, Jenkins).
• Knowledge of distributed computing solutions for data processing (e.g., AWS Glue, AWS EMR, Apache Hadoop, Apache Spark).
• Familiarity with data pipeline orchestration frameworks or serverless tools (e.g., AWS StepFunctions, AWS Glue Workflows, and/or AWS Lambda).
• Experience in developing solutions within AWS cloud environments (S3, Lambda, Aurora, SNS, CloudFormation/CDK).
• Knowledge of Snowflake, Amazon RDS, or other cloud-native data warehouses.
• Understanding of modern data transformation tools (dbt, Dataform, or similar) and best practices for modular, tested SQL transformations within an ELT architecture.
• Experience in supporting healthcare data systems or CMS data environments.
• AWS certifications are advantageous.
• Comprehensive health, dental, and vision insurance.
• Opportunities for professional development and growth.
• Flexible work hours and remote work options.
• Collaborative and innovative work environment.
Arionkoder
Global Alliant Inc
finanzen.net GmbH
Get handpicked remote jobs straight to your inbox weekly.