Junior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, construct, and sustain scalable data pipelines, ETL/ELT workflows, and data models utilizing Databricks, dbt, Apache Spark (PySpark), SQL (PostgreSQL), and Python.

• Design and enhance AWS-native data solutions by leveraging services such as AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch.

• Develop efficient data ingestion, transformation, and orchestration workflows for both structured and semi-structured data using formats like Parquet, ORC, Avro, and Apache Iceberg.

• Merge data from both enterprise and external sources, including relational and NoSQL databases like PostgreSQL, Oracle, Redshift, GraphDB, and various NoSQL platforms.

• Enhance the reliability, scalability, performance, and maintainability of enterprise data platforms through diligent monitoring, troubleshooting, and continuous optimization efforts.

• Create and uphold automated deployment pipelines with Harness and engage in collaboration for cloud infrastructure and platform enhancements.

• Aid in data engineering initiatives that support critical analytics, reporting, and decision-making across extensive federal data environments.

• Work alongside cross-functional teams in an Agile setting to define requirements, produce high-quality data solutions, and consistently refine engineering processes.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.

• 5 years of relevant professional experience in data engineering or similar fields.

• Extensive hands-on experience with Databricks for large-scale data engineering, ETL/ELT development, and data transformation.

• Strong expertise in Dbt, SQL (PostgreSQL), Python, Java, AWS (Redshift, RDS, S3, Glue, Lambda, DMS, CloudWatch), Data Pipelines, Data Modeling, System Maintenance, Data Integration, and Performance Optimization.

• Proficient in AWS-native technologies.

• Exceptional analytical and problem-solving abilities.

• Background in agile, iterative software development settings.

• Capability to swiftly learn and apply new technologies and domain insights.

• Excellent verbal and written communication skills, with the capacity to convey complex subjects to varied audiences.

🏝️ Benefits

• Remote Work

• Competitive Compensation Package

• Medical, Dental, and Vision

• Life Insurance, Short/Long Term Disability

• Employee Assistance Program

• 401(k) with 4% matching

• Liberal PTO vacation policy

• Generous Annual Continuing Education

• Annual Wellness Budget

• Bonus Incentive Programs