Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Designing data workflows, pipelines, and pathways to facilitate ETL/ELT processes while ensuring data quality and the secure exchange of sensitive information across both AWS cloud and on-premises environments.

• Applying systems engineering principles to guarantee the reliability, scalability, and maintainability of data layer systems, including implementing backup and recovery strategies.

• Architecting, deploying, and operating data streaming technologies (such as Kafka, Redpanda, Kinesis, etc.) on Kubernetes, focusing on declarative definitions to simplify day-two operations.

• Collaborating with a platform team to establish best practices for configuration management, security, and performance optimization within Kubernetes and AWS environments.

• Partnering with a platform team to automate infrastructure provisioning, monitoring, and scaling through tools like Terraform while working with cybersecurity subject matter experts to integrate best practices for safeguarding our data layer against potential threats.

• Ensuring that our data layer systems adhere to industry and DoD regulations, standards, and best practices.

• Keeping abreast of industry trends and emerging technologies concerning Kubernetes, containerization, and data engineering.

⛳️ Requirements

• Proven experience (minimum of 5 years) in constructing and managing production data pipelines, databases, and data exchange services on Kubernetes.

• Proficient in designing, deploying, and operating Kafka / Redpanda data streaming solutions on Kubernetes.

• Skilled in creating data pipelines from the ground up, capable of processing large volumes of data and managing data storage solutions.

• Familiarity with containerization technologies like Docker and container orchestration systems such as Kubernetes.

• Understanding of systems engineering principles to ensure the reliability, scalability, and maintainability of data layer systems.

• Knowledge of API Security, Container Security, and AWS Cloud Security.

• Awareness of cybersecurity principles and best practices for securing data layer systems.

• Strong problem-solving abilities, with the capability to work both independently and collaboratively within a team.

• Excellent communication skills, able to articulate complex concepts to both technical and non-technical team members.

• The selected candidate will undergo a pre-employment background check ('CBI') and must be able to obtain and maintain a Secret-level DoD security clearance.

• Experience with machine learning and generative AI models.

🏝️ Benefits

• Medical/Dental/Vision

• Premiums are 100% Company Paid

• Health Savings Account

• Life Insurance

• Disability Insurance

• 401k Retirement Plan

• Company Stock Options

• Home Office Budget

• We offer all full-time Unicorns Flexible Time Off (FTO) plus all Federal Holidays, one week for Thanksgiving, and two weeks for Christmas and New Year’s

• Paid Parental Leave

• Reimbursement for approved trainings/subscriptions

• Conferences (travel, lodging, and fees)