Senior Data Engineer

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Design and execute AI functionalities from start to finish, encompassing data pipelines, GenAI/agentic workflows, and production deployment.

• Utilize judgment regarding model performance, evaluation, reliability, and safety measures.

• Construct and enhance scalable, secure data pipelines alongside ETL/ELT workflows using Python and SQL.

• Create Generative AI, agentic, machine learning, and business intelligence systems leveraging RAG, embeddings, vector databases, and current frameworks.

• Employ MLOps/LLMOps methodologies, which include CI/CD for data workflows, automated agent assessments, and infrastructure as code.

• Ensure data security and governance, covering PII/PHI management, authentication, and role-based access control.

• Independently manage technical workstreams.

• Provide mentorship to junior engineers.

• Advocate for software engineering best practices within the team.

⛳️ Requirements

• An active Secret or Top Secret clearance is required.

• Over 5 years of relevant experience in a data engineering position.

• Proven experience in leading technical workstreams and guiding junior engineers.

• Expert-level skills in Python and SQL.

• Competence in polyglot environments, including Scala and Java.

• Experience in developing Agentic AI, Generative AI, Machine Learning, and Business Intelligence systems.

• Familiarity with prompt design, retrieval-augmented generation (RAG), embeddings, vector databases, context construction, and output management.

• Proficient with modern frameworks such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro.

• Capable of implementing AI features from start to finish and assessing model behavior, reliability, safety measures, quality, latency, and cost trade-offs.

• Knowledge of data security and governance measures, including PII/PHI management, authentication, and role-based access control (RBAC).

• Understanding of MLOps/LLMOps, CI/CD for data workflows, automated agent evaluation, and Terraform.

• Experience with cloud platforms such as AWS, Azure, and GCP.

• Excellent time management skills and the ability to independently oversee technical workstreams.

🏝️ Benefits

• Option for remote work.

• An inclusive and collaborative culture.

• Opportunities for continuous learning.