Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and enhance data pipelines and architectures tailored for AI/ML workflows on cloud platforms.

• Develop ETL/ELT processes while ensuring data quality, consistency, and accessibility.

• Configure and oversee AI/ML-ready cloud infrastructure, including AWS Bedrock and Azure OpenAI.

• Work in collaboration with Data Scientists to operationalize models and facilitate scalable AI solutions.

• Implement data governance, versioning, and lineage tracking to ensure compliance.

• Monitor and sustain high-performance data systems while optimizing throughput.

• Assist in HUD AI/ML proofs of concept and pilot projects.

• Collaborate with Data Scientists, DevOps, and UX teams.

• Document reproducible workflows and participate in iterative Agile development.

⛳️ Requirements

• Over 5 years of experience in data engineering specifically for AI/ML workflows.

• Proficient in cloud-native data systems and large-scale data processing.

• Familiarity with AI/ML pipelines, reproducible workflows, and federal compliance standards.

• Previous experience supporting HUD OCIO is preferred.

• Must pass required Federal background checks and obtain and maintain government clearance and customer approval.

• Must be legally authorized to work in the United States without employer sponsorship, now or in the future.

• Proficient with AWS Bedrock, Azure OpenAI, S3, Redshift, and Data Factory.

• Experience with Airflow, Spark, and Databricks.

• Knowledgeable in data modeling, schema design, and optimization for AI workloads.

• Proficiency in Python and SQL.

• Familiar with Git, GitHub, or GitLab.

• Knowledge of data governance, metadata management, and logging practices.

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.

• Ability to sit for extended periods at a desk while working on a computer.

• May occasionally require lifting up to 25 pounds.

🏝️ Benefits

• Full-time employment.

• Fully remote position.

• Equal Employment Opportunity protections.

• Reasonable accommodations for applicants with disabilities.

• Drug-free workplace.

• E-Verify participation.