Database Engineer

This is a fully remote position, open to applicants in Washington.

📋 Description

• Create scalable, secure, and highly available cloud database solutions.

• Conduct relational data modeling and schema design for large-scale migration projects.

• Assess and implement database technologies, including distributed SQL databases within hybrid cloud environments.

• Execute structured data migration pipelines across development, testing, pre-production, and production environments.

• Transition on-premises relational databases to cloud-based platforms while ensuring data integrity, minimizing downtime, and maintaining performance equality.

• Oversee data staging through cloud object storage and coordinate pipeline progress across various environments.

• Monitor database performance utilizing both cloud-native and third-party tools.

• Detect and address bottlenecks in high-volume environments.

• Apply indexing, partitioning, and query optimization strategies to meet performance service level agreements (SLAs).

• Enforce access controls, encryption, and auditing while ensuring compliance with data protection regulations such as HIPAA and HL7.

• Review and revise security policies as necessary.

• Verify migrated data for accuracy, completeness, and structural integrity.

• Develop and implement test data strategies, including synthetic data generation.

• Create and maintain ETL notebooks and workflows for initial and incremental data loads.

• Automate data transformation, format conversion, and pipeline orchestration.

• Craft scripts for synthetic data generation, routine maintenance, and monitoring tasks.

• Construct and maintain data pipelines using Databricks notebooks and Apache Spark.

• Manage data flow from source systems through cloud object storage staging into target database environments.

• Load synthetic data into containerized local database instances for pipeline validation.

• Monitor and enhance database resource usage while recommending right-sizing and cost-saving strategies.

• Collaborate with product managers, engineers, security specialists, and business analysts to deliver API products in alignment with federal standards and objectives.

• Contribute to the mission of enhancing veteran experiences through digital innovation, compliance, and API development best practices.

⛳️ Requirements

• Bachelor’s degree in Information Technology, Computer Science, Public Administration, or a related discipline (Master’s preferred).

• Practical experience with relational databases, including SQL Server and distributed SQL platforms like CockroachDB.

• Familiarity with Amazon RDS or similar cloud-managed database services.

• Strong capability to query, design, and architect databases for optimal performance and scalability.

• Experience with cloud platforms such as AWS or Azure and cloud-native database services.

• Knowledge of distributed SQL or NewSQL database platforms.

• Familiarity with columnar and open table formats such as Parquet and Delta Parquet.

• Proficiency in Terraform, CloudFormation, Bash, and Python.

• Skilled in Python for data engineering tasks, including pipeline development, data transformation, and test data generation.

• Experience with Apache Spark for large-scale data transformation and pipeline execution.

• Background in developing and maintaining ETL workflows using Databricks or a similar notebook-based data platform.

• Strong understanding of security, compliance, and data governance standards.

• Excellent communication abilities and meticulous attention to detail.

• Analytical mindset and problem-solving skills.

• Capacity to obtain and maintain a Public Trust security clearance.

• Eligibility to work in the United States without sponsorship.

• US Citizenship required due to clearance mandates.

• Strong organizational skills.

• Active VA Public Trust preferred.

• Previous experience with VA data systems or federal health data infrastructure preferred.

• Experience with hybrid cloud architectures spanning multiple providers preferred.

• Databricks certification or equivalent data platform certification preferred.

• Prior successful experience in a remote work environment preferred.

🏝️ Benefits

• Comprehensive medical, dental, and vision care.

• Matching 401K and profit-sharing opportunities.

• Paid time off.

• Training time allocated for personal development.

• Flexible spending accounts.

• Employer-paid life insurance.

• Employer-covered short- and long-term disability insurance.

• Education assistance program with potential merit increases for obtaining work-related certifications.

• Employee recognition programs.

• Referral programs.

• Spot bonuses.

• Additional benefits designed to provide financial protection for employees and their families.