Data Analyst – Data Integration, Quality & Governance

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Design and oversee database systems.

• Lead projects related to database transformation and/or migration for software applications.

• Create and enhance data integration solutions utilizing ETL/ELT, streaming ingestion, and API-driven data interchange.

• Implement and maintain practices for data quality, metadata management, and data lineage.

• Prepare data suitable for AI applications through feature engineering, labeled training datasets, and semantic embeddings.

• Utilize NLP/LLM methodologies for automated tagging of metadata, classification, and extraction of entities and relationships.

⛳️ Requirements

• Over 7 years of pertinent experience.

• Background in database design and management, specifically in transformation and/or migration projects for software applications.

• Familiarity with Databricks, including Delta Lake, Delta Live Tables, Unity Catalog, Workflows, Structured Streaming, and SQL Warehouses.

• Strong command of SQL, Python, and PySpark/Spark.

• Experience with AWS data services such as S3, Glue, and Lambda.

• Proficient in ETL/ELT, streaming ingestion, and API-based data exchange methodologies.

• Knowledge of data quality, metadata, and lineage tools (e.g., Unity Catalog lineage, frameworks for data quality).

• Proficiency with PostgreSQL, Aurora, and DynamoDB.

• Experience in preparing data for AI, including feature engineering, labeled training datasets, and semantic embeddings.

• Familiarity with NLP/LLM techniques for automated tagging of metadata, classification, and extraction of entities and relationships.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.

• Supportive and inclusive company culture.