Senior Architect

This is a fully remote position, open to applicants in California, +4 more states.

📋 Description

• Take full ownership of the architecture for Trinity data products.

• Collaborate with domain experts, data scientists, and AI engineers to convert business needs into data product architecture.

• Establish tooling and technology stack, schemas, attribute inclusion/exclusion, key design, entity resolution, data provenance, and schema evolution strategies.

• Create and develop normalization pipelines for diverse and loosely structured text-based sources.

• Construct multi-stage pipelines that integrate deterministic parsing, LLM-assisted extraction and inference, along with human review and adjudication.

• Lead teams in transforming unstructured or loosely structured data into high-quality enterprise data products.

• Optionally design and develop internal full-stack interfaces that allow analysts to review, approve, and adjust pipeline outputs.

⛳️ Requirements

• Over 8 years of practical experience in data engineering and data architecture.

• Proven experience in leading architecture and technical direction for complex data systems from initial scoping and design to delivery and production support.

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline, or equivalent hands-on experience.

• In-depth knowledge of data modeling, including grain, keys, entity resolution, data/attribute provenance, and schema evolution.

• Proficient in SQL and relational data warehouse concepts, including query optimization and performance tuning.

• Strong skills in Python for building production data pipelines with a focus on orchestration, versioning, testing, and observability at scale.

• Experience in normalizing complex semi-structured and unstructured data sources, such as XML and PDFs, into stable, well-documented schemas.

• Capability to utilize AI coding assistants effectively while ensuring high-quality outputs.

• Exceptional written and verbal communication skills, with the ability to convey technical concepts to non-technical audiences.

• Familiar with PySpark and distributed data processing frameworks.

• Practical experience using Git, Jenkins, and Code Pipeline for version control and continuous integration/continuous deployment (CI/CD).

• Knowledge of Unix/Linux environments and shell scripting.

• Familiarity with AWS, Azure, or GCP for data storage and processing solutions.

• Experience in data validation and implementing data quality checks.

• Understanding of Agile methodologies and project management tools such as JIRA.

🏝️ Benefits

• Annual discretionary performance bonus.

• Equal opportunities and an inclusive workplace environment.