ETL Modernization Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop the architecture and migration strategy for updating legacy ETL and ELT pipelines

• Evaluate IBM DataStage jobs, databases, and data warehouses for readiness to migrate

• Create scalable data solutions utilizing Databricks Spark on AWS

• Set architecture standards, reusable frameworks, and governance protocols

• Design CI/CD pipelines to facilitate automated builds, testing, and deployment

• Lead technical design evaluations, migration planning, and artifact validation processes

• Establish strategies for parity, functional, UAT, regression, and performance testing

• Ensure schema validation, data integrity, lineage, security, and readiness for production

• Direct cutover, go-live, hypercare, and operational stabilization initiatives

• Manage the phasing out of legacy DataStage jobs and associated components

• Generate operational documentation and conduct sessions for knowledge transfer

• Offer technical guidance to developers and engineering teams

⛳️ Requirements

• Work authorization: Only Green Card holders and US Citizens

• Extensive experience in designing enterprise-level ETL/ELT architectures

• Practical experience with IBM DataStage and Databricks modernization initiatives

• Strong expertise in Databricks, Delta Lake, Unity Catalog, Photon, and Spark

• In-depth knowledge of AWS data services, such as Glue, Redshift, and Lambda

• Experience in designing large-scale database and data warehouse migration programs

• Proficient in Python and Unix/Linux scripting

• Familiarity with Terraform and automated deployment pipelines

• Understanding of data governance, observability, lineage, and operational readiness

• Experience in defining testing and production-readiness criteria

• Experience in Agile/Scrum environments and PI planning

• Knowledge of GitLab or Azure DevOps

• Familiarity with JIRA

• Experience with automated data-testing frameworks

• Experience leading enterprise cutover and hypercare operations

• Experience mentoring data engineering teams

🏝️ Benefits

• W2 employment

• Remote work arrangement

• 12-month contract duration