Data and Analytics Architect

This is a fully remote position, open to applicants in India.

📋 Description

• Craft observability architecture that encompasses logs, metrics, and traces.

• Establish the collection methods for application and infrastructure events.

• Develop log ingestion, retention strategies, and analysis techniques.

• Create data pipelines and ETL processes for both batch and streaming workloads.

• Architect data models alongside data lake, data warehouse, and lakehouse frameworks.

• Build a greenfield data lake from scratch.

• Define processes for ingestion and deduplication of structured and unstructured data.

• Formulate the technical strategy for transferring application and user data.

• Design enterprise master data management solutions.

• Develop analytics, custom dashboards, and reporting capabilities using Power BI or Tableau.

• Specify data security measures, access control protocols, lineage, and quality assurances.

• Produce both high-level and low-level designs and collaborate with client architects for reviews.

• Take ownership of the target-state data platform and the technical strategy for managing application, user, and enterprise data transitions.

• Construct new platforms from the ground up as needed for the segmented entity.

⛳️ Requirements

• Over 10 years of pertinent experience in data and analytics architecture.

• Profound expertise in observability, specifically logs, metrics, and traces related to applications and infrastructure.

• Experience in large-scale log ingestion, retention, and analysis.

• Proven track record in building data pipelines, ETL, and ELT solutions.

• Strong capabilities in data modeling.

• 3 to 5 years of hands-on experience with data lakes and data warehouses across a minimum of two vendors.

• Familiarity with data lakehouse architectures.

• Competence in managing both structured and unstructured data.

• Experience in batch processing and operations.

• Knowledge in ingestion and deduplication techniques.

• Experience with data migration involving application and user data.

• Proven experience in enterprise master data management.

• Experience establishing a greenfield data lake from the ground up.

• Proficiency with at least two analytics tools, such as Power BI and Tableau, including custom dashboard creation.

• Understanding of data governance, including cataloguing, lineage, quality, masking, and access control.

• Familiarity with orchestration and streaming tools like Azure Data Factory, Airflow, or Kafka.

• Strong SQL proficiency and a working knowledge of Python.

• Experience with at least two cloud service providers (Azure and AWS).

• Exposure to at least two OEMs or vendors in each relevant technology field.

• Excellent communication skills with prior experience collaborating with UK and EU clients.

• Willingness to travel as necessary and to work within the client’s time zone.

• Prior background in infrastructure alongside the specified specialization.

• Relevant experience in IT consolidations, mergers, demergers, and carve-outs is mandatory.

• Professional certifications relevant to the role are highly recommended.

🏝️ Benefits

• Flexible remote work arrangement.

• Willingness to travel as necessary.