Data Engineering Consultant – Databricks

This is a fully remote position, open to applicants in India.

📋 Description

• Assist in client engagements as an integral member of the project team

• Collect and comprehend both business and technical requirements

• Convert requirements into technical tasks under the mentorship of senior team members

• Create presentations, documentation, and other deliverables

• Develop and support data solutions utilizing Snowflake, Databricks, AWS, Microsoft Fabric, Azure, and DataVault Data Automation

• Construct and manage primarily batch data pipelines, with some exposure to near real-time processing

• Design ETL/ELT and data integration workflows

• Contribute to the development of data lakes and data warehouses

• Adhere to best practices in coding, testing, and performance optimization

• Diagnose and resolve data issues in collaboration with senior team members

• Engage in code reviews, testing, and quality assurance processes

• Oversee assigned tasks and ensure timely delivery within project deadlines with minimal supervision

• Prepare curated datasets for analytical purposes and reporting

• Aid in the preparation of data for machine learning initiatives

• Keep up-to-date with tools, technologies, and industry best practices

• Support data governance, quality, security, compliance, metadata management, lineage, and technical documentation

• Foster client relationships and assist leadership in driving business growth

• Explore new opportunities to contribute and enhance collaborative delivery

⛳️ Requirements

• Bachelor’s degree in Data Analytics, Business Analytics, Information Systems, Computer Science, Statistics, Mathematics, Economics, or a related field

• 3-5 years of experience in data engineering, analytics, or comparable technical positions

• Foundational experience with SQL and basic data modeling principles

• Foundational experience in ETL/ELT processes and data integration methods

• Familiarity with cloud platforms such as AWS, Azure, or GCP

• Basic understanding of modern data architecture concepts, including data lakes and warehouses

• Strong analytical and problem-solving abilities

• Proactive, customer-focused, and quality-oriented mindset

• Capacity to manage multiple priorities and effectively organize time

• Adaptability in a constantly evolving environment

• Familiarity with Snowflake, Databricks, or similar technologies is advantageous

• Experience with Python or Scala is preferred

• Exposure to Power BI or Tableau is an asset

• Datavault experience with VaultSpeed, DataVault Builder, or Wherescape is a bonus

• High attention to detail and a commitment to delivering quality results

• Strong communication and teamwork skills

• Ability to learn quickly and adapt in a fast-paced consulting environment

• Demonstrated curiosity and enthusiasm for data engineering, analytics, and emerging technologies

🏝️ Benefits

• Equal opportunity employer

• Reasonable accommodations for individuals with disabilities