Senior Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Create and develop ETL programs and workflows utilizing Databricks.

• Formulate technical specifications for data loading protocols.

• Guide and mentor Software Engineers by providing technical support.

• Design, develop, and architect software products.

• Create and implement product enhancements tailored to specific customer requirements.

• Generate technical documentation, architectural specifications, data models, installation and qualification manuals, and release notes.

• Assist with technical consulting initiatives for clients in the pharmaceutical industry.

• Design and facilitate solutions for sharing clinical trial information.

• Offer application support for current products.

• Aid in release management using version control tools like Azure DevOps Git.

• Conduct live deployments.

• Collaborate with cross-functional teams from the design phase through to live deployment.

• Contribute to data integration, software product development, and the sharing of clinical trial information.

⛳️ Requirements

• Bachelor's Degree in a technical field (Mathematics, Science, Engineering, Computing, etc.) or a related discipline, or equivalent project-related experience.

• Demonstrated experience in systems integration and implementation, software development, or a related field.

• Proven ability to communicate effectively with multiple stakeholders.

• Over 5 years of experience with Microsoft Azure components, specifically Azure SQL, Azure Databricks, and Azure Data Factory.

• Experience in implementing ETL solutions, particularly with Databricks.

• Strong skills in database development, especially SQL solutions in Azure SQL or Databricks environments.

• Experience handling large datasets.

• Proven track record of enhancing data quality within data warehouses.

• Experience in testing ETL solutions using tools like Genie and MS Copilot.

• Familiarity with enterprise architecture modeling tools, frameworks, and methodologies such as TOGAF, SPARX EA, UML, BPMN, and ArchiMate.

• Experience in designing data warehouses using Kimball's dimensional modeling techniques.

• Experience in architecting ETL systems.

• Background in Agile development methodologies.

• Proficient in authoring technical documents and specifications.

• Experience troubleshooting complex software systems.

• Significant experience in implementing data-driven systems with large-scale relational or object-oriented databases.

• Ability to thrive in a high-pressure, results-driven, and deadline-oriented environment.

• Understanding of common system architecture frameworks and concepts.

• Technical knowledge of security and application software development.

• Comfortable working with Microsoft Azure, Azure Databricks, and Azure DevOps Git.

• Exceptional interpersonal, verbal, and written communication skills.

• Willingness to operate in a matrix environment with a strong appreciation for teamwork.

🏝️ Benefits

• Flexibility.

• Opportunities for growth.

• Continuous learning opportunities.

• Exploration of career paths and skill development.

• A team-oriented work environment.