Software Integrations Developer

This is a fully remote position, open to applicants in India.

📋 Description

• Design and execute comprehensive data pipelines (both batch and streaming) utilizing Azure Data Factory / Synapse Pipelines and Databricks.

• Create scalable ETL/ELT workflows leveraging PySpark, SQL, and Databricks notebooks.

• Develop and enhance data ingestion frameworks to integrate data from various enterprise and external sources.

• Spearhead the design and deployment of a Databricks-based lakehouse architecture.

• Improve Spark job performance, scalability, and cost efficiency.

• Implement data versioning, incremental processing, while ensuring high standards of data quality.

• Leverage Azure services to construct secure and scalable data solutions.

• Collaborate closely with business stakeholders and technical teams to interpret and translate requirements.

⛳️ Requirements

• Over 5 years of experience in Data Engineering / Data Platform development.

• More than 3 years of practical experience with Azure Databricks.

• Extensive experience with Azure Data Factory, ADLS Gen2, and Synapse Analytics.

• Demonstrated experience in building enterprise-scale data pipelines.

• Practical experience in developing application and API integrations utilizing Azure Functions, Logic Apps, and Azure API Management.

• Familiarity with Agile/Scrum methodologies and the complete SDLC lifecycle.

• Strong expertise in Python (PySpark) and SQL.

• Comprehensive understanding of ETL/ELT design patterns.

• Expert-level proficiency with Azure Data Factory / Synapse Pipelines and Azure Data Lake Storage.

• Practical experience in designing integration and API solutions.

🏝️ Benefits

• Opportunities for professional development.

• Chance to lead and influence the organization’s modern data platform strategy.

• Significant ownership and opportunities for technical growth.