
Software Integrations Developer
Posted 1 hour ago

Posted 1 hour ago
This is a fully remote position, open to applicants in India.
• Design and execute comprehensive data pipelines (both batch and streaming) utilizing Azure Data Factory / Synapse Pipelines and Databricks.
• Create scalable ETL/ELT workflows leveraging PySpark, SQL, and Databricks notebooks.
• Develop and enhance data ingestion frameworks to integrate data from various enterprise and external sources.
• Spearhead the design and deployment of a Databricks-based lakehouse architecture.
• Improve Spark job performance, scalability, and cost efficiency.
• Implement data versioning, incremental processing, while ensuring high standards of data quality.
• Leverage Azure services to construct secure and scalable data solutions.
• Collaborate closely with business stakeholders and technical teams to interpret and translate requirements.
• Over 5 years of experience in Data Engineering / Data Platform development.
• More than 3 years of practical experience with Azure Databricks.
• Extensive experience with Azure Data Factory, ADLS Gen2, and Synapse Analytics.
• Demonstrated experience in building enterprise-scale data pipelines.
• Practical experience in developing application and API integrations utilizing Azure Functions, Logic Apps, and Azure API Management.
• Familiarity with Agile/Scrum methodologies and the complete SDLC lifecycle.
• Strong expertise in Python (PySpark) and SQL.
• Comprehensive understanding of ETL/ELT design patterns.
• Expert-level proficiency with Azure Data Factory / Synapse Pipelines and Azure Data Lake Storage.
• Practical experience in designing integration and API solutions.
• Opportunities for professional development.
• Chance to lead and influence the organization’s modern data platform strategy.
• Significant ownership and opportunities for technical growth.
Horizon Hobby
IQVIA
Bart & Associates, Inc.
Socure
Get handpicked remote jobs straight to your inbox weekly.