
Senior Data Engineer, English
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Brazil.
β’ Engage with technical developers and business leaders, cultivating respect and trust among team members and management.
β’ Implement and actively integrate Data Foundation initiatives to bolster core business programs, providing guidance on technology and utilizing leading, industry-standard tools.
β’ Oversee the processes for change management, incident management, and problem management.
β’ Guarantee traceability of requirements β from data through testing and scope adjustments to training and transition.
β’ Enhance implementation efficiency and effectiveness in pilot projects and future initiatives to reduce costs, speed up deployment, and maximize value delivery.
β’ Proven experience in developing ETL/data warehouse processes utilizing Azure services, specifically Azure Data Factory and Databricks.
β’ Practical expertise with Azure Storage, Azure Synapse Analytics, Azure Data Lake, Azure Analysis Services, and Azure Cosmos DB.
β’ Proficient in programming languages such as Python, Scala, and Spark SQL, along with the ability to use PowerShell or the Azure CLI for automation purposes.
β’ Strong understanding of SQL, data sources, and experience in integrating Microsoft services with third-party platforms.
β’ Design, implement, and maintain scalable data pipelines for ingestion, processing, and transformation within the Azure environment.
β’ Capability to optimize, monitor, and troubleshoot data pipelines for enhanced performance, availability, and cost-effectiveness.
β’ Familiarity with Azure DevOps for CI/CD and automation, including scripting and deployment tools.
β’ Previous experience in designing integrated, high-performance data pipelines across various data sources in enterprise settings.
β’ Experience in developing scalable, reusable frameworks for data ingestion and enhancement in big data initiatives.
β’ Project management, stakeholder engagement, and delivery skills to mitigate risks and ensure timely, high-quality outcomes.
β’ Proficient in English (advanced professional working proficiency).
β’ We promote an inclusive culture.
β’ We appreciate diversity in all its dimensions.
Akka (formerly Lightbend)
Swimlane
Get handpicked remote jobs straight to your inbox weekly.