Junior Data Engineer, Azure Databricks

This is a fully remote position, open to applicants in India, +1 more country.

📋 Description

• Assist in enhancing and maintaining current SQL Server data platforms and ETL solutions.

• Create and oversee data pipelines utilizing Azure Databricks.

• Construct and refine data transformations with PySpark and SQL within Databricks.

• Design ETL/ELT pipelines managed through Azure Data Factory.

• Integrate data from various sources into the data platform and analytical layers.

• Uphold data models and data warehouse structures for analytics purposes.

• Ensure data quality, scalability, and performance for extensive data processing pipelines.

• Work alongside BI teams to support Power BI and reporting platforms.

• Engage in the implementation of modern cloud-based data architectures under the guidance of senior team members.

⛳️ Requirements

• A minimum of 2 years of experience in Data Engineering, Data Warehouse development, or a related discipline.

• Proficiency with Azure Databricks.

• Experience in developing data pipelines utilizing PySpark and Spark SQL.

• Understanding of distributed data processing and big data principles.

• Strong SQL skills and experience with SQL Server relational databases.

• Background in building data pipelines with Azure Data Factory.

• Familiarity with data processing and performance optimization concepts.

• Knowledge of Spark optimization strategies (such as partitioning, caching, and cluster tuning) is a plus.

• Exposure to Power BI and Databricks Structured Streaming is advantageous.

• Experience in transitioning from traditional ETL processes to cloud architectures is preferred.

• Familiarity with Delta Lake and Lakehouse architectures is a plus.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• A team player with a proactive attitude.

• Willingness to learn and continually enhance technical skills.

• Adaptable and comfortable in dynamic work environments.

🏝️ Benefits

• Health insurance.

• Language courses.

• Relocation program.

• Remote work flexibility (ForeverRemote work culture).

• Opportunities for professional development.

• Certification programs.

• Mentorship and investment in talent programs.

• Internal mobility options.

• Internship opportunities.

• Collaboration on significant projects for leading global clients.

• An inclusive and supportive workplace environment.

• Regular team-building social events.