Junior Data Engineer – Azure Databricks

This is a fully remote position, open to applicants in India, +1 more country.

📋 Description

• Assist in the enhancement and maintenance of current SQL Server data platforms and ETL solutions.

• Design and manage data pipelines utilizing Azure Databricks.

• Construct and refine data transformations with PySpark and SQL within Databricks.

• Create ETL/ELT pipelines coordinated through Azure Data Factory.

• Consolidate data from various sources into the data platform and analytical layers.

• Oversee data models and data warehouse structures for analytics purposes.

• Guarantee data quality, scalability, and efficiency of extensive data processing pipelines.

• Work collaboratively with BI teams to enhance Power BI and reporting platforms.

• Engage in the implementation of modern cloud-based data architectures under the mentorship of senior team members.

⛳️ Requirements

• A minimum of 2 years of experience in Data Engineering, Data Warehouse development, or a similar field.

• Proficiency with Azure Databricks.

• Demonstrated experience in developing data pipelines using PySpark and Spark SQL.

• Strong understanding of distributed data processing and big data principles.

• Solid SQL skills.

• Familiarity with SQL Server relational databases.

• Proven experience in constructing data pipelines utilizing Azure Data Factory.

• Exposure to data processing and performance enhancement methodologies.

• Knowledge of Spark optimization strategies (like partitioning, caching, and cluster tuning) is a plus.

• Experience with Power BI and Databricks Structured Streaming is a plus.

• Background in transitioning traditional ETL processes to cloud infrastructures is a plus.

• Understanding of Delta Lake and Lakehouse architectures is a plus.

• Strong analytical and problem-solving abilities.

• Effective communication and collaboration skills.

• A team player with a proactive approach.

• Enthusiasm for learning and continuously enhancing technical skills.

• Ability to adapt and thrive in dynamic environments.

🏝️ Benefits

• Comprehensive health insurance.

• Language courses.

• Relocation assistance program.

• Flexibility for remote work (ForeverRemote work culture).

• Opportunities for professional growth and development.

• Access to certification programs.

• Mentorship and talent investment initiatives.

• Internal mobility options.

• Internship opportunities available.

• Collaboration on significant projects for leading global clients.

• A welcoming and supportive work environment.

• Regular company social events for team building.