Mid–Senior Databricks Developer

This is a fully remote position, open to applicants in Texas.

📋 Description

• Design, develop, and maintain scalable data pipelines and ETL workflows utilizing Databricks.

• Construct and enhance Delta Lake architectures and data models.

• Create high-quality, reusable Python code for data processing and automation tasks.

• Write and optimize intricate SQL queries for extensive datasets.

• Implement and oversee solutions on Microsoft Azure, including Azure Data Lake and Azure Data Factory.

• Collaborate with data engineers, analysts, and business stakeholders to comprehend requirements and deliver superior solutions.

• Ensure data quality, reliability, and performance throughout all pipelines.

• Diagnose production issues and conduct root-cause analysis.

• Adhere to best practices concerning version control, CI/CD, and cloud security.

• Analyze data and facilitate digital transformation initiatives to help identify and address business gaps.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline (minimum requirement).

• 8–10+ years of experience in data engineering or software development.

• Strong practical experience with Databricks, encompassing notebooks, jobs, clusters, and Delta Lake.

• Advanced proficiency in Python for data engineering tasks.

• Strong expertise in SQL, including performance tuning capabilities.

• Solid experience with Microsoft Azure cloud services.

• Experience with large-scale distributed data systems.

• Strong problem-solving abilities and capacity to work independently.

• Familiarity with CI/CD tools (Azure DevOps, GitHub Actions) is preferred.

• Knowledge of Spark performance optimization is preferred.

• Experience with data governance and security frameworks is preferred.

• Familiarity with Agile methodologies is preferred.

• Experience working in structured environments with established standards, methodologies, and governance processes is preferred.

• Local candidates only for Lansing, Michigan.

🏝️ Benefits

• Remote work option.

• Contract employment.