Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and enhance batch/streaming ETL workflows utilizing PySpark, SQL, and Delta Lake on the Databricks platform.

• Apply the Medallion architecture (Bronze/Silver/Gold) across various cloud environments.

• Oversee and deploy data resources on AWS, Azure, or GCP.

• Evaluate Spark job performance, optimize SQL efficiency, and automate data validation processes.

• Organize and cleanse extensive enterprise datasets for production machine learning and artificial intelligence applications.

• Partner with prominent enterprise clients to create scalable data platforms, design robust pipelines, and support downstream AI/analytics initiatives.

⛳️ Requirements

• 3+ years of focused experience in Data Engineering.

• Strong expertise in Python, SQL, Databricks, Apache Spark, and Delta Lake.

• Practical experience with data services on AWS, Azure, or GCP.

• Familiarity with data modeling, Git, and basic CI/CD practices.

• Excellent problem-solving abilities and strong client communication skills.

• Databricks Certifications (preferred).

• Experience with Unity Catalog, dbt, or Airflow (preferred).

• Background in consulting or client-facing roles (preferred).

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for continuous learning and professional development.

• Flexible work arrangements and a supportive work environment.

• Comprehensive health and wellness benefits.