Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain enterprise-level data ingestion and transformation pipelines utilizing Azure Data Factory, Databricks, and Apache Kafka.

• Construct and enhance ELT/ETL processes for various data sources.

• Create scalable data solutions that support analytics, reporting, AI/ML, and operational business applications.

• Implement data ingestion frameworks for batch, streaming, and real-time data processing workloads.

• Design and uphold data models, semantic layers, conformed dimensions, and datasets prepared for consumption.

• Assist in the modernization and migration of enterprise data assets into cloud-based Lakehouse architectures.

• Develop and optimize data solutions utilizing Azure cloud services and distributed data processing frameworks.

• Integrate data assets across enterprise systems while ensuring adherence to data lineage and governance standards.

• Implement automated processes for data quality validation, reconciliation, and monitoring.

• Establish controls for data freshness, accuracy, and completeness in line with platform governance requirements.

• Develop Infrastructure as Code (IaC) and automated deployment pipelines for data engineering solutions.

• Implement CI/CD processes for data pipelines and platform services.

• Undertake additional duties as assigned.

• Remotely access customer systems and utilize approved customer-provided communication systems.

• Attend onsite client meetings as required.

⛳️ Requirements

• Over 5 years of experience in developing enterprise data engineering solutions.

• Practical experience with Azure Data Factory (ADF), Azure Databricks, Apache Kafka, Python and/or PySpark, SQL and relational database technologies, and Azure cloud services.

• Proven experience in building and maintaining large-scale ETL/ELT pipelines.

• Strong comprehension of data warehousing, Lakehouse architecture, and distributed data processing.

• Experience in implementing data quality, monitoring, and operational support processes.

• Familiarity with source control tools such as Git and Azure DevOps.

• Solid understanding of Agile software development methodologies.

• Capability to obtain and maintain a Public Trust.

• Eligibility to work in the United States without sponsorship.

• Azure Data Engineer Associate Certification or equivalent cloud certification is highly preferred.

• Strong analytical, troubleshooting, and problem-solving abilities.

• Exceptional verbal and written communication skills.

• Ability to work independently as well as collaboratively within cross-functional Agile teams.

• Experience in supporting large-scale cloud modernization and digital transformation initiatives.

• Active Public Trust is preferred.

🏝️ Benefits

• Comprehensive medical, dental, and vision care.

• Matching 401K and profit-sharing.

• Paid time off.

• Training time for personal development.

• Flexible spending accounts.

• Employer-paid life insurance.

• Employer-paid short and long-term disability coverage.

• Education assistance program with potential merit increases for obtaining work-related certifications.

• Employee recognition programs.

• Referral programs.

• Spot bonuses.

• Additional benefits that provide financial protection for employees and their families.