This is a fully remote position, open to applicants in Florida, +9 more states.

• Design, construct, and sustain scalable data pipelines utilizing Databricks, Apache Spark, and Delta Lake.

• Create and oversee ETL/ELT workflows for the extraction, transformation, and loading of data from various source systems.

• Monitor and troubleshoot issues related to scheduled data movement jobs.

• Contribute to the design of data models and architecture for data lakes and warehouses.

• Provide guidance on architecture and platform choices that support reporting and analytics.

• Integrate data solutions with Azure, AWS, GCP, and other relevant cloud services.

• Implement data quality assurance checks, monitoring, and governance practices.

• Establish and maintain CI/CD pipelines to automate deployments and enhance workflows.

• Collaborate with business analysts and stakeholders to define data requirements and deliver actionable insights.

• Demonstrated experience in data engineering and cloud-based development.

• 3-5 years of experience in a comparable position.

• Proficiency in Databricks and its broader ecosystem, including Databricks SQL, Delta Lake, and Databricks Runtime.

• Skilled in SQL, Python, and Apache Spark.

• Familiarity with Azure, AWS, or GCP.

• Strong comprehension of data modeling, ETL/ELT processes, and data warehousing principles.

• Experience with CI/CD tools and methodologies.

• Exceptional problem-solving, analytical, and communication abilities.

• Willingness to acquire new skills and step in as needed to deliver results.

• Bachelor’s Degree in Information Systems, Computer Science, or a related field, or equivalent professional experience.

• Pro Mach utilizes E-Verify to confirm the employment eligibility of all new hires in the United States.

• Drug-free workplace.

• Competitive salary.

• Comprehensive medical and dental insurance programs.

• Life insurance coverage.

• Generous paid time off policy.

• Retirement savings plan with company matching contributions.

• Immediate eligibility for benefits starting on the first day of employment.

• Opportunities for professional growth.

• Open and communicative environment that encourages individual initiative.

Data Engineer

People also viewed