Senior Software Engineering Advisor

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate with business and technical leaders to identify data and reporting requirements.

• Create and document data solutions that fulfill business needs.

• Design and sustain scalable ETL/ELT processes utilizing Spark and PySpark.

• Construct and maintain data models for both business and analytical purposes.

• Compose and enhance Teradata SQL, Hive SQL, and Spark SQL queries along with stored procedures.

• Develop and uphold data pipelines in Databricks and cloud-based environments.

• Establish and manage DevOps deployment processes using Git, Jenkins, and Artifactory.

• Build and oversee job scheduling and orchestration processes in Databricks.

• Supervise production jobs, diagnose problems, and implement effective solutions.

• Support data warehouse and data lake solutions within Databricks.

• Engage in Agile ceremonies including sprint planning, backlog refinement, daily standups, demos, and retrospectives.

• Work collaboratively with team members to enhance data quality, performance, and reliability.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related discipline, or equivalent professional experience.

• Significant experience in development using Spark, PySpark, Teradata, and Databricks.

• Familiarity with Ab Initio.

• Proficient SQL skills, encompassing Teradata SQL, Hive SQL, Spark SQL, and stored procedures.

• Experience in implementing and maintaining data warehouse and data lake solutions.

• Proficiency with DevOps tools such as Git, Jenkins, and Artifactory.

• Understanding of Unix/Linux environments and shell scripting.

• Experience with AWS services like S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch.

• Familiarity with Databricks features such as Delta Lake, Notebooks, Pipelines, Cluster Management, and cloud integrations.

• Experience using Jira and Confluence.

• Background in Agile development settings.

• Strong skills in problem-solving, troubleshooting, and communication.

• Preferred experience in the healthcare sector.

• Preferred experience in leading technical solutions and managing complex data initiatives.

• Ability to work autonomously and juggle multiple priorities in a fast-paced environment is preferred.

• Access to home internet through cable broadband or fiber optic service with minimum speeds of 10Mbps download/5Mbps upload.

🏝️ Benefits

• Eligibility for an annual bonus plan.

• Medical, vision, and dental benefits available from day one.

• Well-being and behavioral health programs offered.

• 401(k) retirement plan.

• Company-sponsored life insurance.

• Tuition reimbursement opportunities.

• A minimum of 18 days of paid time off annually.

• Paid holidays included.

• Leaves of absence provided.

• Arrangement for remote work/home working.

• Requirement for cable broadband or fiber optic internet service with at least 10Mbps download/5Mbps upload for remote work.