Senior System Analyst

This is a fully remote position, open to applicants in Illinois, +4 more states.

📋 Description

• Analyze, design, develop, and support enterprise data management solutions, including Big Data platforms, ETL/ELT pipelines, and data integration processes.

• Collaborate with business stakeholders, data architects, and engineering teams to transform business requirements into functional and technical specifications.

• Conduct system analysis, impact assessments, gap analysis, data mapping, and source-to-target transformation analysis.

• Design, develop, and enhance large-scale data processing solutions utilizing Databricks, Apache Spark, PySpark, Python, Hadoop/HDFS, Hive, and Azure Data Factory.

• Analyze and provide support for Databricks notebooks, Spark jobs, Delta Lake tables, and Lakehouse workflows.

• Design and maintain ADF data ingestion, transformation, and integration pipelines.

• Develop and optimize SQL queries, stored procedures, data transformations, and source-to-target mapping specifications.

• Analyze, develop, and maintain ETL workflows using SSIS and contemporary cloud-based data integration technologies.

• Create and maintain reusable Python, PySpark, and Unix/Linux Shell Scripts.

• Evaluate data integration requirements across databases, APIs, files, cloud storage, and enterprise applications.

• Support batch processing, job scheduling, dependency management, and workflow orchestration utilizing Control-M, ADF, and Databricks Workflows.

• Conduct data profiling, validation, reconciliation, root cause analysis, and troubleshooting activities.

• Optimize Spark jobs, Databricks workloads, SQL queries, and data pipelines to enhance performance, scalability, and reliability.

• Prepare functional specifications, technical design documents, data mapping documents, process flows, and system integration documentation.

• Collaborate with developers, QA teams, Product Owners, Scrum Masters, and architects during development, testing, and releases.

• Participate in Agile/Scrum ceremonies.

• Assist in production deployments, incident investigations, defect resolutions, change management, and post-deployment validation.

⛳️ Requirements

• Over 8 years of experience in Systems Analysis, Data Engineering, Big Data Development, ETL/ELT, or enterprise data integration.

• Strong hands-on experience with Python, PySpark, Apache Spark, SQL, Databricks, and Azure Data Factory (ADF).

• Proven experience in analyzing, designing, developing, and supporting enterprise-scale data processing applications and ETL/ELT pipelines.

• Skilled in gathering business and technical requirements, performing system impact analysis, documenting functional specifications, and developing source-to-target data mappings.

• Hands-on experience with Azure Data Factory for data ingestion, transformation, integration, and workflow orchestration.

• Familiarity with Hadoop/HDFS and Hive.

• Strong SQL skills, including the ability to write complex queries, stored procedures, and perform data transformations, reconciliation, and performance optimization.

• Experience developing, analyzing, and supporting ETL workflows using SSIS.

• Proficiency in Unix/Linux Shell Scripting and Control-M.

• Strong understanding of Delta Lake, Databricks Workflows, Lakehouse architecture, data warehousing, data modeling, and enterprise data integration.

• Experience with data profiling, validation, source-to-target reconciliation, data quality assessments, troubleshooting, and root cause analysis.

• Competence in preparing business requirements, functional specifications, technical documentation, data flow diagrams, and system integration specifications.

• Experience supporting application development, integration testing, UAT, production deployments, and incident resolution.

• Familiarity with Agile/Scrum environments.

• Strong analytical, problem-solving, stakeholder communication, and cross-functional collaboration skills.

• Desired: Experience with Azure cloud services including ADLS Gen2, Azure Synapse Analytics, and Azure DevOps.

• Desired: Knowledge of AWS services including S3, Glue, EMR, Lambda, and Redshift.

• Desired: Experience with Kafka, Airflow, Java/Scala, Git, Jenkins, and CI/CD pipelines.

• Desired: Proficiency in Power BI, SSRS, Tableau, or other enterprise reporting and analytics tools.

• Desired: Familiarity with data governance, metadata management, data lineage, data quality frameworks, and enterprise data management practices.

• Desired: Previous experience supporting large-scale enterprise data platforms in healthcare, insurance, or other regulated industries.

• Successful completion of a background investigation is required for U.S. employment.

🏝️ Benefits

• Competitive compensation including a profit participation program.

• Comprehensive medical, dental, and vision benefits.

• Basic life and accidental death & dismemberment insurance.

• Matching contributions through a 401(k) plan.

• CGI share purchase plan.

• Paid accrued vacation leave, ranging from 10 to 20 days per year.

• 10 paid holidays per year.

• At least 80 consecutive hours of paid sick/safe leave.

• Paid parental leave, ranging from 20 to 70 consecutive business days.

• Bereavement leave, ranging from 1 to 7 days per year.

• Paid jury duty leave, up to the time summoned.

• Learning opportunities and tuition assistance.

• Wellness and well-being programs.