Senior Data Engineer

📋 Description

• Develop and sustain observability frameworks to track the health, performance, and reliability of data and analytical platforms.

• Deploy tools for real-time monitoring, logging, and alerting to facilitate proactive issue identification and resolution.

• Evaluate system metrics and logs to uncover trends, anomalies, and opportunities for enhancement.

• Create and implement intelligent automation solutions to optimize data and analytical processing workflows and platform operations.

• Generate scripts, tools, and frameworks to automate repetitive tasks and boost system efficiency.

• Work collaboratively with cross-functional teams to pinpoint automation opportunities and execute solutions.

• Ensure the platform's high availability and fault tolerance through effective monitoring and automation strategies.

⛳️ Requirements

• Bachelor's degree from an accredited university or college with at least 2 years of professional experience OR an associate's degree with a minimum of 5 years of professional experience OR a High School Diploma with at least 7 years of professional experience.

• Proficiency in programming languages: Python and Bash scripting.

• Experience with containerization technologies: Docker.

• Familiarity with cloud services: AWS (Lambda, CloudTrail, X-Ray, CloudWatch, S3, IAM).

• Knowledge of observability tools: Prometheus, Grafana, Datadog, FluentBit, ELK stack, OpenSearch.

• Experience with data pipelines: Airflow, Glue, Step Functions.

• Understanding of standards: OpenTelemetry, end-to-end lineage strategy, CDC tooling (AWS DMS, Debezium).

• Experience with databases: SQL, Elasticsearch/OpenSearch stacks.

• Knowledge of infrastructure management: AMI creation, deployment, CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation).

• Note: Military experience is considered applicable to professional experience.

• Eligibility Requirement: Legal authorization to work in the U.S. is mandatory. We will not sponsor individuals for employment visas, either now or in the future, for this position.

🏝️ Benefits

• Comprehensive healthcare benefits including medical, dental, vision, and prescription drug coverage.

• Access to a Health Coach, a 24/7 nurse-based resource.

• Availability of the Employee Assistance Program, which offers 24/7 confidential assessment, counseling, and referral services.

• Retirement benefits feature the GE Retirement Savings Plan.

• A tax-advantaged 401(k) savings option with company matching contributions.

• Access to Fidelity resources and planning consultants.

• Tuition assistance programs.

• Adoption assistance support.

• Paid parental leave policies.

• Disability insurance coverage.

• Life insurance provisions.

• Paid time off for vacation or illness.