Data Engineer

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Create and manage scalable ETL workflows while automating data transformations.

• Design and oversee cloud-native data pipelines along with containerized applications.

• Automate the provisioning of infrastructure and enhance DevOps processes.

• Extract and analyze enterprise data from SAP systems for analytical purposes.

• Develop high-performance pipelines for data ingestion and transformation.

⛳️ Requirements

• A Master’s degree in Computer Science, Engineering, or a related discipline, accompanied by 6 years of relevant experience.

• Prior experience must encompass designing and maintaining scalable ETL workflows, automating data transformations, and orchestration utilizing Airflow, DBT, Wherescape, along with scripting languages such as Python, SQL, and shell scripting, while leveraging cloud services like AWS Lambda and S3.

• Architect and manage cloud-native data pipelines and containerized applications to guarantee high availability and scalability, utilizing AWS, Kubernetes, and FastAPI for developing lightweight, data-focused applications and microservices.

• Streamline DevOps processes and automate infrastructure provisioning using infrastructure-as-code and CI/CD tools, including Terraform, GitHub Actions, and Bitbucket.

• Extract and process enterprise data from SAP systems employing ABAP variants, custom logic, and file-based integrations, facilitating downstream analytics in platforms like Snowflake and Databricks while collaborating closely with SAP functional teams to align data extraction with business needs.

• Construct high-performance data ingestion and transformation pipelines for large-scale analytics and real-time data processing using Kafka and Apache Spark on Databricks.

🏝️ Benefits

• To learn about Grainger’s benefits, please visit: Grainger Benefits.