Senior Data Engineer

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Work collaboratively with product managers, data scientists, engineering teams, and program management to establish product features, business deliverables, and strategies for data products.

• Partner with business stakeholders, operations, and senior management for daily operational support.

• Assist with operational reporting, self-service data engineering initiatives, production data pipelines, and business intelligence tools.

• Engage with various stakeholders to gather and understand business requirements, evaluate feasibility and impact, and deliver high-quality results on time.

• Design effective solutions and suggest alternative methods when required.

• Manage large data volumes, optimizing database queries and addressing complex technical challenges.

• Contribute to multiple projects and demands concurrently.

• Thrive in a fast-paced, collaborative, and iterative work environment.

• Apply independent judgment in selecting methods and techniques to achieve results.

• Operate within an agile/scrum framework.

• Utilize cutting-edge technologies to acquire, ingest, and transform large datasets.

⛳️ Requirements

• Over 8 years of experience in data engineering or related technical fields, including business intelligence and analytics.

• Comfortable problem-solving in ambiguous and constantly changing environments; possess the determination to excel in dynamic settings, inspiring change and collaborating with diverse individuals and partners.

• Proven experience in designing and constructing scalable and robust data pipelines to facilitate data-driven decision-making.

• Strong understanding of the complete software development life cycle.

• Solid grasp of data warehousing concepts and methodologies.

• Expertise in building data pipelines and ETL methodologies.

• Proficiency in creating high-volume data workflows within a cloud environment.

• Experience in developing data warehouse and business intelligence projects.

• Skills in data cleansing, validation, and wrangling.

• Practical experience with AWS cloud and AWS-native technologies such as Glue, Lambda, Kinesis, Lake Formation, S3, and Redshift.

• Familiarity with Spark EMR, RDS, EC2, Athena, API capabilities, CloudWatch, and CloudTrail is advantageous.

• Experience with business intelligence tools like Tableau, Cognos, and ThoughtSpot.

• Knowledge of relational databases such as DB2, Oracle, Redshift, and Snowflake.

• Proficient in SQL, PL/SQL, NoSQL, relational databases (RDBMS), and dimensional modeling concepts.

• Hands-on experience in developing complex business logic and ETL/ELT workflows using Informatica IICS or similar tools, AWS pipelines, Snowpipe, streaming solutions like Kafka, and other industry-standard tools and processes is preferred.

• Proficient in scripting languages such as Python and/or Unix scripting.

• Excellent verbal and written communication abilities.

• Exhibit integrity and maturity with a constructive approach to challenges.

• Demonstrate strong analytical and problem-solving skills, especially in Data Warehouse and Big Data environments.

• Open-minded, solution-oriented, and a strong team player.

• Enthusiastic about programming and learning new technologies, focused on personal and team skill improvement.

• Strong problem-solving and analytical capabilities.

• Ability to manage multiple projects and report effectively across various stakeholders.

• High attention to detail and accuracy.

🏝️ Benefits

• Annual allocation of complimentary hotel stays at Hyatt locations worldwide.

• Flexible working hours.

• Work-life benefits including wellness initiatives such as a free Headspace subscription and discounts at the on-site fitness center.

• A global family assistance policy offering paid time off following the birth or adoption of a child, along with financial support for adoption.

• Paid time off, medical, dental, vision, and a 401(k) plan with company matching.