IT Data Warehouse Engineer

📋 Description

• Responsible for creating batch integration solutions for ABC Supply.

• This role encompasses traditional data warehousing tasks and large nightly extracts that are pre-scheduled.

• Design and develop data models utilizing star schema and snowflake methodologies.

• Construct ADF pipelines to source new data from diverse origins.

• Develop Data Bricks notebooks for data transformation processes.

• Document all solutions as necessary, adhering to ABC's standard documentation practices.

• Plan, review, and execute the implementation of database modifications for integration and data warehousing tasks.

• Maintain integration documentation and auditing tools.

• This includes the development and updating of the integration dashboard.

• Collaborate with the BI team and Product Owner to create necessary tables and transform data for loading into Snowflake.

• Provide support for database and database servers as part of the Data Management team.

• Work alongside project management and business analysis teams to provide estimates and ensure thorough documentation of all requirements.

• Create logical layers (database views) for end-user access to data within database systems.

• Partner with functional support and help desk teams to ensure effective communication, collaboration, and compliance with ABC’s support process standards.

• Execute data management tasks as required.

⛳️ Requirements

• A Bachelor's Degree in Computer Science or a related discipline is mandatory.

• A high school diploma and/or an equivalent combination of education and work experience may be accepted as a substitute.

• At least 7 years of relevant development experience in data warehousing and various ELT or ETL tools.

• Preferred experience with Data Bricks, Azure, and ADF (Azure Data Factory).

• A minimum of 5 years of experience in constructing database tables and models.

• Must be proficient in writing complex SQL for DDL and DML operations.

• Hands-on experience with Python, Pyspark, and Spark SQL is required.

• Strong comprehension of enterprise integration patterns (EIP) and data warehouse modeling is essential.

• Experience in requirements gathering, analysis, and design for development and data warehousing.

• Strong business acumen with a consistent display of forward-thinking capabilities.

• Eager and proactive in exploring new technologies.

• Ability to work effectively with ambiguous or incomplete information.

• Must possess a solid understanding of technical infrastructure, protocols, and networks.

• Significant experience with various hardware and software environments, comfortable in heterogeneous systems.

• Ability to work routinely with minimal to no supervision.

• Capability to efficiently manage multiple and shifting priorities.

🏝️ Benefits

• Health, dental, and vision insurance coverage.

• Employer-paid life insurance.

• 401(k) plan with a generous company match.

• Flexible spending options.

• Paid time off.

• Paid holidays.