Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Implement the organization's data strategy and analytical initiatives within the enterprise data platform.

• Enhance and streamline the architecture of data and data pipelines.

• Improve data flow and collection processes across various functional areas.

• Collaborate with business unit leaders and the Product, Data & Technology teams on technical data issues and infrastructure requirements.

• Gather data from primary sources, refine data architecture, enhance data quality, and ensure timely delivery.

• Extract, load, and transform data from both internal and external sources into the data lake utilizing Snowflake and Informatica.

• Construct complex datasets that fulfill both functional and non-functional business needs.

• Automate manual workflows and enhance infrastructure scalability.

• Develop infrastructure for data extraction, transformation, and loading utilizing SQL and ELT tools.

• Configure environments and tools within Informatica Intelligent Cloud Services.

• Design and execute enterprise processes that govern platform usage, performance, security, and audit compliance.

• Create analytical solutions that provide insights into revenue, operational efficiency, and expense metrics.

• Safeguard personally identifiable information through table splitting, masking, access controls, and redundancy measures.

• Develop data tools for data scientists and members of the analytics team.

• Evaluate the accuracy of data sources and the effectiveness of data collection methods.

• Create tools and processes to monitor the performance and accuracy of the data warehouse.

• Mentor less experienced data professionals, sharing technical expertise and design patterns.

• Facilitate stakeholder reviews and design sessions.

• Provide data, reports, and insights to management.

• Identify technology-related trends and issues, developing solutions across functions.

• Address high-level challenges and contribute to decisions regarding technology direction.

• Oversee platform usage, database sizes, compute resources, and costs associated with third-party services.

• Advocate for data transformation and the generation of insights.

• Manage communications and partnerships with senior leaders, managers, and staff.

• Perform additional duties as assigned.

⛳️ Requirements

• Bachelor's Degree in Statistics, Computer Science, Data Science, or a related quantitative discipline is required.

• A minimum of five to seven years of experience in Data Engineer-related roles.

• At least three years in a senior technical-level position is essential.

• Highly skilled in building and optimizing Big Data pipelines, architecture, and datasets.

• Proficient in data loading, processing, and data warehouse design techniques, including star or snowflake schema designs.

• Well-versed in the administration, configuration, and setup of Informatica Intelligent Cloud Services.

• Proven experience in developing with Informatica Intelligent Cloud Services and associated tools.

• Solid knowledge of best practices for data lakes and warehouses as well as leading marketplace products.

• Expertise in creating data integrations utilizing ETL tools and modern data pipelines.

• Strong understanding of Kafka, Spark, ESB, and/or other messaging queues, as well as real-time data integration and stream processing technologies.

• Experience in querying and analyzing SQL relational databases and NoSQL databases.

• Proficiency in R, Python, Java, Scala, C#, or JavaScript.

• Experience in collecting structured, semi-structured, and unstructured data from internal systems and third-party providers.

• Familiarity with Azkaban, Luigi, Airflow, or similar data pipeline and workflow management tools.

• Experience in conducting root cause analysis on both internal and external data and processes.

• Strong analytical, data governance, and problem-solving abilities.

• Capability to prioritize multiple tasks in a deadline-driven environment.

• Exceptional attention to detail and organizational skills.

• Ability to lead effectively in a matrixed management environment.

• Capacity to think critically and evaluate downstream impacts and risks.

• Excellent verbal and written communication skills.

• Strong leadership, interpersonal, and team-building competency.

• Willingness to learn and adapt to new technologies and techniques.

• Proficient in Microsoft Office Suite, Word, Excel, Wiki, collaborative cloud-based programs, and third-party software applications.

• Commitment to the company's values.

• Ability to work a Monday-Friday business-week schedule.

• Willingness to travel 5% or less.

• Capacity to perform sedentary office work and frequent keyboard/mouse usage.

• Ability to learn tasks, maintain focus, complete work independently, make timely decisions, and adhere to established protocols.

🏝️ Benefits

• Medical insurance

• Dental insurance

• Vision insurance

• Life insurance

• AD&D insurance

• LTD insurance

• 401(k) with employer match

• Pleasant work environment

• Competitive compensation