Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate with leaders in various business units along with the Product, Data & Technology teams to address data-related technical challenges and infrastructure requirements.

• Gather data from primary internal sources and external third-party sources.

• Enhance data architecture, ensure data quality, and guarantee timely delivery of data.

• Extract, load, and transform data into the data lake utilizing Snowflake and Informatica tool suites.

• Construct complex data sets that fulfill both functional and non-functional business needs.

• Automate manual workflows and redesign infrastructure for improved scalability.

• Develop infrastructure for data extraction, transformation, and loading using SQL and ELT tools.

• Configure environments and tools for Informatica Intelligent Cloud Services.

• Design and implement enterprise-level processes to govern platform usage, performance, security, and compliance with audit standards.

• Create analytics tools that provide actionable insights regarding customer acquisition, operational efficiency, and business performance metrics.

• Protect personally identifiable information (PII) data through methods such as table splitting, masking, access controls, and redundancy.

• Develop data tools to support data scientists and members of the analytics team.

• Evaluate the accuracy of data sources and the effectiveness of data-gathering methods.

• Create tools to monitor the performance and accuracy of the data warehouse.

• Mentor junior data professionals, sharing technical expertise and design patterns.

• Engage in stakeholder reviews and design sessions.

• Provide data, reports, and insights to management.

• Monitor technology-related errors and devise cross-functional solutions.

• Enhance policies, procedures, and processes.

• Oversee platform usage, database sizes, compute resources, and costs associated with third-party services.

• Advocate for data transformation and the generation of insights.

• Manage communications and partnerships with senior leaders, managers, and staff, fostering stakeholder relationships.

• Perform additional duties as assigned.

⛳️ Requirements

• A Bachelor’s degree directly related to the position or an equivalent qualification is required.

• A BS in Statistics, Computer Science, Data Science, or a related quantitative field is mandatory.

• A minimum of 3 to 5 years of experience in roles related to Data Engineering is required.

• Proficient in building and optimizing Big Data pipelines, architecture, and data sets.

• Skilled in data loading, processing techniques, and data warehouse design methods, including star or snowflake schema designs.

• Well-versed in Informatica Intelligent Cloud Services, including administration, environment configuration, and tool suite setup.

• Demonstrated expertise in developing with Informatica Intelligent Cloud Services and associated tools.

• Proven experience with best practices regarding data lakes and warehouses, as well as leading marketplace products.

• Expert in creating data integrations using ETL tools and modern data pipelines.

• Strong familiarity with Kafka, Spark, ESB, messaging queues, real-time data integration, and stream processing technologies.

• Experience in querying and analyzing SQL relational databases and NoSQL databases.

• Familiarity with R, Python, Java, Scala, C#, or JavaScript.

• Experience gathering structured, semi-structured, and unstructured data in popular formats from internal systems and third-party sources.

• Proficient with Azkaban, Luigi, Airflow, or similar data pipeline and workflow management tools.

• Experience conducting root cause analysis on both internal and external data and processes.

• Strong analytical, data governance, communication, leadership, interpersonal, and team-building abilities.

• Capable of prioritizing multiple tasks within a deadline-driven environment.

• Ability to think critically and assess facts, data, downstream impacts, and risks.

• A self-starter who is eager to learn and adapt to new technologies and techniques.

• Proficient in Microsoft Office Suite, including Word, Excel, Wiki, collaborative cloud-based applications, and third-party software.

• Commitment to upholding company values.

• Must be available to work Monday through Friday during business hours.

• Must adhere to process protocols and apply established procedures in a timely manner.

🏝️ Benefits

• Medical insurance

• Dental insurance

• Vision insurance

• Life insurance

• AD&D insurance

• LTD insurance

• 401(k) plan with employer matching

• Competitive salary package

• A pleasant working environment

• Limited travel of 5% or less