Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Accountable for enhancing and optimizing our data architecture and data pipeline.

• Provide support to our software developers, database architects, data analysts, and data scientists in data-related initiatives.

• Design and maintain an efficient data pipeline architecture.

• Compile large, intricate data sets that fulfill both functional and non-functional business needs.

• Recognize, design, and execute improvements to internal processes.

• Establish the necessary infrastructure for optimal data extraction, transformation, and loading.

• Develop analytical tools that leverage the data pipeline.

• Collaborate with stakeholders, including Executive, Product, Data, and Design teams, to resolve data-related technical challenges.

• Build data tools for the analytics and data science teams.

⛳️ Requirements

• Over 5 years of experience in a Data Engineer position.

• Proficiency with both relational SQL and NoSQL databases, such as Postgres, Oracle, and Cassandra.

• Familiarity with data pipeline and workflow management solutions.

• Experience with AWS cloud services including S3, EC2, EMR, RDS, and Redshift.

• Knowledge of stream-processing systems such as Storm, Spark-Streaming, and Amazon Kinesis.

• Proficiency in object-oriented or functional scripting languages like Python, Java, and NodeJs.

• Experience in building and optimizing 'big data' pipelines, architectures, and datasets.

• Strong analytical abilities related to managing both structured and unstructured datasets.

• Proven track record of manipulating, processing, and deriving value from large, disparate datasets.

• Working knowledge of message queuing, stream processing, and highly scalable 'big data' storage solutions.

• Excellent project management and organizational skills.

🏝️ Benefits

• Options for remote work.

• Equal Opportunity Employer - Minority/Female/Disability/Veteran/Current Unemployment Status.