Senior Data Engineer – Snowflake

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Accountable for the expansion and enhancement of our data and data pipeline infrastructure.

• Streamlining data flow and collection processes for cross-functional teams.

• Assist our product owners, product analysts, data analysts, and data scientists with data-related initiatives.

• Ensure that the architecture for optimal data delivery is maintained consistently throughout ongoing projects.

• Collaborate with business stakeholders to clarify requirements and connect them to solutions, which includes setting up prototypes and involving multiple parties in design discussions.

• Develop frameworks for data collection, extraction, and transformation for both structured and unstructured data.

• Build and sustain data infrastructure systems (e.g., data warehouses), including data access points.

• Prepare and manipulate data using a variety of integration and pipeline tools, including but not limited to Talend, SQL, Snowflake, Kafka, and Azure Data Factory.

• Create efficient loading processes that include logging, exception handling, notifications for support, and overall operational visibility.

• Structure data into formats that enhance reuse and facilitate efficient delivery to business and analytics teams as well as system applications.

• Integrate data across data lakes, data warehouses, and systems applications to ensure consistent information delivery across the enterprise.

• Responsible for effective architecture and system design.

• Develop and refine the data service layer, engaging the team to assemble components for a premier customer offering.

⛳️ Requirements

• A Bachelor’s degree is required; a Master’s degree is a plus, in Software Engineering, Computer Science, or equivalent experience in a technology or business setting.

• At least 7 years of experience in developing and implementing structured work processes in data engineering.

• Minimum of 7 years of experience in developing integration solutions with data integration tools (e.g., Talend, Azure Data Factory).

• A minimum of 3 years of experience with real-time data streaming tools such as Kafka or similar technologies.

• Familiarity with cloud platforms including Azure, AWS, or GCP.

• Experience with data warehousing platforms like Snowflake or Databricks.

• High proficiency in SQL, Python, and other programming languages.

• Strong expertise in data management, governance, data design, and database architecture.

• Documented success in manipulating, processing, and deriving value from large, disparate datasets.

• Competence in data modeling and data architecture with experience in WhereScape RED/3D being an asset.

• Familiarity with big data tools such as Hadoop, Spark, and Kafka.

• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

• Proficient in data pipeline and workflow management tools like Azkaban, Luigi, and Airflow.

• Knowledge of AWS cloud services including EC2, EMR, RDS, and Redshift.

• Experience with stream-processing systems such as Storm and Spark-Streaming.

• Proficiency in object-oriented/function scripting languages like Python, Java, C++, Scala, etc.

• Highly skilled in data modeling, data integrations, data orchestration, and supporting methodologies.

• Proven ability to lead large-scale projects or significant project phases, effectively communicating progress and strategies with both technical and non-technical peers and leaders.

• Highly skilled in multiple programming languages and coding practices.

• Excellent capability to design and engineer moderately complex enterprise solutions.

• Familiar with message queuing, stream processing, and highly scalable ‘big data’ data stores.

• Strong project management and organizational abilities.

🏝️ Benefits

• Enjoy the flexibility and freedom to work from anywhere.

• Receive compensation in USD that aligns with your expertise.

• Recharge with dedicated paid time off for relaxation.

• Propel your career forward with fully funded international certifications.

• Access coworking spaces globally whenever you need a professional environment.

• Enhance your English skills while broadening your international network.

• Participate in engaging activities that connect our global team.

• Feel valued with personalized gifts and a thoughtful welcome kit.

• Help grow our community and earn rewards through our referral program.