GCP Data Engineer – Lead Consultant

📋 Description

• You will join a team responsible for the design, modeling, and development of a comprehensive GCP data ecosystem for one of our clients, which includes Cloud Storage, Cloud Functions, and BigQuery.

• Your engagement will span the entire process, starting from gathering, analyzing, modeling, and documenting business and technical requirements, requiring direct interaction with clients.

• You will model data from various sources and technologies while troubleshooting and resolving complex, high-impact issues to deliver new features and functionalities.

• You will design and optimize data storage architectures, including data lakes, data warehouses, and distributed file systems. This includes implementing techniques like partitioning, compression, and indexing to enhance data storage and retrieval. Additionally, you will identify and rectify bottlenecks, optimize queries, and apply caching strategies to improve data retrieval speed and overall system efficiency.

• Your role will involve identifying and addressing issues related to data processing, storage, or infrastructure. You will monitor system performance, detect anomalies, and conduct root cause analyses to ensure seamless data operations.

• You will be responsible for training and mentoring junior data engineers, facilitating knowledge transfer and guidance.

⛳️ Requirements

• A minimum of 7 years of experience as a Data Engineer with expertise in GCP cloud-based infrastructure and systems.

• Profound knowledge of Google Cloud Platform and its cloud computing services.

• Significant experience in designing, building, and deploying data pipelines in the cloud, including data ingestion from various sources such as databases, APIs, or streaming platforms.

• Proficient in database management systems, particularly SQL (BigQuery is essential) and NoSQL. The ideal candidate should be capable of designing, configuring, and managing databases to ensure optimal performance and reliability.

• Strong programming skills in SQL, Python, and other scripting languages.

• Expertise in data modeling techniques and database optimization, with necessary knowledge in query optimization, indexing, and performance tuning for efficient data retrieval and processing.

• Familiarity with at least one orchestration and scheduling tool, with Airflow being a requirement.

• Experience with data integration tools and techniques, such as ETL and ELT, with the ability to integrate data from multiple sources and transform it into an analyzable format.

• Understanding of modern data transformation tools like DBT and Dataform.

• Excellent communication skills for effective collaboration with cross-functional teams, including data scientists, analysts, and business stakeholders. Ability to articulate technical concepts clearly to non-technical stakeholders.

• Capability to actively participate in or lead discussions with clients to identify and evaluate concrete and ambitious opportunities for improvement.

• Familiarity with tools such as Git, Jira, Confluence, etc.

• Willingness to learn new technologies and solutions.

• Experience working in a multinational environment with distributed teams.

🏝️ Benefits

• Stable employment with a presence in the market since 2008, currently employing over 1500 talents across 7 global locations.

• Option to work remotely or in-office, depending on your location, following the “Office as an option” model.

• Flexibility in working hours and the choice of your preferred contract format.

• Comprehensive online onboarding program with a “Buddy” assigned from day one.

• Opportunity to collaborate with top-tier engineers and experts.

• Unlimited access to the Udemy learning platform from the first day.

• Certificate training programs, with Lingarians earning over 500 technology certificates annually.

• Support for upskilling through capability development programs, Competency Centers, knowledge-sharing sessions, community webinars, and over 110 training opportunities each year.

• Access to an internal Gallup Certified Strengths Coach for personal growth support.

• Opportunities for career advancement, as 76% of our managers are promoted from within.

• A diverse, inclusive, and values-driven community.

• Autonomy in choosing your work style, as we trust your ideas.

• Collaboration in building our community together, with referral bonuses for recommending friends.

• Activities aimed at supporting your well-being and health.

• Numerous opportunities to donate to charities and contribute to environmental initiatives.

• Modern office equipment available for purchase or borrowing, depending on your location.