Senior Data Engineer – Agentic Development focus

This is a fully remote position, open to applicants in Spain, +1 more country.

📋 Description

• Design, develop, and maintain data pipelines, utilizing AI agents for code generation.

• Create algorithms that convert data into actionable insights.

• Analyze data to uncover issues and establish the logic for intricate functions and scripts.

• Oversee and validate AI-generated solutions to ensure adherence to standards, emphasizing simplicity, performance, and maintainability.

• Take ownership of data modeling and quality, serving as the expert behind the AI that delivers results.

• Investigate new data sources and incorporate them into data products.

• Collaborate with CI/CD processes for data, along with data testing and monitoring.

• Develop prototypes and documentation detailing key aspects of the work.

• Work on data models, ETL pipelines, and services for a major multinational client in the financial sector.

• Establish and contribute to a robust agentic development framework.

⛳️ Requirements

• You possess a bachelor’s, master’s, or Ph.D. in mathematics, statistics, physics, engineering, or other quantitative disciplines.

• You have substantial hands-on experience with dbt and SQL, which are our primary data transformation tools on Databricks.

• You either have experience with or a keen interest in AI-driven/agentic development and are adept at directing and validating AI-generated code rather than manually coding.

• You can establish and contribute to an efficient agentic framework.

• You have demonstrated proficiency in Python programming (PySpark knowledge is a plus).

• You possess a software development background with an understanding of design patterns and unit testing, allowing you to review and validate AI-generated code effectively.

• You have verified experience with CI/CD processes for data, as well as data testing and monitoring.

• You exhibit excellent communication skills (verbal and written), capable of explaining complex technical concepts and results clearly and in detail to non-technical audiences.

• You have a strong foundation in data modeling, data quality, and data architecture principles.

• You possess knowledge of system design, data structures, algorithms, storage systems, and cloud infrastructure.

• Experience working on agile projects and familiarity with agile collaboration tools (e.g., Jira, Confluence) is a plus.

• Previous experience in the insurance/reinsurance or financial sectors is advantageous.

• You are a proficient communicator in English (B2/C1 level).

🏝️ Benefits

• Competitive compensation package with potential bonuses based on company and individual performance.

• Flexible remote work options that promote a healthy work-life balance.

• Access to courses, workshops, and conferences to facilitate ongoing learning and development.

• Health insurance coverage.

• Support and constructive feedback for professional advancement.

• Team-building activities.

• A dynamic and agile work environment.