Senior Software Engineer, Data Platform

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop highly dependable data services that integrate with numerous blockchains.

• Create intricate real-time ETL pipelines that process vast amounts of structured and unstructured data.

• Design and structure data models that are optimized for efficient storage, retrieval, and rapid blockchain-data queries.

• Manage the deployment and monitoring of substantial database clusters with an emphasis on performance and high availability.

• Collaborate with data scientists, backend engineers, and product managers to innovate new data models.

• Create scalable self-service automation for database creation, disk scaling, and cluster scaling/updating.

• Identify 80/20 opportunities to expedite deployment and operational timelines.

• Deliver initial “skateboard” projects like observability dashboards and refine them based on stakeholder feedback.

⛳️ Requirements

• A Bachelor's degree (or equivalent) in Computer Science or a related discipline.

• Over 5 years of hands-on experience in architecting distributed system architecture and guiding projects from conception to production deployment.

• Outstanding programming abilities in Python.

• Proficiency in SQL or SparkSQL.

• Experience with data storage solutions and engines such as Iceberg, Trino, BigQuery, StarRocks, and Citus.

• Skilled in data pipeline and workflow orchestration tools like Airflow and DBT.

• Expertise in data processing and streaming technologies, including Spark, Kafka, and Flink.

• Competent in deploying and monitoring infrastructure on public cloud platforms using Docker, Terraform, Kubernetes, and Datadog.

• Capable of loading, querying, and transforming large datasets.

• Applied AI fluency.

• Willingness and ability to participate in on-call duties.

🏝️ Benefits

• Competitive benefits, wellness programs, and time off, tailored according to country and local employment regulations.