Cloud Architect

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design and establish robust Lakehouse and Medallion architectures encompassing Bronze, Silver, and Gold layers.

• Ensure the creation of reliable data pipelines that are production-ready.

• Troubleshoot, monitor, and optimize large-scale Apache Spark jobs utilizing caching, partitioning, and broadcast joins.

• Develop and implement unified governance models for enterprise data and AI assets through Unity Catalog.

• Enforce role-based access control, along with row-level and column-level security, while ensuring comprehensive data lineage.

• Integrate Databricks into AWS, Azure, or GCP cloud ecosystems.

• Set up virtual networks and IAM roles, including ADLS/Entra and S3/IAM.

• Monitor and enhance Databricks Units (DBUs).

• Optimize serverless and multi-node clusters for efficiency.

• Apply strategies to manage cloud costs effectively and maximize return on investment.

• Leverage Delta Lake for ACID transactions, schema enforcement, time travel, Z-ordering, and advanced optimization.

⛳️ Requirements

• 5+ years of demonstrated experience as a Cloud Architect, Principal Data Engineer, or a similar position with a strong emphasis on modern cloud data architectures and distributed computing.

• In-depth understanding of Databricks, Apache Spark internals, and the Lakehouse Platform.

• Advanced proficiency in SQL.

• Expert-level programming abilities in Python or Scala.

• Strong knowledge of native cloud ecosystems (AWS, Azure, or GCP) concerning networking, storage, and security.

• Resilience, emotional intelligence, and a commitment to agile delivery in high-stakes data environments.

• Comprehensive understanding of designing scalable, secure, and cost-effective distributed systems.

• Advanced proficiency in Oral English.

• Advanced proficiency in Spanish.

• Valid Databricks Certified Data Architect or Databricks Certified Data Engineer Professional badges are highly preferred.

• Experience in building, deploying, and monitoring GenAI applications and ML models using Databricks Model Serving, Vector Search, and the Mosaic AI suite is desired.

• Experience in automating Databricks workflows using Git (Databricks Repos) and orchestration tools like dbt, Azure Data Factory, or Apache Airflow is desired.

• Familiarity with Databricks Structured Streaming and Auto Loader is desired.

• Understanding of Databricks SQL, Serverless Warehouses, and integration with downstream BI tools such as Power BI is desired.

• Familiarity with cloud-native foundations or AI coding assistants is desirable.

🏝️ Benefits

• Fully remote work environment.

• Opportunities for global career advancement and engagement with high-impact projects within an international network of expertise.

• Involvement in end-to-end digital transformation projects for leading global organizations.

• Work for a company recognized as one of the most sustainable corporations worldwide.