Principal Software Engineer, BI & Data Platform

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design and develop large-scale, mission-critical BI and data platform solutions that serve millions of users worldwide, utilizing AWS native technologies such as Athena, Redshift, Glue, QuickSight, and S3.

• Oversee the architecture and execution of robust data pipelines, data lakes, and data warehouses employing modern architectures (Iceberg, Parquet, columnar formats) to facilitate real-time and batch analytics at scale.

• Direct the technical strategy and architectural choices for the BI platform, focusing on data modeling, query optimization, performance enhancement, and cost efficiency across AWS services.

• Create and sustain advanced back-end services, ETL/ELT workflows, and front-end analytics applications utilizing Python, SQL, React, and contemporary web technologies.

• Develop and implement efficient data storage solutions across relational databases (Redshift, PostgreSQL) and non-relational databases (DynamoDB, S3), ensuring optimal performance and cost-effectiveness.

• Design and maintain REST APIs and event-driven architectures to facilitate seamless integration between data services, analytics tools, and customer-facing applications.

• Act as the technical lead and mentor for engineering teams, conducting architecture reviews, code reviews, and offering guidance on intricate technical challenges.

• Collaborate with cross-functional teams, including data engineers, analytics engineers, product managers, and DevOps, to deliver innovative BI solutions that enhance business value.

• Advocate for engineering excellence by establishing best practices, design patterns, and coding standards for data-intensive applications.

• Lead Agile ceremonies, manage sprint planning, and ensure the timely delivery of high-quality software solutions while managing technical debt effectively.

• Assess and integrate emerging AWS services and open-source technologies to continually enhance platform capabilities and boost developer productivity.

• Diagnose and resolve complex performance issues in distributed data systems, optimizing query performance, data processing workflows, and infrastructure costs.

• Engage in strategic planning and roadmap development, converting business requirements into scalable technical solutions.

• Participate in the team's on-call rotation, delivering expert-level support for production environments and mentoring team members on incident response.

⛳️ Requirements

• Over 10 years of professional experience in software development, with at least 5 years focusing on data engineering, business intelligence, or analytics platforms within enterprise SaaS environments.

• Extensive expertise in AWS data and analytics services including **Athena, Redshift, Glue, S3, QuickSight, Lake Formation**, with hands-on experience in architecting and operating production workloads.

• Advanced proficiency in **Python** for data processing, ETL/ELT development, and back-end services, with solid knowledge of frameworks such as FastAPI, Flask, or similar.

• High-level **SQL** skills including complex query optimization, window functions, CTEs, and performance tuning across various database engines (Redshift, PostgreSQL, Athena).

• Strong full-stack development skills with proficiency in **React, JavaScript/TypeScript**, and modern front-end frameworks for developing analytics dashboards and data visualization interfaces.

• Proven experience with **Apache Iceberg, Parquet, or similar columnar formats** and contemporary data lake architectures.

• Thorough understanding of data modeling techniques for both OLTP and OLAP workloads, including dimensional modeling, star/snowflake schemas, and denormalization strategies.

• Extensive experience with AI coding assistants such as GitHub Copilot, Cursor, and Windsurf to streamline development and enhance code quality.

• Familiarity with both relational databases (Redshift, PostgreSQL, Aurora) and non-relational databases (DynamoDB, OpenSearch, DocumentDB).

• Demonstrated ability to design and implement scalable REST APIs, event-driven architectures (Lambda, EventBridge, SQS, SNS), and microservices patterns.

• Experience with **AWS CDK (Cloud Development Kit)** or CloudFormation/Terraform for infrastructure-as-code and automated deployment pipelines.

• Strong background in data pipeline orchestration using AWS Step Functions, Glue workflows, or similar tools.

• Proven track record of leading technical initiatives, mentoring senior engineers, and influencing architectural decisions in complex distributed systems.

• Experience with CI/CD pipelines, automated testing frameworks (pytest, Playwright), and DevOps practices for data platforms.

• Excellent problem-solving abilities with the capacity to troubleshoot complex issues in large-scale, distributed data systems.

• Strong understanding of the software development lifecycle (SDLC), Agile methodology, and experience in leading technical teams through the complete development lifecycle.

• Exceptional communication skills with the capability to articulate complex technical concepts to both technical and non-technical stakeholders.

• Adaptable with the ability to shift technical stacks and domains to respond to changing customer and business needs while maintaining strategic focus.

🏝️ Benefits

• Global team recognized for their passion and innovation.

• Innovative product culture and project exposure.

• Training and development from industry-leading experts.

• Cutting-edge benefit programs that include: 401(k) with company matching; medical, dental, and vision insurance; disability and life insurance; flexible PTO; paid holidays and parental leave; tuition reimbursement and more.

• We offer market-competitive pay and benefits based on the candidate’s skills, experience, and qualifications.