Data Engineer

This is a fully remote position, open to applicants in Australia.

📋 Description

• Oversee the technical aspects of our data platform, which encompasses both structured and unstructured data repositories, ingestion pipelines, and visualization tools.

• Create and sustain ETL/ELT pipelines for data ingestion across both operational and analytical systems.

• Manage and enhance existing on-premises Microsoft SQL Server environments and their associated integrations.

• Assist in migration projects from legacy data warehousing systems to contemporary analytical platforms, including ClickHouse.

• Build data ingestion frameworks that can accommodate structured, semi-structured, and streaming data sources.

• Apply data retention, partitioning, indexing, and optimization strategies for large datasets.

• Construct data pipelines and feature engineering workflows to bolster AI and machine learning initiatives.

• Improve SQL queries, indexing strategies, and database performance across various environments.

• Design, develop, and maintain operational dashboards, executive reporting suites, and interactive visualizations for both technical and non-technical stakeholders using Microsoft Power BI, Grafana, and SQL Server Reporting Services (SSRS).

• Ensure robust security measures against unauthorized access to data, data sources, reports, and dashboards, while ensuring appropriate data partitioning for relevant users.

⛳️ Requirements

• Proficient experience with Microsoft SQL Server query and procedure development, optimization, and maintenance of linked servers and SQL Server Reporting Services environments.

• Advanced skills in SQL and Python development as well as troubleshooting.

• Proven experience in designing and maintaining ETL/ELT pipelines.

• Familiarity with designing and implementing data warehouses and data lake architectures.

• Experience with orchestration and automation platforms such as Rundeck and Airbyte.

• Knowledge of data visualization and dashboarding tools, including Microsoft Power BI and Grafana.

• Experience with modern analytical databases like ClickHouse and OpenSearch.

• Intermediate-level experience with Linux and Windows server administration.

• Strong attention to detail and commitment to operational reliability.

• Self-driven with the capacity to work independently.

• Experience in supporting MLOps frameworks and AI infrastructure, including vector databases, embeddings, or semantic search systems is an advantage.

🏝️ Benefits

• Hybrid working model (for most of our roles) with team anchor days to foster collaboration.

• Comprehensive training and development opportunities that facilitate continuous growth as part of your career planning.

• Significant discounts and benefits to maximize your financial well-being.

• Choice of IT equipment to enhance your success, along with access to cost-price technology for personal use.

• Enjoyable team events to celebrate successes and foster connections with colleagues outside of work, contributing to our vibrant culture.

• CT values diversity and ensures every voice is heard as we strive to create the world we envision. Apply today and join a team that appreciates innovation, inclusivity, variety, and diverse backgrounds.

• *Note: A valid *Vulnerable People /* Working with Children Check (WWCC) and Police Check are mandatory.*