Data Engineer

This is a fully remote position, open to applicants in Sri Lanka.

📋 Description

• Construct and sustain data pipelines, integrations, reporting datasets, dashboards, and visualizations.

• Collaborate with the Head of Data Practice and stakeholders to identify data sources and establish requirements.

• Design and uphold data ingestion pipelines and ETL/ELT processes.

• Create and manage API-based and alternative data integrations.

• Compose and refine SQL queries and views for relational data transformation.

• Utilize Python for data processing and to automate recurring preparation tasks.

• Analyze existing schemas and uphold structured data models.

• Aid in data processing and transformation within Databricks.

• Ensure data completeness, accuracy, and consistency from source to reporting.

• Investigate and resolve issues related to pipelines, integrations, and data quality.

• Develop and sustain reports, dashboards, metrics, and visualizations for internal and client users.

• Convert business requirements into effective layouts, visualizations, and precise calculations.

• Maintain and enhance current Power BI reports.

• Create reporting solutions leveraging GoodData and Databricks.

• Migrate and consolidate legacy reporting solutions, including SSRS reports.

• Verify migrated outputs against established requirements.

• Facilitate visualizations through client portals and embedded reporting environments.

• Contribute to AI-assisted analytics and natural language data exploration, including Databricks Genie.

• Document data flows, transformations, data models, and report logic.

• Oversee engineering and reporting deliverables until completion.

• Communicate dependencies, progress, and challenges.

• Collaborate with the broader technology team and stakeholders.

• Adjust delivery priorities as business needs evolve.

⛳️ Requirements

• Practical experience in data engineering, data preparation, and report development.

• Proficient SQL skills, encompassing queries, joins, transformations, and views.

• Familiarity with relational databases, schemas, data flows, and data modeling.

• Experience in developing dashboards, reports, and visualizations using a recognized BI platform.

• Capability to convert business requirements into data preparation, reporting logic, and meaningful metrics.

• Experience troubleshooting data pipelines, reporting, and data quality issues.

• Experience in maintaining existing solutions while addressing new requirements.

• SQL and relational database technologies knowledge.

• Data modeling and preparation of datasets for reporting and analytics.

• Familiarity with Power BI, Tableau, QlikView, or a similar BI platform.

• Preferred: Experience with data ingestion pipelines and ETL/ELT processes.

• Preferred: Proficiency in Python for data processing, transformation, and automation.

• Preferred: Familiarity with Databricks.

• Preferred: Experience with GoodData and MAQL.

• Preferred: Maintenance, troubleshooting, and enhancement of Power BI reports.

• Preferred: Knowledge of API-based integrations.

• Preferred: Experience with SSRS and legacy report migration.

• Preferred: Understanding of embedded visualizations and iframe concepts.

• Preferred: Familiarity with Databricks Genie or similar AI-assisted analytics capabilities.

• Preferred: Knowledge of Microsoft Azure data environments.

• Strong communication skills and confidence in clarifying business requirements.

• Analytical thinking and practical problem-solving abilities.

• Exceptional attention to detail and data accuracy.

• Ability to prioritize effectively and adapt to changing requirements.

• Collaborative approach with both technical and business stakeholders.

• Strong self-management and communication skills in a remote setting.

🏝️ Benefits

• Compensation in Australian Dollars.

• Medical insurance from day one covering you and your spouse (or parents if unmarried).

• Generous OPD coverage for doctor visits and all medical needs.

• Home office setup allowance.

• Internet allowance.

• Gym and wellness allowance.

• Regular team events and engagement activities.

• Diji Assist mental health and counseling support.

• Reimbursement for industry certifications.

• Open-door culture.

• Flexible work arrangements – home or office.

• Rewards and recognition programs.

• Christmas and financial year-end parties.