
Senior Cloud Data Engineer
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in Ireland, +1 more country.
• Build and manage the data platform that supports fleet telematics products on AWS.
• Create ingestion pipelines, alerting and reporting systems, and customer-facing data features at a production scale.
• Take ownership of critical workstreams from start to finish, including architecture, design documents, implementation, deployment, and production monitoring.
• Develop streaming and batch pipelines utilizing Kinesis, Flink, EMR, and ETL orchestrated by Airflow.
• Establish data reliability and quality controls, including deduplication, schema validation, completeness checks, and root-cause analysis.
• Create Grafana mission-control dashboards featuring recency and frequency KPIs.
• Enforce manifest-driven data retention policies across RDS, DynamoDB, S3, and OpenSearch, including organization-specific policies and audit trails.
• Enhance performance and reduce costs through database routing, query optimization, OpenSearch tuning, and AWS cost management.
• Engage in sprint-based deliveries, daily standups, ticket triage, and design discussions.
• 5+ years of experience in data engineering or backend engineering with a strong emphasis on data.
• Proficient in Python; practical experience with AWS Lambda and serverless architectures.
• Advanced SQL and relational database expertise (PostgreSQL/MySQL), including query optimization, partitioning, and locking behavior.
• Practical experience with several of the following: Kinesis or Kafka, Airflow, Flink, EMR/Spark, DynamoDB, OpenSearch/Elasticsearch.
• Experience in troubleshooting data quality issues in production and developing validation/monitoring to mitigate recurrence.
• Comfortable managing ambiguous problems from start to finish: drafting design documents, scoping tickets, and driving projects to deployment.
• Familiarity with Grafana/CloudWatch observability tools is desirable.
• Experience with Athena federated queries is a plus.
• Knowledge of data retention and compliance-driven data lifecycle management is advantageous.
• Exposure to LLM/GenAI tools is considered beneficial.
• Experience in telematics, IoT, or high-volume time-series data domains is a plus.
• Experience with AWS cost optimization is a bonus.
• Remote-first work environment with structured collaboration.
• AI-assisted development is actively promoted.
• Chance to make a noticeable impact swiftly.
• Autonomy to shape solutions and see your work implemented directly in production.
• Opportunity to work with modern technology at scale.
• Opportunities for growth within a scaling global business.
Magna Legal Services
Huron
Strategic Systems International
Get handpicked remote jobs straight to your inbox weekly.