This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Design, construct, and manage both batch and streaming pipelines that capture high-volume usage events from Akamai Cloud compute services.

• Create metering and rating logic to transform raw usage data into billable units and implement rate cards along with contract terms.

• Develop and sustain a data lakehouse on object storage to serve as the authoritative source for usage and billing information.

• Coordinate workflows utilizing Apache Airflow, encompassing backfills, late-arriving data, retries, and SLA monitoring.

• Develop production-quality Python and Spark or Flink jobs, packaged and deployed using Docker.

• Establish reconciliation and data quality checks with audit trails for billing information.

• Write clean, thoroughly tested, and well-documented code.

• Evaluate the work of others and enhance the engineering standards of the team.

⛳️ Requirements

• Over 6 years of experience in software/data engineering.

• Bachelor's degree in Computer Science or a related discipline, or equivalent professional experience.

• Strong programming abilities in Python.

• Ideally, familiarity with Java or Scala.

• Practical experience in constructing large-scale pipelines with Apache Spark or Apache Flink.

• Production experience in orchestrating pipelines using Apache Airflow.

• Comprehensive SQL proficiency, including complex joins, window functions, query optimization, and data modeling for analytics.

• Experience in building or managing a data lakehouse, such as Delta Lake, Apache Iceberg, or Apache Hudi on object storage.

• Familiarity with at least one public cloud platform: AWS, GCP, or Azure.

🏝️ Benefits

• Annual bonus or incentives.

• Equity awards.

• Employee Stock Purchase Plan (ESPP).

• Healthcare coverage.

• 401K savings plan.

• Company holidays.

• Vacation time in the form of PTO.

• Sick leave.

• Parental leave.

• Employee assistance program.

• Mental wellness support.

• Financial wellness support.

• Flexible work arrangements: at home, in an office, or a combination of both.