Senior Developer – Cloud-Native Data, AWS, Kafka

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, create, and sustain scalable components.

• Construct AWS-based data pipelines, event-driven workflows, APIs, microservices, and integration services.

• Develop Kafka producers and consumers with suitable topic, partitioning, schema, offset management, retry, and error-handling strategies.

• Design and implement metadata-driven pipelines, dynamic business-rule engines, configurable APIs, data integration frameworks, template-based code generation solutions, and parameterized reusable services.

• Design and optimize interpreters for JSON, YAML, and XML configurations.

• Implement configuration validation, versioning, auditing, rollback, backward compatibility, and error handling.

• Create reusable and maintainable software using Python and/or Java.

• Design SQL and NoSQL data models for business rules and system configurations.

• Build and integrate solutions utilizing Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB.

• Develop REST APIs, asynchronous services, batch processing components, and event-based integrations.

• Implement automated unit, integration, component, and contract testing.

• Integrate components with CI/CD pipelines and GitOps deployment workflows.

• Build, package, and deploy applications using Docker and Kubernetes.

• Implement logging, monitoring, distributed tracing, dashboards, and alerting with Dynatrace.

• Diagnose production issues and conduct root-cause analysis across application, integration, data, and infrastructure layers.

• Perform code reviews and uphold engineering, security, performance, and maintainability standards.

• Collaborate with architects, product owners, quality analysts, data engineers, DevOps engineers, and developers.

• Utilize Windsurf and other AI-assisted engineering tools for development, refactoring, automated testing, troubleshooting, and documentation.

⛳️ Requirements

• 8+ years of experience in software engineering and application development.

• 4+ years of direct experience in building AWS-based solutions, Kafka integrations, and data pipelines.

• Proven experience in designing and developing distributed, cloud-native applications.

• Strong proficiency in Python or Java; hands-on experience with both is preferred.

• Extensive experience in developing AWS-based pipelines and cloud-native applications.

• Practical experience with Apache Kafka and event-driven architectures.

• Experience in building metadata-driven pipelines and workflows, dynamic business-rule engines, configuration-driven applications, configurable API and data-integration frameworks, template-based code-generation frameworks, and parameterized reusable services.

• Strong experience with JSON-, YAML-, and XML-based configuration interpreters.

• Understanding of configuration schemas, validation, versioning, auditability, backward compatibility, and rollback.

• Knowledge of SQL and NoSQL database modeling.

• Experience with Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB.

• Familiarity with REST APIs, microservices, asynchronous processing, and distributed systems.

• Experience with CI/CD pipelines, Git, and GitOps practices.

• Proficiency in Docker, Kubernetes, and container orchestration.

• Working knowledge of Dynatrace.

• Familiarity with Windsurf or similar AI-assisted development tools.

• Preferred: experience with high-volume, fault-tolerant distributed platforms; Kafka schema management and Avro, JSON, or Protobuf; knowledge of data lineage, schema evolution, data contracts, and data-quality controls; infrastructure-as-code and tools such as Terraform, Helm, or Argo CD; understanding of retry management, dead-letter queues, idempotency, caching, and fault tolerance; secure APIs and cloud services; relevant AWS, Kubernetes, Java, or Python certifications.

• Ability to work independently and mentor junior developers.

• Capacity to deliver within an Agile product-engineering environment.

🏝️ Benefits

• Remote position.