Java QA Automation Engineer – Banking

This is a fully remote position, open to applicants in Romania.

📋 Description

• Develop API and integration test coverage for Java/Spring routers and database workflows.

• Design and implement Playwright end-to-end tests for essential user journeys.

• Create robust mocking and fixture strategies (MSW, test fixtures, seeded test data).

• Establish CI quality gates for linting, unit/integration/end-to-end tests, coverage, and reporting.

• Increase coverage to previously untested UI and workflow areas while preventing regressions.

• Create a discipline for LLM evaluation using golden datasets and measurable quality thresholds.

• Monitor model output reliability, identify drift, and manage releases based on quality and stability criteria.

• Enhance test maintainability, eliminate flakiness, and optimize execution time.

• Utilize LangChain4j for JVM-native LLM application support, covering agents, RAG, and guardrails.

• Employ the Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison.

• Implement the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation.

• Integrate Promptfoo into CI for language-agnostic regression checks and red-team evaluations surrounding the Java stack.

• Apply Java schema validation and guardrail patterns with Jackson, Swagger annotations, and LangChain4j guardrails.

• Leverage OpenTelemetry-based traces and Langfuse datasets as the reproducible source of truth for release gates.

⛳️ Requirements

• Minimum of 3 years in QA automation for production systems.

• Strong expertise in Java backend testing.

• Proficient in frontend testing.

• Experience in building and maintaining Playwright/Cypress/Selenium end-to-end test suites.

• Proficient in API testing (REST, schema validation, authentication/error scenarios).

• Familiarity with SQL/PostgreSQL testing and test data management.

• Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines, or Jenkins).

• Practical knowledge of testing non-deterministic LLM outputs.

• Nice to have:

• Familiarity with Java-compatible LLM evaluation and regression tools such as Promptfoo and Langfuse, along with trace-based observability and output validation via API/OpenTelemetry integrations.

• Experience in performance and benchmark testing.

• Background in WebSocket testing.

• Awareness of security and dependency scanning.

• Experience in legal-tech, fintech, or other regulated sectors.

🏝️ Benefits

• Comprehensive medical package.

• Lunch Tickets & Pluxee Card.

• Bookster subscription.

• 13th salary/yearly bonuses.

• Job security typical of enterprises combined with a startup culture (diverse and engaging environment, international exposure, flat hierarchy) under the stability of a secure multinational.

• Supportive culture that values ownership, autonomy, and a healthy work-life balance, complemented by excellent colleagues, team events, and activities.

• Flexible working arrangements with openness to remote work.

• Collaborative approach – employees have a say in shaping their benefits, tools, team events, and internal practices.

• Varied opportunities in Software Development with international exposure.

• Freedom to select projects that align with your career trajectory and technical aspirations.

• Access to premium learning platforms, courses, and certifications (Pluralsight, Udemy, Microsoft, Google Cloud).

• Opportunities for career growth and learning through mentorship programs, certifications, professional development, and above-market salaries.