Євгеній

Yevhenii Kolubielov
Senior QA Engineer / QA Tech Lead
[відкрити контакти](див. вище в блоці «контактна інформація») (Telegram, WhatsApp) email: [відкрити контакти](див. вище в блоці «контактна інформація»)

PROFESSIONAL SUMMARY
Senior QA Engineer / QA Tech Lead with 5+ years of experience testing enterprise web applications,
microservices-based systems and AI-based internal chatbot, with a focus on manual and exploratory
testing for scenarios requiring human judgment — including AI output evaluation, UX, and edge-case
discovery. Background in B2B business analysis and sales, which built a solid foundation for gathering
requirements and working with stakeholders. Strong expertise in API, integration, regression, and end-to-
end testing across e-commerce and product data management platforms. Experienced in leading QA teams,
mentoring engineers, establishing testing processes, collaborating with developers and product managers,
and driving cross-team communication in Agile environments. Comfortable using AI-assisted tools in
daily QA workflows.

SKILLS
✓ Analysis & Documentation: requirements analysis, test plans, traceability matrices, test cases,
bug reports, stakeholder reporting, testing effort estimation
✓ Testing Types: Functional, API, Integration, Regression, UI/Usability, A/B testing, Localization
(l10n) / Internationalization (i18n) testing — web, desktop, and mobile applications at integration,
system, and end-to-end levels. Cross-browser and cross-device testing with BrowserStack. Manual
and exploratory testing for AI/LLM output evaluation, UX, and edge-case discovery.
✓ API & Diagnostics: Postman, Swagger, REST, SOAP, Fiddler, Chrome DevTools
✓ Messaging & Data: Kafka (message queue testing), SQL (data verification)
✓ Design/UI: Figma
✓ Team & Process Tools: Jira, Confluence, Jenkins (running automated test suites on request,
reviewing run results)
✓ AI-assisted Tools: Gemini, Claude — requirements analysis, test case generation, prompt testing,
prompt regression testing

WORK EXPERIENCE

AUTODOC SE, GERMANY/UKRAINE | QA ENGINEER Oct 2021 – Aug 2026

PROJECT 1: AI Chatbot (TecDoc-based, Agentic RAG Application)
Role: QA Tech Lead, QA Engineer

● Set up QA processes from scratch for an agentic RAG chatbot built on an LLM and TecDoc parts
data.
● Analyzed LLM outputs using evaluation criteria and quality metrics to determine the relevance,
accuracy, and validity of its responses.
● Built evaluation datasets and reference questions to test chatbot accuracy on part lookups, vehicle-
fit logic, and multi-step queries.
● Led prompt and regression testing across version iterations, comparing outputs across prompt
versions to catch quality drops before release.
● Tested agentic flows end-to-end — multi-step reasoning, TecDoc data retrieval, and handling of
vague or multi-turn questions.
● Checked chatbot answers against TecDoc data to catch hallucinations, outdated info, and retrieval
errors.
● Defined release criteria and quality gates for AI feature rollouts.

● Worked closely with AI/ML engineers and product owners to turn model behavior into testable
acceptance criteria.
● Tracked AI-specific quality metrics (accuracy, hallucination rate, groundedness) to support release
decisions.

PROJECT 2: A product data management system based on microservices
Role: QA Tech Lead, QA Engineer

● Led a team of 4 QA engineers, coordinating testing across multiple microservices and driving
cross-team communication.
● Introduced a standardized test case template and structure across the team to ensure consistent,
transferable test documentation.
● Established a mandatory test coverage review before release, requiring peer sign-off on critical
scenarios prior to shipping.
● Set up regular QA–development sync meetings across microservices to surface cross-service
dependencies earlier in the planning stage.
● Standardized the bug report format in Jira (reproduction steps, severity/priority, logs) to speed up
developer triage and fixes.
● Assigned QA engineers to specific microservices/modules for clearer ownership, replacing ad hoc
task distribution.
● Created an onboarding checklist for new QA engineers, covering access setup, tech stack, and
initial testing scope.
● Ensured the effectiveness of the QA team and planned testing activities in line with the overall
project plan and customer expectations.
● Ran pair-testing sessions with junior QA engineers, walking through test design techniques on real
tasks.
● Reviewed junior engineers' test cases and provided regular feedback to improve quality and
consistency.
● Led internal knowledge-sharing workshops (e.g., API testing with Postman/Swagger) to raise the
team's overall skill level.
● Held regular 1:1s with team members to discuss career development and learning goals.
● Cross-trained team members on microservices and Kafka-based testing.
● Provided escalation support, helping junior engineers troubleshoot complex or unclear defects.

PROJECT 3: An online shop: websites for selling products for cars
Role: QA Engineer

● Executed a wide range of testing activities for a product data management system — functional,
UI, usability, regression, integration, A/B, and localization testing — to ensure application quality
and performance.
● Designed and executed API test suites covering 100+ endpoints for critical business workflows,
using Postman/Swagger to validate endpoints and data integrity.
● Tested Kafka-based message queues to verify inter-service communication and data flow between
microservices.
● Led integration testing for a new microservices architecture, identifying and resolving critical
dependencies before production deployment.
● Analyzed business and technical requirements to develop test documentation, including test suites
and test cases; used Figma specifications to verify UI implementation accuracy.

● Identified, investigated, and documented defects in Jira with clear reproduction steps and
severity/priority classification for the development team.
● Used AI tools (Gemini, Claude) to accelerate requirements analysis and test case generation.

EPAM SYSTEMS | QA ENGINEER Jan 2021 – Oct 2021
Responsibilities:
● Performed end-to-end software testing, covering functional, UI, and regression test cycles.
● Developed and executed API test suites using Postman and Swagger to ensure backend services
met specifications.
● Investigated and reported software defects using Jira, contributing to overall product stability.
● Developed and maintained clear test documentation to support the quality assurance process.
AUTOTRUCKTIR LTD, UKRAINE | BUSINESS ANALYST Oct 2011 – Jan 2021
Responsibilities:
● Performed business analysis of client requirements, translating business needs into actionable
specifications — a foundation later applied directly to QA requirements analysis and test scoping.
● Developed strong B2B communication skills, managing stakeholder relationships and expectations
across the sales cycle.

EDUCATION
National Technical University “KPI”
Master’s degree in Energy Management, 2004–2010

LANGUAGES
● English — B2
● Ukrainian — Native