Skip to main content
← Back to CT-GenAI: GenAI for Software Testing

Practice: LLM-Powered Test Infrastructure for Software Testing

0/15 answered

Q1K2

In the architecture of an LLM-powered test infrastructure, what is the primary purpose of back-end post-processing before responses are sent to the front-end?

Q2K2

Which of the following statements about LLM-powered test infrastructure is INCORRECT?

Q3K2

You are building an LLM-powered test tool. Existing test cases are stored in a relational database, while API specifications and security requirements are stored in a vector database. A tester asks the system to generate test cases aligned with the latest security requirements. Which back-end data source should be queried FIRST for semantically relevant specification content?

Q4K2

During user prompt processing, a RAG system operates through which TWO sequential steps?

Q5K2

A test team implements RAG so their LLM-powered tool can access the latest requirements from a documentation repository. After deployment, the LLM still occasionally generates test cases for features removed from the requirements six months ago, even when current documents are retrieved correctly. This problem is MOST LIKELY caused by:

Q6K2

Match each RAG preprocessing activity (1–4) with its correct position in the document preparation pipeline (A–D)

Which matching is CORRECT?

Items

  • 1Break large documents into smaller chunks
  • 2Clean and process document chunks
  • 3Encode chunks into embeddings and store them in a vector database
  • 4Retrieve relevant chunks based on semantic similarity at runtime

Descriptions

  • AFirst step
  • BSecond step
  • CThird step
  • DActivity performed during inference, not preprocessing
Q7K2

What capability MOST fundamentally distinguishes LLM-powered agents from traditional AI chatbots in test automation?

Q8K2

In a multi-agent LLM-powered test architecture, what does "orchestration" refer to?

Q9K2

Your organization deploys LLM-powered agents to automate test design for a safety-critical medical device application. Given the risks of hallucinations and reasoning errors, which approach BEST balances automation with reliability?

Q10K2

Which of the following statements about fine-tuning language models for specific test tasks is INCORRECT?

Q11K2

A test organization fine-tunes a GenAI model but finds the model performs well on training user stories yet poorly on new, unseen user stories. This is MOST LIKELY an example of:

Q12K2

An organization wants its GenAI model to generate test cases from user stories in a company-specific Gherkin format and terminology. The team has a high-quality dataset of existing user stories and corresponding test cases. Which approach BEST addresses this requirement?

Q13K2

Which of the following BEST describes the primary focus of LLMOps when deploying and managing LLMs for test tasks?

Q14Select 2K2

Select TWO answers needed. Which pair of factors must an organization evaluate when adopting a test tool with integrated GenAI capabilities?

0 of 2 selected

Q15K2

An organization considers three LLMOps approaches: using an AI chatbot, using a test tool with GenAI capabilities, and in-house development of a GenAI-based test tool. Which consideration applies to ALL three approaches?