Practice: Deploying and Integrating Generative AI in Test Organizations

Which statement about shadow AI is INCORRECT?

A distributed team uses three different public chatbots to draft test cases from confidential requirement documents. None of the tools were approved by security or legal. Which area is MOST directly threatened?

A test manager's GenAI strategy draft includes measurable objectives and an LLM chosen by public NLP ranking, but no training plan and no review gates for AI outputs. Which improvement is MOST critical?

An organization wants to align with syllabus strategy guidance: define objectives, align LLM with infrastructure, establish process guidelines, and measure effectiveness. Which sequence (using i-iv below) is BEST? i. Select LLMs aligned with objectives and scalability. ii. Define measurable GenAI test objectives. iii. Collect metrics on GenAI effectiveness. iv. Establish process guidelines including quality gates.

Which statement about a Generative AI test strategy is INCORRECT?

A team must generate Gherkin test cases from domain-specific user stories using organization-specific terminology. They have historical story-to-test pairs and a limited budget. Which pair of selection criteria matters MOST?

A team runs weekly defect-trend analysis using approximately 50K input tokens and 10K output tokens per run on a commercial LLM. Which factor is LEAST relevant when estimating recurring cost?

When evaluating model performance for test-task selection, an organization should PRIMARILY:

Select TWO answers needed. A test organization shortlists LLMs for requirements-based test case generation. Which pair are BOTH valid selection criteria per the syllabus?

0 of 2 selected

Select TWO answers needed. Which pair of activities BOTH belong to the Discovery phase of GenAI adoption?

0 of 2 selected

An organization has: (1) provided LLM access and run pilot workshops, (2) not yet prioritized use cases or evaluated test infrastructure, (3) no continuous monitoring in place. The organization is MOST likely in which phase?

Leadership notices morale dropping because testers fear GenAI will replace them. According to adoption guidance, this concern should be addressed:

A tester notices an LLM truncates early requirements when generating test conditions from a large specification. They split the specification into sections and adjust prompts after verifying intermediate outputs. Which competency does this MOST reflect?

A junior tester receives AI-generated boundary-value test cases for a payment module. Before approving them, which competency is MOST essential?

A team uses the largest available LLM for every task, including reformatting single-line test notes. Which practice BEST aligns with syllabus environmental guidance?

A tester must share stack traces containing internal hostnames with an external LLM service. Which action is MOST appropriate BEFORE submitting the prompt?

An internal community of practice meets monthly to review successful GenAI test applications and share reusable prompt templates. This primarily supports:

The organization wants sustainable GenAI skill building. Which approach is LEAST aligned with syllabus recommendations?

A test manager establishes governance for approved GenAI use cases, monitors AI-based test processes, and ensures the team retains both traditional testing skills and AI literacy. These actions reflect:

After GenAI adoption, a tester's work includes reviewing AI-generated regression suites, refining prompts in a team library, and verifying outputs against acceptance criteria — while still applying test techniques. This role is BEST described as:

During sprint planning, a test manager allocates work between human testers and GenAI-powered agents that generate draft API tests. Which responsibility is the manager exercising?