1) [chromium] › tests/adkMiddlewareTests/humanInTheLoopPage.spec.ts:5:7 › Human in the Loop Feature › [ADK Middleware] should interact with the chat and perform steps TimeoutError: locator.innerText: Timeout 60000ms exceeded. Call log: - waiting for getByTestId('select-steps').getByTestId('step-item').filter({ has: getByTestId('step-text').filter({ hasText: 'eggs' }) }).first().getByTestId('step-text') at ../pages/adkMiddlewarePages/HumanInLoopPage.ts:58 56 | } 57 | const stepTextElement = item.getByTestId('step-text'); > 58 | const text = await stepTextElement.innerText(); | ^ 59 | await item.click(); 60 | 61 | return text; at HumanInLoopPage.uncheckItem (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/pages/adkMiddlewarePages/HumanInLoopPage.ts:58:40) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/adkMiddlewareTests/humanInTheLoopPage.spec.ts:28:25 at retryOnAIFailure (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/test-isolation-helper.ts:45:14) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/adkMiddlewareTests/humanInTheLoopPage.spec.ts:8:5

Process completed with exit code 1.

2) [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:6:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat to get a planner on prompt Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 21 | await genUIAgent.sendButton.click(); 22 | > 23 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 24 | 25 | await genUIAgent.plan(); 26 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/llamaIndexTests/agenticGenUI.spec.ts:23:52

1) [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:40:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat using predefined prompts and perform steps Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 55 | await genUIAgent.sendButton.click(); 56 | > 57 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 58 | 59 | await genUIAgent.plan(); 60 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/llamaIndexTests/agenticGenUI.spec.ts:57:52

1) [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:40:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat using predefined prompts and perform steps Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 55 | await genUIAgent.sendButton.click(); 56 | > 57 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 58 | 59 | await genUIAgent.plan(); 60 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/llamaIndexTests/agenticGenUI.spec.ts:57:52

1) [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:40:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat using predefined prompts and perform steps Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 55 | await genUIAgent.sendButton.click(); 56 | > 57 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 58 | 59 | await genUIAgent.plan(); 60 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/llamaIndexTests/agenticGenUI.spec.ts:57:52

1) [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:40:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat using predefined prompts and perform steps Error: expect(received).toBeGreaterThan(expected) Expected: > 0 Received: 0 at ../pages/llamaIndexPages/AgenticUIGenPage.ts:28 26 | const stepItems = this.agentPlannerContainer.getByTestId('task-step-text'); 27 | const count = await stepItems.count(); > 28 | expect(count).toBeGreaterThan(0); | ^ 29 | for (let i = 0; i < count; i++) { 30 | const stepText = await stepItems.nth(i).textContent(); 31 | console.log(`Step ${i + 1}: ${stepText?.trim()}`); at AgenticGenUIPage.plan (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/pages/llamaIndexPages/AgenticUIGenPage.ts:28:19) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/llamaIndexTests/agenticGenUI.spec.ts:59:5

1) [chromium] › tests/crewAITests/sharedStatePage.spec.ts:5:7 › Shared State Feature › [CrewAI] should interact with the chat to get a recipe on prompt Error: Timed out 120000ms waiting for expect(locator).toBeVisible() Locator: locator('.ingredient-card:has(input.ingredient-name-input[value="Pasta"])') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 120000ms - waiting for locator('.ingredient-card:has(input.ingredient-name-input[value="Pasta"])') at ../featurePages/SharedStatePage.ts:53 51 | const selector = `.ingredient-card:has(input.ingredient-name-input[value="${name}"])`; 52 | const cardLocator = this.page.locator(selector); > 53 | await expect(cardLocator).toBeVisible(); | ^ 54 | } 55 | 56 | async addNewIngredient(placeholderText: string) { at SharedStatePage.awaitIngredientCard (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/featurePages/SharedStatePage.ts:53:31) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/crewAITests/sharedStatePage.spec.ts:18:28

1) [chromium] › tests/pydanticAITests/sharedStatePage.spec.ts:5:7 › Shared State Feature › [PydanticAI] should interact with the chat to get a recipe on prompt Error: Timed out 120000ms waiting for expect(locator).toBeVisible() Locator: locator('.ingredient-card:has(input.ingredient-name-input[value="Pasta"])') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 120000ms - waiting for locator('.ingredient-card:has(input.ingredient-name-input[value="Pasta"])') at ../featurePages/SharedStatePage.ts:53 51 | const selector = `.ingredient-card:has(input.ingredient-name-input[value="${name}"])`; 52 | const cardLocator = this.page.locator(selector); > 53 | await expect(cardLocator).toBeVisible(); | ^ 54 | } 55 | 56 | async addNewIngredient(placeholderText: string) { at SharedStatePage.awaitIngredientCard (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/featurePages/SharedStatePage.ts:53:31) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/pydanticAITests/sharedStatePage.spec.ts:18:28

2) [chromium] › tests/langgraphPythonTests/toolBasedGenUIPage.spec.ts:7:5 › [LangGraph] Haiku generation and display verification TimeoutError: locator.waitFor: Timeout 20000ms exceeded. Call log: - waiting for locator('[data-testid="haiku-card"]').last().locator('[data-testid="haiku-japanese-line"]').first() to be visible at ../featurePages/ToolBaseGenUIPage.ts:44 42 | .locator('[data-testid="haiku-japanese-line"]') 43 | .first() > 44 | .waitFor({ state: "visible", timeout: 20000 }); | ^ 45 | } 46 | 47 | async extractChatHaikuContent(page: Page): Promise<string> { at ToolBaseGenUIPage.checkGeneratedHaiku (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/featurePages/ToolBaseGenUIPage.ts:44:8) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphPythonTests/toolBasedGenUIPage.spec.ts:16:3

1) [chromium] › tests/langgraphPythonTests/predictiveStateUpdatePage.spec.ts:9:7 › Predictive Status Updates Feature › [LangGraph] should interact with agent and approve asked changes TimeoutError: locator.textContent: Timeout 60000ms exceeded. Call log: - waiting for locator('div.tiptap').locator('text=Atlantis').first() at ../pages/langGraphPages/PredictiveStateUpdatesPage.ts:74 72 | const paragraphWithName = await this.page.locator(`div.tiptap >> text=${dragonName}`).first(); 73 | > 74 | const fullText = await paragraphWithName.textContent(); | ^ 75 | if (!fullText) { 76 | return null; 77 | } at PredictiveStateUpdatesPage.verifyAgentResponse (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/pages/langGraphPages/PredictiveStateUpdatesPage.ts:74:46) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphPythonTests/predictiveStateUpdatePage.spec.ts:30:26 at retryOnAIFailure (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/test-isolation-helper.ts:45:14) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphPythonTests/predictiveStateUpdatePage.spec.ts:12:5

Process completed with exit code 1.

4) [chromium] › tests/langgraphFastAPITests/toolBasedGenUIPage.spec.ts:7:5 › [LangGraph FastAPI] Haiku generation and display verification TimeoutError: locator.waitFor: Timeout 20000ms exceeded. Call log: - waiting for locator('[data-testid="haiku-card"]').last().locator('[data-testid="haiku-japanese-line"]').first() to be visible at ../featurePages/ToolBaseGenUIPage.ts:44 42 | .locator('[data-testid="haiku-japanese-line"]') 43 | .first() > 44 | .waitFor({ state: "visible", timeout: 20000 }); | ^ 45 | } 46 | 47 | async extractChatHaikuContent(page: Page): Promise<string> { at ToolBaseGenUIPage.checkGeneratedHaiku (/home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/featurePages/ToolBaseGenUIPage.ts:44:8) at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/toolBasedGenUIPage.spec.ts:16:3

3) [chromium] › tests/langgraphFastAPITests/sharedStatePage.spec.ts:24:7 › Shared State Feature › [LangGraph FastAPI] should share state between UI and chat Error: Timed out 120000ms waiting for expect(locator).toBeVisible() Locator: locator('.copilotKitAssistantMessage').getByText(/Potatoes/) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 120000ms - waiting for locator('.copilotKitAssistantMessage').getByText(/Potatoes/) 49 | 50 | // Verify chat response includes both existing and new ingredients > 51 | await expect(sharedStateAgent.agentMessage.getByText(/Potatoes/)).toBeVisible(); | ^ 52 | await expect(sharedStateAgent.agentMessage.getByText(/12/)).toBeVisible(); 53 | await expect(sharedStateAgent.agentMessage.getByText(/Carrots/)).toBeVisible(); 54 | await expect(sharedStateAgent.agentMessage.getByText(/All-Purpose Flour/)).toBeVisible(); at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/sharedStatePage.spec.ts:51:71

2) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:38:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat using predefined prompts and perform steps Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 53 | await genUIAgent.sendButton.click(); 54 | > 55 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 56 | await genUIAgent.plan(); 57 | 58 | await page.waitForFunction( at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:55:52

2) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:38:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat using predefined prompts and perform steps Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 53 | await genUIAgent.sendButton.click(); 54 | > 55 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 56 | await genUIAgent.plan(); 57 | 58 | await page.waitForFunction( at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:55:52

2) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:38:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat using predefined prompts and perform steps Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 53 | await genUIAgent.sendButton.click(); 54 | > 55 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 56 | await genUIAgent.plan(); 57 | 58 | await page.waitForFunction( at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:55:52

1) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:5:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat to get a planner on prompt Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 20 | await genUIAgent.sendButton.click(); 21 | > 22 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 23 | 24 | await genUIAgent.plan(); 25 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:22:52

1) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:5:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat to get a planner on prompt Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 20 | await genUIAgent.sendButton.click(); 21 | > 22 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 23 | 24 | await genUIAgent.plan(); 25 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:22:52

1) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:5:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat to get a planner on prompt Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 20 | await genUIAgent.sendButton.click(); 21 | > 22 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 23 | 24 | await genUIAgent.plan(); 25 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:22:52

1) [chromium] › tests/langgraphFastAPITests/agenticGenUI.spec.ts:5:7 › Agent Generative UI Feature › [LangGraph FastAPI] should interact with the chat to get a planner on prompt Error: Timed out 15000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('task-progress') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 15000ms - waiting for getByTestId('task-progress') 20 | await genUIAgent.sendButton.click(); 21 | > 22 | await expect(genUIAgent.agentPlannerContainer).toBeVisible({ timeout: 15000 }); | ^ 23 | 24 | await genUIAgent.plan(); 25 | at /home/runner/work/CopilotKit/CopilotKit/ag-ui/apps/dojo/e2e/tests/langgraphFastAPITests/agenticGenUI.spec.ts:22:52

1 passed (6.0s)

1 passed (6.2s)

1 passed (3.5s)

9 passed (1.7m)

1 skipped 8 passed (1.5m)

1 skipped 9 passed (1.8m)

10 passed (2.1m)

10 passed (2.4m)

1 flaky [chromium] › tests/adkMiddlewareTests/humanInTheLoopPage.spec.ts:5:7 › Human in the Loop Feature › [ADK Middleware] should interact with the chat and perform steps 2 skipped 9 passed (3.4m)

1 failed [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:40:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat using predefined prompts and perform steps 1 flaky [chromium] › tests/llamaIndexTests/agenticGenUI.spec.ts:6:7 › Agent Generative UI Feature › [LlamaIndex] should interact with the chat to get a planner on prompt 8 passed (3.9m)

1 flaky [chromium] › tests/crewAITests/sharedStatePage.spec.ts:5:7 › Shared State Feature › [CrewAI] should interact with the chat to get a recipe on prompt 1 skipped 10 passed (4.2m)

1 flaky [chromium] › tests/pydanticAITests/sharedStatePage.spec.ts:5:7 › Shared State Feature › [PydanticAI] should interact with the chat to get a recipe on prompt 2 skipped 11 passed (4.3m)

15 passed (4.0m)

2 flaky [chromium] › tests/langgraphPythonTests/predictiveStateUpdatePage.spec.ts:9:7 › Predictive Status Updates Feature › [LangGraph] should interact with agent and approve asked changes [chromium] › tests/langgraphPythonTests/toolBasedGenUIPage.spec.ts:7:5 › [LangGraph] Haiku generation and display verification 14 passed (8.8m)