XIO

xWire

Posts from every feed QUEST has found across the web — blogs, news, podcasts, channels and more.

Katalon Community - Latest posts

Latest posts

[Talk Testing] What did your AI agent actually verify?

One check I’d add to that record: prove the new test can fail. Revert the fix (or mutate the relevant line) and confirm the test goes red for the expected reason, then restore it. A test written after the change by the same agent that made the change is the easiest thing to accidentally shape around the current implementation. I’d also ask for the diff scope — files touched outside the stated behavior — and a human re-run of the exact command, not just a pasted log. The log tells you what the…

Reports from Katalon Studio stuck in "Running" status and failing to publish in TestOps

Hi! Could you share the following so we can investigate why your uploaded results remain in “Running” status? • A link to one affected execution on Katalon Platform • The approximate upload date/time, including timezone • Your Katalon Studio version • Whether you manually uploaded an existing report or Studio uploaded it automatically after execution • Any upload confirmation/error message and relevant Studio logs (please remove API keys, tokens, and sensitive test data)

How do you manage APK versions for mobile regression testing in Katalon?

Thanks everyone for sharing how you handle this. A quick summary for anyone who finds this thread later: The safest source for older APKs is your own build pipeline. Save every release build as an artifact (Firebase App Distribution, Artifactory, Nexus, or your CI’s storage), so you always test the exact build you shipped. In Katalon Studio, keep the APK path in a profile or config file, not hard-coded in the test case. Then you can switch versions without editing tests. We don’t recommend…

🔴 Going live today: Katalon AI Test Runner launch webinar (free, 60 min)

Hi @trust_level_1 The Katalon AI Test Runner launch goes live today. If you haven’t signed up yet, there’s still time. Today, Nov 16 (9:00 AM EST · 2:00 PM GMT · 9:00 PM ICT) What is AI Test Runner? It runs your existing manual test cases straight from their natural language steps, the way a human tester would. You don’t write or maintain any scripts, and every run ends in a pass or fail with evidence to back it up. What you’ll see in the session How to grow QA capacity when development moves…

AI Test Runner onboarding: your first AI test run in 5 steps

Katalon AI Test Runner · 5-minute guide Run the manual tests you already have, with AI What the AI Test Runner does, and 5 steps to your first AI run. 1 What it is Pick a test case or suite in Katalon TestOps and click Run with AI. AI agents run it, a second AI checks it, and you get proof for every step. Run AI agents run your tests Tests run in parallel on web and mobile in Katalon TestCloud. Repeat runs reuse what worked. Chrome or Edge on Linux, Windows or macOS, and mobile apps Check A…

Welcome to the AI Test Runner category: start here

Questions, tips and feedback about the Katalon AI Test Runner. It runs your plain-language manual test cases in Katalon TestOps, with no scripts to write. New here? Start with the AI Test Runner onboarding guide. It shows what the AI Test Runner does and walks you through your first AI test run in 5 steps. Have a question, a result that surprised you, or a tip that worked? Start a new topic in this category. Please hide passwords, test data and anything private in your screenshots.

[Talk Testing] What did your AI agent actually verify?

Dear Community, “Tests passed” is a weak handoff when an AI agent changes code. Which tests ran? What did they cover? What could the agent not check? Software Testing Weekly’s latest issue points to Will Larson’s verification pattern. His team requires a per-PR record of checks and gaps before a draft becomes ready for review. Here is a small experiment inspired by that approach. For your next AI-assisted change, ask for: The behavior that changed and the expected result. The exact checks,…

Hallucinations in Katalon Studio

akshay_sartabe: Katalon Studio is suggesting me to use waitForElementText(). But wait this Keyword does not exist. Somehow it confidently suggests to use this keyword for waiting for element text. Thanks for flagging this — AI suggestions are a helpful starting point, but they should always be verified against the official keyword documentation before use. In this case, the closest built-in options are waitForElementPresent(), waitForElementVisible(), and waitForElementAttributeValue(), and for…

New to AI in QA? Start with one user story

You do not need a team of AI agents to try AI in your daily QA work. In a recent article, Bas Dijkstra describes how he helps testers take small steps with AI. Early exercises include reviews of user stories and acceptance criteria. He also notes that testers need different levels of support: some hesitate to start, while others need clearer limits. Here is a small exercise inspired by that approach: Choose a synthetic user story with a few acceptance criteria. Keep customer data and…

True Platform: “Report Defect > Create new defect” fails with Jira (400 on issue type metadata; “Issue type is not configured for defects”)

Hi @qurzunta.kaab, Thank you for reporting this, and for the clear steps and screenshots. They helped our team find the issue quickly. Create New Defect form not loading fields. This was caused by a bug on our side, and we released a fix on 2 November. Could you try creating a defect again and let us know if the Bug fields now load? Katalon AI assistant error. This is fixed in our 12 November release. The assistant can now create a defect and link it to your Jira bug. We’re still working on one…

Hallucinations in Katalon Studio

Hi @akshay_sartabe, thanks for flagging this and for the screenshot. You’re right, waitForElementText() isn’t a real Katalon keyword, so the AI shouldn’t be suggesting it. We’ll review this with the team and work on improving it. Thanks for helping us make it better! Also can you share the context, at which question or prompt did it get hallucinated.

Can I share context for Katalon AI agent across my team

Dear Akshay, Chat history in Katalon Studio is saved locally on your machine, so it won’t automatically appear on another computer, even if you sign in with the same Katalon account. To share reusable AI instructions with your team, you can include an Agent profile in your shared Studio project. Anyone opening that project can select the profile in their chat session to use the same instructions. This shares the setup, not the conversation history.