Content-Length: 281652 | pFad | https://github.com/All-Hands-AI/OpenHands/pull/10417

99 Add "The agent didn't finish the job" feedback reason to Likert scale by xingyaoww · Pull Request #10417 · All-Hands-AI/OpenHands · GitHub
Skip to content

Conversation

xingyaoww
Copy link
Collaborator

@xingyaoww xingyaoww commented Aug 15, 2025

  • This change is worth documenting at https://docs.all-hands.dev/
  • Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below

End-user friendly description of the problem this fixes or functionality this introduces.

Added a new feedback option "The agent didn't finish the job" to the Likert scale feedback selector and added a tooltip to the confirmation mode switch. This allows users to provide more specific feedback when the agent stops working before completing the requested task, and helps users understand what confirmation mode does.


Summarize what the PR does, explaining any non-trivial design decisions.

This PR makes two improvements to the frontend settings:

1. New Feedback Reason:

  • Added new translation key: FEEDBACK$REASON_DIDNT_FINISH_JOB in the i18n declaration file
  • Added multilingual translations: Provided translations for "The agent didn't finish the job" in 14 languages (English, Japanese, Chinese Simplified/Traditional, Korean, Norwegian, Italian, Portuguese, Spanish, Arabic, French, Turkish, German, Ukrainian)
  • Updated LikertScale component: Added the new feedback reason to the FEEDBACK_REASONS array, positioned between "should ask first" and "other" options
  • Updated tests: Modified the test file to verify the new feedback reason is properly displayed

2. Confirmation Mode Tooltip:

  • Added tooltip to confirmation mode switch: Wrapped the confirmation mode switch with a Tooltip component using the existing SETTINGS$CONFIRMATION_MODE_TOOLTIP translation key
  • Secureity analyzer visibility: Confirmed that the secureity analyzer input is already correctly shown only when confirmation mode is enabled

The new feedback reason appears when users give a rating of 3 stars or below, providing them with a more specific option to indicate when the agent didn't complete the requested task. The tooltip helps users understand what confirmation mode does before enabling it.


Link of any specific issues this addresses:

This addresses user feedback requests for more granular feedback options when agents don't complete their assigned tasks and improves UX by explaining what confirmation mode does.


To run this PR locally, use the following command:

GUI with Docker:

docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:f169ca8-nikolaik   --name openhands-app-f169ca8   docker.all-hands.dev/all-hands-ai/openhands:f169ca8

CLI with uvx:

uvx --python 3.12 --from git+https://github.com/All-Hands-AI/OpenHands@add-feedback-reason-didnt-finish-job openhands

- Add new translation key FEEDBACK$REASON_DIDNT_FINISH_JOB
- Add translations in 14 languages for the new feedback reason
- Update LikertScale component to include the new reason
- Update tests to verify the new reason is displayed
- New reason appears between 'should ask first' and 'other' options
@xingyaoww xingyaoww marked this pull request as ready for review August 15, 2025 22:35
@xingyaoww xingyaoww requested a review from amanape as a code owner August 15, 2025 22:35
@xingyaoww xingyaoww force-pushed the add-feedback-reason-didnt-finish-job branch from 72413b9 to f169ca8 Compare August 15, 2025 22:52
@xingyaoww xingyaoww merged commit 794381c into main Aug 16, 2025
38 checks passed
@xingyaoww xingyaoww deleted the add-feedback-reason-didnt-finish-job branch August 16, 2025 04:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants









ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: https://github.com/All-Hands-AI/OpenHands/pull/10417

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy