|
|
def _build_hint_judge_messages(response_text: str, next_state_text: str, next_state_role: str = "user") -> list[dict]: system = ( "You are a process reward model used for hindsight hint extraction.\n" "You are given:\n" "1) The assistant response at turn t.\n" "2) The next state at turn t+1, along with its **role**.\n\n" "## Understanding the next state's role\n" "- role='user': A reply from the user (follow-up, correction, new request, etc.).\n" "- role='tool': The return value of a tool the assistant invoked. " "This content was NOT available before the assistant's action — " "it exists BECAUSE the assistant called the tool. " "A successful, non-error tool output generally means the assistant's " "action was appropriate; do NOT treat it as information the assistant " "should have already known.\n\n" "Your goal is to decide whether the next state reveals useful hindsight information\n" "that could have helped improve the assistant response at turn t.\n\n"
|
|