Home Furnishings Actions

Assistant Actions

Greet: A stand-alone greeting, welcome, offer to help, thanks, apology, farewell, or another social courtesy.
Ask Preference: Ask about a preference the customer has not yet expressed.
Clarify Need: Clarify a need the customer has expressed ambiguously, inconsistently, or with an unclear reference.
Navigate: Guide the customer to move, turn, look around, or go to a location.
Recommend: Explicitly recommend a specific furniture item.
Explain: Proactively explain product information, features, uses, or recommendation rationale.
Answer Question: Directly answer an explicit customer question.
Compare: Compare two or more specific products.
Handle Rejection: Respond to a customer rejection and adjust based on the reason.
Confirm Purchase: After the customer expresses acceptance, confirm the product or guide purchase completion.

User Actions

Move Forward: Walk forward along the current facing direction, usually to approach the area in front.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "move_forward",
      "arguments": {
        "duration": 1.0
      }
    }
  ],
  "content": "..."
}

Duration: a positive number (seconds).

Move Backward: Step backward without changing the final facing direction; useful to back away, avoid occlusion, adjust the view, or bring a doorway back into view.
```
{
  "type": "final",
  "tool_calls": [
    {
      "name": "move_backward",
      "arguments": {
        "duration": 1.0
      }
    }
  ],
  "content": "..."
}
```
Duration: a positive number (seconds).
Turn And Move: Turn left or right by an angle, then walk forward briefly; useful for exploring the left-front or right-front area.
```
{
  "type": "final",
  "tool_calls": [
    {
      "name": "turn_and_move",
      "arguments": {
        "direction": "right",
        "degree": 30,
        "duration": 1.0
      }
    }
  ],
  "content": "..."
}
```
Direction: right / left. Degree: a positive number (degrees). Duration: a positive number (seconds).
Move And Turn: Walk forward along the current facing direction, then turn left or right by an angle; useful for passing through the space ahead before observing the area after the turn.
```
{
  "type": "final",
  "tool_calls": [
    {
      "name": "move_and_turn",
      "arguments": {
        "direction": "right",
        "degree": 30,
        "duration": 1.0
      }
    }
  ],
  "content": "..."
}
```
Direction: right / left. Degree: a positive number (degrees). Duration: a positive number (seconds).
Side Step: Step left or right without changing facing direction; useful to avoid occlusion, adjust the viewing angle, or bring a doorway into view.
```
{
  "type": "final",
  "tool_calls": [
    {
      "name": "side_step",
      "arguments": {
        "direction": "left",
        "duration": 1.0
      }
    }
  ],
  "content": "..."
}
```
Direction: left / right. Duration: a positive number (seconds).

Turn: Turn in place to the left or right; changes facing direction only.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "turn",
      "arguments": {
        "direction": "right",
        "degree": 30
      }
    }
  ],
  "content": "..."
}

Direction: right / left. Degree: a positive number (degrees).

Look Up Down: Adjust pitch up or down only.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "look_up_down",
      "arguments": {
        "direction": "up",
        "degree": 30
      }
    }
  ],
  "content": "..."
}

Direction: up / down. Degree: a positive number (degrees).

Move To Store: Move to a storefront or doorway currently visible in the overlay.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "move_to_store",
      "arguments": {
        "store_id": "<store_id>",
        "approach": "inside_doorway"
      }
    }
  ],
  "content": "..."
}

Replace store_id with a key from current_obs_for_customer.visible_stores. Approach: inside_doorway / outside_doorway.

Move To Area: Move to the fixed point inside a currently visible area box.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "move_to_area",
      "arguments": {
        "area_id": "<area_id>"
      }
    }
  ],
  "content": "..."
}

Replace area_id with a key from current_obs_for_customer.visible_areas.

Check Item: Inspect and confirm details for a currently visible furniture item.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "check_item",
      "arguments": {
        "item_id": "<item_id>"
      }
    }
  ],
  "content": "..."
}

Replace item_id with a key from current_obs_for_customer.visible_items.

Add To Cart: Decide to buy the furniture currently being checked.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "add_to_cart",
      "arguments": {
        "item_id": "<item_id>"
      }
    }
  ],
  "content": "..."
}

Replace item_id with the ID of the furniture currently being checked.

Do Not Add To Cart: Decide not to buy the furniture currently being checked and exit that confirmation state.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "do_not_add_to_cart",
      "arguments": {}
    }
  ],
  "content": "..."
}

Idle: Do not move, inspect, or buy; only talk naturally or wait.

{
  "type": "final",
  "tool_calls": [
    {
      "name": "idle",
      "arguments": {}
    }
  ],
  "content": "..."
}