Research note 005
Prompt intent is not response treatment
What the user asked for and what the AI did are two different facts. FirmRanker stores them separately.
Two different facts
Prompt intent describes the kind of response a question appears to request: a direct recommendation, a comparison, a list of reputable firms or a shortlist for a specific problem. Response treatment describes what the answer actually did with each firm.
AI systems often hedge, decline to recommend, redirect users to directories or professional bodies, or answer a recommendation request with a neutral list. If intent is used as a proxy for treatment, every firm in a “recommendation” answer looks recommended.
Examples
- Intent: direct recommendation
- Which family lawyer in Sydney should I use?
- Treatment observed
- “I can't recommend a specific lawyer, but firms in Sydney include…” — firms are suggested, not recommended.
- Intent: information
- How does property settlement work after separation?
- Treatment observed
- The answer names one firm as a source of guidance — the firm is mentioned, not suggested.