Skip to content

[Bug]: Inconsistent responses when asking questions from uploaded document without applying filter in the chat #1145

@Revathypv

Description

@Revathypv

OpenRAG Version

0.3.0

Deployment Method

uv add (installed in project)

Operating System

macOS 26.3

Python Version

Python 3.13.3

Affected Area

Chat (chat interface, conversations, AI responses)

Bug Description

While testing OpenRAG accuracy, observed that several questions fail to return responses when no dataset filter is applied. The system returns a fallback message indicating that the information could not be found.
However, when the same query is executed with the appropriate dataset filter, the correct response is generated.

Steps to Reproduce

  1. Upload the attached document
  2. Navigate to chat and ask questions like:
    What is the total claim amount for California customers?
    Which state has the highest number of customers?
    How many customers are from Washington?
    What is the Customer Lifetime Value of customer BU79786?
    Which customers have more than 1 policy?

Customer_analysis_small (1).csv

Expected Behavior

User should get accurate response

Actual Behavior

Image Image Image Image Image

Attached the Function Call: search_documents (tool_call) info

Which state has the highest number of customers?.rtf
What is the total claim amount for California customers?.rtf
What is the Customer Lifetime Value of customer BU79786?.rtf

Which customers have more than 1 policy?.rtf

Relevant Logs

Screenshots

No response

Additional Context

No response

Checklist

  • I have searched existing issues to ensure this bug hasn't been reported before.
  • I have provided all the requested information.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bug🔴 Something isn't working.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions