From Leo:
Dear Brave Search Team,
I’m writing to report a significant accuracy issue in a recent AI-generated response related to SNAP benefit issuance dates in [notwillingtosay] County, Pennsylvania.
The AI initially provided correct general information about the issuance schedule (based on the last digit of the case number). However, when asked about September 2025, it incorrectly stated that benefits for case numbers ending in 6–0 would be issued on September 8, 2025 — which is wrong.
The correct date is September 10, 2025, as it is the 7th business day of the month, accounting for Labor Day (September 1) as a holiday. The AI admitted the error after correction but failed to catch it on the first attempt.
What went wrong:
-
The AI miscalculated business days due to a holiday (Labor Day).
-
It failed to verify date logic against standard Pennsylvania SNAP issuance rules.
-
The correction came only after user challenge, which risks harm if users don’t know the correct information.
Recommended fixes:
-
Improve date logic in AI responses — especially for time-sensitive public benefits information.
-
Integrate verified calendars (e.g., federal holidays) into reasoning for SNAP/EBT issuance dates.
-
Add a verification layer for high-stakes topics like food assistance, healthcare, and social services.
-
Allow user-reported errors to be logged and reviewed for model retraining.
This type of error may seem small, but for someone relying on food stamps to plan meals, a two-day mistake can cause real hardship. Accuracy in public benefit information is critical.
I urge you to treat this as a priority for improving trust and reliability in your AI assistant.
Description of the issue: Accuracy Issue in AI Response – Incorrect SNAP Benefit Date Provided for [notwillingtosay] County, PA
Brave Version (check About Brave):
Brave 1.82.161 (Official Build) (64-bit)
Operating System:
Edition Windows 11 Pro
Version 24H2
Installed on 6/1/2025
OS build 26100.5074
Experience Windows Feature Experience Pack 1000.26100.234.0