Experts Warn Generative AI Lacks Wisdom for Counseling

Generative AI is increasingly being used for emotional support, as large language models can quickly retrieve mental-health information and respond to personal concerns. Experts caution, however, that access to knowledge does not make a system a qualified counselor. Effective therapy also depends on empathy, self-reflection, emotional regulation and judgment grounded in a client’s circumstances — qualities that current models cannot reliably reproduce through language prediction alone.

The latest expert assessment says today’s models tend to deliver conclusions or advice instead of guiding users through questions that help them understand their emotions and needs. To serve safely in counseling, AI systems would need architectures designed for sustained, reflective dialogue, alongside safeguards against misleading responses and excessive dependence. The report cited no specific institution, publication date, financial amount or quantitative performance measure, limiting direct comparisons with licensed human practitioners.