AI is consistently wrong about all kinds of things, not just medical advice. One chatbot for a company running a mental health wellness program handed out advice more likely to cause people to have negative mental health. NYC’s chatbot encouraged landlords and business managers to break tenant and labor law, respectively.
Someone’s making a pile of money over it, though, and until we stop that it will keep getting shoved at us until we submit to it.
AI is consistently wrong about all kinds of things, not just medical advice. One chatbot for a company running a mental health wellness program handed out advice more likely to cause people to have negative mental health. NYC’s chatbot encouraged landlords and business managers to break tenant and labor law, respectively.
Someone’s making a pile of money over it, though, and until we stop that it will keep getting shoved at us until we submit to it.