<\/p>\n
If you ask Alexa, Amazon\u2019s voice assistant AI system, whether Amazon is a monopoly, it responds by saying it doesn\u2019t know<\/a>. It doesn\u2019t take much to make it lambaste the other tech giants<\/a>, but it\u2019s silent about its own corporate parent\u2019s misdeeds.<\/p>\n When Alexa responds in this way, it\u2019s obvious that it is putting its developer\u2019s interests ahead of yours. Usually, though, it\u2019s not so obvious whom an AI system is serving. To avoid being exploited by these systems, people will need to learn to approach AI skeptically. That means deliberately constructing the input you give it and thinking critically about its output.<\/p>\n Newer generations of AI models, with their more sophisticated and less rote responses, are making it harder to tell who benefits when they speak. Internet companies\u2019 manipulating what you see to serve their own interests is nothing new. Google\u2019s search results and your Facebook feed are filled with paid entries<\/a>. Facebook<\/a>, TikTok<\/a> and others manipulate your feeds to maximize the time you spend on the platform, which means more ad views, over your well-being.<\/p>\n What distinguishes AI systems from these other internet services is how interactive they are, and how these interactions will increasingly become like relationships. It doesn\u2019t take much extrapolation from today\u2019s technologies to envision AIs that will plan trips for you, negotiate on your behalf, or act as therapists and life coaches.<\/p>\n They are likely to be with you 24\/7, know you intimately, and be able to anticipate your needs. This kind of conversational interface to the vast network of services and resources on the web is within the capabilities of existing generative AIs like ChatGPT<\/a>. They are on track to become personalized digital assistants<\/a>.<\/p>\n As a security expert<\/a> and data scientist<\/a>, we believe that people who come to rely on these AIs will have to trust them implicitly to navigate daily life. That means they will need to be sure the AIs aren\u2019t secretly working for someone else. Across the internet, devices and services that seem to work for you already secretly work against you. Smart TVs spy on you<\/a>. Phone apps collect and sell your data<\/a>. Many apps and websites manipulate you through dark patterns<\/a>, design elements that deliberately mislead, coerce or deceive website visitors<\/a>. This is surveillance capitalism<\/a>, and AI is shaping up to be part of it. <\/p>\n Quite possibly, it could be much worse with AI. For that AI digital assistant to be truly useful, it will have to really know you. Better than your phone knows you. Better than Google search knows you. Better, perhaps, than your close friends, intimate partners, and therapist know you.<\/p>\n You have no reason to trust today\u2019s leading generative AI tools<\/a>. Leave aside the hallucinations<\/a>, the made-up \u201cfacts\u201d that GPT and other large language models produce. We expect those will be largely cleaned up as the technology improves over the next few years.<\/p>\n But you don\u2019t know how the AIs are configured: how they\u2019ve been trained, what information they\u2019ve been given, and what instructions they\u2019ve been commanded to follow. For example, researchers uncovered the secret rules<\/a> that govern the Microsoft Bing chatbot\u2019s behavior. They\u2019re largely benign but can change at any time.<\/p>\n Many of these AIs are created and trained at enormous expense by some of the largest tech monopolies. They\u2019re being offered to people to use free of charge, or at very low cost. These companies will need to monetize them somehow. And, as with the rest of the internet, that somehow is likely to include surveillance and manipulation.<\/p>\n Imagine asking your chatbot to plan your next vacation. Did it choose a particular airline or hotel chain or restaurant because it was the best for you or because its maker got a kickback from the businesses? As with paid results in Google search, newsfeed ads on Facebook, and paid placements on Amazon queries, these paid influences are likely to get more surreptitious over time.<\/p>\n If you\u2019re asking your chatbot for political information, are the results skewed by the politics of the corporation that owns the chatbot? Or the candidate who paid it the most money? Or even the views of the demographic of the people whose data was used in training the model? Is your AI agent secretly a double agent? Right now, there is no way to know.<\/p>\n We believe that people should expect more from the technology and that tech companies and AIs can become more trustworthy. The European Union\u2019s proposed AI Act<\/a> takes some important steps, requiring transparency about the data used to train AI models, mitigation for potential bias, disclosure of foreseeable risks, and reporting on industry-standard tests. <\/p>\n Most existing AIs fail to comply<\/a> with this emerging European mandate, and, despite recent prodding<\/a> from Senate Majority Leader Chuck Schumer, the U.S. is far behind on such regulation.<\/p>\n The AIs of the future should be trustworthy. Unless and until the government delivers robust consumer protections for AI products, people will be on their own to guess at the potential risks and biases of AI and to mitigate their worst effects on people\u2019s experiences with them.<\/p>\n So when you get a travel recommendation or political information from an AI tool, approach it with the same skeptical eye you would a billboard ad or a campaign volunteer. For all its technological wizardry, the AI tool may be little more than the same.<\/p>\n This article is republished from <\/em>The Conversation<\/a> under a Creative Commons license. Read the original article<\/a> by Bruce Schneier<\/a>, Adjunct Lecturer in Public Policy, Harvard Kennedy School<\/a>, and Nathan Sanders<\/a>, Affiliate, Berkman Klein Center for Internet and Society, Harvard University<\/a>.<\/em><\/p>\n<\/p><\/div>\nPersonalized digital assistants <\/h2>\n
In the dark<\/h2>\n
Making money<\/h2>\n
Trustworthy by law<\/h2>\n
\n