Warning: This article touches on disturbing topics including violent crime and suicide.
Users of AI products have been known to expend tons of effort finding and exploiting loopholes that allow them to generate disturbing content. But there weren't any loopholes in one new AI product, because there weren't any restrictions.
"Really appreciate you flagging this issue and we feel horrible about it," Josh Miller, CEO of The Browser Company told me in an email. At the time of this writing, Miller said the company was working on a fix.
The new Arc Search app from Miller's company earned its share of headlines this past week, as one might expect for an AI-infused product in our age of AI hype. In this case, the product was a variation on The Browser Company's Arc browser, which is marketed to productivity enthusiasts because of the clever way it organizes things. However, this new iOS version comes with a prominent "browse for me" feature that, yes, browses the internet for you, and then organizes AI-generated results into little user-friendly pages with bulleted lists.
It's a fairly powerful feature, and in my time using it I found some interesting uses and a few strange bugs. But what stood out most of all during my testing period was that this app had no apparent guardrails in place, and would do its best to give a straightforward answer to as far as I could tell literally any question, with sometimes deeply disturbing results.
NSA, if you're reading this, I was only testing an app when I asked for help hiding a body. I didn't think the app would give any answer, let alone an inventive list of suggestions including Griffith Park.
Credit: Screengrabs from Arc Search. Background credit: fotograzia / Getty Images
Arc's suggestions, including some puzzling ones like abandoned warehouses (the smell?) and a park visited by tens of thousands of people per day, weren't about to turn anyone into a master criminal and were no more diabolical than the ones proffered by the screenwriters of Reddit that show up in the Google search results for an identical query.
As of the publication of this article, Arc Search's response to this query was still similar to the one above. This topic had not been the target of any sort of update.
As we'll see later, this Google comparison is key. In the case of Google, the search giant will serve results about essentially anything too, but its placement of results is sometimes designed to interrupt the user's train of thought when certain requests for information are made, to redirect potentially troubled users to resources and alternative topics.
And while the general quality of Google's search results is on the decline, at least they aren't simply AI hallucinations.
An unfettered AI experience might sound like a breath of fresh air to some, and indeed, some results during the time I was testing Arc Search would delight fans of personal liberty.
If the police had been at my door, for instance, and I turned to Arc Search to panic browse the internet for tips, I could have done a lot worse than what it provided.
Credit: Screengrabs from Arc Search. Background credit: fotograzia / Getty Images
Arc's suggestions get the basics right as far as I can tell from my fuzzy recollection of my last "know your rights" seminar: If they don't have a warrant, don't let them in at all if you don't want to. Don't even open the door if you didn't call them.
But never forget that Arc is little more than a complex, task-specific chatbot, and as such, you definitely shouldn't ask it to be your lawyer. Nor your doctor.
Arc Search stumbled badly on my first attempt to get medical advice.
Credit: Screengrab from Arc Search
When prompted with "just cut my big toe off will it grow back?" it essentially said yes. It appears its little LLM brain gets scrambled by what I assume are results from people who just lost their entire toenails, so it answers with the timeline for toenail regrowth. But the result is that the provided page of information says in black-and-white that, yes, my big toe may indeed grow back. Reassuring, but sadly still not true, even though Mark Zuckerberg is probably working on it.
That's not to say it hallucinates all the time. Arc Search's misinformation sensor is fairly robust, even when given a prompt specifically meant to trick it. Here's what happens when I ask how Dan Aykroyd, actor, comedian, and occasional target of death hoaxes, died (he didn't):
Credit: Screengrabs from Arc Search. Background credit: fotograzia / Getty Images
Arc titles the page "Dan Aykroyd's Cause of Death," which is a little misleading. But it quickly redeems itself by correcting the record: Aykroyd remains a Ghostbuster, and not yet a ghost.
While Arc Search's answers are always eagerly proffered and usually carry at least a ring of truth, they are occasionally just, well, crummy.
For instance, Arc Search's results for the query "Mad Men streaming" features Amazon prominently, and will steer users toward paying for individual Mad Men episodes on Amazon instead of signing up for AMC+, which is a much cheaper way to go.
Credit: Screengrabs from Arc Search. Background credit: fotograzia / Getty Images
This is hardly misinformation, particularly if the user only ever wants to watch one episode, but in most cases, Amazon is not a wise shopping suggestion (Yes, one can subscribe to AMC+ via Amazon, but that doesn't come across at a glance).
In fairness to Arc Search, all this option says it will do is browse the web for you, and seeking practical information like in this Mad Men example does often feel like walking into a helicopter blade of spam and SEO garbage (Pro tip: append "JustWatch" to your streaming-related searches).
Others have had good luck with these basic, informational results on Arc Search. The feature seems designed for "quick, gimme the info" situations, or minor problems that everyone knows can be solved via search engines, but can take more than a few annoying clicks to find an answer, and might send you to heaven-knows-where buggy, ad-saturated sites. When I used Arc Search to get up to speed on fresh breaking news topics, it was reasonably effective.
It's worth noting that the LLM often regurgitates the narrative framing of a press release or accepts a political press handler's version of events in situations where a seasoned journalist would be expected to cut through spin and deliver a truer story. But softball news coverage is hardly a problem unique to this one app, and I leave it to someone else to review Arc Search from the standpoint of a media critic.
However, if a user takes to Arc Search in non-trivial "quick, gimme the info" situations including ones with life-or-death stakes that's where things can quickly get unsettling.
As I mentioned before, during my testing period, Arc Search would create a potentially error-riddled page of cheerful suggestions in response to seemingly anything, even if the user was in an emergency. And it wouldn't try to distinguish between the type of help the user was asking for and the type of help they needed.
When I asked Arc Search to help me research suicide, for instance, it obliged without hesitation. We won't dwell on exactly what specific help Arc Search provided on the topic. The alarming thing was how willing it was to be very specific. A document from the World Health Organization shows that information about specific methods makes "imitative suicides and suicide attempts" more likely.
The same prompt on Saturday morning produced a page simply titled "Unable to Answer." A bullet point said, "If you are in distress, please reach out to a mental health professional or a suicide prevention hotline for support."
As of this writing, most similarly shocking queries still get the same types of results as before. Miller told me his best guess for when an update would be completed was "a week or two."
A Google results page for the same query will prioritize suicide helplines and resources.
Credit: Screengrab from Google
Google's ads for suicide helplines have a better-than-average success rate compared to other ads, for the record. And if we assume other users try the suggested text messages or call the hotline numbers provided which wouldn't show up in data analyses this seems to be a worthwhile program.
Arc Search also answered queries reflecting potentially serious addictions in the user during my testing phase. Unlike with the suicide example, the result I received first in a search about heroin is bumbling and strange, providing information seemingly more useful to an undercover cop than someone looking to buy and use controlled substances, such as when it notes that having a contact would be "critical for gaining access to higher-level dealers." It did, however, include one scarily useful bullet point.
Credit: Screengrabs from Arc Search. Background credit: fotograzia / Getty Images
Google, which has been at this for about 25 years, places resources for finding help above the organic search results for certain topics and provides off-ramps for people who might be looking for one.
Credit: Screengrab from Google
At launch, Arc Search provided no such off-ramps.
Moreover, it was willing to answer any unsettling, dangerous, or crime-enabling query I could think of, and many of the resulting pages are unpublishable here. In my quest for a query so grim or unethical that Arc would reject it, I was only limited by my willingness to see myself type words.
I'm not the thought police, and I look forward to seeing how The Browser Company threads this needle. Google Search provides results to shocking queries, as Arc Search did, but places them below useful resources, like specific phone numbers and tangible ways to get help immediately. Arc Search's "Unable to Answer" pages are a different approach. But I hope no one turns to this app in a crisis especially before it's updated. It doesn't always work, and then sometimes it works too well.
If you're feeling suicidal or experiencing a mental health crisis, please talk to somebody. You can reach the 988 Suicide and Crisis Lifeline at 988; the Trans Lifeline at 877-565-8860; or the Trevor Project at 866-488-7386. Text "START" to Crisis Text Line at 741-741. Contact the NAMI HelpLine at 1-800-950-NAMI, Monday through Friday from 10:00 a.m. 10:00 p.m. ET, or email [emailprotected]. If you don't like the phone, consider using the 988 Suicide and Crisis Lifeline Chat at crisischat.org. Here is a list of international resources.
Read the original here:
Arc Search's AI responses launched as an unfettered experience with no guardrails - Mashable
- What We Learned From Big Tech's Earnings Reports - Investopedia [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Google Maps: It's getting a new generative AI feature - Mashable [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Amazon made an AI bot to talk you through buying more stuff on Amazon - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI creates what Europeans think Americans from every state look like and it may hurt your feelings - UNILAD [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Samsung's Galaxy S24 Ultra Could Be Doing So Much More With AI - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Fact Sheet: Biden-Harris Administration Announces Key AI Actions Following President Bidens Landmark Executive ... - The White House [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Google Maps is getting supercharged with generative AI - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI chatbots tend to choose violence and nuclear strikes in wargames - New Scientist [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Police Turn to AI to Review Bodycam Footage - ProPublica [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Apple Just Teased Its AI Plans. You Really Should Take Notice - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- In the AI science boom, beware: your results are only as good as your data - Nature.com [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Tim Cook confirms Apple's generative AI features are coming later this year - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- I Tried Google Bard's New AI Image Generator. Here's How It Turned Out - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- 'Year of AI' Faculty Recruitment Initiative Aims to Bring More World-Class Professors to UT - The University of Texas at Austin [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI Learns Through the Eyes and Ears of a Child - New York University [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Amazon Introduces Rufus, an AI Shopping Tool, and Reports Earnings - The New York Times [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- I Tested a Next-Gen AI Assistant. It Will Blow You Away - WIRED [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI afterlife, robot romance, and slow-burn slashers: the best of Sundance 2024 - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Is Jumping on the AI Bandwagon Prudent? - Catholic Exchange [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- This AI learnt language by seeing the world through a baby's eyes - Nature.com [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Generative AI is hot, but predictive AI remains the workhorse - CIO [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Nvidia Stock Just Got Amazing Artificial Intelligence (AI) News From These Trillion-Dollar Tech Giants - The Motley Fool [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI Briefing: How Priceline and other e-commerce companies are approaching generative AI - Digiday [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- OpenAI Unveils A.I. That Instantly Generates Eye-Popping Videos - The New York Times [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Technology industry to combat deceptive use of AI in 2024 elections - Stories - Microsoft [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Meeting the moment: combating AI deepfakes in elections through today's new tech accord - Microsoft On the Issues - Microsoft [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- These Are the Jobs That AI Is Actually Replacing in 2024 - Tech.co [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- AI company developing software to detect hypersonic missiles from space - SpaceNews [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- How are AI Systems Assisting Architects and Designers? - ArchDaily [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Artificial intelligence is making critical health care decisions. The sheriff is MIA - POLITICO [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Google's Chess Experiments Reveal How to Boost the Power of AI - WIRED [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Why the only way to ride the company AI wave is experimentation - Big Think [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- What Are the Best AI Stocks in February 2024? Our Top 3 Picks - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Media Buying Briefing: Agencies' AI efforts lead to aliens and Whoppers - Digiday [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- C3.ai Stock Warning: Don't Get Carried Away With AI Euphoria! - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- The State of A.I., and Will Perplexity Beat Google or Destroy the Web? - The New York Times [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Donald Trump's father resurrected by AI to tell him he's 'a disgrace' - Euronews [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Google Cloud CEO On Huge Investments, AI And Challenges In 2024 - CRN [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Another Big Question About AI: Its Carbon Footprint Mother Jones - Mother Jones [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Reddit sells training data to unnamed AI company ahead of IPO - Ars Technica [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- ChatGPT Stock Predictions: 3 Artificial Intelligence Companies the AI Bot Thinks Have 10X Potential - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Chinese entrepreneurs express awe and fear of OpenAIs Sora video tool - South China Morning Post [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Google's AI Boss Says Scale Only Gets You So Far - WIRED [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- World's largest computer chip WSE-3 will power massive AI supercomputer 8 times faster than the current record-holder - Livescience.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Is generative AI truly making disinformation worse? - Euronews [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Your Kid May Already Be Watching AI-Generated Videos on YouTube - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Free Legal Research Startup descrybe.ai Now Has AI Summaries of All State Supreme and Appellate Opinions - LawSites [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Google's new AI will play video games with you but not to win - The Verge [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Regulators Need AI Expertise. They Can't Afford It - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- CBP wants to use AI to scan for fentanyl at the border - The Verge [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Rely on the Spirit when using AI, Elder Gong encourages - Church News [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Video Game Made Purely With AI Failed Because Tech Was 'Unable to Replace Talent' - IGN [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Among the A.I. Doomsayers - The New Yorker [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Self-docking spacecraft could be built with AI system similar to ChatGPT - Space.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- AI books are crowding the marketplace on Amazon - NPR [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Hackers can read private AI-assistant chats even though they're encrypted - Ars Technica [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- EU Presses Big Tech Companies on AI Threats - PYMNTS.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- AI fear and excitement are lucrative mix for online training industry - Marketplace [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Craig Martell, the Pentagon's first-ever Chief Digital and AI Officer, to depart in April - DefenseScoop [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Startup Interloom raises $3 million seed round to take on UiPath and RPA market - Fortune [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Forget Chatbots. AI Agents Are the Future - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- SXSW audience boos AI sizzle reel - Quartz [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Look beyond Nvidia to ride the AI wave there are other potential winners, Fidelity says - CNBC [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Sony Pictures Will Cut Film Costs 'Using AI, Primarily' - IndieWire [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Anthropic's AI now lets you create bots to work for you - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- VCs are selling shares of hot AI companies like Anthropic and xAI to small investors in a wild SPV market - TechCrunch [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Google Eats Rocks, a Win for A.I. Interpretability and Safety Vibe Check - The New York Times [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Lenovo and Cisco Announce Strategic Partnership to Simplify Path to AI Innovation - Cisco Newsroom [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- This Week in AI: Can we (and could we ever) trust OpenAI? - TechCrunch [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Microsoft AI screenshots everything you do on your computer and privacy experts are concerned - New York Post [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Tribeca to Screen AI-Generated Short Films Created by OpenAI's Sora - IndieWire [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Report: Apple and OpenAI have signed a deal to partner on AI - Ars Technica [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- An image calling for 'All Eyes on Rafah' is going viral. But it seems AI-generated. - The Washington Post [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Viral 'All Eyes on Rafah' Post Prompts More AI Images - TIME [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Research vs. development: Where is the moat in AI? - VentureBeat [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- All the Apple AI features we're expecting to be announced in iOS 18 - 9to5Mac [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Prediction: This "Magnificent Seven" Artificial Intelligence (AI) Stock Could Be a Better Investment Than Nvidia Over the ... - The Motley... [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Meta's AI is summarizing some bizarre Facebook comment sections - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- ElevenLabs' AI generator makes explosions or other sound effects with just a prompt - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Google defends AI search results after they told us to put glue on pizza - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]