Microsoft increases Bing AI chat tower limits per session

Less than a week after imposing search limits on the AI ​​version of its Bing search engine, Microsoft is raising those limits.

Following embarrassing reports of erratic behavior on the new Bing, Microsoft decided last Friday to limit a user’s daily chat usage to five “rounds” of chat per session and 50 rounds per day.

A round consists of a question from a user and an answer from Bing. After five rounds, users are prompted to change the subject of their conversation with the AI.

The changes were necessary because the underlying AI model used by the new Bing can get confused by long chat sessions consisting of multiple rounds, the company explained in its Bing blog.

However, on Tuesday, after an outcry from Bing users, Microsoft raised usage limits to six spins per session and 60 spins per day.

The new limits will allow the vast majority of users to use the new Bing naturally, the company blogged.

“That said, our intention is to go further and we plan to increase the daily cap to 100 total chats soon,” he added.

“Also,” he continued, “with this upcoming change, your normal searches will no longer count towards your chat totals.”

Crowd entrance required

Microsoft has decided to impose limits on the use of AI-powered Bing after some users found ways to trick the search engine into calling them an enemy and even making it double down on factual errors that ‘he committed, like the name of Twitter. CEO.

“[W] We have found that in long and extended chat sessions of 15 or more questions, Bing can become repetitive or be prompted/provoked to provide answers that are not necessarily helpful or in line with our designed tone,” Microsoft acknowledged in a blog.

With the new Bing AI usage limits, the company can admit something else. “It indicates that they did not correctly predict some of the responses and the turns this took,” said Greg Sterling, co-founder of Near Media, a news, commentary and analysis website, at TechNewsWorld.

“Despite the horror stories written about the new Bing, there are a lot of productivity gains with it, which shows the usefulness of such a tool in certain content scenarios,” said Jason Wong, vice president and analyst at Gartner.

“For many software companies, you won’t know what you’re getting until you take your software public,” Wong told TechNewsWorld.

“You can have all kinds of tests,” he said. “You can have teams do stress tests on it. But you won’t know what you have until the crowd gets there. Then hopefully you can discern some wisdom from the crowd.

Wong cited a lesson learned by LinkedIn founder Reid Hoffman, “If you’re not bothered by the first version of your product, you’ve launched it too late.”

Google too cautious with Bard?

Microsoft’s decision to launch its AI search vehicle with potential warts contrasts with the more cautious approach taken by Google with its Bard AI search product.

“Bing and Google are in different positions,” Sterling explained. “Bing needs to take more risks. Google has more to lose and will therefore be more cautious.

But is Google being too cautious? “It depends on what kind of bunny they have in their hat,” observed Will Duffield, political analyst at the Cato Institute.

“You’re only being too careful if you have a really good bunny and you don’t let him out,” Duffield told TechNewsWorld. “If your rabbit isn’t ready, there’s nothing overly cautious about holding him back.”

“If they have something good and they release it, then maybe people will say they should have released it months ago. But maybe months ago this wasn’t as good,” he added.

Threat to workers

Microsoft also announced on its blog that it will begin testing a Bing AI option that lets a user choose the tone of a chat from “accurate” – which will use Microsoft’s proprietary AI technology to focus on shorter, more research-oriented answers – to “balanced” and “creative” – which will use ChatGPT to give a user longer, more chatty answers.

The company explained that the goal is to give users more control over the type of chat behavior to better suit their needs.

“The choice is good in the abstract,” observed Sterling. “However, in these early days, the quality of ChatGPT answers may not be high enough.”

“So until the guardrails get tougher and the accuracy of ChatGPT improves, maybe it’s not such a good thing,” he said. “Bing will have to manage expectations and exclude ChatGPT content to some degree.”

Along the same lines, a survey of 1,000 business leaders published Tuesday by Resume Builder found that 49% of their businesses use ChatGPT; 30% plan to do so, and among companies using AI technology, 48% say it has replaced workers. The following charts reveal more data on how companies are using ChatGPT.

Co-pilot for humans

Sterling was skeptical of the replaced workers found in the survey. “I think a lot of companies are testing it. So in that sense, companies are ‘using’ it,” he noted.

“And some companies may recognize ways to save time or money and potentially replace manual labor or outsourcing,” he continued. “But the survey results lack context and present only partial information.”

He acknowledged, however, that patterns of hiring and self-employment will change over time due to AI.

Wong found the number of businesses using ChatGPT unsurprising, but not with the number of backup people.

“I can see that no one is writing documentation for an app or portal update, but to downsize or move people out of a role because they’re using ChatGPT, I’d be hard pressed to believe it,” he said.

“Gartner’s advice to customers exploring ChatGPT and Bing chat is to think of them as co-pilots,” he continued. “It’s going to help create something that should be reviewed by a human, by someone who is going to assess the validity of an answer.”

“Only in a small number of use cases could they replace a human,” he concluded.