Where? Apple and Microsoft are the only ones I’ve seen offering on-device AI. It’s been proven that Google is lying about this on several occasions. Mostly with their photo editor.
Gemini Nano. It’s in Pixel Recorder and Gboard but multimodal capabilities are coming soon. It’s very limited to a couple phones and not many companies outside of Google have access, but it has been used in production since last year.
Apple does not have on device AI in production today. Microsoft’s “Copilot+PCs” launched less than 2 weeks ago, but are significantly more powerful machines.
It’s something similar like the dotcom crash where everyone and their mother is looking to capitalize on The Next Big Thing™ which will then crash spectacularly but will leave a host of survivors that’ll be the next big companies.
Writing it off as a fad is rather ignorant. Sure there’s a lot of hype and bullshit surrounding AI, but it already has strong use cases and earns a profit for the companies involved. It’s still the early years for the tech too, so it is reasonable to expect it to improve in the coming years, both in terms of accuracy and performance.
Saying it’s not a fad is rather ignorant. Sure it has practical uses but it’s also being shoved into literally everything, even if purely by name, with little to no actual improvement.
I don’t disagree with the idea that AI is being shoved into software without much purpose or thought, but that’s got little to do with whether it is here to stay or not. It’s here to stay for its many practical uses, be it new personal assistants like what Apple has shown off with Siri, text summarization like what is being added to browsers, rephrasing/tone checking like what is being added to office software, or code completion and debugging like what is being added to code editors. These applications have proved their worth, and even if some applications are just because hype, these applications are here to stay.
I’m sitting here really hoping that models hit a plateau in capabilities soon. Continuing to get smaller/more efficient would be great, but if the capabilities of our best models would plateau for a bit and give society time to adjust to the impact I would be very happy.
It’s certainly not moving as fast as their promises (what ever does), and perhaps has slowed, but for me at least it’s too early to call a plateau. Perhaps someone who works in the field or follows more closely can provide a better characterization, though.
We’re already seeing a slight leveling off compared to what we had previously. Right now there is a strong focus on optimization, getting models that can run on-device without losing too much quality. This will both help make LLMs sustainable financially and energy-wise, as well as mitigate the privacy and security concerns inherent to the first wave of cloud-based LLMs.
I’ve never seen more hype around anything in my life than AI. This is so wild. Can’t wait for this fad to die.
There is no way it’s going to die.
I’ve been using various “Ai” things and it’s helped me significantly with my work. (Freelance)
Just yesterday I was able to complete a 15-20 minute task in just 4 minutes.
I use it everyday and it’s enabled me to do so much of my busy work in minutes.
This has already been discussed in other comments in this thread.
especially remote ai that relies on google’s servers, because it’s not even impressive anymore.
Ironically Google is kind of the only one actually doing on device AI.
Where? Apple and Microsoft are the only ones I’ve seen offering on-device AI. It’s been proven that Google is lying about this on several occasions. Mostly with their photo editor.
Gemini Nano. It’s in Pixel Recorder and Gboard but multimodal capabilities are coming soon. It’s very limited to a couple phones and not many companies outside of Google have access, but it has been used in production since last year.
Apple does not have on device AI in production today. Microsoft’s “Copilot+PCs” launched less than 2 weeks ago, but are significantly more powerful machines.
Nor does Google. It says right on this page:
Huh? Multimodal is coming later this year (like I said in my last comment).
They have had on device Gen AI running on Pixel phones in production since last year.
I don’t understand any of these words and they all sound super made-up and ridiculous.
It’s something similar like the dotcom crash where everyone and their mother is looking to capitalize on The Next Big Thing™ which will then crash spectacularly but will leave a host of survivors that’ll be the next big companies.
Writing it off as a fad is rather ignorant. Sure there’s a lot of hype and bullshit surrounding AI, but it already has strong use cases and earns a profit for the companies involved. It’s still the early years for the tech too, so it is reasonable to expect it to improve in the coming years, both in terms of accuracy and performance.
It’s still a fad. Sure it has some uses but most of it is hype right now and they throw AI onto everything.
Saying it’s not a fad is rather ignorant. Sure it has practical uses but it’s also being shoved into literally everything, even if purely by name, with little to no actual improvement.
I don’t disagree with the idea that AI is being shoved into software without much purpose or thought, but that’s got little to do with whether it is here to stay or not. It’s here to stay for its many practical uses, be it new personal assistants like what Apple has shown off with Siri, text summarization like what is being added to browsers, rephrasing/tone checking like what is being added to office software, or code completion and debugging like what is being added to code editors. These applications have proved their worth, and even if some applications are just because hype, these applications are here to stay.
Some of it will stay. Most of it will go. That’s how fads work.
I’m sitting here really hoping that models hit a plateau in capabilities soon. Continuing to get smaller/more efficient would be great, but if the capabilities of our best models would plateau for a bit and give society time to adjust to the impact I would be very happy.
Hasn’t it already kind of p;plateaued, or slowed at least. They where promising the world and it seems to have kind of halted.
It’s certainly not moving as fast as their promises (what ever does), and perhaps has slowed, but for me at least it’s too early to call a plateau. Perhaps someone who works in the field or follows more closely can provide a better characterization, though.
We’re already seeing a slight leveling off compared to what we had previously. Right now there is a strong focus on optimization, getting models that can run on-device without losing too much quality. This will both help make LLMs sustainable financially and energy-wise, as well as mitigate the privacy and security concerns inherent to the first wave of cloud-based LLMs.