💬 Using GPT4All.. on a Mac Pro 2013
I fully admit this might have been a bad idea. I found that you could load GPT4All onto your local machine and that it was available for Mac. Since 2013 supports Monterey, I decided to give it a shot. The install was a breeze and in a few minutes I was downloading the recommended model and database – Hermes at 13GB. With that done, it was time to give local AI a try. And that’s when the joyfulness was over. I’m not going to say a Mac Pro 2013 was the right machine for the job, but the processing of my request took minutes to complete, and the result was typed out like it was 1980 and I was on a 300 baud dial-up connection. The response is measured in tokens per second and it never got into the double digits. It crawled along at 6-8 max with lots of pauses. Maybe the AI engine was as annoyed as I […]
Recent Comments