Too Cheap to Meter
A 125-billion-parameter model now runs on the computer under my desk at about 38 tokens a second. What it compares to, where it falls short, and the overnight work I want from it.…
}
Skip to main content2 posts
A 125-billion-parameter model now runs on the computer under my desk at about 38 tokens a second. What it compares to, where it falls short, and the overnight work I want from it.…
The screwdriver ships in the box. The RAM doesn't come out. A short walk through building the Framework Desktop, and what it said when I turned it on.…