Q*Bert Reynolds

QBertReynolds@sh.itjust.works

Game Boys, bears, baseball

0 Posts
2 Comments

Joined 1 year ago

Cake day: July 1st, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

Q*Bert Reynolds@sh.itjust.workstoTechnology@lemmy.ml•1-bit LLM performs similarly to full-precision Transformer LLMs with the same model size and training tokens but is much more efficient in terms of latency, memory, throughput, and energy consumption.
link
fedilink
arrow-up
4·
8 months ago
Says 1-bit then goes on to describe inputs as -1, 0, or 1. That’s 2-bit. Am I missing something here?

link
fedilink

Q*Bert Reynolds@sh.itjust.workstoTechnology@lemmy.ml•Unpacking the hype around OpenAI’s rumored new Q* model
link
fedilink
arrow-up
13·
edit-2
11 months ago
It’s probably based on Q learning, which has been around for 30+ years, and I’m guessing the star is a nod to A* because it’s an optimization of some kind.

link
fedilink