We will add quantized CodeGen for fast inference on CPUs up on cformers (https:/... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ayushkaushal on March 22, 2023 \| parent \| context \| favorite \| on: FauxPilot – An open-source GitHub Copilot server We will add quantized CodeGen for fast inference on CPUs up on cformers (https://github.com/NolanoOrg/cformers/) by later today.

meghan_rain on March 22, 2023 | [–]

> by later today

Wow, that's the timeframe things are moving at right now, we better get used to it!

syntaxing on March 22, 2023 | | [–]

Whoa is there a PR or wiki about this

underlines on March 22, 2023 | [–]

4bit GPTQ maybe?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact