Finally, excited to launch Truffle-1 — a $1299 inference engine designed to run OSS models using just 60 watts preorder.itsalltruffles.com
Truffle is not peak $/flop on the market nor is it designed to be. Instead, we built a compiler stack from the ground up for an Nvidia Orin device, a custom carrier board, and a nice shell.
It'll run Mixtral at 22+ tokens/s without speculative decoding, which is 2x faster than GGML on the Nvidia Orin architecture because of our software stack.
Our compiler is not open source. It is optimized for our boards, and thus wouldn't be valuable to OSS anyway
This tweet will cost me followers, make people think I’m a religious nut job, and likely blacklist me from being funded by some VCs but it’s important
> Sam Altman is probably the anti christ
1. He’s setting up a totalitarian system, and knows how to play the charisma card.
Worldcoin: An Iris scan for some useless token. UBI via the world app, and we’re not even allowed to talk about the technology the Orb is built off to make sure it isn’t nefariously storing data
> He did a bait and switch with OpenAI. Nobodies asking for gpt4 weights. But he used OSS research (transformers) to get this far, and won’t even contribute back with knowledge.
He says it’s for “SaFEty” but where have we heard that before? Oh yeah — financial regulation after 9/11, forced vaccinations during Covid. Etc.
The crypto bill should pass with the strictest regulations possible.
A contrarian 🧵 (1/7)
Whitepapers have been published on every single protocol, explaining how their protocols are censorship resistant, decentralized, etc etc. All the buzzwords you'd expect from a crypto project,
None have been battle-tested.
If you've been in crypto for a long time, you knew that the day would come when governments would stop laughing at it, but start fighting it. The day is now here.
What use is crypto if it's unable to withstand even the strictest regulation?