We are happy to announce that we have brought up support for Llama-3.1-70B inference on Tenstorrent’s 8-chip systems, the TT-QuietBox and the TT-LoudBox. The source code for Llama-3.1-70B and other models that are supported is on our GitHub ---> https://lnkd.in/e7vXJYX3
Tenstorrent
Computer Hardware Manufacturing
Toronto, ON 39,011 followers
Building computers for AI.
About us
Tenstorrent is a next-generation computing company that builds computers for AI. Headquartered in the U.S. with offices in Austin, Texas, and Silicon Valley, and global offices in Toronto, Belgrade, Seoul, Tokyo, and Bangalore, Tenstorrent brings together experts in the field of computer architecture, ASIC design, RISC-V technology, advanced systems, and neural network compilers. Tenstorrent is backed by Eclipse Ventures and Real Ventures, Archerman Capital, Samsung Catalyst Fund, and Hyundai Motor Group among others. Join us: www.tenstorrent.com/careers.
- Website
-
https://www.tenstorrent.com
External link for Tenstorrent
- Industry
- Computer Hardware Manufacturing
- Company size
- 201-500 employees
- Headquarters
- Toronto, ON
- Type
- Privately Held
- Founded
- 2016
- Specialties
- Deep learning hardware
Locations
Employees at Tenstorrent
Updates
-
""It’s always rewarding to get more of our products into developer hands," shared Jim Keller in a press release. "Releasing development systems with our Wormhole card helps developers scale up and work on multi-chip AI software."
Tenstorrent's RISC-V-based Wormhole AI accelerators are available for pre-order today — pre-built workstations start at $12,000
tomshardware.com
-
Watch Jim Keller, Raja Koduri, Chris Walker and Charlie Cheng talk about how #OpenSource is transforming AI and hardware -->
RISC V Ecosystem Panel | Open Source is Transforming AI and Hardware
https://www.youtube.com/
-
The Wormhole™ cards, TT-LoudBox and the TT-QuietBox are fully supported by Tenstorrent’s open-source TT-Buda and TT-Metallium software stacks which enable support for multiple LLMs and other popular AI models. Join the Tenstorrent Discord to chat directly with the developer community and get support from the Tenstorrent team.
Join the Tenstorrent Discord Server!
discord.com
-
Meet Wormhole™, our next generation chip featuring PCIe cards and workstations designed for developers who are interested in scalability for multi-chip development using Tenstorrent’s powerful open-source software stacks. The Wormhole™ family includes the all new TT-QuietBox, a high-end, water-cooled AI developer workstation that delivers the power of eight processors in a quiet form factor, now available for pre-order.
Wormhole
tenstorrent.com
-
"I can't tell today if this is going to be bigger or smaller. So our strategy is that we build a technology that fits a wide range of products," Jim Keller in Nikkei.
U.S. chip designer aims to bring down AI prices pushed up by Nvidia
asia.nikkei.com
-
Thanks Sally Ward-Foxton
Jim Keller's startup Tenstorrent is working on another form factor for its #AI computers—this time, in a field with little competition.
Tenstorrent To Offer AI Workstation For Developers
https://www.eetimes.com
-
"He also visited offices of promising AI startups there to be updated on the latest tech advancements. In particular, Koo paid keen attention to a complete AI value chain during a visit to the headquarters of Figure AI, a humanoid robot startup there. He also met with Tenstorrent CEO Jim Keller to exchange views on the AI chip industry, as its usage is rapidly expanding in a number of tech sectors, encompassing consumer electronics, vehicle components and telecommunications." Thank you Chairman Koo Kwang-mo for the visit LG Electronics
LG chief visits US to seek AI, bio, clean tech growth engines
koreatimes.co.kr
-
“We believe Baya’s high-performance, reliable chiplet-ready fabric, and advanced analysis capability, design-time, and post-silicon runtime tuning, will be an essential component of Tenstorrent's ability to deliver high-performance costperformance cost-effective multi-chip designs that next-level energy efficiency and are future-proofed for fast evolving applications.” We are excited to announce that we will be licensing Baya Systems customizable Weave IP™ fabric. Find out more -->
Tenstorrent Licenses Baya Systems’ Fabric into next-generation AI and Compute Chiplet Solutions
https://tenstorrent.com
-
"We give you 100% #opensource software and 100% open source models. You can get on Hugging Face, download the model and run it; we make it very easy for you to do that.” -Tenstorrent COO Keith Witek in Analytics India Magzine.
‘AI Chips Will Eventually Replace GPUs and Even NVIDIA Knows This’
http://analyticsindiamag.com