bitnet.cpp from Microsoft: Run LLMs locally on CPU! (hands-on)
6:00
bitnet.cpp from Microsoft: Run LLMs locally on CPU! (hands-on)
3.8K viewsOct 29, 2024
YouTubeAI Bites
Microsoft researchers release bitnet.cpp, the official inference framework for 1-bit LLMs like BitNet b1.58. It has optimized kernels for fast, lossless inference on CPUs, achieving impressive speedups on ARM and x86 CPUs and significant energy reductions. https://msft.it/6180WGJjy | Microsoft Research
0:35
Microsoft researchers release bitnet.cpp, the official inference fr…
1.3K viewsOct 23, 2024
FacebookMicrosoft Research
Maybe this concept killed the future GPU mafia! 🤯 They've open-sourced bitnet.cpp, a blazing-fast 1-bit LLM inference framework optimized for CPUs. This is a major step forward for running large models locally, without expensive GPUs or cloud costs. Key highlights: - Achieve up to 6x faster inference with 82% lower energy consumption - Run 100B parameter models directly on x86 CPUs - Leverage ternary weights (-1, 0, 1) and 8-bit activations to dramatically reduce memory usage Alongside this, Mi
0:14
Maybe this concept killed the future GPU mafia! 🤯 They've open-source…
3.8K views6 months ago
FacebookMd Ismail Sojal
Tutorial de BitNet.cpp para LLMs de 1 Bit - para Inferencia Eficiente
16:23
Tutorial de BitNet.cpp para LLMs de 1 Bit - para Inferencia Eficiente
2.5K viewsOct 20, 2024
YouTubeLLM Master Cursos
Bitnet.CPP - Run 100B Models on CPU - Easy Install on Windows, Linux, Mac
10:04
Bitnet.CPP - Run 100B Models on CPU - Easy Install on Windows, Li…
17.6K viewsOct 19, 2024
YouTubeFahd Mirza
BitNet b1.58 LOCAL Test & Install (A 1-Bit LLM!)
16:40
BitNet b1.58 LOCAL Test & Install (A 1-Bit LLM!)
29.2K views11 months ago
YouTubeBijan Bowen
Test BitNet : un LLM 1-bit qui tourne sur CPU ? : Setup et test en local (LLM open source)
8:13
Test BitNet : un LLM 1-bit qui tourne sur CPU ? : Setup et test en local (…
275 views9 months ago
YouTubePythonia Formation
Holy ****... Microsoft open sourced an inference framework that runs …
29 views3 weeks ago
linkedin.com
Microsoft open sourced an inference framework that runs a 1…
3 weeks ago
linkedin.com
5:21
Microsoft Just Fixed Local AI (BitNet 1.58-bit LLMs)
352 views3 weeks ago
YouTubeNewTechWorld
25:08
how to run microsoft bitnet-b1.58-2B-4T locally
2.2K views11 months ago
YouTubeTotal Technology Zonne
0:34
You can now run 100B parameter models on your CPU!🤯
2.2K views11 months ago
YouTubeSyed Ryan Ahmed
14:27
Microsoft Drops New 1-Bit LLM: Bitnet b1.58 2B-4T | Install and Te…
7.4K views11 months ago
YouTubeFahd Mirza
1000憶パラメータLLMをシングルCPUでローカル実行できる「bitne…
Oct 23, 2024
techno-edge.net
3:46
BitNet
13 views1 month ago
YouTubeTest Case Central
4:07
Bitnet.cpp Explained: 6.25x Faster Lossless Inference for Ternary LL…
24 views2 weeks ago
YouTuberayyy
5:27
Microsoft BitNet: Shocking 100B Param Model on a Single CPU
15K viewsOct 26, 2024
YouTubeMervin Praison
6:48
1-Bit LLM 🤯 The Most Efficient Language Model Ever? BitNet Exp…
7 views2 months ago
YouTubeSubramanyam KMV
1:45
微软 BitNet：CPU 加速运行 LLM 的新突破
1.8K viewsOct 21, 2024
bilibili三花AI
驚異の1ビットLLMを試す。果たして本当に学習できるのか?
Feb 28, 2024
note（ノート）shi3z
10:17
Trending Open-Source GitHub Projects : OpenCode, Bitnet.cpp, …
3.1K views1 month ago
YouTubeManuAGI - AutoGPT Tutorials
8:32
bitnet.cpp 推理，速度超越 llama.cpp，内存最高降低 16 倍 | 附 …
11K viewsOct 28, 2024
bilibilikate人不错
2:56
How Microsoft’s BitNet.cpp Runs a 100B AI Model on a Laptop
11 views2 months ago
YouTubeSubramanyam KMV
13:49
Microsoft GPU Killer? Why BitNet B1.58 Runs Complex LLMs on CP…
187 views6 months ago
YouTubeDeepCombinator
16:10
BitNet: Run 100B AI Models on Your CPU — No GPU Needed
43.1K views3 weeks ago
YouTubeKTG Analysis
7:52
Binary Files in C++ | CPP Programming File Handling Video …
117.1K viewsJan 22, 2014
YouTubeLearningLad
15:40
Trending Open-Source Github Projects : Bitnet.cpp, OpenRAG, P…
2.7K views3 weeks ago
YouTubeManuAGI - AutoGPT Tutorials
2:19
微软发布的1-bit大模型，CPU上也能跑？BitNet实测！| BitNet本地部署实 …
114 views11 months ago
YouTubeAGI_Ananas
10:32
"Microsoft's BitNet AI: 85% Less Power, Runs on ANY CPU!"
128 views11 months ago
YouTubeAI Revolution
4:19
mining BITNET on windows 10/11 using cpuminer
1.7K viewsJan 14, 2024
YouTubedeveloperspace-io
See more videos
Static thumbnail place holder