සුපිරි AI model එකක් Local run කරා.

kanakaJ

Active member

Oct 16, 2025

156

102

43

• Apr 23, 2026

• #1

MiniMax 2.7 230B model eka local run kara with iQ3_S quantized weights. CPU eken inference kare. Runtime eka Vulkan llama.cpp(linux)

Promt processing 9tk/s
Promt evaluation 6tk/s

Q3 quantized hinda BF16 full model eka tharam quality na.

 

• 

Reactions: geethq, 6h057 and Inigo Montoya

Mr Bones

Well-known member

Mar 13, 2023

16,714

1

32,936

113

• Apr 23, 2026

• #2

What's the purpose ?

 

kanakaJ

Active member

Oct 16, 2025

156

102

43

• Apr 23, 2026

• #3

Mr Bones said:

What's the purpose ?

Click to expand...

Immunity to Outages, Privacy, Network Independence and Offline Availability, I have control over both Serving infrastructure and application layer.

 

• 

Reactions: 6h057, Naughtykolla48 and Inigo Montoya

Clockwork

Well-known member

Mar 6, 2024

9,129

8,510

113

• Apr 23, 2026

• #4

kanakaJ said:

Immunity to Outages, Privacy, Network Independence and Offline Availability, I have control over both Serving infrastructure and application layer.

Click to expand...

Resources khmd

 

Mr Bones

Well-known member

Mar 13, 2023

16,714

1

32,936

113

• Apr 23, 2026

• #5

kanakaJ said:

Immunity to Outages, Privacy, Network Independence and Offline Availability, I have control over both Serving infrastructure and application layer.

Click to expand...

What do you plan to do with network independence, offline availability, and controlling both infrastructure and application layers?

 

anushkapubudu

Well-known member

Dec 6, 2022

558

452

63

• Apr 23, 2026

• #6

pc eke specs kohomada

 

A

AllGood

Well-known member

Dec 22, 2023

1,058

1,620

113

• Apr 23, 2026

• #7

කැම්පස් වල ෆස්ට්ඉය ඉන්න හුජ්ජ කොල්ලෝ කරන වැඩ. ඊයෙත් දැක්ක එකෙක් ලින්ක්ඩ්ඉන් එකේ හෙන හෑල්ලක් එක්ක ශෙයා කරලා තියෙනවා

 

• 
• 

Reactions: kanakaJ and Honey Bunch

kanakaJ

Active member

Oct 16, 2025

156

102

43

• Apr 23, 2026

• #8

Clockwork said:

Resources khmd

Click to expand...

Q3, Q2 quantized model ekat 96GB wage one. Q4 walata 128GB

---

Mr Bones said:

What do you plan to do with network independence, offline availability, and controlling both infrastructure and application layers?

Click to expand...

Nothing
------ Post added on Apr 23, 2026 at 1:17 PM

---

anushkapubudu said:

pc eke specs kohomada

Click to expand...

96GB DDR5, Ryzen 9 7945HX, No GPU
------ Post added on Apr 23, 2026 at 1:18 PM

---

AllGood said:

කැම්පස් වල ෆස්ට්ඉය ඉන්න හුජ්ජ කොල්ලෝ කරන වැඩ. ඊයෙත් දැක්ක එකෙක් ලින්ක්ඩ්ඉන් එකේ හෙන හෑල්ලක් එක්ක ශෙයා කරලා තියෙනවා

Click to expand...

LOL, just visit r/LocalLLaMA
------ Post added on Apr 23, 2026 at 1:20 PM

 

• 

Reactions: Mr Bones

lilman

Well-known member

May 10, 2009

40,081

53,026

113

Colombo

• Apr 23, 2026

• #9

ඕකෙන් කුක්කු පොටෝ, වීඩියෝ ජෙනරෙට් කරන්න පුලුවන්ද ?

 

• 

Reactions: Mr Bones

Hamu mahaththaya1

Well-known member

Dec 7, 2017

20,643

21,635

113

ගම මහනුවරයි

• Apr 23, 2026

• #10

lol

 

kanakaJ

Active member

Oct 16, 2025

156

102

43

• Apr 23, 2026

• #11

lilman said:

ඕකෙන් කුක්කු පොටෝ, වීඩියෝ ජෙනරෙට් කරන්න පුලුවන්ද ?

Click to expand...

Meke Text Generation witharai support. Photo, Video generation models run karanna high VRAM GPU ekak or GPU Cluster ekak one.

 

• 

Reactions: lilman

lilman

Well-known member

May 10, 2009

40,081

53,026

113

Colombo

• Apr 23, 2026

• #12

kanakaJ said:

96GB DDR5, Ryzen 9 7945HX, No GPU

Click to expand...

මච්චර specs තිබිලත් text models විතරද රන් කරන්න පුලුවන් ?

 

kanakaJ

Active member

Oct 16, 2025

156

102

43

• Apr 23, 2026

• #13

lilman said:

මච්චර specs තිබිලත් text models විතරද රන් කරන්න පුලුවන් ?

Click to expand...

GPU ekak nathuwa ImageGen, VideoGen models run karanna amarui, Barikamakuth na output ekak enna paya ganak yai.
Mixture of expert type Text generation model walata loku processing power, memory bandwith one na. Model eka RAM eka athulata danna puluwan nam usable/.

 

• 

Reactions: lilman