tcsenpai

joined 1 year ago
[–] tcsenpai@lemmy.ml 3 points 4 days ago (1 children)

I noticed that for Q4 to above too, with my sweet spot at Q6 if i manage to. I am really confused about Q2-Q3 for models that are 2x+ of Q4 models. E.g. sometimes it seems Gemma3 12b Q4 (or Q6) is better than Gemma3 27b Q3_XS and sometimes it seems the opposite.

 

So, I have a 16GB vram GPU (4070 ti Super) and 32GB DDR4 RAM. The RAM is slow af and thus I tend to run models fully on GPU.

I can easily run up to 21b-ish models with Q4, sometimes high Q3.

I am testing various models out there but I was wondering if you guys have any reccommendation.

I am also really interested in understanding if quantization really decrease the model quality so much. Like, It would be better to have a Q6 12b model (like Gemma 3 12b), a Q2_K_L 32b model (such as QwQ 32b) or a Q3_XS model (such as Gemma 3 27b)?

[–] tcsenpai@lemmy.ml 12 points 8 months ago (2 children)

To be honest, a lot of system configuration is better done on the CLI or editing configuration files manually (see the majority of the audio stack). I like that approach way more than Windows but even the System Registry in Windows is more "GUI-like" than editing ALSA files or pam.d files manually (usually on the cli as they mostly require sudo). This scares people.

[–] tcsenpai@lemmy.ml 12 points 8 months ago

Let me live in the Ideal Shrek Zone

[–] tcsenpai@lemmy.ml 5 points 8 months ago

At this point I just admit I won't remember it

[–] tcsenpai@lemmy.ml 12 points 8 months ago (2 children)

While everybody's right in saying text captchas are outdated, there are concerning amount of services (especially for small-mid businesses) that still use them.

Anyway, if an AI could control something like Selenium with the necessary modifications (aka not presenting itself as Selenium), I am pretty sure most of the "Click here to confirm you are an human" captchas like the cloudflare one would be defeated too.

I think the most challenging are image-based weird challenges that are difficult even to humans. The annoying ones.

[–] tcsenpai@lemmy.ml 31 points 8 months ago (1 children)

D for Dementia

[–] tcsenpai@lemmy.ml 3 points 8 months ago

So sad alexa play mad world

[–] tcsenpai@lemmy.ml 1 points 8 months ago

Quick q: do you use all the space available or partition your disk?

[–] tcsenpai@lemmy.ml 4 points 8 months ago (2 children)

Tell me is real

[–] tcsenpai@lemmy.ml 9 points 8 months ago (3 children)

I assume this is either a meme or a very unique situation. "Not working" is too generic, if you can provide more details we could even help