• ATDA@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    7 days ago

    I’ve fiddled with a few models but my woeful home server gets like 20 words a min. Maybe my setup is the issue.

      • CharlesDarwin@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 days ago

        I hope to try out a local rig I have that I once used for mining a little bit and then later for folding@home - but I need more disk space on there. That host has the tiniest drive on it - 128G. Once I solve that problem, I hope things like ollama can make use of the cards I have in it…for now, I’m using a 2022 macbook and it seems to do okay-ish with some models anyway.

        I hope I never have to give one red cent to the likes of Altman.