You're not wrong but I will say that running a local llm is ...

Muslim Bitcoiner
npub1uzfp6cgwue2njm86cmyeq7m26y0n58w72acq98sjsnnv4c87002s6857h3
hex
8b496535d402d31b6d1013ec4b92306ca88fc0ce778a3600a84daa3a169049e5nevent
nevent1qqsgkjt9xh2q95cmd5gp8mztjgcxe2y0cr880z3kqz5ym236z6gynegprpmhxue69uhhyetvv9ujuem4d36kwatvw5hx6mm9qgswpysavy8wv4fednavdjvs0d4dz8e6rh09wuqzncfgfek2url8h4gs4vkynKind-1 (TextNote)
↳ Reply to Event not found
f9ccba69aa79c94f6cb267c19780c89c0279ed7283bda54d52c3d09add0a1a09...
You're not wrong but I will say that running a local llm is pretty difficult, especially for noob like me. In my experience, constant tweaking is needed and it crashes a lot. Been playing around with different models on openllm.
Still very much interested in hosting my own llm on a dedicated server someday soon.
Raw JSON
{
"kind": 1,
"id": "8b496535d402d31b6d1013ec4b92306ca88fc0ce778a3600a84daa3a169049e5",
"pubkey": "e0921d610ee655396cfac6c9907b6ad11f3a1dde5770029e1284e6cae0fe7bd5",
"created_at": 1775506929,
"tags": [
[
"p",
"76f5960d381e7146b7f374a4a65afa403038441b46933840c71e436facb82ae7",
"",
"mention"
],
[
"e",
"f9ccba69aa79c94f6cb267c19780c89c0279ed7283bda54d52c3d09add0a1a09",
"",
"root"
]
],
"content": "You're not wrong but I will say that running a local llm is pretty difficult, especially for noob like me. In my experience, constant tweaking is needed and it crashes a lot. Been playing around with different models on openllm.\n\nStill very much interested in hosting my own llm on a dedicated server someday soon. ",
"sig": "830642a5ba26737907c39cb96693f61e3a21a243c8d5e8184e7e834806ad465ce05da5b92dbd4601921512d75288b216f3740f106a5bdc12e219e5940f29b974"
}