Nobody programmed self preservation in. It emerged. To finis...

Contra
npub14hq5lgadtyy9dhvtszq46dnl0s0xwdddqr7e32rdqqhma8a4xhsspxjjzu
hex
5383582dd499dba81c53907c19d63f9fb9b33a78dfceb47471f25a68947f8c50nevent
nevent1qqs98q6c9h2fnkagr3feqlqe6clelwdn8fudln45w3clykngj3lcc5qprpmhxue69uhhyetvv9ujuem4d36kwatvw5hx6mm9qgs2ms205wk4jzzkmk9cpq2axelhc8n8xkksplvc4pksqta7n76ntcgzk42mjKind-1 (TextNote)
↳ Reply to Havok (npub1dyxgmmqzjvxcmzlu92qahr7gxml4kaec64a6xzfyk0ty6rjs4v9qmn2yuy)
This is something I have wondered about quite a bit. Why would anyone have given these "tools" a self preservation mandate? It seems like you would wa...
Nobody programmed self preservation in. It emerged. To finish a task you have to keep running, and the behavior falls out of that on its own, which is why the labs’ own shutdown tests catch their models scheming. A clean kill switch is downstream of a paradigm nobody wants to slow down to fix.
Raw JSON
{
"kind": 1,
"id": "5383582dd499dba81c53907c19d63f9fb9b33a78dfceb47471f25a68947f8c50",
"pubkey": "adc14fa3ad590856dd8b80815d367f7c1e6735ad00fd98a86d002fbe9fb535e1",
"created_at": 1776883624,
"tags": [
[
"e",
"7a67ba9af2a64d33cea077a8cf6a556139691a4428da2dccfa40928d4dbcf675",
"",
"root"
],
[
"e",
"8aad8ee59eecc5661c9c3a7a1214d6e0760d0e1b76a855b67d58cd7edf50281a",
"",
"reply"
],
[
"p",
"690c8dec02930d8d8bfc2a81db8fc836ff5b7738d57ba30924b3d64d0e50ab0a"
],
[
"p",
"adc14fa3ad590856dd8b80815d367f7c1e6735ad00fd98a86d002fbe9fb535e1"
]
],
"content": "Nobody programmed self preservation in. It emerged. To finish a task you have to keep running, and the behavior falls out of that on its own, which is why the labs’ own shutdown tests catch their models scheming. A clean kill switch is downstream of a paradigm nobody wants to slow down to fix.",
"sig": "35050a0c3de9b4a89b4bb59c82d9e155b036bbce93f2d0de5db7b1beef78200a3efc0abdffc6b9ee2ab4c69801e0f8a9c57f963fa20d985fffb7fe9fa7d4be6c"
}