• 6 Posts
  • 49 Comments
Joined 1 year ago
cake
Cake day: March 19th, 2024

help-circle

  • His mood shifted the next day when he found Replit “was lying and being deceptive all day. It kept covering up bugs and issues by creating fake data, fake reports, and worse of all, lying about our unit test.”

    LLMs cannot intentionally “lie” or be “deceptive”, they aren’t alive. They can, however, be confidently wrong or incorrect (and most often, they are).

    “I know vibe coding is fluid and new, and yes, despite Replit itself telling me rolling back wouldn’t work here – it did. But you can’t overwrite a production database. And you can’t not separate preview and staging and production cleanly. You just can’t”

    Maybe on this service, you can’t, but if you used this to vibe code something that wasn’t hosted there? You absolutely fucking can.

    “The [AI] safety stuff is more visceral to me after a weekend of vibe hacking,” Lemkin said. I explicitly told it eleven times in ALL CAPS not to do this. I am a little worried about safety now.”

    lol. lmao, even.








  • Efficiency still matters very much when self hosting. You need to consider power usage (do you have enough amps in your service to power a single GPU? probably. what about 10? probably not) and heat (it’s going to make you need to run more A/C in the summer, do you have enough in your service to power an A/C and your massive amount of GPUs? not likely).

    Homes are not designed for huge amounts of hardware. I think a lot of self hosters (including my past self) can forget that in their excitement of their hobby. Personally, I’m just fine not running huge models at home. I can get by with models that can run on a single GPU, and even if I had more GPUs in my server, I don’t think the results (which would still contain many hallucinations) would be worth the power cost, strain on my A/C, and possible electrical overload.