• 3 Posts
  • 55 Comments
Joined 1 year ago
cake
Cake day: March 22nd, 2024

help-circle
  • Traning data is curated and continous.

    In other words, one (for example, Musk) can finetune the big language model on a small pattern of data (for example, antisemetic content) to ‘steer’ the LLM’s outputs towards that.

    You could bias it towards fluffy bunny discussions, then turn around and send it the other direction.

    Each round of finetuning does “lobotomize” the model to some extent though, making it forget stuff, reducing its ability to generalize, ‘erasing’ careful anti-reptition tuning and stuff like that. In other words, if Elon is telling his engineers “I don’t like these responses. Make the AI less woke, right now,” he’s basically sabotaging their work. They’d have to start over with the pretrain and sprinkle that data into months(?) of retraining to keep it from dumbing down or going off the rails.

    There are ways around this, but Big Tech is kinda dumb and ‘lazy’ since they’re so flush with cash, so they don’t use them. Shrug.





  • There is a nugget of ‘truth’ here:

    https://csl.noaa.gov/news/2023/390_1107.html

    I can’t find my good source on tis, but there are very real proposals to seed the arctic or antarctic with aerosols to stem a runaway greenhouse gas effect.

    It’s horrific. It would basically rain down sulfiric acid onto the terrain; even worse than it sounds. But it would only cost billions, not trillions of other geoengineering schemes I’ve scene.

    …And the worst part is it’s arctic/climate researchers proposing this. They intimately know exactly how awful it would be, which shows how desperate they are to even publish such a thing.

    But I can totally understand how a layman (maybe vaguley familiar with chemtrail conspiracies) would come across this and be appalled, and how conservative influencers pounce on it cause they can’t help themselves.

    Thanks to people like MTG, geoengineering efforts will never even be considered. :(


    TL;DR Scientists really are proposing truly horrific geoengineering schemes “injecting chemicals into the atmosphere” out of airplanes. But it’s because of how desperate they are to head off something apocalyptic, and it’s not even close to being implemented. They’re just theories and plans.




  • OK, while in principle this looks bad…

    This is (looking it up) like an experienced engineer’s salary in Peru, in line with some other professions.

    It’s reasonable to compensate a president, and for the expectation to not be coming in rich/connected enough to not need a salary. Nor for them to broker power for personal wealth, all as long as other offices and reasonably compensated too.

    It avoids perverse incentives, doesn’t seem excessive and TBH is probably a drop in the Peruvian govt’s budget.










  • Yeah, just paying for LLM APIs is dirt cheap, and they (supposedly) don’t scrape data. Again I’d recommend Openrouter and Cerebras! And you get your pick of models to try from them.

    Even a framework 16 is not good for LLMs TBH. The Framework desktop is (as it uses a special AMD chip), but it’s very expensive. Honestly the whole hardware market is so screwed up, hence most ‘local LLM enthusiasts’ buy a used RTX 3090 and stick them in desktops or servers, as no one wants to produce something affordable apparently :/