Lvxferre [he/him]

The catarrhine who invented a perpetual motion machine, by dreaming at night and devouring its own dreams through the day.

  • 5 Posts
  • 1.11K Comments
Joined 1 year ago
cake
Cake day: January 12th, 2024

help-circle


  • Yes, it is expensive. But most of that cost is not because of simple applications, like in my example with grammar tables. It’s because those models have been scaled up to a bazillion parameters and “trained” with a gorillabyte of scrapped data, in the hopes they’ll magically reach sentience and stop telling you to put glue on pizza. It’s because of meaning (semantics and pragmatics), not grammar.

    Also, natural languages don’t really have nonsensical rules; sure, sometimes you see some weird stuff (like Italian genderbending plurals, or English question formation), but even those are procedural: “if X, do Y”. LLMs are actually rather good at regenerating those procedural rules based on examples from the data.

    But I wish it had some broader use, that would justify its cost.

    I with that they cut down the costs based on the current uses. Small models for specific applications, dirty cheap in both training and running costs.

    (In both our cases, it’s about matching cost vs. use.)



  • Why not quanta? Don’t you believe in the power of the crystals? Quantum vibrations of the Universe from negative ions from the Himalayan salt lamps give you 153.7% better spiritual connection with the soul of the cosmic rays of the Unity!

    …what makes me sadder about the generative models is that the underlying tech is genuinely interesting. For example, for languages with large presence online they get the grammar right, so stuff like “give me a [declension | conjugation] table for [noun | verb]” works great, and if it’s any application where accuracy isn’t a big deal (like “give me ideas for [thing]”) you’ll probably get some interesting output. But it certainly not give you reliable info about most stuff, unless directly copied from elsewhere.


  • The whole thing can be summed up as the following: they’re selling you a hammer and telling you to use it with screws. Once you hammer the screw, it trashes the wood really bad. Then they’re calling the wood trashing “hallucination”, and promising you better hammers that won’t do this. Except a hammer is not a tool to use with screws dammit, you should be using a screwdriver.

    An AI leaderboard suggests the newest reasoning models used in chatbots are producing less accurate results because of higher hallucination rates.

    So he’s suggesting that the models are producing less accurate results… because they have higher rates of less accurate results? This is a tautological pseudo-explanation.

    AI chatbots from tech companies such as OpenAI and Google have been getting so-called reasoning upgrades over the past months

    When are people going to accept the fact that large “language” models are not general intelligence?

    ideally to make them better at giving us answers we can trust

    Those models are useful, but only a fool trusts = is gullible towards their output.

    OpenAI says the reasoning process isn’t to blame.

    Just like my dog isn’t to blame for the holes in my garden. Because I don’t have a dog.

    This is sounding more and more like model collapse - models perform worse when trained on the output of other models.

    inb4 sealions asking what’s my definition of reasoning in 3…2…1…


  • I wish EU4 had more automation, the amount of micromanagement there was awful. And this sort of game is more interesting when you can focus on the big picture.

    Sadly I don’t trust Hipsters’ Electronic Arts Paradox to do automation right. And by “right” I mean:

    • Transparent. You could reasonably get why the game AI will / won’t take a certain decision, without spending hours in the wiki or fucking around the game files.
    • Flexible. The best decision is often circumstantial, and playing styles are a thing.
    • Powerful, but not overpowered. The AI’s decisions should be decent, but not the best - a player who takes the time to learn how stuff works should be rewarded. (Or even better, tweak the AI so it does the best.)



  • Since a lot of people are asking what happened, here’s some context.

    Recently Nutomic requested more donations to Lemmy. This was cross-posted everywhere (like here, here, here, here, here). And, inevitably, people started calling out things like:

    • The devs’ defence of authoritarian regimes;
    • tankie here, tankie there;
    • lemmy .ml extremely shitty moderation practices;
    • Nutomic’s transphobic message; etc.

    as reasons to not donate to the development.

    That should be enough to get the meme OP shared.

    My take on this matter.

    If I don’t do this, odds are some assumptive trash will assume = lie = bullshit words into my mouth.

    The criticism against the devs is mostly valid, but not the full picture - even if they say all this shit, they’re still creating a platform that enables people to fight against it, and this should be taken into account.

    So it’s all about balancing those two things, you know? On moral and practical matters. For me at least the balance is overall positive; I’d be donating to the platform if I wasn’t broke. Plus, continued Lemmy development benefits us, and if they need to take a job the development slows down.

    But, still… I get people who won’t support them, I don’t think that they’re completely wrong, it’s just that they weight things different than I do. Either way, people should not focus on picking sides, but on being fair.

    I’d also like to encourage people who don’t want to contribute with Lemmy to do it for either PieFed or Sublinks. Both are independent from Lemmy, compete with it, but are still part of the Fediverse.



  • Thank you! This sort of graph is actually easy to do in Inkscape:

    • Use the “calligraphy” tool for lines; default configs, quick strokes. If the stroke gets slightly off it’s OK, but if it’s really off simply redraw it (easier than trying to fix it). The dashed lines are simply sequences of lines using the same tool.
    • For the text plenty cursive fonts work fine; I used First-Grader, but Lehn183, Berenice, and even Comic Sans would be good options.
    • Red background: I found easier to start with a larger-than-necessary rectangle, and then shave it off by subtracting copies of other elements.
    • If any object is a bit too detailed, or has rough edges, a few hits of the “simplify” tool (Ctrl+L) fixes it.


  • Lvxferre [he/him]@mander.xyztoLefty Memes@lemmy.dbzer0.comCuz baby, I'm an anarchist
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    7
    ·
    edit-2
    8 days ago

    For me it’s both, I guess?

    A poorly made graph, resembling hand drawn ones. There are no units in the graph. The X axis is labelled "The amount of bullshit the liberal said", and the Y axis is labelled "how polite I am". The graph itself shows a sigmoid curve: it starts high, then suddenly drops, then stays low. The dropping area is highlighted, and labelled "the bullshit threshold".

    Before the bullshit threshold I’m calmly reading what the liberal says, and calmly explaining stuff like:

    • why capitalism won’t fix itself
    • why it’s a bad idea to give the Nazi a voice, Weimar Republic style
    • why all this “my country” thing is inane, and why we should be identifying ourselves first and foremost as human beings
    • why and how gender and sex are different things

    But as the liberal keeps babbling, and enters the bullshit threshold, my attitude suddenly flips to something like “aaaah, cut off the crap! I already explained this, dammit. Do you need to be spoonfed basic [reading comprehension | reasoning]???”

    I don’t typically use the word “bootlicker” in English, but in Portuguese I do use “pelego” (kind of the same thing) a fair bit.



  • In addition to that:

    A proletariat that keeps disempowering itself is a proletariat unable to fight in an eventual revolution. And fascism is all about disempowering the masses.

    So sometimes you need to bite into the sour apple and vote, even if this means voting in an absolute clown against someone who’s a clown and a fascist, and in the process playing along a system that is utterly corrupt and made to enforce the elites are kept in place.