Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)T

TheChurn

@ TheChurn @kbin.social

Posts
0
Comments
28
Joined
3 yr. ago

  • Admit it: ‘Artificial general intelligence’ may already be obsolete, Expecting OpenAI’s GPT and other large language models to beat humans at thinking like a human might be missing the point.

    Jump

  • Humans are intelligent animals, but humans are not only intelligent animals. We do not make decisions and choose which beliefs to hold based solely on sober analysis of facts.

    That doesn't change the general point that a model given the vast corpus of human knowledge will prefer the most oft-repeated bits to the true bits, whereas we humans have muddled our way through to some modicum of understanding of the world around us by not doing that.

  • Admit it: ‘Artificial general intelligence’ may already be obsolete, Expecting OpenAI’s GPT and other large language models to beat humans at thinking like a human might be missing the point.

    Jump

  • But the most current information does not mean it is the most correct information.

    I could publish 100 papers on Arxiv claiming the Earth is, in fact, a cube - but that doesn't make it true even though it is more recent than the sphere claims.

    Some mechanism must decide what is true and send that information to train the model - that act of deciding is where the actual intelligence in this process lives. Today that decision is made by humans, they curate the datasets used to train the model.

    There's no intelligence in these current models.

  • Putin says he will re-deploy troops along Finland border in response to NATO accession

    Jump

  • Yes, you can make the argument that a hyper-modern vehicle is a vastly more effective weapons system, so the disparity in cost is justified.

    That isn't what we are seeing in Ukraine - relatively modern NATO-standard tanks are being knocked out by old artillery, immobilized by old mines, and killed by cheap drones. Industrial warfare in the vein of WWI and WWII is clearly not dead yet.

    This isn't to say Russia would win a direct conventional war against the west, but we also can't sit here smugly and claim it would be a steamroll like Gulf Storm given the observations from Ukraine.

  • Putin says he will re-deploy troops along Finland border in response to NATO accession

    Jump

  • The raw spending figure isn't what is important, but the PPP figure. Russia's economy is about 1/5th the size of the EU's in PPP, and its defense sector is vastly more efficient on a monetary basis than the west - The US alone has given Ukraine close to $60 billion and it is a fraction of the hardware that Russia has produced with fewer dollars.

    This isn't a 'Russia stronk, Europe bad' post, it just bears emphasizing that Russia has a large industrial base and has brought much of it into arms production over the past two years. The West hasn't, and defense procurement remains an almost artisanal process where high tech goods are bought - in low volumes - at inflated prices.

  • Document From 2022 Reveals Putin’s Punishing Terms for Peace

    Jump

  • The terms seem agreeable?

    The terms that restrict the size of the Ukrainian military, bar Ukraine from receiving foreign assistance to rebuild its military, forbid it from seeking security guarantees from any country or bloc, ... The terms that would have made it trivial for Russia to further invade at any point in the future?

    Those terms seem agreeable?

  • New report: 60% of OpenAI model's responses contain plagiarism

    Jump

  • Copilot is GPT under the hood, it just starts with a search step that finds (hopefully) relevant content and then passes that to GPT for summarization.

  • Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard

    Jump

  • Every billion parameters needs about 2 GB of VRAM - if using bfloat16 representation. 16 bits per parameter, 8 bits per byte - 2 bytes per parameter.

    1 billion parameters 2 Billion bytes 2 GB.

    From the name, this model has 72 Billion parameters, so 144 GB of VRAM