• 1 Post
  • 116 Comments
Joined 2 years ago
cake
Cake day: August 4th, 2023

help-circle



  • I’m guessing that exactly the same LLM model is used (somehow) on both sides - using different models or different weights would not work at all.

    An LLM is (at core) an algorithm that takes a bunch of text as input and produces an output of a list of word/probabilities such that the sum of all probabilities adds to 1.0. You could place a wrapper on this that creates a list of words by probability. A specific word can be identified by the index in the list, i.e. first word, tenth word etc.

    (Technically the system uses ‘tokens’ which represent either whole words or parts of words, but that’s not important here).

    A document can be compressed by feeding in each word in turn, creating the list in the LLM, and searching for the new word in the list. If the LLM is good, the output will be a stream of small integers. If the LLM is a perfect predictor, the next word will always be the top of the list, i.e. a 1. A bad prediction will be a relatively large number in the thousands or millions.

    Streams of small numbers are very well (even optimally) compressed using extant technology.













  • It’s horrific, isn’t it. I think the reason is education and media.

    I grew up in the 70s and 80s and we were taught about the Nazis and their horrific legacy. A lot of movies were about WWII and the heroes were the ones shooting Nazis. My generation generally doesn’t like Nazis.

    However the millennials and Gen Z have grown up in an environment where the bad guys are mainly communists, muslim terrorists and scientists building world-destroying technical weapons. And in school little is said about the Nazi Germany period.

    Trump, PP, Nigel Farage, Peterson and all the other right wing talking heads say are our enemies are the same as the above - communists, brown people (who may or may not be muslim) and science. And, guess what, who is supporting the genocide in Gaza? The idiotic anti-China tariffs? Who is denying global climate change and decimating science spending? Who labels their enemies ‘radical socialists’ or ‘communists’?




  • Is UPF food with ultra high fibre bad?

    I don’t know.

    My thoughts are that your total daily intake is more important than considering any single food item. As such, having some UPF in your diet is ok. The problem becomes epidemiologically measurable when, like the UK and US, 60% of calories consumed by some demographics are from UPF food.

    And there are almost certainly multiple different things ‘wrong’ with UPF and so if you fix one problem, you may still be at risk from another. For example in your question, there are a lot of studies showing the importance of fibre in the diet, including those that add bran to whatever the person normally eats. So UPF with lots of fibre, all things equal, is likely less bad than UPF without.

    Is UPF with ultra high vitamin A bad?

    Fat soluble vitamins (A, D, E and K) are interesting in that they don’t show benefits above RDA, and in high doses cause a long list of nasty symptoms. In particular, vitamin A in excess is correlated with increased risk of multiple major diseases and even death.


  • Scientists only use terms like ultra processed food after defining them in their scientific papers. The problem here is that the media find it difficult to write a short article for the general audience if they have to define things scientifically.

    What specifically is bad about UPF foods is still being researched. A few leading ideas are:

    • Very little fibre
    • Starches are all immediately accessible to digestion and so blood glucose spikes much more than for the non-UPF equivalent
    • UPF foods are soft and dry (so weigh less) making it very easy to eat a lot very fast, so you eat too many calories.
    • Relatively high in salt and sugar
    • Use of emulsifiers. These may change your gut microbiota and also make your gut more leaky causing inflammation
    • Use of preservatives and artificial colours
    • Frequently have a lot of oil

    Low fibre, emulsifiers and preservatives, while lacking variety of phytochemicals found in fresh food is known to change your gut health. People on UPF diets tend to eat more and have higher blood glucose spikes leading to heart disease and diabetes.

    Altogether this is a recipe for a shorter, less healthy life