• just_an_average_joe@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    20 hours ago

    LLM training and processing batched requests are 2 things that can be done i think. Batched requests have a 24-48h window when they need to be processed.