Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)T

Tobberone

@ Tobberone @lemm.ee

Posts
0
Comments
191
Joined
2 yr. ago

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • I'm just in the beginning, but my plan is to use it to evaluate policy docs. There is so much context to keep up with, so any way to load more context into the analysis will be helpful. Learning how to add excel information in the analysis will also be a big step forward.

    I will have to check out Mistral:) So far Qwen2.5 14B has been the best at providing analysis of my test scenario. But i guess an even higher parameter model will have its advantages.

  • Microsoft said it lost weeks of security logs for its customers' cloud products

    Jump

  • And exactly why are they missing? Who stole what at Microsoft?

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • Thank you! Very useful. I am, again, surprised how a better way of asking questions affects the answers almost as much as using a better model.

  • Fossil fuels could become cheaper and more abundant, says IEA

    Jump

  • This is expected. Oil prize has been on the decline for some time. I didn't expect demand to erode this fast, though. which I guess is kinda a good thing.

    The only way forward is for renewables to become even cheaper that fossils. Which can be done. The EUs fit-for-55 will bring down energy prizes. Summertime we will see really low electricity prizes the comming decade in Europe because of this.

  • Sweden switches on largest battery energy storage system in the Nordics - Energy Storage

    Jump

  • It's the only chemistry possible to source unfortunately. I read about other chemistries, but they are hard to find.

  • Sweden switches on largest battery energy storage system in the Nordics - Energy Storage

    Jump

  • There is usually a 1:1 between MW:MWh at these capacities.

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • I need to look into flash attention! And if i understand you correctly a larger model of llama3.1 would be better prepared to handle a larger context window than a smaller llama3.1 model?

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • Thanks! I actually picked up the concept of context window, and from there how to create a modelfile, through one of the links provided earlier and it has made a huge difference. In your experience, would a small model like llama3.2 with a bigger context window be able to provide the same output as a big modem L, like qwen2.5:14b, with a more limited window? The bigger window obviously allow more data to be taken into account, but how does the model size compare?

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • Thank you for your detailed answer:) it's 20 years and 2 kids since I last tried my hand at reading code, but I'm doing my best to catch up😊 Context window is a concept I picked up from your links which has provided me much help!

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • The problem I keep running into with that approach is that only the last page is actually summarised and some of the texts are... Longer.

  • Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT

    Jump

  • Do you know of any nifty resources on how to create RAGs using ollama/webui? (Or even fine-tuning?). I've tried to set it up, but the documents provided doesn't seem to be analysed properly.

    I'm trying to get the LLM into reading/summarising a certain type of (wordy) files, and it seems the query prompt is limited to about 6k characters.

  • Everyone get out of the way, it’s me!!!

    Jump

  • I couldnt disagree more with you. If there are pedestrians nearby you drive slow and keep your distance regardless of where you drive.

    The same goes for pedestrians, though. Don't walk where it's not safe, for everyones safety. Like the interstate. It's a shared responsibility.

    This, however, is in the middle of a neighborhood where a ball and a kid could come flying at moments notice...

  • The US is spending billions to build direct-air-capture plants. But some fear the projects won’t succeed unless the government buys more of what they’re selling.

    Jump

  • You are on to the issue yourself. First and foremost we need to stop releasing CO2. That in and of itself is not enough, but the most important bit. Some countries (a lot?) has enough tree cover to offset a huge chunk of their CO2 emissions today by trees. Some might even be CO2 neutral, had it not been for the use of wood for fuel. Therein lies the potential. And this is already a mature industry with market dependencies well established.

    Resembling this CO2 uptake with man made processes will require a monumental investment in both monetary and energy terms and the output will be pitiful when the net effect is calculated.

    So slamming the effect of trees, which does not require any of that development and investment costs because it doesn't solve the entire problem, because it isn't a silver bullet is rather short sighted. It is already today the best tool we have to sequester carbon from the atmosphere for cheap and with a comoditiezed biproduct.

  • The US is spending billions to build direct-air-capture plants. But some fear the projects won’t succeed unless the government buys more of what they’re selling.

    Jump

  • What's wrong with trees? They cost next to nothing and runs on renewable energy.

  • What inspired you to get into clean energy?

    Jump

  • Nah, just about anything except climate change. Economical, less blackouts, better resilience and sticking it to the man (as in the incompetent power companies) I'd imagine would be the go-to arguments...

  • Mentally I am here

    Jump

  • For me it's the opposite. My body may be on the premises, but mentally...

  • EVs outlasting ICE cars says Renault boss | Auto Express

    Jump

  • Yeah, some of us have skills others don't. You'd not want to ride a car where I've swapped the engine, I'll tell you that.

    My comment is, however, a paraphrase on the two most common questions regarding EVs. From people who doesn't, unlike you, know how to change a transmission. If ICE cars are as unreliable compared to EVs as alluded to in the article, then EVs should be considered the safe and reliable option...

  • EVs outlasting ICE cars says Renault boss | Auto Express

    Jump

  • That didn't stop Nissan to conclude that the batteries lasted twice as long as the rest of the car. The number of (newish# cars taken out of traffic each year is higher than we expect.

  • EVs outlasting ICE cars says Renault boss | Auto Express

    Jump

  • Aren't you afraid you will need to change the (ICE) motor? Those are costly and tend to fail more often than batteries, you know?