Skip Navigation

Posts
35
Comments
448
Joined
2 yr. ago

  • Oh. I was joking. I'm aware that my storage capabilities really are an outlier, even though I still feel inadequate whenever I go to a hoarding community.

    I've spent around 1200$ USD since I started collecting things back on 2021, which is about 300/year, or 25/month. I don't expect to purchase anymore for another three years or so, right around when a 24tb drive drops to 150/each. It's still not like, super cheap or anything though.

  • Nothing "almost" about it. Retail drives are available right now at 30tb. Although, the more reasonable price/GB is at around 8tb with occasional outliers.

  • Yeah. Normal people have about 100tb of total space. My 96tb (64tb usable) of space is completely average and not at all an indicator of something being wrong or abnormal.

  • If you visit their website, it looks like a scam website. Or maybe a hobby by a single person. https://zinwa.cn/

    It has no photos of the actual product, it has no shipped products, even though the older version is supposed to ship this month, they link a discord on their website, and they use gmail for their email. It's all just so halfassed for someone trying to ship a physical product.

  • Deleted

    Permanently Deleted

    Jump
  • Oof. Top three, but at the same time, half as much as the top paying site does.

  • Yeah, and on the smaller / earlier side of a theoretical search engine company, google offers their api for free. I think this is actually another one of the biggest contributors to why nobody has tried to make a new search engine with their own index. Why waste hundreds of thousands of dollars in hardware, and even more on personnel costs, when you can just have google do it for you instead?

  • When I said 'direct expenses' I mostly meant the cost of owning / running a database of internet pages and metadata comprehensive enough to be considered part of a 'fully featured search engine'. There's also the other half; the compute required to create that metadata, as well as obtain it, but at most I would guess that those would be equal in cost to just having the space for a database of all the internet pages (scaling up after that based on how many users you need to support). In short, a scaled down web engine that had access to every page on the internet that people would want to find could cost as low as 100,000$ for a first time purchase for the hardware.

    The internet archive does in fact have their own web crawler they use. They also do sites upon request as well; i've had my personal website on there for almost two decades now, specifically at my request.

    They also have a full-featured search function available for anyone on their website at archive.org. This is why I say they're a reasonable price comparison for a full-featured search engine. They may spend more on storage and less on metadata compute than a theoretical smaller search engine, but at the end of the day, that's just a re-balancing of the cost, not a completely new and more excessive cost.

    I think direct expenses; the cost of owning and maintaining an internet index database, are definitely significant enough that the completely free access that google gives to anyone who wants it, are way more than any single private entity or company is able to support just because they want to have it. I don't think it would be anywhere even close to a billion dollars though.

    I think the hardest part of having a internet index database would be the knowledge required to create and maintain it, especially under the hostile forces that are the 75 billion dollar seo industry. If a selfhosted search engine became big enough that the seo industry started trying to break it, I don't think that company would survive for very long at all.

    Google is losing that battle, like, almost completely. What hope would a small startup style company have of battling it and staying financially solvent, especially if they're trying to be different from google and bing and actually showing results without the pressure of advertisers breathing down their necks?

    I think the hardware side of a search engine is solvable with silicon valley startup level of funding. I think it's impossible for anyone in the current day and age to make that sort of project solvent while keeping the user (instead of the advertiser) as the main customer. For anyone else who can't get those funds, or don't actually want to do a results-oriented search engine, they can just mooch of off google and bing for free.

  • Size isn't everything, so the real question is: what search site uses only the common crawl index and has results on par with bing or google?

    None of them. At least, none that I'm aware of. I just don't think that direct expenses are the reason that there are are only two major web search tools. I also don't think Google and bing are good examples to point at when estimating the cost of running a complete search engine.

    If you read all of your article, the author notes that while Google has index of about 400 billion, the internet archives index is actually bigger at around 865 billion.

    The internet archive has an operating cost of about 33m/year. I think that is a much more reasonable example to point to and say "running a complete search engine would have a similar price as that".

    Also, very neat article btw. I would have never guessed that googles search index count has been shrinking for the past little bit. Or that Google actively culls results from their database that it thinks people won't ever want to see.

  • I think most startup search engines use Google/bing because it's free/way cheaper than running their own database, not because it's impossible. It also likely sidesteps a lot of the seo bullshit simply because Google/bing have more experience working around it

    So like, short term/small size its cheaper and straight up easier to piggyback off of the big two companies, rather than manage your own data set. Long term, if you get popular enough to be noticed, I expect that the seo business would wreck any selfhosting search engine startup company's results pretty regularly.

  • That's like saying that it's impossible to run a car manufacturing company without 100 billion because that's how much Ford spends on their car manufacturing processes. It makes no sense.

    Yes, making an original search engine is hard, just like making trucks is. But that doesn't mean that running either one requires billions of dollars to do.

    Common crawl is a nonprofit that regularly shares free copies of every internet page with metadata, and it damn well doesn't take billions to do it either. https://commoncrawl.org/

  • The issue is that the internet is too large to index.

    It's really not. At least, not yet. It's a large part of why it isn't done, but it's not the only one, and I'd argue, not even the main reason it isn't really done.

    A complete crawl with meta data of the internet in 2025 is only 424TiB. For comparison, my 1000$ home setup can handle about a tenth of that(in storage at least). The hardware to maintain a single database of the internet with metadata could cost under $100,000, easily.

    Dave, your comment about it costing a billion to run Bing or Google might be true, but it is completely unrelated to the realities of running a small search engine and has everything to do with the fact that they are Google and Microsoft products respectively.

    The real issue isn't the physical size of the internet, it's much more likely to be the complexity of making a search algorithm that can compete with the 75 billion seo market that wxists to break search engines.

  • What about hanging it vertically?

  • As much as LTT deserves shit, and he really does, choosing to ignore a warning because its what the average user does, really shouldn't be one of them. Users absolutely pull stupids like that, and his job was to see what a regular user would experience.

  • Not OP, but I left for similar reasons. The CEO publically supported the Republican admin (mildly, but even at the time, stupidly). The statement sent out about it after the fact was also sus, but not really super bad.

    I left anyway. I'd rather not pay a CEO to publically support the administration that is specifically targeting my family for political points.

    I also heard a lot of fear mongering on the fediverse about how their new AI conversations can't be private because it gets to their servers directly, but I couldn't find anyone reasonable online who actually looked into it and confirmed that.

    So like, they've got all the ingredients for more stupidity, and as we've seen time and again, everything pressuring them to fuck up/enshitify is also there in the background too.

  • Yeah, gamers nexus is usually worth the watch, for sure. My favorite part was the terrible software being a requirement to make certain hardware features work.

    Good luck with your search.

  • This is a vague and unprovable take.

    Mr incredible had to work out to get his strength back, and managed to do it while having a job, family, and friends who all were happier with how much more time he was spending on them during his getting more fit phase.

  • It really depends on the source of the super strength. The juggernaut is a god-empowered being of strength; he looks muscley because that's what strength is supposed to look like, not because it affects his ability to do work.

    Superman looks strong because that's the ideal humanoid form, apparently, and his eugenics-obsessed ancestors chose that as the look they wanted to breed for.

    Mr incredible/robert parr from the incredibles had to work out, and used literal trains as his gym equipement. It's likely his super power wasn't super strength so much as fewer limits on how much improvement he could get from his workouts. He is out of shape at the start of his story, and getting rid of that, while relatively easy for him compared to others, did require actual work on his part.

    If you had a superhero who had like, a psychic shield or similar that surrounded their body and gave the appearance of super strength, like Victoria Dallon from Worm, then yeah, they'd have to work a lot harder to look like the strength they use on a regular basis.

    Except in rare cases, I think you've got it backwards. Heroes with super strength get their muscles from their powers, and only the rare few outliers don't get muscles from their superpowers.

  • For what it's worth; your Razer issues were likely not a random thing. Razer has a rough history of bad quality control and even worse customer support. The one thing they're still good at is marketing. https://m.youtube.com/watch?v=KhfqhCxqpQ8

    I've also heard good things about the frameworks laptops, but I've not personally used any of them. At least with a frameworks laptop you can do upgrades later, rather than having to buy a completely new device whenever a part breaks or you have it for longer than three years. Easily available battery replacements alone make that a good deal.

  • I think my favorite quote from the video is "You don't have to make a product that fits everyone for it to be a good product".

  • It's still victim blaming. There is no reasonable situation where shooting a kid in the back is ever a good choice. Fucking ever.

    Worse, you can't expect a child to look up online how dangerous a joke is before playing it. Their brains aren't wired that way. Kids will be ringing doorbells and running away until doorbells stop existing. Shooting them for it is co.pletely and entirely on the person with the gun. Every single time.