• 0 Posts
  • 48 Comments
Joined 1 year ago
cake
Cake day: June 15th, 2023

help-circle



  • I’m guessing you weren’t around in the 90s then? Because the amount of money set on fire on stupid dotcom startups was also staggering.

    The scale is very different. OpenAI needs to raise capital at a valuation far higher than any other startup in history just to keep the doors open another 18-24 months. And then continue to do so.

    There’s also a very large difference between far ranging bad investments and extremely concentrated ones. The current bubble is distinctly the latter. There hasn’t really been a bubble completely dependent on massive capital investments by a handful of major players like this before.

    There’s OpenAI and Anthropic (and by proxy MS/Google/Amazon). Meta is a lesser player. Musk-backed companies are pretty much teetering at the edge of also rans and there’s a huge cliff for everything after that.

    It’s hard for me to imagine investors that don’t understand the technology now but getting burned by it being enthusiastic about investing in a new technology they don’t understand that promises the same things, but is totally different this time, trust me. Institutional and systemic trauma is real.

    (took about 15 years because 2008 happened).

    I mean, that’s kind of exactly what I’m saying? Not that it’s irrecoverable, but that losing a decade plus of progress is significant. I think the disconnect is that you don’t seem to think that’s a big deal as long as things eventually bounce back. I see that as potentially losing out on a generation worth of researchers and one of the largest opportunity costs associated with the LLM craze.


  • Sure, but those are largely the big tech companies you’re talking about, and research tends to come from universities and private orgs.

    Well, that’s because the hyperscalers are the only ones who can afford it at this point. Altman has said ChatGPT 4 training cost in the neighborhood of $100M (largely subsidized by Microsoft). The scale of capital being set on fire in the pursuit of LLMs is just staggering. That’s why I think the failure of LLMs will have serious knock-on effects with AI research generally.

    To be clear: I don’t disagree with you re: the fact that AI research will continue and will eventually recover. I just think that if the LLM bubble pops, it’s going to set things back for years because it will be much more difficult for researchers to get funded for a long time going forward. It won’t be “LLMs fail and everyone else continues on as normal,” it’s going to be “LLMs fail and have significant collateral damage on the research community.”


  • There is real risk that the hype cycle around LLMs will smother other research in the cradle when the bubble pops.

    The hyperscalers are dumping tens of billions of dollars into infrastructure investment every single quarter right now on the promise of LLMs. If LLMs don’t turn into something with a tangible ROI, the term AI will become every bit as radioactive to investors in the future as it is lucrative right now.

    Viable paths of research will become much harder to fund if investors get burned because the business model they’re funding right now doesn’t solidify beyond “trust us bro.”








  • our last “just war” that was even a little cut and dry was world war two.

    The Balkans were pretty cut and dry in justified intent.

    It was an intervention into the worst genocide in Europe since WW2. We’re talking not only wholesale slaughter of civilians, but even the establishment of literal rape camps as part of an organized, systemic campaign of ethnic cleansing. What was happening in the former Yugoslavia was absolutely horrific and the US and NATO stepping in to put an end to it was an unequivocally good thing.

    That said, there were still questionable incidents like the “accidental” bombing of the Chinese embassy or the numerous cases of civilians killed by NATO bombs. But that mostly emphasizes the fact that there’s no such thing as a clean war. War is always going to leave blood on your hands, even if it’s being fought for the right reasons.



  • Maybe it’s simply because he’s not the sitting president and his detail is much smaller?

    USSS details are heavily supplemented by locals for events like this. Even if the USSS team was relatively small, somebody – whether it was USSS, local, or state police – should have had a location that blindingly obvious secured. That building was literally the only real elevated position with clear line of sight in the vicinity of the stage. The fact that somebody could get up there without immediate security response is really almost unfathomable if it weren’t for the fact that it happened.


  • As somebody that’s a paying Kagi user and generally happy with the service, it is interesting seeing exactly where the tradeoffs are.

    While I’d say Kagi pretty much universally returns better results for technical information or things like recipes where it deprioritizes search spam, it’s also pretty clear that there are other areas where the absence of targeting hurts results. Any type of localized results, e.g., searching for nearby restaurants or other businesses tends to be really hit or miss and I tend to fall back to Google there.

    Of course, that’s because Kagi is avoiding targeting to the point where they don’t even use your general location to prioritize results. It’s an interesting balancing act and I’m not quite sure they’ve hit the sweet spot yet, at least for me personally, but I like the overall mission and the results for most searches so I’m happy with the overall experience currently.


  • Searches are supposed to be fast at giving you the answer you’re looking for. But that is antithetical to advertising.

    And we have evidence that this is exactly why it happened, too:

    https://www.wheresyoured.at/the-men-who-killed-google/

    While I’d highly recommend giving either the article a read or the companion podcast a listen because Ed Zitron did some fantastic reporting on this, the tl;dr is that a couple of years ago, there was direct conflict between the search and advertising wings of Google over search query metrics.

    The advertising teams wanted the metrics to go up to help juice ad numbers. The search team rightly understood that there were plenty of ways they could do so, but that it would make for a worse user experience. The advertising team won.

    The head of the advertising team during this was a man named Prabhakar Raghavan. Roughly a year later, he became the head of Google Search. And the timing of all this lines up with when people started noting Google just getting worse and worse to actually use.

    Oh, and the icing on the cake? Raghavan’s previous job? Head of Yahoo Search just before that business cratered to the point that Yahoo decided to just become a bing frontend.

    Zitron is fond of saying that these people have names and it’s important that we know who’s making the decisions that are actively making the world of tech worse for everyone; I tend to agree.


  • Tree nested communication is much more superior than traditional thread based communication

    Heavily depends, IMO.

    Nested threads are great temporary discussion of a specific story or idea. They’re absolutely miserable for long-running discussions. New posts get lost in the tree and information ends up scattered across multiple threads as a result.

    It’s also been my personal experience that the nested threads format just doesn’t seem to build communities in the same way forums did. I have real-life friendships that were made on forums decades ago and I never had that experience with reddit despite being a very early user.

    I don’t think that’s entirely due to the ephemeral format, but I do think it plays a part in it. A deep thread between two people on Reddit might last a few hours and a dozen replies before it falls off the page. On forums threads running months or years were pretty common, and that kind of engagement with the same people certainly changes how your relationships develop with them.



  • Subaru’s AWD system is legitimately better at putting down power to the wheels and getting traction than the vast majority of other AWD systems on the market. There are plenty of third party tests showing as much.

    That said, it’s a question of whether you actually need that. The truth is the vast majority of people don’t need AWD at all for the kind of driving they’ll actually do.

    I have an STi which has an active center differential beyond even the typical Subaru system and I absolutely love it. It’s magic feeling it at work. But my “likes to take the car on dirt and go sideways at 50MPH” use case isn’t needed for a commuter either.