As I previously warned, artificial intelligence companies are running out of data. A Wall Street Journal piece from this week has sounded the alarm that some believe AI models will run out of "high-quality text-based data" within the next two years in what an AI researcher called "a frontier research

This article describes what ive been thinking about for the last week. How will these billions of investments by big tech actually create something that is significantly better than what we have today already?

There are major issues ahead and im not sure they can be solved. Read the article.

  • proceduralnightshade@lemmy.mlEnglish
    2·
    8 months ago

    tl;dr AI companies are slowly running out of data to train their models; synthetic data is not a viable alternative.

    I can’t remember where I saw it, but someone somewhere on YouTube suspected the next step for OpanAI and such would be to collect user data directly; recording conversations of users and using that data to train models further.

    If I find the vid I will add a link here.

    • 1984@lemmy.todayOPEnglish
      21·
      8 months ago

      Yeah that would be the logical end game since companies have invested billions into this trend now.

  • Xaphanos@lemmy.worldEnglish
    31·
    8 months ago

    My company is in AI. One of our customers pays for systems capable of the hard computational work to design the drugs to treat Parkinson’s. This is the only newly possible with the newest technology.

    • MysteriousSophon21@lemmy.worldEnglish
      4·
      8 months ago

      This is acutally one of the most promising applications - AI can screen millions of potential drug compounds and predict protein interactions in hours instead of months, which is why we’re seeing breakthroughs in neurodegenerative disease research.

  • some_kind_of_guy@lemmy.worldEnglish
    2·
    8 months ago

    I wonder if AI applications other than just “be a generalist chat bot” would run into the same thing. I’m thinking about pharma, weather prediction, etc. They would still have to “understand” their english-language prompts, but the LLMs can do that just fine today, and could feed systems designed to iteratively solve for problems in those areas. A model feeding into itself or other models doesn’t have to be a bad thing.

    • Optional@lemmy.worldEnglish
      11·
      8 months ago

      Only in the sense that those “words” they know are pointers to likely connected words. If the concepts follow alike then, theoretically all good. But beyond FAQs and such I’m not seeing anything that would indicate it’s ready for anything more.