• redditmademedoit@piefed.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 days ago

    Are you sure about that? I’ve been reading mixed information on how expensive it is to operate these chat bots, e.g. the cost of “inference”, when you don’t develop and maintain the actual models. Some claim inference is actually quite cheap. Not sure how that applies to Proton though, but as far as I understand Lumo is mostly a front end for some generally available models?

    I think privacy is the biggest concern for users (as opposed the plethora of horrible problems AI brings to the world at large) with ChatGPT and similar services. I can see the market space for a privacy centered service.

    • ideonek@piefed.social
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      2 days ago

      That’s a fair question. Am I sure? No. The problem is that nobody is publishing explicitly about how expensive this all truly is (which is concerning on its own). But a lot of points are out in that direction. I think that “cost of inference” may be a fake metric on its own that it’s designed to obscure that you need multiple sub-queries to run one “thinking” query - but granted, I’m out of my depth, so I may be wrong here.

      AI companies are running two arms races here: one: who can create a better model. two: who can create shitteir cheeper psudo-model that can pass as “AI” (which are also too expensive).

      When you complain that those models can do anything useful, and it makes terrible mistakes, they reply that you don’t use the truly smart one. When you complain that there is no way that the smart one will ever be scalable because it’s crazy expensive, they tell you, “but look how much cheaper the ‘fast’ ones are”. Never truly addressing the questions, and bundling those so you are never sure which one youare using.

      Does anyone successfully run this openy avaible models locally on their own machines? I’m seriously asking, since, as I unserstand that doesn’t work out as well as one would hope. That suggests that the resources required are still massive.

        • ideonek@piefed.social
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          2 days ago

          Haha so your response to my aqusation that you don’t do enought to stop the oppressor in your country is to go trought my profil and downvote every comment and post something mean about it? That’s great use.of.your time and energy. No wonder you have nohing more to spent on doing something against people braking your own constitution.

          • hector@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 days ago

            I went through and read and downvoted the ones I disagreed with, maybe half after checking context and am glad I did because of the 8 I went back you made the exact same argument 2 or 3 times. Blaming people for those that rule them. A standard that would discount any group of people, one fed to the weak minded to set people against each other and not unite against them, the oligarchy.

            • ideonek@piefed.social
              link
              fedilink
              English
              arrow-up
              1
              ·
              2 days ago

              I wish you were half this active on opposing people who “rule you”, as you are on opposing people who think that you shoud take some responsibility for your country.

              • hector@lemmy.today
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 days ago

                On the contrary, the only way to unseat them is to take the opposition, and as they are still in power, partly due to arguments like yours, illogical though they may be, there is no way to get rid of them as people all trust the wrong people.

                You are full of judgement for the downtrodden subjects of the imperial power, yet have not taken any responsibility for your country’s same problems as I’ve pointed out multiple times. Ask yourself what you are going to do? Nothing, with your attitude the answer is clearly going to be nothing but blaming the wrong people that are blamed by the people you wrongly trust.

                • ideonek@piefed.social
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  2 days ago

                  You are went trough my comments to belittle my untealeted arguments about AI in completely different treat becouse I don’t like that youre making casual remarks about your country invading the allies. You are litteraly acctively prosecuting people that don’t like that your country is tretenig to attack them. And I’ll be the one doing nothing and shifting the blame? This may not be the best use of your effort.

                  • hector@lemmy.today
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    2 days ago

                    I am taking issue with your blaming people for not overthrowing their government. That is the only comment I’ve made in regards to your dumbass posts, but I lost interest in any debate because you did not bring a reasoned argument, which you can’t because your argument defies reason.