• Blue_Morpho@lemmy.world
    link
    fedilink
    arrow-up
    10
    arrow-down
    1
    ·
    5 months ago

    That’s why NPU’s are actually a good thing. The ability to run LLM local instead of sending everything to Microsoft/Open AI for data mining will be great.

    • schizo@forum.uncomfortable.business
      link
      fedilink
      arrow-up
      5
      arrow-down
      1
      ·
      5 months ago

      I hate to be that guy, but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it, in the form of “diagnostic data” or “usage telemetry” or whatever weasel-worded bullshit in the terms of service?’

      They’ll just send the results for “quality assurance” instead of doing the math themselves and save a bundle on server hosting.

      • chicken@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        5 months ago

        but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it

        Yes, obviously, especially if you are running all open source software.

      • alessandro@lemmy.ca
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        5 months ago

        All your unattended date will be taken (and some of the attended one). This doesn’t mean you should stop to attend your data. Even of you’re somehow forced to use Windows instead open alternative, it doesn’t mean you can’t dual boot or use other privacy conscious devices when dealing with your sensitive data.

        Closed/proprietary OS and hardware driver can’t be considered safe by design)

      • Blue_Morpho@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        5 months ago

        I replied to the person above “locally on Linux”.

        Even in Windows, local queries give the possibility of control. Set your firewall and it cannot leak.