Xbox 'Copilot' Demonstration Hints At How It'll Work On Your Series X|S

Cue people complaining for optional stuff. 👌🏻

Can't wait to see how it works in action hopefully it's useful to use and not just another feature useless to me ha.
Exciting times ahead as AI continues to evolve!

This is going to take up computational processing power on my console and additional energy when I play on my series x.
This better be optional/opt in and be able to be turned off because I (personally) do not want this.

Can I see a use for it? Yeah. But I don’t want to use it.

The first thing I did as soon as I saw it on Xbox Ally was remove it from the bar. I think it’s totally useless, but hey, maybe it’s useful to someone.

I probably won't use it very often but it seems kind of neat. I see some potential in this.

@FraserG That's not good I was hoping it would be handy and fast to use it will be literally useless if it's easier to just take out your phone and search for something real quick.
I was hoping it would be good for resident evil games to get a puzzle solution or safe code super quick I guess it will be another useless app for now at least unfortunately 😞

Ah, but is it truly optional? Can I disable it or block it or remove it from the ui experience? Or are we talking passive-aggressive ‘optional’, like it’ll be shoved in our faces at every available opportunity with menu/UI layout designs ‘heavily encouraged’ to make use of it?

Hopefully actually optional and not ‘optional’ in the way first party game releases and store sales are where they shove a full screen advert down your throat. I want the option not to be continually harassed to use it.

@Kramlar I don't believe such a model is running on devices, although I don't mind being flabbergasted if it is indeed an LLM running on device. It probably takes screenshots of whatever is on the screen and sends it to the cloud, where a model trained on thousands of YouTube walkthrough commentaries gives you the answer.

@FraserG I believe it will improve quite a lot as use cases are better defined and Microsoft has the usage data on what aspects need to be improved. It will be a great accessibility feature for casual gamers.

@Globo It is a first-gen product that would need a few iterations before Microsoft optimised for its intended use. I believe it sends the screenshot of what you are currently doing in the game along with you question to it, so it will be a lot faster at recognizing exact scenarios, when it starts working as intended.

@Balaam_ They will definitely push it on store page and even the dashboard through advertisements. However, I think it will only ever run when we use some kind of a button shortcut on the controller (and probably a background service to make that launch quicker), since it won't make sense for them to capture entire gameplay (most likely due to storage concerns).

I hate this… the exchange alone has that vomit inducing affirmation I detest so much from
AI “absolutely! let’s do this” 🤢

Also this thing is going to be constantly looking at my activity… this better be a feature that can be disabled entirely because I don’t want no ai spying at all I do in any game.

If Xbox was really listening to feedback, this thing would be scrapped. But it won’t, because despite the lies, there IS a mandate to incorporate this slop.

@MinervaX76 You are completely mistaken. It (CoPilot) doesn't need to constantly look at your activity because your Xbox already records that and even shows it to you on your PC app and Cloud. And, unless you opted out of sharing usage data during setup, Microsoft is already storing that information.

I usually am against generative AI because companies use marketing jargon to make it seem like the AI knows and understands a lot, whereas, in reality, it is far from it. However, this is clearly an accessibility feature for casual gamers. It is only one step more than one asking ChatGPT a question regarding the game, that one step more being the screenshot of the game.

@kmtrain83 It is likely taking a screenshot of the game only when you ask it a question, otherwise storing to transmitting all what a player is doing is both nonsensical and a technical nightmare to do.

@FraserG Already used it, and it has helped me several times. That said, depending on the game’s popularity and the complexity of the question, the answers can vary, and sometimes I still have to go directly to Google. But overall, I think it’s a feature that’s heading in the right direction, useful, and something that can only get better over time.

It’s been a long time since I last played Sea of Thieves, but I admit that at the beginning I was completely lost, and Copilot probably would have helped me.

Now tell me Xbox C AI isn't the perfect name for their next big thing.

Doubles as SEE AI and Can't Afford It! Both are equally bad.

@betterthings Yeah it will probably need a couple updates to work as truly intended but I think It sounds in theory anyway like a handy feature that could be very useful.
I'll definitely give it a go when it comes to the consoles.

So first if I want a next gen Xbox I will be forced to have windows on it, and now I'll have to have an app I don't even want on my current gen console? I really hope you have to download it from the store like any other app.

@themightyant From what I've seen on my Ally, it looks like it actually shuts down completely when you disable it. In general, when you disable any section of the Xbox bar, it takes a while to restart if you re-enable it. It seems like they don't just run in the background.

Came here to see some crying

@kmtrain83 Most implementation of copilot in other places (like Visual Studio) rely heavily on constantly being attentive at what you are doing in the thing you are working on for situational awareness (and to learn from your actions).

I have zero doubt this will be any different.

At least in those products, entirely disabling copilot is an option because many corporate customers would literally jump ship if it was mandatory.

@betterthings There is a gigantic difference between snapshots being synced to one cloud, or basic stats like how long you play, time you earned achievements, etc being collected.

On every context Copilot is implemented, it's aware of your every single action and learns from everything unless the application in question allows for it to be entirely disabled or uninstalled.

@betterthings AI systems don't store or transmit raw video. Its complex to go into all details but it converts all its awareness into vector databases that are not as data heavy as full captures/streams. This vector data processing is precisely why GPUs are so important for AI.

BTW don't confuse vector databases with vector image conversions, it's different stuff.

Anyways, despite this simplification of the context representation, the total data collects are gargantuan and why AI datacenters are not just wrecking havoc on ram and GPU costs but also on all forms of quick storage.

This very simplified video might give you an idea:
https://www.youtube.com/watch?v=gl1r1XV0SLw

@INeedGoodGraphics At least in a PC based Helix console, there is a chance that as a more open system we can just kill the process. If not easily, then via community provided tools.

Nice. I don't get the hate for it tbh. I use an AI Assistent on my phone everyday. And it's not like you'll be forced to use it either.

@FraserG can you ask it to pull information from a specific guide? Like I wouldn’t mind it if I found a guide by google and than used this so I wouldn’t have to keep pulling up my phone.

@kmtrain83 They are claiming there is no AI mandate for Xbox (they shied away from actually saying it would not be added if **they** feel its beneficial) but there been plenty of articles about MS making AI usage a mandatory part of even working at MS.

https://www.windowscentral.com/microsoft/using-ai-is-no-longer-optional-did-microsoft-makes-copilot-mandatory-for-staff