Devin Arthur, Author at Windows Latest https://www.windowslatest.com/author/devin/ Your source for all things Microsoft Sat, 23 Nov 2024 20:58:18 +0000 en-US hourly 1 Hands on: Windows Recall AI on Windows 11 is great and now rolling out to testers https://www.windowslatest.com/2024/11/24/hands-on-windows-recall-ai-on-windows-11-is-great-and-now-rolling-out-to-testers/ https://www.windowslatest.com/2024/11/24/hands-on-windows-recall-ai-on-windows-11-is-great-and-now-rolling-out-to-testers/#comments Sat, 23 Nov 2024 20:53:02 +0000 https://www.windowslatest.com/?p=77159 This past week Microsoft finally released a preview version of the much talked about Recall feature in Windows 11. Here's our experience with the new feature

The post Hands on: Windows Recall AI on Windows 11 is great and now rolling out to testers appeared first on Windows Latest

]]>
This past week Microsoft finally released a preview version of the much talked about Recall feature in Windows 11. Previously announced during the Copilot+ PC launch, this feature was met with so much pushback due to privacy concerns that Microsoft has delayed the feature, vowing not to release it until it met their high standards for security and privacy.

Recall preview in Windows 11
Recall sits in the system tray with an easy way to pause snapshots and open the Recall app.

That time seems to be now, that is, if you are part of the Windows Insider program set to the Dev channel, and running a Snapdragon X Series powered computer. If you are one of the lucky few to tick all those boxes, you will now have access to Recall on Windows 11 if you choose to enable it.

Now when this feature was first announced, I was very excited to start using it. During my typical day I am opening and closing hundreds of windows, browser tabs, and other documents throughout my day, so seeing the ability to seamlessly search through every piece of content I was using and being able to get back to those tasks was very exciting to me.

Recall’s recall for enhanced security

With the updated Recall, security does come first. You will need to ensure your system has Bitlocker enabled as well as Windows Hello, as you need to authenticate each time you launch Recall. I can see how this may get bothersome if you need to access it multiple times per day, so it would be nice if Microsoft had some configuration available to control when you need to re-authenticate.

Windows Recall Privacy Settings
The settings for Recall, which can be accessed via Privacy & security in the Settings app, includes the ability to filter specific websites and apps from saving snapshots.

The settings for Recall are similar to what they were during the previews we saw earlier this year at Microsoft Build, but now with the ability to automatically filter out sensitive information like credit card numbers, passwords, etc. You can also add specific websites and apps to the filter list that will prevent Recall from saving information. For example, if you have a banking website, you can add this and no information from that site will get saved into Recall.

Privacy & security in Windows 11

Of course, if you decided to stop using it, you always have the ability to delete all saved snapshots and to turn off Recall completely. Microsoft has also stated that you will be able to remove Recall from the OS, with this functionality coming in a future release and before this feature hits the public.

Using Recall and Click to Do

After using Recall for a full day, I am still excited to see this come out of preview. Searching through your timeline was nearly instantaneous, bringing up cards with your search terms. Clicking on the card will bring up what was on your screen, allowing you to either go back to that app or use Click to Do to extract text, modify images, or do any other number of things you may need to.

Recall NPU in Windows 11
Accessing Recall and Click to Do relies on the Neural Processing Unit (NPU) which is part of the Snapdragon X Elite.

Since you are now required to authenticate with Windows Hello whenever you open your Recall timeline, this addresses a key concern that anyone was able to see what you had on your screen or were working on. However, it would be nice if Microsoft provided some additional options for configuration, especially if you are working from home and are one of the only users of your PC. One suggestion would be the ability to change authentication from each time you launch Recall to whenever your screen gets locked.

Video caption: The error message is a known issue for the preview version of Recall and does not affect the functionality.

Personally, I am excited to finally get a chance to use this feature that was part of the original Copilot+ PC announcement and will be using this more to get a feel of how it can work for me.

What are your thoughts? Will you be using Recall on your Copilot+ PC now that Microsoft has re-designed it with a security focus?

The post Hands on: Windows Recall AI on Windows 11 is great and now rolling out to testers appeared first on Windows Latest

]]>
https://www.windowslatest.com/2024/11/24/hands-on-windows-recall-ai-on-windows-11-is-great-and-now-rolling-out-to-testers/feed/ 0
Hands-on with Snapdragon X Elite: Benchmarks, games, NPU processing and more https://www.windowslatest.com/2024/04/07/hands-on-with-snapdragon-x-elite-benchmarks-games-npu-processing-and-more/ https://www.windowslatest.com/2024/04/07/hands-on-with-snapdragon-x-elite-benchmarks-games-npu-processing-and-more/#comments Sun, 07 Apr 2024 16:50:50 +0000 https://www.windowslatest.com/?p=72287 A few weeks ago, I was invited to Qualcomm's headquarters in San Diego for some hands-on demos of the X Elite platform to answer just that - how does the Snapdragon X Elite stack up to the competition?

The post Hands-on with Snapdragon X Elite: Benchmarks, games, NPU processing and more appeared first on Windows Latest

]]>
Ever since the announcement of the Snapdragon X Elite platform late last year, we’ve seen a constant stream of rumours and leaks about its performance. Fortunately, we’ve now been able to get hands on experience with it to show just how powerful and efficient this platform is shaping up to be.

Snapdragon X Elite benchmarks

A few weeks ago, I was invited* to Qualcomm’s headquarters in San Diego for some hands on demos of the X Elite platform to answer just that – how does the Snapdragon X Elite stack up to the competition?

Benchmarks

During the demos, we had access to a few reference hardware systems that were running pre-defined benchmarks, such as 3D Mark, Jetstream, etc. The table below lists some of the results of these tests that were running on a 23w Snapdragon X Elite model (system wattage not package wattage) versus an Intel Core Ultra 7 155h:

Benchmark Snapdragon X Elite 23w Intel Core Ultra 7-155h
7-Zip File Compression (lower is better) 18.98s 21.09s
Visual Studio Code Compilation (lower is better) 30.56s 68.14s
3D Mark GPU Benchmark 39.11 FPS 33.98 FPS
Spedometer2.0 (Edge – Native ARM, higher is better) 438 376
Spedometer2.0 (Chrome – Native ARM, higher is better) 457 413
JetStream 2 (Chrome – Native ARM, higher is better) 316.765 295.098
Geekbench 6 CPU 2774 single / 14027 multi 2401 single / 13001 multi
Procyon – AI Inference Benchmark 1716 (Qualcomm SNPE) 514 (Intel OpenVINO)

As you can see from the numbers above, the X Elite is no slouch, beating out the Intel Core Ultra 7 155h in every single benchmark at just a fraction of the power draw. And that’s the key for me, at least – the fact the X Elite was running a total system power draw of around 23w compared to the 100+w that just the CPU can draw on the Intel system.

Power vs Performance

One thing that’s interesting is the way that Qualcomm provides power information for their platform. Unlike traditional chip manufacturers, the CPU is not measured in TDP (or Thermal Design Power), which is a number that’s used to effectively measure amount of heat expected for a CPU under load. While not based on ‘power consumption’ per say, reviewers usually refer to this number as sort of a de-facto reference to the raw power of a chip. Qualcomm, instead, is using system total power, most likely carried over from how they measure power consumption of their mobile platform chips like the Snapdragon 8 Gen 3. This means that like in the example system above, the 23 watt figure is for the entire system and not just the CPU, presumably leading to the fact the CPU uses even less power – which is something I’m eager to test once I get my hands on actual hardware.

Unfortunately we didn’t have the ability to measure temperatures or other metrics on these systems, but speaking from experience as someone who uses a newer 13th gen Intel Core Ultra 7 laptop for work that idles at or above 60 degrees Celsius, having something that can be even more efficient at just a fraction of the power draw is a very attractive prospect.

Gaming

But can you run games? The answer, of course, is yes! While these are not marketed as ‘gaming systems’, that doesn’t mean we can’t run games well enough for some light gaming on the go.

We were able to experience a few game demos such as Baulders Gate 3, Control, and Redout 2, and in the videos below you can see how well they were running. I won’t get into a debate on 30fps vs 60fps, but to my eyes you can get a good enough gaming experience for some light on the go gaming if you wanted to squeeze a few rounds in between meetings.

Baulders Gate 3

While I’m unsure what graphical settings were selected, the resolution was at 1080p and was hovering around 30fps for this demo, without any stuttering.

Redout 2

Again, this game was running at 1080p but with framerates well above 30fps.

It’s worthwhile to re-iterate the fact these systems are not marketed as gaming system, but rather a testament to the work Qualcomm has done in conjunction with Microsoft to make Windows 11 ARM (and the X Elite GPU) work well enough to run modern games.

On-Device AI

One of the more interesting aspects of the X Elite platform is on-device AI processing. While Intel and AMD have released their own offerings with dedicated NPU’s (or Neural Processing Units), the X Elite is the most powerful, at least on paper. For comparison’s sake, Intel combines NPU with its CPU/GPU to process on-device AI to increase its processing power which could lead to increased battery life and slower performance, while the X Elite has enough raw processing in a dedicated NPU to run all AI tasks without the need of the CPU or GPU (but can also run on the GPU/CPU if needed, but that isn’t the focus).

AI is currently measured in a value called TOPS (or trillions of operations per second) which tells us how fast AI models can be processed on-device:

Processor NPU Power Peak (with GPU/CPU)
Snapdragon X Elite 45 TOPS 75 TOPS
Intel Meteor Lake 11 TOPS 34 TOPS
AMD Ryzen Hawk Point 16 TOPS 38 TOPS

 

As you can see the X Elite comes out well on top compared to Intel and AMD’s current offerings.

So what does this mean in real world performance/applications? It means you can process AI models very fast. How fast? Here’s a video I had to take a few times because it was happening so quick. The demo is on-device Stable Diffusion which takes a text prompt and generates an image:

Blink and you might miss it. What’s especially impressive about this demo is that the entire Stable Diffusion model is happening on-device running only on the Hexagon NPU. And while it is possible to do something similar on an AMD or Intel system with combined NPU/CPU/GPU, this ends up being less efficient and requires more power. NPUs are specifically designed for AI processing tasks, so using a dedicated NPU makes a lot more sense especially on a laptop where every minute of battery life counts.

The future of computing

So after all of these demos and benchmarks, you may be asking, when will we get to see real models with this chip? The answer is soon. By all accounts we’ve heard summer 2024 will see a flurry of announcements from OEMs like Dell, Acer, Lenovo and even Microsoft’s own Surface lineup.

We’ll definitely revisit once we can get our hands on actual production hardware, but in the meantime, we are very anxiously awaiting products powered by Snapdragon X Elite as it has the potential to completely change the compute space for the better.

*Qualcomm was gracious enough to invite me to their HQ in San Diego for these demos and paid for travel and accommodation, but otherwise they had no editorial influence.

The post Hands-on with Snapdragon X Elite: Benchmarks, games, NPU processing and more appeared first on Windows Latest

]]>
https://www.windowslatest.com/2024/04/07/hands-on-with-snapdragon-x-elite-benchmarks-games-npu-processing-and-more/feed/ 0