generative ai

Posted on by Jean-Luc Aufranc (CNXSoft) - 14 Comments on Qualcomm Snapdragon X Elite – A 4.3 GHz 12-core Arm AI processor for next gen PCs and laptops

Qualcomm Snapdragon X Elite – A 4.3 GHz 12-core Arm AI processor for next gen PCs and laptops

Qualcomm Snapdragon X Elite highlights

Qualcomm has now provided Arm chips for mobile PCs (aka laptops) for several years, but apart from a 20-hour battery life, the performance and price of Snapdragon laptops have often been disappointing. The Snapdragon X Elite aims to change that at least on the performance front. The new Qualcomm 12-core 64-bit Arm processor is clocked at up to 3.8 GHz boosting to up to 4.3 GHz, and is said to deliver up to twice the CPU performance against the competition (Intel/AMD/Apple) or provides the same level of performance at a third of the power consumption. The SoC will also be able to run on-device generative AI with over 13B parameters thanks to 75 TOPS of AI performance and support the latest wireless connectivity technologies such as 5G and WiFi 7 through external chips from the company. Qualcomm Snapdragon X Elite specifications: CPU – 12-core 64-bit Armv8 Oryon processor clocked at […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 57 Comments on Sophgo SG2380 – A 2.5 GHz 16-core SiFive P670 RISC-V processor with a 20 TOPS AI accelerator

Sophgo SG2380 – A 2.5 GHz 16-core SiFive P670 RISC-V processor with a 20 TOPS AI accelerator

Sophgo SG2380 RISC-V processor

Sophgo SG2380 is an upcoming 2.5 GHz 16-core RISC-V processor based on SiFive Performance P670 cores and also equipped with a 20 TOPS AI accelerator using SiFive Intelligence X280 and Sophgo TPU that will find its way into a $120 desktop-class mini-ITX motherboard in H2 2024. The RISC-V processor also supports up to 64GB RAM, as well as UFS 3.2 and SATA 3.0 storage, comes with an Imagination GPU for 3D graphics and a VPU capable of 4Kp60 H.265, H.264, AV1, and VP9 video decoding, plenty of interfaces, and the system can manage locally deployed larger-scale LLMs like LLaMA-65B without the need for external NVIDIA or AMD accelerator cards. Sophgo SG2380 RISC-V SoC Sophgo SG2380 specifications: CPU 16-core SiFive P670 (RV64GCVH) 64-bit RISC-V processor @ up to 2.5GHz with RISC-V Vector v1.0, Vector Crypto Cluster configuration – 12x 2.5 GHz performance cores, 4x 1.6 GHz efficiency cores Full RISC-V RVA22 […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 3 Comments on Generative AI on NVIDIA Jetson Orin, Jetpack 6 SDK to support multiple OSes

Generative AI on NVIDIA Jetson Orin, Jetpack 6 SDK to support multiple OSes

Jetson Orin Generative AI

NVIDIA has had several announcements at ROSCon 2023 related to robotics & embedded with highlights including generative AI on the NVIDIA Jetson Orin module and the Jetpack 6 SDK will be released next month (November 2023) with supports for Ubuntu as usual, but also other operating systems and platforms such as Debian, Yocto, Wind River, Redhawk RTOS, and Balena. Generative AI on NVIDIA Jetson Orin There’s been a lot of hype in the last year about generative AI thanks to services such as ChatGPT, Google Bard, or Microsoft Bing Chat. But those rely on closed-source software that runs on powerful servers in the cloud. As we noted in our article about the “AI in a box” offline LLM solution there are some open-source projects such as Whisper speech-to-text model and Llama2 language models that could be run on embedded hardware at the edge, but as noted by some readers platforms […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 3 Comments on SiFive announces Intelligence X390 NPU, Performance P870 RISC-V core

SiFive announces Intelligence X390 NPU, Performance P870 RISC-V core

SiFive Performance P870 RISC V Intelligence X390 NPU

SiFive has announced two new high-performance IP blocks with the Intelligence X390 NPU and the Performance P870 RISC-V core that should find their way into SoC designed for Generative AI and ML applications. We had already covered the Performance P870 and its automotive sibling – the P870-A – from information in an earlier presentation, but the SiFive Intelligence X390 NPU is new to me and appears to be aimed at generative AI in data centers, although we will very soon be seeing companies implement generative AI at the edge in pretty powerful embedded devices. SiFive Performance P870 highlights: Full support for the RVA23 RISC-V profile specification and Vector 1.0 and Vector Crypto Six-wide, out-of-order 64-bit core Up to a 32-core cluster >12 SpecINT2k6/GHz, or a 50% peak single thread performance upgrade over the previous generation SiFive Performance P670 SiFive Features 2x 128b VLEN RVV Vector crypto and hypervisor extensions IOMMU […]

EmbeddedTS embedded systems design