generative ai News - Page 3 of 3 - CNX Software

November 7, 2023November 7, 2023 by Jean-Luc Aufranc (CNXSoft) - 18 Comments

MediaTek drops efficiency cores in Dimensity 9300 Cortex-X4/A720 mobile SoC

MediaTek Dimensity 9300 is a premium octa-core 5G mobile SoC with two clusters of four Cortex-X4 cores and four Cortex-A720 cores, but doing without any Cortex-A520 efficiency core, plus the latest Arm Mali-G720 GPU, and a MediaTek APU 790 neural processing unit (NPU) capable of support generative AI and large language models (LLM) with up to 33 billion parameters. Arm invented big.LITTLE and then DynamIQ technologies in order to mix cores with different power efficiency and performance characteristics in order to improve power consumption. Their latest launches included the Cortex-X4 premium core, Cortex-A720 performance/big core, and Cortex-A520 efficient/LITTLE core, but MediaTek decided to do without the Cortex-A520 in the Dimensity 9300 which strikes me as odd for a mobile SoC where power efficiency is important for a long battery life. MediaTek Dimensity 9300 specifications: Octa-core CPU with DynamIQ 4x Arm Cortex-X4 at up to 3.25GHz 4x Arm Cortex-A720 up to […]

October 26, 2023October 26, 2023 by Jean-Luc Aufranc (CNXSoft) - 14 Comments

Qualcomm Snapdragon X Elite – A 4.3 GHz 12-core Arm AI processor for next gen PCs and laptops

Qualcomm has now provided Arm chips for mobile PCs (aka laptops) for several years, but apart from a 20-hour battery life, the performance and price of Snapdragon laptops have often been disappointing. The Snapdragon X Elite aims to change that at least on the performance front. The new Qualcomm 12-core 64-bit Arm processor is clocked at up to 3.8 GHz boosting to up to 4.3 GHz, and is said to deliver up to twice the CPU performance against the competition (Intel/AMD/Apple) or provides the same level of performance at a third of the power consumption. The SoC will also be able to run on-device generative AI with over 13B parameters thanks to 75 TOPS of AI performance and support the latest wireless connectivity technologies such as 5G and WiFi 7 through external chips from the company. Qualcomm Snapdragon X Elite specifications: CPU – 12-core 64-bit Armv8 Oryon processor clocked at […]

October 21, 2023February 7, 2024 by Jean-Luc Aufranc (CNXSoft) - 57 Comments

Sophgo SG2380 – A 2.5 GHz 16-core SiFive P670 RISC-V processor with a 20 TOPS AI accelerator

Sophgo SG2380 is an upcoming 2.5 GHz 16-core RISC-V processor based on SiFive Performance P670 cores and also equipped with a 20 TOPS AI accelerator using SiFive Intelligence X280 and Sophgo TPU that will find its way into a $120 desktop-class mini-ITX motherboard in H2 2024. The RISC-V processor also supports up to 64GB RAM, as well as UFS 3.2 and SATA 3.0 storage, comes with an Imagination GPU for 3D graphics and a VPU capable of 4Kp60 H.265, H.264, AV1, and VP9 video decoding, plenty of interfaces, and the system can manage locally deployed larger-scale LLMs like LLaMA-65B without the need for external NVIDIA or AMD accelerator cards. Sophgo SG2380 RISC-V SoC Sophgo SG2380 specifications: CPU 16-core SiFive P670 (RV64GCVH) 64-bit RISC-V processor @ up to 2.5GHz with RISC-V Vector v1.0, Vector Crypto Cluster configuration – 12x 2.5 GHz performance cores, 4x 1.6 GHz efficiency cores Full RISC-V RVA22 […]

October 19, 2023October 19, 2023 by Jean-Luc Aufranc (CNXSoft) - 3 Comments

Generative AI on NVIDIA Jetson Orin, Jetpack 6 SDK to support multiple OSes

NVIDIA has had several announcements at ROSCon 2023 related to robotics & embedded with highlights including generative AI on the NVIDIA Jetson Orin module and the Jetpack 6 SDK will be released next month (November 2023) with supports for Ubuntu as usual, but also other operating systems and platforms such as Debian, Yocto, Wind River, Redhawk RTOS, and Balena. Generative AI on NVIDIA Jetson Orin There’s been a lot of hype in the last year about generative AI thanks to services such as ChatGPT, Google Bard, or Microsoft Bing Chat. But those rely on closed-source software that runs on powerful servers in the cloud. As we noted in our article about the “AI in a box” offline LLM solution there are some open-source projects such as Whisper speech-to-text model and Llama2 language models that could be run on embedded hardware at the edge, but as noted by some readers platforms […]

October 18, 2023October 18, 2023 by Jean-Luc Aufranc (CNXSoft) - 3 Comments

SiFive announces Intelligence X390 NPU, Performance P870 RISC-V core

SiFive Performance P870 RISC V Intelligence X390 NPU

SiFive has announced two new high-performance IP blocks with the Intelligence X390 NPU and the Performance P870 RISC-V core that should find their way into SoC designed for Generative AI and ML applications. We had already covered the Performance P870 and its automotive sibling – the P870-A – from information in an earlier presentation, but the SiFive Intelligence X390 NPU is new to me and appears to be aimed at generative AI in data centers, although we will very soon be seeing companies implement generative AI at the edge in pretty powerful embedded devices. SiFive Performance P870 highlights: Full support for the RVA23 RISC-V profile specification and Vector 1.0 and Vector Crypto Six-wide, out-of-order 64-bit core Up to a 32-core cluster >12 SpecINT2k6/GHz, or a 50% peak single thread performance upgrade over the previous generation SiFive Performance P670 SiFive Features 2x 128b VLEN RVV Vector crypto and hypervisor extensions IOMMU […]