Posted on by Jean-Luc Aufranc (CNXSoft) - 2 Comments on picoLLM is a cross-platform, on-device LLM inference engine

picoLLM is a cross-platform, on-device LLM inference engine

picoLLM Raspberry Pi 5

Large Language Models (LLMs) can run locally on mini PCs or single board computers like the Raspberry Pi 5 but with limited performance due to high memory usage and bandwidth requirements. That’s why Picovoice has developed the picoLLM Inference Engine cross-platform SDK optimized for running compressed large language models on systems running Linux (x86_64), macOS (arm64, x86_64), and Windows (x86_64), Raspberry Pi OS on Pi 5 and 4, Android and iOS mobile operating systems, as well as web browsers such as Chrome, Safari, Edge, and Firefox. Alireza Kenarsari, Picovoice CEO, told CNX Software that “picoLLM is a joint effort of Picovoice deep learning researchers who developed the X-bit quantization algorithm and engineers who built the cross-platform LLM inference engine to bring any LLM to any device and control back to enterprises”. The company says picoLLM delivers better accuracy than GPTQ when using Llama-3.8B MMLU (Massive Multitask Language Understanding) as a […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 9 Comments on WCH CH32V002 32-bit RISC-V MCU comes with 4KB SRAM, supports 2V to 5V DC supply voltage

WCH CH32V002 32-bit RISC-V MCU comes with 4KB SRAM, supports 2V to 5V DC supply voltage

CH32V002

WCH CH32V002 is an industrial-grade general-purpose 32-bit RISC-V microcontroller that is pin-to-pin compatible with the popular CH32V003 MCU with 4KB SRAM instead of 2KB, a wider input voltage range from 2V to 5V, and other improvements. Earlier this month we wrote about the WCH CH32V006 RISC-V microcontroller that offers an upgrade to the CH32V003 with more I/Os, memory, and storage, requiring a new PCB layout. But now, the Chinese company has unveiled a pin-compatible alternative with the CH32V002 that adds more SRAM, uses the new V2C core with RV32EmC instruction set (also used in the CH32V006), offers a larger bootloader and configuration memories, upgrades the ADC to 12-bit, and adds support for 8-channel touch-key channel detection. WCH CH32V002 specifications (highlights in bold show differences against the CH32V003): CPU – 32-bit “RISC-V2C” core up to 48 MHz using RV32EmC instruction set Memory – 4KB SRAM Storage – 16KB flash, 3328 Bytes […]

ArmSoM CM5 - Raspberry Pi CM4 alternative with Rockchip RK3576 SoC
Posted on by Debashis Das - No Comments on Jetway JNUC-ADN1 4″x4″ Intel N97 “NUC” SBC features two 2.5GbE ports for industrial automation and edge computing

Jetway JNUC-ADN1 4″x4″ Intel N97 “NUC” SBC features two 2.5GbE ports for industrial automation and edge computing

Jetway JNUC ADN1 SBC with Intel N97 SoC

Jetway JNUC-ADN1 is an Intel N97-powered SBC in the Next Unit of Computing (NUC) form factor. The SBC can be equipped with up to 16GB DDR5 RAM via a single SO-DIMM socket, 64GB of eMMC storage, and dual M.2 sockets for additional storage and networking. The SBC comes with two 2.5GbE Ethernet ports and has an operating temperature range of -20°C ~ 60°C, making it suitable for Edge Computing, IoT, and industrial applications. Jetway offers four variants of their NUC-ADN1 SBC whereas the N97000 version does not include eMMC or TPM 2.0 security, the N97002 version features TPM 2.0 but doesn’t have eMMC, the N97004 version omits TPM 2.0 but offers 64GB of eMMC storage, and finally the N97008 version has both TPM 2.0 and 64GB of storage. Previously we have written about similar SBCs from Jetway like the JF35-ADN1 and the Jetway  MI05-0XK, we also covered several N97-based industrial […]

Posted on by Tomisin Olujinmi - No Comments on HealthyPi Move is an open-source nRF5340-powered biometric monitor worn like a watch (Crowdfunding)

HealthyPi Move is an open-source nRF5340-powered biometric monitor worn like a watch (Crowdfunding)

HealthyPi Move

The HealthyPi Move is the latest biometric monitor in the HealthyPi series from ProtoCentral. It is the first to come in a wearable form factor and can measure up to eight vital signs. It is powered by a Nordic Semiconductor nRF5340 dual-core SoC, with a Cortex-M33 application processor and a Cortex-M33 network processor. It features 128MB of flash memory connected through a high-speed QSPI interface that can store up to 10 days of processed data. It is capable of measuring galvanic skin response (EDA/GSR), electrocardiogram (ECG) signals, and photoplethysmogram (PPG) signals for determining blood oxygen level (SPO2), blood pressure, and heart rate variability. It also includes a body temperature sensor and inertial measurement unit (IMU) with a 6-axis accelerometer and gyroscope. HealthyPi Move targets medical and biotech applications, including personal health tracking, building healthcare devices, and even clinical research with approval from the FDA or IRB. We have previously covered […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 1 Comment on ECS “LIVA Mini Box QC710 Desktop” Windows 10 mini PC goes for $99.99 (Promo)

ECS “LIVA Mini Box QC710 Desktop” Windows 10 mini PC goes for $99.99 (Promo)

ECS LIVA Mini Box QC710 Desktop discount

ECS LIVA Mini Box QC710 Desktop powered by a Qualcomm Arm mini PC-looking developer kit was launched in 2021 for $219, and the company is now apparently getting rid of stocks and selling the remaining Snapdragon 7c devices for $99.99 on Stack Social. The system features a Qualcomm Snapdragon 7c (SC7180) octa-core Cortex-A76/A55 SoC, 4GB RAM, 64GB eMMC flash, HDMI output, 10/100Mbps Ethernet and WiFi 5, and several USB ports. As a reminder, here are the ECS LIVA Mini Box QC710 Desktop specifications: SoC –  Qualcomm Snapdragon 7c Compute Platform (SC7180) with octa-core Qualcomm Kryo 468 (2x Cortex-A76, 6x Cortex-A55) CPU @ up to 2.4 GHz, Adreno 618 GPU System Memory – 4GB Storage – 64GB eMMC flash, MicroSD card socket Video & audio output – 1x HDMI port Networking 10/100M Ethernet WiFi 5 and Bluetooth USB 1x USB 3.2 Gen1 (5 Gbps) Type-A port 1x USB 2.0 Type-A port […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 12 Comments on Canonical releases Ubuntu 24.04 Server image for Milk-V Mars RISC-V SBC

Canonical releases Ubuntu 24.04 Server image for Milk-V Mars RISC-V SBC

Milk-V Mars Ubuntu 24.04 server

Canonical has been releasing Ubuntu RISC-V images for SBCs and QEMU at least since 2021. The latest addition is an Ubuntu 24.04 Server image for the Mars credit-card-size SBC powered by StarFive JH7110 quad-core RISC-V SoC and designed by Shenzhen Milk-V Technology. That means we now have Ubuntu Server images for the QEMU emulator, AllWinner Nezha SBC, Microchip Polarfire SoC FPGA Icicle Kit, SiFive Unmatched mini-ITX motherboard, Sipeed LicheeRV Dock, StarFive VisionFive 2 SBC, and the Mars SBC. You’ll note there aren’t any Ubuntu Desktop images for now, because the GPU (if any) in RISC-V SoCs is not yet fully supported. Mars SBC specifications: SoC – StarFive JH7110 CPU – Quad-core RISC-V processor (RV64GC) at up to 1.5GHz GPU – Imagination BXE-4-32 GPU with support for OpenCL 1.2, OpenGL ES 3.2, Vulkan 1.2 VPU H.264 & H.265 4Kp60 decoding H.265 1080p30 encoding JPEG encoder / decoder System Memory – 1GB, […]

Rockchip RK3568/RK3588 and Intel x86 SBCs
Posted on by Sponsored Post - No Comments on GEEKOM A5 mini PC is now even better value with a $70/£50 coupon code (Sponsored)

GEEKOM A5 mini PC is now even better value with a $70/£50 coupon code (Sponsored)

GEEKOM A5 $70 off coupon code

The GEEKOM A5 is one of the mini PCs with the best performance/price ratio we’ve reviewed, with the AMD Ryzen 7 5800H mini PC performing great in Windows 11 Pro and Ubuntu 22.04 (with a recent Linux kernel) and selling at a significantly lower price point than other systems delivering only marginal performance gains. The good news is that the GEEKOM A5 is now even better value with the company providing the CNXA5 coupon code for a $70 discount on GEEKOM US and a £50 discount on GEEKOM UK for the model with 32GB RAM and 512 NVMe SSDH bringing the price down to $329 and £329 respectively. The CNXA5 coupon code also works on GEEKOM Australia. Here are GEEKOM A5 specifications as a reminder: SoC – AMD Ryzen 7 5800H 8-core/16-thread processor up to 3.2 GHz / 4.4 GHz (Turbo) with 16MB cache, AMD Radeon Vega 8 Graphics; TDP: […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 1 Comment on Olimex open-source hardware NXP i.MX 8M Plus industrial-grade SoM runs mainline Linux

Olimex open-source hardware NXP i.MX 8M Plus industrial-grade SoM runs mainline Linux

Olimex i.MX 8M Plus SOM mainline Linux

Olimex has just announced the iMX8MP-SOM-4GB-IND industrial-grade, open-source hardware system-on-module based on NXP i.MX 8M Plus Arm AI SoC and 4GB LPDDR4 thar runs mainline Linux and operates in the -20°C to +85°C temperature range. The CPU module also features a wide range of interfaces exposed through female headers including HDMI 2.0, MIPI-DSI, LVDS, dual MIPI CSI, dual Gigabit Ethernet, CAN FS and more. Olimex also designed the iMX8MP-SOM-EVB evaluation board for easy evaluation. Olimex iMX8MP-SOM-4GB-IND system-on-module Specifications: SoC – NXP i.MX 8M Plus (MIMX8ML8CVNKZAB) CPU Quad-core Arm Cortex-A53 processor @ up to 1.6 GHz Arm Cortex-M7 real-time core @ 800 MHz Cache – 512KB GPU – Vivante GC7000UL 3D GPU, Vivante GC520L 2D GPU VPU – 1080p H.265/H.264 video decoder & encoder DSP HiFi 4 DSP AI accelerator – 2.3 TOPS Neural Processing Unit (NPU) System Memory – 4GB LPDDR4 Storage – EEPROM for Linux configuration Display and camera […]

Boardcon Rockchip and Allwinner SoM and SBC products