Rockchip RKLLM toolkit released for NPU-accelerated large language models on RK3588, RK3588S, RK3576 SoCs

Rockchip RK3588 RKLLM

Rockchip RKLLM toolkit (also known as rknn-llm) is a software stack used to deploy generative AI models to Rockchip RK3588, RK3588S, or RK3576 SoC using the built-in NPU with 6 TOPS of AI performance. We previously tested LLM’s on Rockchip RK3588 SBC using the Mali G610 GPU, and expected NPU support to come soon. A post on X by Orange Pi notified us that the RKLLM software stack had been released and worked on Orange Pi 5 family of single board computers and the Orange Pi CM5 system-on-module. The Orange Pi 5 Pro‘s user manual provides instructions on page 433 of the 616-page document, but Radxa has similar instructions on their wiki explaining how to use RKLLM and deploy LLM to Rockchip RK3588(S) boards. The stable version of the RKNN-LLM was released in May 2024 and currently supports the following models: TinyLLAMA 1.1B Qwen 1.8B Qwen2 0.5B Phi-2 2.7B Phi-3 […]

Linux 6.10 Release – Notable changes, Arm, RISC-V, and MIPS architectures

Linux 6.10 Release Changelog

Linux Torvalds has announced the release of Linux 6.10 on LKML: So the final week was perhaps not quote as quiet as the preceding ones, which I don’t love – but it also wasn’t noisy enough to warrant an extra rc. And much of the noise this last week was bcachefs again (with netfs a close second), so it was all pretty compartmentalized. In fact, about a third of the patch for the last week was filesystem-related (there were also some btrfs latency fixes and other noise), which is unusual, but none of it looks particularly scary. Another third was drivers, and the rest is “random”. Anyway, this obviously means that the merge window for 6.11 opens up tomorrow. Let’s see how that goes, with much of Europe probably making ready for summer vacation. And the shortlog below is – as always – just the last week, not some kind […]

RAUC open-source OTA update solution for embedded Linux ported to Rock Pi 4 SBC

RAUC OTA firmware update Rock Pi 4

RAUC open-source OTA update solution enabling A/B updates for embedded Linux images has recently been ported to the Radxa Rock Pi 4 Model B SBC powered by a Rockchip OP1 SoC by the project’s maintainer, Leon Anavi working for Konsulto Group. If you run a Linux distribution like Ubuntu, Debian, or Fedora, packages and OS images are taken care of automatically or by running a few commands. However, software engineers who build custom embedded Linux images with the Yocto Project or Buildroot must handle this themselves. Luckily, there are already open-source OTA firmware update solutions such as Mender, Balena, Torizon, OSTree, Snap, or RAUC, and we’ll look at the latter today. RAUC (Robust Auto-Update Controller) was started by Pengutronix in 2015 and eventually adopted by the community. It’s a lightweight update client that runs on an Embedded Linux device and controls the A/B update procedure when a new firmware revision […]

Radxa Fogwise Airbox AI box review – Part 2: Llama3, Stable Diffusion, imgSearch, Python SDK, YOLOv8

Radxa Airbox Fogwise review

After checking out Radxa Fogwise Airbox hardware in the first part of the review last month, I’ve now had time to test the SOPHGO SG2300x-powered AI box with an Ubuntu 20.04 Server image preloaded with CasaOS as well as Stable Diffusion and Llama3 containers. I’ll start the second part of the review by checking out the pre-installed Stable Diffusion text-to-image generator and Llama3 AI chatbot, then manually install imgSearch AI-powered image search engine in CasaOS web dashboard, test the Python SDK in the command line, and run some AI vision models, namely Resnet50 and YOLOv8. Radxa Fogwise Airbox OS installation Radxa only provided an Ubuntu Server 20.04 image last month with only the basics pre-installated. The company has now improved the documentation and also made two images available for the Radxa Fogwise Airbox: Base image (1.2GB) – Based on Ubuntu Server 20.04; contains only Sophon base SDK and backend. Full […]

SBC software news – Armbian 24.5.1, DietPi 9.4, and Otii server for the Raspberry Pi 4/5

Qoitech Otii Raspberry Pi 4

There’s been some notable software news for single board computers (SBCs) in the last few weeks with the release of Armbian 24.5.1 Havier with a focus on stability and UX improvement, the release of DietPi 9.4 lightweight Debian distritions for SBCs, and Otii server, the software for Qoitech Arc power supply, meter, and DAQ, has been finally released for the Raspberry Pi 4/5. Armbian 24.5.1 Havier Armbian announced 24.5.1 Havier on May 25 with bug fixes and improvements as a point release, but also some new boards. Here are some of the highlights. New boards Orange Pi 5 Pro FriendlyElec CM3588 NAS board Radxa ROCK 5 ITX Radxa Zero 3E/3W Avaota A1 SBC SK-AM68 board tqma8mpxl board CSC Hinlink H6xk boards RK3588-based Cool Pi CM5 EVB Improve Khadas support Resolve Rockchip patch maintenance nightmare Add functionality to freeze git resources Improve support for Radxa Rock S 0 and test USB […]

Radxa Fogwise Airbox edge AI box review – Part 1: Specifications, teardown, and first try

Radxa Fogwise Airbox review

Radxa Fogwise Airbox, also known as Fogwise BM168M, is an edge AI box powered by a SOPHON BM1684X Arm SoC with a built-in 32 TOPS TPU and a VPU capable of handling the decoding of up to 32 HD video streams. The device is equipped with 16GB LPDDR4x RAM and a 64GB eMMC flash and features two gigabit Ethernet RJ45 jacks, a few USB ports, a speaker, and more. Radxa sent us a sample for evaluation. We’ll start the Radxa Fogwise Airbox review by checking out the specifications and the hardware with an unboxing and a teardown, before testing various AI workloads with Tensorflow and/or other frameworks in the second part of the review. Radxa Fogwise Airbox specifications The specifications below come from the product page as of May 30, 2024: SoC – SOPHON SG2300x CPU – Octa-core Arm Cortex-A53 processor up to 2.3 GHz VPU Decoding of up to […]

Radxa ROCK 5C (Lite) SBC features Rockchip RK3588S2 or RK3582 SoC, WiFi 6, Raspberry Pi PCIe FFC connector

Radxa Rock 5C

First came the ROCK 5B pico-ITX SBC, then the Raspberry Pi 4-sized ROCK 5A board, and now Radxa has launched the Radxa ROCK 5C and 5C Lite single board computers powered by respectively Rockchip RK3588S2 octa-core and RK3582 hexa/octa-core “Lottery” processors. The ROCK 5C (Lite) design is very similar to the ROCK 5A, but there are some notable differences. First, it replaces the two micro HDMI ports with a single HDMI port, then it removes the Key M socket for M.2 wireless modules to make place for a built-in WiFi 6 and Bluetooth 5.4 module plus a Raspberry Pi PCIe FFC connector, and finally, the ROCK 5C does not support an SPI flash module anymore. The specifications of the ROCK 5C and ROCK 5 Lite SBC can be found in the table below. Both processors are new, so let’s have a look. First, how does RK3588S2 differ from RK3588S? They […]

Radxa Zero 3E SBC offers gigabit Ethernet and PoE in Raspberry Pi Zero 2 W form factor

Radxa Zero 3E

Last December, we wrote about the Rockchip RK3566-powered Radxa Zero 3W WiFi 6 SBC and noted that the Radxa Zero 3E with gigabit Ethernet and optional PoE supports would be coming soon with about the same dimensions as the Raspberry Pi Zero 2 W. “Soon” is now as the Radxa Zero 3E is now available on Aliexpress or Amazon with RAM capacities from 1GB to 8GB LPDDR4. The small SBC also comes with optional eMMC flash up to 64GB, a microSD card slot for storage, a micro HDMI video output port, a MIPI CSI connector compatible with Raspberry Pi Camera V1 and V2, two USB-C ports, and a 40-pin GPIO header for expansion. Radxa Zero 3E specifications: SoC – Rockchip RK3566 CPU – Quad-core Arm Cortex-A55 processor @ 1.6 GHz GPU – Arm Mali G52-2EE GPU with support for OpenGL ES 1.1/2.0/3.2, Vulkan 1.1, OpenCL 2.0 NPU – 0.8 TOPS […]

EmbeddedTS embedded systems design