Rockchip RKLLM toolkit (also known as rknn-llm) is a software stack used to deploy generative AI models to Rockchip RK3588, RK3588S, or RK3576 SoC using the built-in NPU with 6 TOPS of AI performance. We previously tested LLM’s on Rockchip RK3588 SBC using the Mali G610 GPU, and expected NPU support to come soon. A post on X by Orange Pi notified us that the RKLLM software stack had been released and worked on Orange Pi 5 family of single board computers and the Orange Pi CM5 system-on-module. The Orange Pi 5 Pro‘s user manual provides instructions on page 433 of the 616-page document, but Radxa has similar instructions on their wiki explaining how to use RKLLM and deploy LLM to Rockchip RK3588(S) boards. The stable version of the RKNN-LLM was released in May 2024 and currently supports the following models: TinyLLAMA 1.1B Qwen 1.8B Qwen2 0.5B Phi-2 2.7B Phi-3 […]
Linux 6.10 Release – Notable changes, Arm, RISC-V, and MIPS architectures
Linux Torvalds has announced the release of Linux 6.10 on LKML: So the final week was perhaps not quote as quiet as the preceding ones, which I don’t love – but it also wasn’t noisy enough to warrant an extra rc. And much of the noise this last week was bcachefs again (with netfs a close second), so it was all pretty compartmentalized. In fact, about a third of the patch for the last week was filesystem-related (there were also some btrfs latency fixes and other noise), which is unusual, but none of it looks particularly scary. Another third was drivers, and the rest is “random”. Anyway, this obviously means that the merge window for 6.11 opens up tomorrow. Let’s see how that goes, with much of Europe probably making ready for summer vacation. And the shortlog below is – as always – just the last week, not some kind […]
High Torque Robotics Mini π is a bipedal robot powered by an Orange Pi 5 SBC
High Torque Robotics’ Mini π is a 54cm high bipedal robot that can walk and dance with two legs and leverages the Orange Pi 5 SBC’s features such as the 6 TOPS AI accelerator in the Rockchip RK3588S processor. The robot offers 12 degrees of freedom (DOF) and can run, jump, and even flip thanks to its twelve join motors that were developed by the company. The Mini π is designed for locomotion algorithm research and education and supports ZMP (zero moment point), MPC (Model Predictive Control), reinforcement learning locomotion control algorithms, and ROS SLAM navigation features. Mini π bipedal robot highlights: SBC – Orange Pi 5 RK3588S single board computer Controller – Custom-design “high-performance underlying controller” using 4x CAN FD communication DOF – 6 DoF per leg, or 12 in total Joint motors 8x HTDM-5047-36-NE with gear ratio: 36, 16Nm peak torque 4x HTDM-4438-32-NW with gear ratio: 32, […]
Mixtile Edge AI boxes work with ONVIF cameras to deploy video analytics solutions (Sponsored)
Mixtile Edge AI solution supports ONVIF cameras and leverages object detection, object classification, real-time analysis, and intelligent monitoring to create IoT video analytics applications across the security, transportation, logistics, retail, industry, and agriculture sectors. The hardware is based on the time-tested Mixtile Edge 2 Kit IoT gateway powered by a Rockchip RK3568 SoC with a 1 TOPS NPU and 1080p60 VPU, or Mixtile Blade 3 SBC featuring the more powerful Rockchip RK3588 octa-core SoC with a 6 TOPS AI accelerator and an 8Kp60 VPU. The former can analyze up to 10 streams in real-time, and the latter up to a whopping 40 streams. So the novelty here is on the software side that has been developed by Mixtile and works the following way: The ONVIF cameras transmit video streams to a Mixtile Edge AI Box over the network. The Edge AI Box then runs pre-trained AI models to analyze the […]
Banana Pi BPI-M5 Pro low-profile SBC features Rockchip RK3576 octa-core Cortex-A72/A53 AIoT SoC
Banana Pi BPI-M5 Pro, also known as Armsom Sige5, is a low-profile single board computer (SBC) powered by the Rockchip RK3576 octa-core Cortex-A72/A53 SoC for the AIoT market that offers a mid-range offering between Rockchip RK3588 and RK3399 SoCs. The board comes with 16GB LPDDR4X and 128GB eMMC flash by default, offers dual GbE, WiFi 6 and Bluetooth 5.2 connectivity, an M.2 2280 PCIe socket for expansion, HDMI and MIPI DSI display interfaces, two MIPI CSI camera interfaces, a few USB ports, and a 40-pin GPIO header. Banana Pi BPI-M5 Pro specifications: SoC – Rockchip RK3576 CPU 4x Cortex-A72 cores @ 2.2GHz, four Cortex-A53 cores @ 1.8GHz Arm Cortex-M0 MCU at 400MHz GPU – ARM Mali-G52 MC3 GPU with support for OpenGL ES 1.1, 2.0, and 3.2, OpenCL up to 2.0, and Vulkan 1.1 NPU – 6 TOPS (INT8) AI accelerator with support for INT4/INT8/INT16/BF16/TF32 mixed operations. VPU Video Decoder: […]
Orange Pi CM5 – A Raspberry Pi CM4 alternative with up to 16GB RAM, 256GB eMMC flash
Orange Pi CM5 is a system-on-module mostly compatible with the Raspberry Pi CM4 (and upcoming Raspberry Pi CM5?) powered by a Rockchip RK3588S octa-core Cortex-A76/A55 processor that supports up to 16GB LPDDR4 and 256GB eMMC flash compared to the Pi CM4 module that is limited to 8GB RAM and 32GB flash. Since the Rockchip RK3588S has more interfaces than the Broadcom BCM2711 found in the Raspberry Pi CM4, the company added an extra 100-pin board-to-board connector with extra interfaces such as native USB 3.0, SATA III, CAN Bus, and an additional PCIe 2.0 x1 interface for a total of two. Orange Pi CM5 Orange Pi CM5 specifications: SoC – Rockchip RK3588S octa-core processor with 4x CortexA76 cores @ up to 2.4GHz, 4x CortexA55 core @ 1.8GHz Arm Mali-G610 MP4 “Odin” GPU with support for OpenGL ES1.1/2.0/3.2, OpenCL 2.2 and Vulkan 1.2 Video decoder – 8Kp60 H.265, VP9, AVS2, 8Kp30 H.264 […]
Orange Pi 3B V2.1 SBC has been revamped with better WiFi 5 connectivity, M.2 2280 NVMe/SATA SSD socket
Shenzhen Xunlong Software has introduced the Orange Pi 3B V2.1 SBC with an M.2 socket that supports 2280 NVMe or SATA SSDs, and a new Ampak AP6256 WiFi 5 and Bluetooth 5 wireless module replacing the Allwinner AW859A-based CDTech 20U5622 module in the first revision of the board. The Orange Pi 3B SBC was first introduced in August 2023 as a Rockchip RK3566 SBC with Raspberry Pi 3B form factor and support for M.2 2230 and 2242 NVMe or SATA storage. The new Orange Pi 3B V2.1 supports longer M.2 2280 SSDs at the cost of being slightly bigger than a credit card (89×56 mm) and offers better WiFi 5 connectivity. Orange Pi 3B V2.1 specifications: SoC – Rockchip RK3566 CPU – Quad-core Cortex-A55 processor @ up to 1.8 GHz GPU – Arm Mali-G52 2EE GPU with support for OpenGL ES 1.1/2.0/3.2, OpenCL 2.0, Vulkan 1.1 NPU – 0.8 TOPS […]
SBC software news – Armbian 24.5.1, DietPi 9.4, and Otii server for the Raspberry Pi 4/5
There’s been some notable software news for single board computers (SBCs) in the last few weeks with the release of Armbian 24.5.1 Havier with a focus on stability and UX improvement, the release of DietPi 9.4 lightweight Debian distritions for SBCs, and Otii server, the software for Qoitech Arc power supply, meter, and DAQ, has been finally released for the Raspberry Pi 4/5. Armbian 24.5.1 Havier Armbian announced 24.5.1 Havier on May 25 with bug fixes and improvements as a point release, but also some new boards. Here are some of the highlights. New boards Orange Pi 5 Pro FriendlyElec CM3588 NAS board Radxa ROCK 5 ITX Radxa Zero 3E/3W Avaota A1 SBC SK-AM68 board tqma8mpxl board CSC Hinlink H6xk boards RK3588-based Cool Pi CM5 EVB Improve Khadas support Resolve Rockchip patch maintenance nightmare Add functionality to freeze git resources Improve support for Radxa Rock S 0 and test USB […]