Posted on

Rockchip RKLLM toolkit released for NPU-accelerated large language models on RK3588, RK3588S, RK3576 SoCs

Rockchip RKLLM toolkit (also known as rknn-llm) is a software stack used to deploy generative AI models to Rockchip RK3588, RK3588S, or RK3576 SoC using the built-in NPU with 6 TOPS of AI performance. We previously tested LLM’s on Rockchip RK3588 SBC using the Mali G610 GPU, and expected NPU support to come soon. A post on X by Orange Pi notified us that the RKLLM software stack had been released and worked on Orange Pi 5 family of single board computers and the Orange Pi CM5 system-on-module. The Orange Pi 5 Pro‘s user manual provides instructions on page 433 of the 616-page document, but Radxa has similar instructions on their wiki explaining how to use RKLLM and deploy LLM to Rockchip RK3588(S) boards. The stable version of the RKNN-LLM was released in May 2024 and currently supports the following models: TinyLLAMA 1.1B Qwen 1.8B Qwen2 0.5B Phi-2 2.7B Phi-3 […]

Posted on

Radxa ROCK 5C (Lite) SBC features Rockchip RK3588S2 or RK3582 SoC, WiFi 6, Raspberry Pi PCIe FFC connector

First came the ROCK 5B pico-ITX SBC, then the Raspberry Pi 4-sized ROCK 5A board, and now Radxa has launched the Radxa ROCK 5C and 5C Lite single board computers powered by respectively Rockchip RK3588S2 octa-core and RK3582 hexa/octa-core “Lottery” processors. The ROCK 5C (Lite) design is very similar to the ROCK 5A, but there are some notable differences. First, it replaces the two micro HDMI ports with a single HDMI port, then it removes the Key M socket for M.2 wireless modules to make place for a built-in WiFi 6 and Bluetooth 5.4 module plus a Raspberry Pi PCIe FFC connector, and finally, the ROCK 5C does not support an SPI flash module anymore. The specifications of the ROCK 5C and ROCK 5 Lite SBC can be found in the table below. Both processors are new, so let’s have a look. First, how does RK3588S2 differ from RK3588S? They […]

ArmSoM RK3588 AIModule7 NVIDIA Jetson Nano-compatible SOM
Posted on

Save up to $75 on Rockchip RK3588-powered Mixtile Blade 3 SBC and Core 3588E module (Sponsored)

Mixile has launched a promotion that could save you up to $75 on the company’s Rockchip RK3588-powered devices, namely the Mixtile Blade 3 SBC that can be used standalone or integrated into a cluster and Core 3588E SO-DIMM system-on-module that follows the NVIDIA Jetson Nano, TX2 NX, Xavier NX, and Orin Nano form factor and will work with most carrier boards designed for those. The first part of the “Lucky Offer” promotion is a $50 discount coupon code (cnx50off) applicable to the Mixtile Blade 3, Mixtile Blade 3 Case, and Mixtile Cluster Box. The Mixtile Blade 3 is a pico-ITX SBC powered by a Rockchip RK3588 octa-core Cortex-A76/A55 processor, with up to 32GB RAM, up to 256GB eMMC flash, three display interfaces, an HDMI input port, dual GbE, a 30-pin GPIO header, and a U.2 connector carrying 4-lane PCIe Gen3 and SATA 3.0 signals and specifically designed for cluster applications. […]

Posted on

Rockchip RK3588’s NPU open-source driver performs object detection at 30 FPS

Tomeu Vizoso has been working on an open-source driver for NPU (Neural Processing Unit) found in Rockchip RK3588 SoC in the last couple of months, and the project has nicely progressed with object detection working fine at 30 fps using the SSDLite MobileDet model and just one of the three cores from the AI accelerator. Many recent processors include AI accelerators that work with closed-source drivers, but we had already seen reverse-engineering works on the Allwinner V831’s NPU a few years ago, and earlier this year, we noted that Tomeu Vizoso released the Etvaniv open-source driver that works on Amlogic A311D’s Vivante NPU. Tomeu has now also started working on porting his Teflon TensorFlow Lite driver to the Rockchip RK3588 NPU which is closely based on NVIDIA’s NVDLA open-source IP. He started his work in March leveraging the reverse-engineering work already done by Pierre-Hugues Husson and Jasbir Matharu and was […]

Posted on

Orange Pi 5 Pro – A low-cost Rockchip RK3588S SBC with up to 16GB LPDDR5 RAM, dual HDMI video output

As mentioned in the Orange Pi Developer Conference 2024 article, the Orange Pi 5 Pro launch was just around the corner, and the latest Rockchip RK3588S SBC is now available on Amazon or Aliexpressfor $109 and up with 16GB LPDDR5 RAM, but cheaper 4GB ($60) and 8GB ($80) variants are coming soon. One would think the Orange Pi 5 Pro would be an evolution of the Orange Pi 5 SBC with LPDDR4 memory, and in some ways it is, but there are enough changes to display ports, storage, wireless, GPIO header, and even the form factor that make a direct comparison challenging. Orange Pi 5 Pro specifications: SoC – Rockchip RK3588S CPU – Octa-core processor with 4x Cortex-A76 cores @ up to 2.4 GHz, 4x Cortex-A55 cores @ up to 1.8 GHz GPU – Arm Mali-G610 MP4 GPU with OpenGL ES 3.2,  OpenCL 2.2, and Vulkan 1.2 support VPU – […]

Posted on

Rockchip RK3582 is a cost-down version of RK3588S with two Cortex-A76 cores, four Cortex-A55 cores, no GPU

Rockchip RK3582 hexa-core SoC is pin-to-pin compatible with the popular Rockchip RK3588S octa-core Cortex-A76/A55 SoC, but only features two Cortex-A76 cores, a 5 TOPS NPU (instead of 6 TOPS) and does not come with a 3D GPU. I was first made aware of the Rockchip RK3582 in October 2023 when I was sent a photo of a board allegedly for a TV box, but while the RK3582 still features a 4K video decoder, the lack of a 3D GPU could make it problematic with 3D accelerated user interface. We now have more details with Radxa having released the datasheet and a few more interesting details. Rockchip RK3582 specifications: Hexa-core CPU – 2x Cortex-A76 and 4x Cortex-A55 cores in dynamIQ configuration (frequencies are still shown as TBD in the datasheet) GPU No 3D GPU 2D graphics engine up to 8192×8192 source, 4096×4096 destination AI Accelerator – 5 TOPS NPU 3.0 (Neural […]

Rockchip RK3568, RK3588 and Intel x86 SBCs and SoMs in 2025
Posted on

Testing AI and LLM on Rockchip RK3588 using Mixtile Blade 3 SBC with 32GB RAM

We were interested in testing artificial intelligence (AI) and specifically large language models (LLM) on Rockchip RK3588 to see how the GPU and NPU could be leveraged to accelerate those and what kind of performance to expect. We had read that LLMs may be computing and memory-intensive, so we looked for a Rockchip RK3588 SBC with 32GB of RAM, and Mixtile – a company that develops hardware solutions for various applications including IoT, AI, and industrial gateways – kindly offered us a sample of their Mixtile Blade 3 pico-ITX SBC with 32 GB of RAM for this purpose. While the review focuses on using the RKNPU2 SDK with computer vision samples running on the 6 TOPS NPU, and a GPU-accelerated LLM test (since the NPU implementation is not ready yet), we also went through an unboxing to check out the hardware and a quick guide showing how to get started […]

Posted on

EmbedFire LubanCat 4 card computer – A Rockchip RK3588S dev board with a mini PCIe socket for WiFi or 4G LTE

Launched by Yehuo Electronic EmbedFire LubanCat 4 card computer or LubanCat 4 in short, is a Rockchip RK3588S SBC that packs quite a lot of features in an 85x56mm form factor with Ethernet, USB, mini PCIe, HDMI 2.1, SIM & microSD card holder, and more. The board comes with up to 16GB of RAM and 128GB of eMMC flash. It comes with a Gigabit Ethernet port, five USB ports (including one USB-C), a built-in microphone, multiple audio inputs and outputs, a 40-pin Raspberry Pi compatible expansion header, and supports HDMI input through an adapter connected to a MIPI CSI port. EmbedFire LubanCat 4 card computer specifications: SoC – Rockchip RK3588S CPU – Octa-core processor with 4x Cortex-A76 cores @ up to 2.2-2.4 GHz, 4x Cortex-A55 cores @ up to 1.8 GHz GPU –  Arm Mali-G610 GPU with OpenGL ES 3.2,  OpenCL 2.2, and Vulkan 1.2 support VPU – 8Kp60 video decoder […]

Boardcon EM3562 Rockchip RK3562 SBC with 8 analog camera inputs