picoLLM is a cross-platform, on-device LLM inference engine

picoLLM Raspberry Pi 5

Large Language Models (LLMs) can run locally on mini PCs or single board computers like the Raspberry Pi 5 but with limited performance due to high memory usage and bandwidth requirements. That’s why Picovoice has developed the picoLLM Inference Engine cross-platform SDK optimized for running compressed large language models on systems running Linux (x86_64), macOS (arm64, x86_64), and Windows (x86_64), Raspberry Pi OS on Pi 5 and 4, Android and iOS mobile operating systems, as well as web browsers such as Chrome, Safari, Edge, and Firefox. Alireza Kenarsari, Picovoice CEO, told CNX Software that “picoLLM is a joint effort of Picovoice deep learning researchers who developed the X-bit quantization algorithm and engineers who built the cross-platform LLM inference engine to bring any LLM to any device and control back to enterprises”. The company says picoLLM delivers better accuracy than GPTQ when using Llama-3.8B MMLU (Massive Multitask Language Understanding) as a […]

Kodi 21.0 Omega released with FFmpeg 6, LG webOS support, and more

Kodi 21.0 Omega

Kodi 21.0 “Omega” has just been released with the latest version of the open-source media center adding 3,750 commits since the release of Kodi 20.0 “Nexus” on January 15th, 2023 that notably added AV1 hardware decoding in Android and x86. The new Kodi 21.0 version updates FFmpeg to version 6, adds native support for LG webOS televisions after some reverse-engineering, and implements new features such as Dolby Vision on-the-fly profile conversion in Android, native windowing in macOS that does not rely on the SDL library, and an in-game player viewer to view which game port each player’s controller is currently connected to. Most of the changes were not user-facing and instead, were under-the-hood improvements to the stability, performance, and security of Kodi. You’ll find more changes in the Kodi 21.0 Alpha/Beta/RC pre-release announcements and the complete list of changes on GitHub.  That also means Kodi v22 “P*” development has started. […]

M5Stack releases local server implementations of UIFlow visual programming Web IDE

Visual programming local Web IDE

Visual programming is now a very popular method to teach programming to kids and M5Stack relies on UIFlow for their ESP32-based IoT development kit. Like most other companies, M5Stack provides either a Web IDE accessible from their server or a desktop program available for Windows, MacOS, or Linux, but the company has now released a local server implementation that allows users to run a Web IDE instance in their local network. The local server is available for Windows 11 x64, MacOS, Ubuntu 22.04, and Linux Arm (e.g. Raspberry Pi), so I downloaded the Ubuntu version to give it a try on my laptop. Somehow the Ubuntu release is full of Windows DLLs, but let’s ignore that for now, and the README.txt tells us to install one dependency and run the program as follows:

A window pops up letting us start or stop the server. It can be accessed with […]

56% off UPDF – An Adobe Acrobat Alternative for PC, Mac, iOS and Android (Sponsored)

UPDF view read PDF

UPDF is an all-in-one PDF editor that can read, annotate, edit and sync, convert, encrypt, sign, and organize PDFs. It’s a cross-platform software that works on Mac OS, Windows, Android, and iOS with one license working on all operating systems. The developers also plan to release AI features next month to automatically translate, summarize, write, rewrite, explain, and proofread PDFs quickly using the latest artificial intelligence development, but users can already benefit from a 56% discount for UDPF Pro as part of the Father’s Day promotion for which we’ll provide more detail at the end of this post. Key features of UPDF PDF Editor View and Read PDF – UPDF supports basic features of PDF readers such as opening and reading PDFs, printing PDF, searching for a text query, or even displaying a PDF as a slideshow. Edit and Sync PDF – As an advanced PDF editor, the program can […]

Add Z-Wave LR (Long Range) to Raspberry Pi or Home Assistant Yellow with Zooz 800 Series USB stick or GPIO Module

Z-Wave Long Range Raspberry Pi Home Assistant Yellow

We wrote about the new Z-Wave Long Range (LR) standard aka “Z-Wave Plus LR” promising four times the range and 10-year battery life in September 2020 but hadn’t heard much about it since then, at least until now, as Zooz has launched the ZST39 LR USB Stick and ZAC93 LR GPIO module based on a Z-Wave 800 Series chip, with the GPIO module compatible with Home Assistant Yellow and Raspberry Pi SBCs. Zooz 800 Series Z-Wave Long Range GPIO Module ZAC93 LR ZAC93 LR specifications: Z-Wave Frequency  – 908.42 MHz (US, CA, MX) / 921.4 MHz (AU, NZ) / 868.42 MHz (EU) Wireless Range – Up to 1 mile/1.6 km in open space with Long Range enabled (up to 300 meters in open space, up to 76 meters indoors in traditional mesh networks) Support for up to 200 devices in a single network Host interface – 10-pin header to Raspberry […]

KiCad 7.0.0 release – Custom fonts, text boxes, SpaceMouse, crash reporting, and much more

KiCad 7.0.0

KiCad 7.0.0 open-source EDA software has just been released with a range of new features from custom fonts to 3Dconnexion SpaceMouse integration to opt-in Sentry crash reporting, and many more. It took over three years between KiCad 5.0.0 and KiCad 6.0.0 announcements, but only a little over a year for the release of KiCad 7.0.0. Did KiCad developers acquire superhuman abilities or did AI get involved in the development somehow? Most probably not, and instead they change the release schedule to a yearly one, so we should get annual releases of the open-source EDA suite going forward, with KiCad 8.0.0 to be released in Q1 2024. Some notable changes to KiCad 7.0 include: Custom Fonts support is now available in the schematic, PCB, and worksheet editors to allow the use of any system font. Text box support was added in both the schematic and PCB editors. 3Dconnexion SpaceMouse support in […]

ESP32 MPY-Jama is a MicroPython IDE for ESP32 boards

ESP32 MPY-Jama

ESP32 MPY-Jama is a cross-platform MicroPython IDE specifically designed for ESP32 boards with a file manager, a  REPL terminal, real-time dashboards, and various ESP32-specific features. The IDE is an open-source Python program using pyWebView and pySerial plus some JavaScript for the user interface, and the developer of the program, Jean-Christophe Bos, provides binaries for Windows 64-bit and macOS 64-bit Arm or x86. It’s also possible to use it in Linux but needs to be built from source. Some of the key features of the ESP32 MPY-Jama IDE include: MicroPython code editor with syntax highlighting REPL interface Access to information dashboards with real-time data about WiFi and Bluetooth connections, system info with GPIO status, CPU frequency, memory and SPI flash details Easy 2-click methods to connect to WiFi and create an access point Graphical interface to install a new firmware through esptool Ability to create, import, and run “Jama Funcs” mini-applications […]

Orange Pi OS – An Android-based desktop OS with Windows 11’s look and feel

Orange Pi OS Android Windows 11 interface

The manufacturer of Orange Pi boards, Shenzhen Xunlong Software, has formally announced the release of Orange Pi OS based on Android with a Windows 11-styled desktop that we are told can also be switched to macOS look and feel, and offering features typically found in desktop operating systems such as multi-window support. I understand the current release of the operating system works on Orange Pi 800 keyboard PC and the Orange Pi 5 SBC should also be supported once soon. We’re told Orange Pi OS is based on Android 12, but that may be an error since I’m not aware of an Android 12 SDK for the Rockchip RK3399 processor. The company plans to release an Arch Linux Arm version named Orange Pi OS (Arch) as well as an Open Harmony variant called Orange Pi OS (OH) next year. Orange Pi OS highlights: Design similar to Windows 11 with a […]

Exit mobile version
EmbeddedTS embedded systems design