picoLLM is a cross-platform, on-device LLM inference engine

picoLLM Raspberry Pi 5

Large Language Models (LLMs) can run locally on mini PCs or single board computers like the Raspberry Pi 5 but with limited performance due to high memory usage and bandwidth requirements. That’s why Picovoice has developed the picoLLM Inference Engine cross-platform SDK optimized for running compressed large language models on systems running Linux (x86_64), macOS (arm64, x86_64), and Windows (x86_64), Raspberry Pi OS on Pi 5 and 4, Android and iOS mobile operating systems, as well as web browsers such as Chrome, Safari, Edge, and Firefox. Alireza Kenarsari, Picovoice CEO, told CNX Software that “picoLLM is a joint effort of Picovoice deep learning researchers who developed the X-bit quantization algorithm and engineers who built the cross-platform LLM inference engine to bring any LLM to any device and control back to enterprises”. The company says picoLLM delivers better accuracy than GPTQ when using Llama-3.8B MMLU (Massive Multitask Language Understanding) as a […]

uCAN CAN Ethernet Converter and Logger is Based on Orange Pi Zero Board

The CAN bus is a serial communication protocol used in automotive and automation applications. The guys at ucandevices.pl have designed a solution around Orange Pi Zero board that allows you to log CAN bus data or act as a bridge between the CAN bus and Ethernet or WiFi. They call it “CAN Ethernet converter, CAN Logger, Linux CAN computer”. Sorry, no shorter name that I could find… uCAN (pronounced micro CAN) CAN Bus board specifications: Main Board – Orange Pi Zero with Allwinner H2+ quad core cortex-A7 processor, 256 MB RAM Network Connectivity – 10/100M Ethernet, 802.11 b/g/n WiFi Can Bus – 2-pin terminal block; support for CAN version 2.0 support Power Supply – DC 5V/2A via micro USB port Dimension – 50 x 50 x 20 mm The device comes pre-load with Debian distribution provided by Armbian plus various CAN tools. The getting started video below shows uCANTools web […]

Microsoft Releases Raspberry Pi 3 Web Simulator Working with Azure IoT Cloud

If you were already following this blog when the first Raspberry Pi launched, you may have tried to emulate a Raspberry Pi and run Fedora in QEMU, as getting a board was a challenge at that time. Microsoft has launched its own Raspberry Pi (3) simulator running in web browsers, connecting to virtual sensors and components using Fritzing, and interfacing with the company’s Azure IoT cloud service. The preview version of the simulator does not allow you customize components on the breadboard, something you’ll be able to do in the release version, so we are stuck with a BMP280 sensor and red LED in the assembly window. on the left. On the top right, we’ve got sample source code written using Node.js to read temperature data from the sensor, push it to an Azure IoT Hub, and blink the LED in the coding area, and finally the integrated console window […]

Top Programming Languages & Operating Systems for the Internet of Things

The Eclipse foundation has recently done its IoT Developer Survey answered by 713 developers, where they asked  IoT programming languages, cloud platforms, IoT operating systems, messaging protocols (MQTT, HTTP), IoT hardware architectures and more.  The results have now been published. So let’s have a look at some of the slides, especially with regards to programming languages and operating systems bearing in mind that IoT is a general terms that may apply to sensors, gateways and the cloud, so the survey correctly separated languages for different segments of the IoT ecosystem. C and C++ are still the preferred languages for constrained devices, and developers are normally using more than one language as the total is well over 100%. IoT gateways are more powerful and resourceful (memory/storage) hardware, so it’s no surprise higher level languages like Java and Python join C and C++, with Java being the most used language with 40.8% […]

$80 BeagleBone Blue Board Targets Robots & Drones, Robotics Education

Last year, we reported that BeagleBoard.org was working with the University of California San Diego on BeagleBone Blue board for robotics educational kits such as EduMiP self-balancing robot, and EduRover four wheel robot. The board has finally launched, so we know the full details, and it can be purchased for about $80 on Mouser, Element14 or Arrow websites. BeagleBone Blue specifications: SiP (System-in-Package) – Octavo Systems OSD3358 with TI Sitara AM3358 ARM Cortex-A8 processor @ up to 1 GHz,  2×32-bit 200-MHz programmable real-time units (PRUs), PowerVR SGX530 GPU, PMIC, and 512MB DDR3 Storage – 4GB eMMC flash, micro SD slot Connectivity – WiFi 802.11 b/g/n, Bluetooth 4.1 LE (TI Wilink 8) with two antennas USB – 1x USB 2.0 client and host port Sensors – 9 axis IMU, barometer Expansion Motor control – 8x 6V servo out, 4x DC motor out, 4x quadrature encoder in Other interfaces – GPIOs, 5x UARTs, 2x […]

How to use Sonoff POW with ESPurna Firmware and Domoticz Home Automation System

Sonoff POW is an ESP8266 based wireless switch with a power meter that comes pre-loaded with a closed-source firmware that works with eWelink app for Android or iOS by default. But we’ve also seen Sonoff POW, and other Sonoff wireless switches from the same family, can be flash with open source firmware supporting MQTT (Message Queuing Telemetry Transport) lightweight messaging protocol such as ESPurna, and I initially sent data from Sonoff POW to ThingSpeak via an MQTT broker (mosquitto) to draw some pretty charts. I did that with the switch connected to a lightbulb, but I’ve since installed Sonoff POW in my office to measure the room’s power consumption minus the ceiling light and aircon as shown below. Sonoff cable mechanism is really a pain for hard copper wires, as they are hard to push inside the mechanism, and something come out. I finally managed by it took longer than […]

Tibbo Project System is a Modular Linux IoT Prototyping Platform based on TI Sitara Cortex A8 Processor

If you’ve found yourself needing to quickly demo a system that does not look like a mess of wire to a customer, or your project is requires low production volumes, making the cost of designing your own and mass-producing the hardware prohibitive, Tibbo Project System might be worth looking into. It features an almost bare board powered by Texas Instruments Sitara processor, and a large area for Tibbit blocks to add features as needed, as well as an enclosure. Size 3 Linux Project PCB (LTPP3) specifications: SoC – Texas Instruments Sitara AM335x Cortex A8 processor up to 1.0 GHz System Memory – 512 MB DDR3 Storage – 512 MB NAND flash, 2KB EEPROM, optional micro SD slot Connectivity – 10/100M Ethernet (RJ45), optional WiFi (via LW1000 module) and GPRS connectivity (via Tibbit #47) Expansion – 51 I/Os: 7x tiles 14x sockets for Tibbit module including 4x with UART capability up […]

Quick Start Guide for LinkIt Smart 7688 (Duo) Board

Mediatek Labs has announced LinkIt Smart 7688 development boards powered by Mediatek MT7688 WiSoC earlier today, but I was selected for a close beta several weeks before the launch, and I’ve had time to play a little with the boards, so today I’ll report my experience getting started with LinkIt Smart 7688 amd 7688 Duo by writing a Quick Start Guide showing how to setup the boards, upgrade firmware, access the serial console, run “Blink LED” sample applications with Python and JavaScript, as well as the Arduino IDE, and connect to the Internet. Initial Setup You’ll only need a micro USB cable and a computer with WiFi and USB ports to get started with the board. The green LED (top) for the MCU will turn on immediately, while the red LED (bottom) for WiFI will blink once, and only turn on continuously after 5 seconds, and within 30 seconds after […]

EmbeddedTS embedded systems design