Running an LLM on an Android Phone

In my last blog post, I showed you how to work with JFR files using DuckDB, which started a blog series that I surely will continue. Just not this week. Instead, I want to showcase a tiny app to run AI models using the MediaPipe API directly on your phone. I created the app for another purpose (perhaps described in a future blog post) earlier this year, but never wrote anything about it. So here we are.

TL;DR: I built an Android app that offers AI models via a server

The app is open-source and available on GitHub; it’s experimental, but maybe it can help you build your own apps. You can download the releases page of the repo and install it.

The LLM API endpoint, writing a poem on a backyard scene
Continue reading

Running Garden Linux on a Phone

A month ago, I showed you in my article CAP in the pocket: Developing Java Applications on your Phone (a more concise version), how to run a CAP development environment on your phone. In this week’s short blog post, I use a different angle. I wanted to see whether I could run SAP’s Garden Linux on my phone.

If you’re waiting for my CPU time profiler blog post, it’ll come soon (hopefully on Monday).

Garden Linux is a Debian GNU/Linux derivate that aims to provide small, auditable Linux images for most cloud providers (e.g. AWS, Azure, GCP etc.) and bare-metal machines. Garden Linux is the best Linux for Gardener nodes. Garden Linux provides great possibilities for customizing that is made by a highly customizable feature set to fit your needs.

gardenlinux.io

TL;DR: Yes, you can install it. And it works somewhat.

Continue reading

CAP in the pocket: Developing Java Applications on your Phone

Smartphones are more powerful then ever, with processors rivaling old laptops. So let’s try to use them like a laptop to develop web-applications on the go. In this weeks blog post I’ll show you how to do use run and develop a CAP Java Spring Boot application on your smartphone and how to run VSCode locally to develop and modify it. This, of course, works only on Android phones, as they are a Linux at their core.

Continue reading