Performance Optimization Articles

Android On-device LLM Context Window Engineering

A practical Android on-device LLM context management strategy covering layered prompt compression, summary caching, dialog state machines, and token budget allocation.

Android On-device LLM Streaming Output: From Tokens to Compose UI

A full-stack architecture for Android on-device LLM streaming output, covering KV Cache memory pressure, Kotlin Flow backpressure, and incremental Compose rendering.

Android On-device AI Model Delivery and Version Management

A practical model delivery architecture that decouples on-device AI models from APK releases with three-layer versioning, BSDiff incremental updates, and hot rollback.

Android On-device AI Power and Thermal Management: From SoC DVFS to Thermal Throttling

A practical look at sustained on-device LLM inference, GPU power profiles, DVFS scheduling, thermal throttling, and thermal-aware load scheduling that reduced P99 latency from 890ms to 380ms.

Android On-device AI Memory Bandwidth: GPU Shared Memory to NPU Zero-copy

A practical guide to Android on-device AI memory-bandwidth optimization, from camera-to-GPU data movement to AHardwareBuffer, ION reuse, and NPU zero-copy paths.

Android Cold Start Optimization with Baseline Profiles

A practical Android cold start optimization guide covering Baseline Profile principles, generation, integration, measurement, test results, and rollout caveats.

Android On-device AI Profiling with Perfetto: NPU Scheduling and Memory Bandwidth

A Perfetto-based profiling method for Android on-device AI inference, tracing NPU scheduling, GPU counters, DRM contention, and memory bandwidth bottlenecks.

Android On-device AI Image Preprocessing: From Bitmap Pixels to Tensor Input

A full Android on-device AI preprocessing pipeline from Bitmap pixels to tensor input, covering memory layout, pixel conversion, resize choices, normalization, and zero-copy optimization.

Android Hybrid AI Routing and Offline Fallback: End-to-end On-device and Cloud Inference Scheduling

A practical Android hybrid AI inference architecture covering multidimensional routing, network-quality awareness, three-tier offline fallback, and priority request scheduling.

Android Push Delivery: FCM, Vendor Channels, and Doze

A practical look at Android push delivery across FCM and OEM vendor channels, including keepalive behavior, Doze impact, routing, TTL, and fallback design.

Android Screen Capture Internals: MediaProjection, Surface, and MediaCodec

A deep dive into Android screen capture, covering MediaProjection permissions, VirtualDisplay, ImageReader, MediaCodec, BufferQueue transport, and frame-rate debugging.

Android Text Rendering: Typeface, Minikin, Skia, and Measurement

(Updated on )
Trace Android text from Typeface through font matching and glyph drawing, then measure the bottleneck before changing fonts or caches.

Android Shared Element Transitions: ActivityOptions to Compose SharedTransitionScope

A practical guide to Android shared element transitions, covering ActivityOptions, Snapshot and GhostView, Compose SharedTransitionScope, pitfalls, and migration.

Android Zygote Process Deep Dive: From init fork to App Incubation

A deep dive into Android Zygote startup, preloading, socket communication, fork specialization, and how COW makes app process creation fast.

Inside Android Vulkan: Migrating from OpenGL ES to Low-Overhead GPU Rendering

A practical Android Vulkan migration guide covering command buffers, render passes, descriptor sets, pipeline cache, VMA, AHardwareBuffer, and GPU driver tuning.

Inside Android TTS: From TextToSpeech API to On-Device Vocoders

A full-stack look at Android TTS, including engine binding, synthesis callbacks, on-device HiFi-GAN vocoders, streaming playback, and TTFA tuning.

HTTP Protocol Evolution from a Performance Perspective

HTTP is a request-response application-layer protocol for transferring hypertext and other web resources between browsers and servers.

Inside the Android Sensor Framework: From SensorManager API to Sensor HAL

A full-stack look at Android sensors, covering SensorManager, SensorService scheduling, BitTube delivery, virtual sensor fusion, batching, and power tuning.

Android Native Memory Analysis: From malloc_debug to heapprofd

A practical guide to Android native heap leak analysis, from quick malloc_debug checks to Perfetto heapprofd flamegraphs and sampling workflows.

Android NNAPI: HAL Architecture, Deprecation, and Migration

(Updated on )
Understand NNAPI HAL and NPU architecture, its Android 15 deprecation, and migration options for existing on-device inference workloads.