Skip to content

Commit 0ca1303

Browse files
committed
docs: update documentation, release notes, changelog, and in-app updates for v4.2.9
1 parent 79f24f4 commit 0ca1303

6 files changed

Lines changed: 292 additions & 30 deletions

File tree

‎README.md‎

Lines changed: 33 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@
2626

2727
## 🚀 Overview
2828

29-
**LeanType** combines the trusted, lightweight, privacy-focused foundation of HeliBoard with modern productivity features: Multi-Provider Cloud, Self-Hosted & Offline AI proofreading, On-Device Whisper Voice Typing, Handwriting Recognition, In-Keyboard Offline Camera & Screenshot OCR, Real-time Inline Math Calculations, Zero-Latency Custom Sound Packs, Smart Toolbar Auto-Spanning, Built-in Self-Updater, and Rich Text Tools, while keeping you in complete control over your data.
29+
**LeanType** combines the trusted, lightweight, privacy-focused foundation of HeliBoard with modern productivity features: Multi-Provider Cloud, Self-Hosted & Offline AI proofreading, On-Device Whisper Voice Typing, Handwriting Recognition, In-Keyboard Offline Camera & Screenshot OCR, GIF Search & Media Picker, CJK (Chinese, Japanese & Korean) Engine, Hexagonal Honeycomb Layouts, Real-time Inline Math Calculations, Zero-Latency Custom Sound Packs, Live System Wallpaper Blur, Auto Floating in Landscape, Smart Toolbar Auto-Spanning, Built-in Self-Updater, and Rich Text Tools, while keeping you in complete control over your data.
3030

3131
---
3232

@@ -52,10 +52,6 @@
5252

5353
LeanType is available in two purpose-built flavors designed to match your exact privacy preferences, hardware specifications, and feature requirements:
5454

55-
> [!NOTE]
56-
> **Flavor Consolidation (v4.2.6)**:
57-
> As announced in v4.2.5, `standardfull` has been completely merged into `standard`. Both editions operate with zero sensitive permissions (no `READ_CONTACTS`, `SYSTEM_ALERT_WINDOW`, or `REQUEST_INSTALL_PACKAGES`). Users previously using `standardfull` can update directly to `standard` with full data and settings preservation.
58-
5955
| Feature / Capability | 🌿 Standard (Recommended)<br>`-standard-release.apk` | 🛡️ Offline<br>`-offline-release.apk` |
6056
| :--- | :---: | :---: |
6157
| **Target Audience** | **Recommended** (F-Droid & Direct users) | Privacy purists & Air-gapped devices |
@@ -82,10 +78,17 @@ LeanType is available in two purpose-built flavors designed to match your exact
8278
### 🤖 AI Integration & Smart Tools
8379
- **Multi-Provider Cloud & Self-Hosted AI**: Integrated proofreading, grammar correction, and text rewriting powered by **Google Gemini**, **Groq** (Llama 3.3, Mixtral, DeepSeek), **OpenAI**, or any **Self-Hosted local LLM server** (Ollama, LM Studio, LocalAI, vLLM, or custom OpenAI-compatible endpoints).
8480
- **Dynamic Model Fetching**: Automatically fetches and populates the latest available model IDs directly from your cloud or self-hosted provider.
85-
- **🛡️ Offline Neural Proofreading (GGUF)**: Run compact, quantized GGUF language models directly on your device via embedded `llama.cpp`—100% private, zero network access (`offline` flavor).
81+
- **🛡️ Offline Neural Proofreading (GGUF)**: Run compact, quantized GGUF language models directly on your device via embedded `llama.cpp` (100% private, zero network access in `offline` flavor).
8682
- **🌐 Multi-Mode In-Keyboard Translation**: Translate text directly into any language without switching apps. Choose between **Offline Translation Plugin** (supported across all flavors), **Built-in Offline Translation (ML Kit)**, or your configured **Cloud / Self-Hosted AI Provider** (Gemini, Groq, OpenAI, Ollama) with seamless fallback.
8783
- **🧠 Custom AI Keys & Capsules**: Assign custom prompts, personas (`#editor`, `#proofread`), and themed tag capsules to 10 customizable toolbar keys.
8884

85+
### 🈲 Multilingual & CJK Support
86+
- **CJK (Chinese, Japanese & Korean) Plugin Engine**: Complete East Asian language typing via companion plugin without bloating the core app.
87+
- **Chinese Pinyin**: Smart Pinyin input engine with fuzzy matching, syllable segmentation, and contextual multi-character phrase predictions (Simplified and Traditional).
88+
- **Japanese Kana & Romaji**: 12-key Flick input and standard QWERTY Romaji with live Kana-to-Kanji candidate dictionary lookups.
89+
- **Korean Hangul**: 2-Set (Dubeolsik) and 10-key Chunjiin layouts with real-time on-the-fly Jamo syllable combiner (Choseong, Jungseong, Jongseong).
90+
- **Dynamic Candidate Strip**: High-performance scrolling candidate bar with expansion grid overlay and frequency-weighted ranking.
91+
8992
### 📷 Offline Camera & Screenshot OCR
9093
- **In-Keyboard Camera Viewfinder**: Open a live camera viewfinder directly inside the keyboard to extract printed or handwritten text with 1 tap.
9194
- **Screenshot Suggestion Pill**: Automatically detects newly captured screenshots and displays a compact suggestion pill (`[OCR] [Screenshot] [X]`) for immediate 1-tap text extraction.
@@ -98,24 +101,32 @@ LeanType is available in two purpose-built flavors designed to match your exact
98101
- **✍️ Handwriting Recognition**: Draw characters or words directly on an expansive writing canvas using the [LeanType Handwriting Plugin](https://github.com/LeanBitLab/Leantype-Handwriting-Plugin) (supported across all flavors), with dedicated settings and in-app/offline model management.
99102

100103
### ⌨️ Layouts, Audio & Typing
104+
- **⬡ Hexagonal Honeycomb Layout Engine**: Typewise-style (`hex_typewise`) and hexagonal QWERTY (`hex_qwerty`) layouts with enlarged touch targets, mathematical axial hit-testing, gesture flicks, and ergonomic landscape thumb split.
101105
- **🎵 Custom Sound Packs & Audio Customization**: Native zero-latency key audio engine with 12+ built-in sound styles (iOS Tap, Mechanical Cherry MX, Thocky Mechanical, Vintage Typewriter, Retro CRT Terminal, Bubble Pop, Soft Velvet, Woodblock Minimal, Acoustic Marimba, Modern Crisp Tick, Sci-Fi, 8-Bit Chiptune Arcade), live sample audition, remote sound pack catalog, and custom `.zip` pack import.
102106
- **👆 Gesture / Glide Typing**: Smooth swipe typing powered by native C++ libraries (`libjni_latinime.so`).
107+
- **👆 Full Keyboard & 2D Backspace Swipe Gestures**: Edge-to-edge horizontal swipes across the full keyboard to switch languages, glide the cursor, or toggle numpad, plus 2D multidirectional backspace gestures for vertical multi-line text selection.
103108
- **📐 Smart Auto-Spanning Toolbar**: Dynamically expands and balances toolbar keys symmetrically to prevent awkward gaps across portrait, landscape, and tablet widths.
104109
- **🧭 Dedicated Text Editing Panel**: Gboard-style precision DPAD arrow navigation, selection mode (Shift + arrows), select word, select all, and editing shortcuts.
105110
- **🖱️ Touchpad Mode**: Swipe up on the spacebar to control the cursor freely across the screen, including full-screen laptop-style touchpad mode.
106111
- **🪟 Native IME Floating Window**: Seamless native IME window architecture with zero sensitive permissions (no `SYSTEM_ALERT_WINDOW`), pass-through background touches, bottom control bar (close, center-drag pill, resize drag handle), multi-touch tracking, zero dead space, and persistent mode memory.
107-
- **⚙️ Per-App Profiles & Compatibility Engine**: Tailor keyboard behavior per application (**Settings → Preferences → App Profiles**)—enable web editor compatibility, automatic incognito, force non-incognito, direct commit mode, symbol composing (preserving underscores `_` in Tasker variables), dialer search field compatibility (`TYPE_NULL`), and custom Enter action overrides.
112+
- **🪟 Auto Floating Keyboard in Landscape**: Automatically switches to a compact moveable floating window when entering landscape orientation and restores full docked width in portrait.
113+
- **🖼️ Live System Wallpaper & FastBlurEngine**: Dynamic blurred home/lock screen wallpaper background beneath keys with adjustable blur intensity slider and adaptive contrast.
114+
- **⚙️ Per-App Profiles & Compatibility Engine**: Tailor keyboard behavior per application (**Settings → Preferences → App Profiles**): enable web editor compatibility, automatic incognito, force non-incognito, direct commit mode, symbol composing (preserving underscores `_` in Tasker variables), dialer search field compatibility (`TYPE_NULL`), and custom Enter action overrides.
108115
- **⌨️ First-Class Hardware Keyboard Support**: Full predictive text, auto-correction, candidate selection shortcuts (`1`, `2`, `3`), and D-PAD navigation in emoji palettes for external Bluetooth/USB keyboards, with smart toolbar elevation above the navigation bar.
109116
- **🎨 Advanced Appearance & Key Ergonomics**: Independent corner radius sliders for Normal Keys, Functional Keys (Shift/Backspace), and Action Keys (Enter/Space), adjustable key gaps, customizable padding scales, and distinct Shift/Caps visual state indicators (outline, filled, underlined).
110117
- **⌨️ Dual Toolbar / Split Suggestions**: Option to split suggestions from the quick-action toolbar.
111118
- **🎨 Custom Layout Profiles**: Save up to 5 custom layout profiles with persistent slot index tracking.
112119
- **⌨️ Direct Switch Target IME & Custom Keycodes**: Bind keycode `-10076` to any toolbar key to switch directly to a specific target keyboard (e.g. Japanese, Korean, or Chinese IME). See the [Comprehensive Keycodes & Actions Reference](docs/FEATURES.md#30-comprehensive-keycodes--actions-reference) for the full keycodes catalog.
113120

114121
### 📋 Clipboard & Productivity
122+
- **🎬 GIF Search & Media Picker**: High-performance in-keyboard GIF and sticker media picker powered by GIPHY and Tenor, with live animated preview, trending search, recent tray, and automatic WhatsApp sticker normalization (512x512 WebP).
123+
- **📋 In-Keyboard Action Pill & Multi-Select Clipboard**: Gboard-style compact floating action pill on long press (paste, pin, delete, share), multi-select batch deletion/pinning, and sensitive OTP/card data filtering.
115124
- **🔢 Real-Time Inline Math Calculations**: Automatically evaluates mathematical expressions upon typing `=` (e.g. `25*4=`, `500-15%=`, `(12+8)/4=`) and shows the answer directly in the suggestion strip for 1-tap replacement.
116125
- **🔍 Smart Clipboard History & Inline Editing**: Search clips in real-time, swipe right to edit text directly in the toolbar with full gesture cursor/deletion, swipe left to delete with 5s undo, and fold pinned items.
117126
- **📸 Screenshot Suggestions**: Detects recently taken screenshots and offers instant 1-tap sharing via the suggestion strip or clipboard history.
118127
- **📝 Versatile Text Expander**: Built-in shortcut expansion with dynamic variables (`%date%`, `%time%`, `%clipboard%`, `%cursor%`), composable modifier filters (`%clipboard:clean%`, `:singleline`, `:title`, `:slug`, `:upper`, `:replace`), and automatic Wikipedia / research paper citation cleaner.
128+
- **💾 Storage & Cache Management**: Visual disk space auditing across AI models, dictionaries, sound packs, and media cache, with 1-tap cache purging and history reset (**Settings → Plugins → Storage & Cache**).
129+
- **🔐 Granular Backup & Encrypted API Key Export**: Export preferences, layouts, custom wordlists, typing history, and text expander shortcuts separately, with optional AES-256 encrypted export for third-party AI and media API keys.
119130
- **💾 Selective Category Backup & Restore**: Export and restore your data modularly with independent category checkboxes (**Layouts**, **Theme & Custom Backgrounds**, **Dictionaries & Typing History**, **Clipboard History**, and **General Settings**) without all-or-nothing overwrites.
120131
- **🔎 In-Palette Emoji Search**: Search emojis instantly by name or keyword directly within the emoji palette view, powered by locale-aware emoji dictionaries.
121132
- **✉️ Privacy-First OTP Auto-Fill**: Notification-based OTP verification code detection without sensitive SMS permissions, with customizable messaging app selection.
@@ -198,6 +209,16 @@ LeanType is available in two purpose-built flavors designed to match your exact
198209
2. **Offline Flavors**: Download `ocr_plugin.apk` from [GitHub Releases](https://github.com/LeanBitLab/LeanType-Ocr-Plugin/releases/latest) and load it in **Settings → Plugins → OCR**.
199210
3. Tap the **Camera / OCR** icon on the toolbar to open the in-keyboard scanner or take a screenshot to see the instant suggestion pill.
200211

212+
### 8. GIF Search & Media Picker Setup
213+
1. Open **Settings → Plugins → GIF Settings** (or tap the GIF key on the toolbar).
214+
2. Select your preferred provider (**GIPHY** or **Tenor**). Optionally configure custom API keys.
215+
3. Search trending GIFs, browse stickers, or insert media directly into compatible messaging apps.
216+
217+
### 9. CJK (Chinese, Japanese & Korean) Setup
218+
1. Open **Settings → Languages → Add language** and select Chinese, Japanese, or Korean.
219+
2. In **Settings → Plugins → CJK Settings**, enable the CJK Engine (or install the companion plugin if prompted).
220+
3. Select your input style (e.g. Pinyin for Chinese, Flick/Romaji for Japanese, 2-Set Hangul for Korean) and type with the live candidate strip.
221+
201222
---
202223

203224
## 🧩 Ecosystem & Plugins
@@ -211,6 +232,8 @@ Expand LeanType with official companion plugins:
211232
| 📷 **OCR Plugin** | [LeanBitLab/LeanType-Ocr-Plugin](https://github.com/LeanBitLab/LeanType-Ocr-Plugin) | On-device ML Kit camera viewfinder & screenshot text extraction |
212233
| 🌐 **Translation Plugin** | [LeanBitLab/LeanType-Translation-Plugin](https://github.com/LeanBitLab/LeanType-Translation-Plugin) | Dedicated on-device translation provider engine |
213234
| ✍️ **Handwriting Plugin** | [LeanBitLab/Leantype-Handwriting-Plugin](https://github.com/LeanBitLab/Leantype-Handwriting-Plugin) | ML Kit Digital Ink canvas recognition engine |
235+
| 🎬 **GIF Plugin** | [LeanBitLab/LeanType-Gif-Plugin](https://github.com/LeanBitLab/LeanType-Gif-Plugin) | In-keyboard GIF & sticker search engine (GIPHY & Tenor) with WhatsApp normalization |
236+
| 🈲 **CJK Plugin** | [LeanBitLab/LeanType-CJK-Plugin](https://github.com/LeanBitLab/LeanType-CJK-Plugin) | Pinyin Chinese, Japanese Romaji/Kana & Korean Hangul input engine |
214237
| 🎵 **Sound Packs** | [LeanBitLab/LeanType-Sound-Packs](https://github.com/LeanBitLab/LeanType-Sound-Packs) | Synthesized and physical modeling keypress sound packs |
215238
| 🎨 **Community Themes** | [GitHub: `leantype-theme`](https://github.com/topics/leantype-theme) | Browse and share custom color themes |
216239

@@ -252,10 +275,10 @@ If LeanType improves your daily typing workflow, please consider sponsoring our
252275

253276
## 📜 Credits & Acknowledgments
254277

255-
- **[HeliBoard](https://github.com/Helium314/HeliBoard)** by Helium314 — the foundational keyboard project
278+
- **[HeliBoard](https://github.com/Helium314/HeliBoard)** by Helium314: the foundational keyboard project
256279
- **[OpenBoard](https://github.com/openboard-team/openboard)** & **[AOSP LatinIME](https://android.googlesource.com/platform/packages/inputmethods/LatinIME/)**
257-
- **[llama.cpp](https://github.com/ggerganov/llama.cpp)** & **[llamacpp-kotlin](https://github.com/ljcamargo/llamacpp-kotlin)** — on-device local LLM execution
258-
- **[whisper.cpp](https://github.com/ggerganov/whisper.cpp)** — on-device speech recognition
280+
- **[llama.cpp](https://github.com/ggerganov/llama.cpp)** & **[llamacpp-kotlin](https://github.com/ljcamargo/llamacpp-kotlin)**: on-device local LLM execution
281+
- **[whisper.cpp](https://github.com/ggerganov/whisper.cpp)**: on-device speech recognition
259282
- All [contributors](https://github.com/LeanBitLab/LeanType/graphs/contributors) and open-source supporters!
260283

261284
---

‎app/src/main/java/helium314/keyboard/settings/screens/UpdatesScreen.kt‎

Lines changed: 12 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -63,14 +63,18 @@ import java.net.HttpURLConnection
6363
import java.net.URL
6464

6565
private val currentChangelogItems = listOf(
66-
"• Clipboard Lifecycle & Trim Protection: Prevented memory trim and deallocation from tearing down active clipboard view",
67-
"• GIF Cursor & Search Navigation: Routed spacebar swipe and arrow keys to GIF search query cursor",
68-
"• GIF Picker Stability: Committed host text on open, restored shift unshift, and fixed Android 9 crash",
69-
"• Input Auto-Space & Backspace Undo: Fixed standalone auto-spacing after suggestions and backspace undo offset",
70-
"• 2D Delete Swipe Deselection: Supported horizontal-right swipe deselect immediately after vertical swipe",
71-
"• Toolbar & Touchpad Recovery: Restored suggestion strip after touchpad mode and fixed split toolbar state",
72-
"• Theme Color Defaults: Pulled active theme defaults in Show All Colors and preserved child toolbar settings",
73-
"• Language Detector Tests: Added comprehensive unit test suite covering multilingual script and diacritic detection"
66+
"• GIF Search & Media Plugin: Integrated companion GIF plugin with GIPHY/Tenor search, live preview, and WhatsApp stickers",
67+
"• CJK Companion Engine: Added modular support for Chinese, Japanese, and Korean typing with dedicated candidate strip UI",
68+
"• Full Keyboard Swipe Gestures: Added configurable full-keyboard horizontal swipe gestures with sensitivity threshold",
69+
"• 2D Delete Swipe & Hold-to-Delete: Added 2D swipe selection adjustments and continuous whole-word deletion on backspace hold",
70+
"• Internal Fields Gesture Typing: Enabled gesture typing trails and floating preview in emoji and clipboard search/edit",
71+
"• Web Editor Suggestion Replacement: Resolved text duplication and cursor desync in Chromium and web browser inputs",
72+
"• Core Stability & Memory Protection: Hardened batch edit lifecycle, ContentObserver leaks, and clipboard trim protection",
73+
"• Clipboard Action Pill & Multi-Select: Added Gboard-style long-press action pill, multi-select, and sensitive data filtering",
74+
"• Landscape Auto-Floating: Added option to automatically float the keyboard in landscape and restore in portrait",
75+
"• Dynamic Sound Wave Visualizer: Added acoustic harmonic waves, shimmer animation, and voice recording wake lock",
76+
"• Granular Backup & Encrypted API Keys: Added selectable dictionaries/history and encrypted API keys export",
77+
"• 100% Global Translations: Completed 100% translation coverage across 30 supported languages"
7478
)
7579

7680
@Composable

0 commit comments

Comments
 (0)