Moonshine v2 Large STT
Ultra-lightweight, edge-native speech-to-text (STT) encoder-decoder model optimized for on-device real-time transcription and edge robotics with 5x lower compute latency than Whisper Large v3.
Moonshine v2 Large STT
Ultra-lightweight, edge-native speech-to-text (STT) encoder-decoder model optimized for on-device real-time transcription and edge robotics with 5x lower compute latency than Whisper Large v3.
- • FP16 Weights = 0.5B × 2B = 0.96 GB
- • INT4 Weights = 0.5B × 0.55B = 0.26 GB
- • KV Cache (65536 ctx, FP16) ≈ 8.00 GB
- • Activation Buffer = ~20% overhead
Hardware & Execution ParametersAudio
Genealogical Graph & Evolutionary Provenance
Tracing foundational base architecture ancestry, architectural successors, scale siblings, and reasoning distillation derivatives.
Moonshine v2 Large STT operates as an autonomous foundation model architecture without direct precursor derivatives in this catalog.
Architecture Engineering & Capability Deep-Dive
An objective architectural evaluation of Moonshine v2 Large STT by Useful Sensors, analyzing underlying compute dynamics, memory constraints, and deployment economics.
Topology & Attention Mechanics
A robust autoregressive transformer utilizing standard attention patterns for predictable and coherent token generation.
Evaluation Profile & Reasoning
Exhibits frontier-tier behavior in reasoning and coding.
LLM Hardware Sizing & Serving
For open deployments via vLLM/SGLang, quantization (INT4/AWQ) is heavily recommended to fit dense memory constraints, or multi-GPU pipeline parallelism for full FP16.
Inference Economics & Workflows
Well-suited for enterprise pipelines where capability is balanced against per-million token costs.
Architectural Strengths vs. Considerations
An objective balance sheet analyzing the operational advantages and production constraints of deploying Moonshine v2 Large STT.
Key Architectural Strengths
- Ultra cost-effective inference at $0/1M input tokens enables high-frequency agent loops.
- Demonstrated RTF (Real-Time Factor) evaluation score of 0.08% in verified benchmarks.
Operational Considerations
- Non-deterministic reasoning chains require schema validation in safety-critical deployments.
Inference Runtimes & Hardware Sizing
Deployment targets, inference engines, and memory requirements for Moonshine v2 Large STT.
python3 -m vllm.entrypoints.openai.api_server --model Moonshine v2 Large STT --tensor-parallel-size 1 --gpu-memory-utilization 0.95 --max-model-len 4096 --enable-chunked-prefillollama run moonshine v2 large sttpython3 -m sglang.launch_server --model-path Moonshine v2 Large STT --tp 1 --trust-remote-codetext-generation-launcher --model-id Moonshine v2 Large STT --num-shard 1 --max-batch-prefill-tokens 32000High-throughput PagedAttention server
One-click CLI & local desktop serving
Fast multi-turn structured decoding
Text Generation Inference
GGUF CPU/Apple Silicon execution
~1.2 GB VRAM required
~0.6 GB VRAM (Hopper speedup)
~0.3 GB VRAM
CPU RAM / Apple Silicon optimized
LLM Benchmark Database & Performance Metrics
3 TestedStandardized evaluation results across reasoning, agentic coding, computer use, and alignment.
CommonVoice Multilingual WER %
LibriSpeech Clean WER %
RTF (Real-Time Factor)
API & Deployment Pricing
Open-weights model available for local and private cloud deployment. Compute costs depend on the target GPU hardware instance.
| Usage Tier | Rate / Unit |
|---|---|
| Prompt / Input Tokens | $0 / 1M tokens |
| Completion / Output Tokens | $0 / 1M tokens |
Comparable Foundation Architectures
Alternative models in the Audio class with similar capabilities, context windows, or deployment profiles.
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ.get("USEFUL_SENSORS_KEY", "EMPTY"),
base_url="http://localhost:8000/v1"
)
response = client.chat.completions.create(
model="moonshine-v2-speech-stt-2026",
messages=[{"role": "user", "content": "Explain quantum superposition in 2 sentences."}]
)
print(response.choices[0].message.content)Frequently Asked Questions about Moonshine v2 Large STT
Essential facts, architectural specs, hardware constraints, and pricing answers for Moonshine v2 Large STT.
To run Moonshine v2 Large STT (480M) locally, you generally need Depends on quantization. We recommend using quantized GGUF/AWQ formats with Ollama or vLLM to optimize memory footprint.
All technical specifications, parameter distributions, context architectures, and benchmark evaluations for Moonshine v2 Large STT are audited against primary source release documentation, research whitepapers, and verified vendor API endpoints.