Compact AI models that run directly on phones and laptops are becoming more capable, handling transcription, translation and summaries offline. Keeping data on the device can improve privacy and reduce delays. Developers say the trade-off is that the largest tasks still need cloud computing.