shorttechnewsのブログ

We Are Provide Tech News In Short

Apple unveils OpenELM, open-source language models, meant for on-device tasks

Even as tech giants scramble to lead the AI ​​arms race, Apple has been slow. However, this is not the case, Apple has been working on AI for a long time. Since the brand is synonymous with secrecy, not much has been known about Its grand schemes. However, recently, Apple has introduced a generative AI model named OpenELM which has reportedly outperformed several other language models that have been trained on public data.


OpenELM is a family of small open-source language models designed to run efficiently on devices such as iPhones and Macs. Apple claims that OpenELM is a state-of-the-art language model that uses a layer-wise scaling strategy to efficiently allocate parameters within each layer of the transformer model resulting in enhanced accuracy. Reportedly, OpenELM consists of eight models with four different parameter sizes – 270M, 450M, 1.1B, and 3B – all of which are trained on public datasets.