Meta releases Llama 3.1 · AI Mastermind

Meta releases Llama 3.1

Meta, formerly known as Facebook, has released Llama 3.1. The latest version of its large language model has up to 450 billion parameters, although there are also smaller variants. It supports eight languages.

Llama 3.1 supports not only English but also French, German, Spanish, Italian, Portuguese, Thai, and Hindi, as shown on the HuggingFace page. It is an open-source model that anyone can freely download and use. However, users must share some data via HuggingFace before they can download the model, such as username and email address.

The model can process up to 128,000 tokens, compared to 8,000 for Llama 3. The model with 450 billion parameters is new, but there are also updates for the models with 70 and 8 billion parameters, according to Meta. Llama 3 was released a few months ago.

Llama 3.1 is expected to perform similarly to GPT-4 and Claude 3.5 Sonnet, as claimed by Meta based on benchmarks and human evaluations. The company is also working on smaller models to run more easily on devices. Additionally, Llama 3.1 currently only accepts text and files as input and output, but other forms, such as images, are expected to be added.

0 comments