loader image
[elementor-template id="8262"]

Meta releases the first variants of its new Llama-3 large language model

On Thursday, Meta released the first variants of its new Llama-3 large language model, including Llama-3 8b, which has been trained on a incredible 15 trillion tokens. After spending a full weekend with it, I’m in complete awe of what Meta has created. It’s a beast!

For starters, I’m able to run it on my Macbook M3 Max with 48 GB RAM. This is true of other compact LLMs as well, up to and including Mixtral 8x7b, but given that Llama-3 has “only” 8 bilion parameters, it’s lightning fast. The added bonus of being able to run it locally means I can access it anywhere at any time, without worrying about internet connectivity or throttling. Plus, my Mac shrugs it off – no fan noise, no battery drain.

Maybe the most interesting aspect of my weekend adventures is that I found LLama-3 to be superior to Chat GPT 4 when it comes to polishing emails and other business communications.

The vanilla version of Llama-3 is also the only compact LLM (and in fact the only model apart from Chat GPT 4 that I’m aware of) that can solve the logical problems I’ve presented to pretty much every LLM since October 2022:

1. The Sock Problem. Imagine being in a dark room with a box of black and white socks. How often do you need to reach into the box to guarantee a matching pair?

2. The Ball-and-Van Problem. A ball rolls onto a street, followed by a van approaching with a loud bang. After the van passes, there’s a sheet of plastic on the street. What happened?

The first problem tests reasoning, while the second tests real-world understanding, and the vanilla version of Llama-3 8b accurately solves both problems.

The instruct version doesn’t do as well on this particular task, but that’s just a case of horses for courses. What the instruct version does excel at is following instructions, which is, of course, key for companies like ours, which develop software that relies on LLMs for natural language understanding. I look forward to seeing these improvements getting incorporated into Melody, Mike, and our various other generative AI-based solutions.

What about other Llama-3 variants? I haven’t tested Llama-3 70b yet, but I hear good things about it. And Llama-3 400b appears to perform at levels comparable to Chat GPT 4. Further variants are expected to come out in the coming weeks and months, including versions with larger context sizes – the 8k context window of Llama-3 8b is the only disappointment in an otherwise hugely impressive release (Meta has indicated that it’s working on an update).

By the way: We’ve organized a few generative AI events, some in partnership with NVIDIA. At these events, we talk about AI generally, answer questions about what’s possible given the current state of the art, and give product demos using real-world applications. We’re currently in the process of planning further events in London, New York, and other cities. If you or your organization would like to receive an invitation, please let me know.

Related articles

Unstructured Reflections: US structured products will hit a new global record with $163 billion

In December, we initially projected a 12.5% increase in 2024 sales if the S&P 500 reached 5,000. However, with the S&P 500 now at 5,300, our forecasts have adjusted significantly, find out why.

Save the date: Structured Products Conference set to return to Nashville

The SPi Conference will take place Nashville, Tennessee on 12 November.

Unlock the Future of Finance: SPi launches Canadian event

Join WSD's SPi Conference for Exclusive Market Insights and AI Strategies!
Sprechen Sie mit einem unserer Experten, um zu erfahren, wie wir Ihr Unternehmen auf die nächste Ebene bringen können.

Abonnieren Sie unseren Newsletter.

    Durch Anklicken von "Abonnieren" erklären Sie sich damit einverstanden, Newsletter, exklusive Einladungen zu personalisierten Veranstaltungen und sorgfältig ausgewählte Angebote von WSD per E-Mail zu erhalten. Sie können sich jederzeit abmelden.


    +44 (0) 203 865 1787

    Ebene 3, 40 Bank Street, London, E14 5NR, Vereinigtes Königreich

    575 5th Avenue, New York, NY, 10017, Vereinigte Staaten

    At vero eos et accusamus et iusto odio digni goikussimos ducimus qui to bonfo blanditiis praese. Ntium voluum deleniti atque.

    Melbourne, Australia
    (Sat - Thursday)
    (10am - 05 pm)