Comparing reasoning in open-source LLMs

Alibaba recently released their “QwQ” model, which they claim is capable of chain-of-thought reasoning comparable to OpenAI’s o1-mini model. It’s pretty impressive — even more so because we can run this model on our own devices (provided you have enough RAM).

While testing the chain-of-thought reasoning abilities, I decided to compare my test prompt to Llama3.2 and was kind of shocked at how good it was. I had to come up with ever more ridiculous scenarios to try and break it.

That is pretty good, especially for a non chain-of-thought model. Okay, come on. How do we break it! Can we?

Alright, magical unicorns for the win.

“Nexus” by Yuval Noah Harari

Yuval Noah Harari’s latest book, Nexus: A Brief History of Information Networks from the Stone Age to AI, was a fascinating (if sometimes overwhelming) journey through human history that explores the power (and the peril) of information. From the first markings inscribed on stone walls to the potential all-seeing eye of artificial intelligence, Harari takes readers on a sweeping tour of how information and stories have shaped human networks — and, by extension, civilization.

The central idea in Nexus is that information is one of the key forces that connects people, enabling us to cooperate on a massive scale. Harari illustrates this point with a bunch of historical examples, from the canonization of the Bible to the use of propaganda under totalitarian regimes. He argues that information doesn’t merely represent reality; rather, it creates new realities through the power of shared stories, myths, and ideologies. This gives us some insight into the forces that have shaped society—sometimes for the better, sometimes for the worse.

One interesting part of the book is Harari’s thoughts on the relationship between information and truth. Harari references a Barack Obama speech in Shanghai in 2009, where Obama said, ‘I am a big believer in technology and I’m a big believer in openness when it comes to the flow of information. I think that the more freely information flows, the stronger the society becomes.

Harari calls this view naive, pointing out that while openness is important, the reality of how information is used is much more complicated. He argues that information isn’t inherently the same as truth; it’s been manipulated countless times throughout history to serve those in power. This kind of manipulation is especially evident in the recent rise of populism, which, as Harari explains, is all about the belief that there’s no objective truth and that power is the only reality.

He explains, ‘In its more extreme versions, populism posits that there is no objective truth at all and that everyone has “their own truth,” which they wield to vanquish rivals. According to this worldview, power is the only reality. All social interactions are power struggles, because humans are interested only in power. The claim to be interested in something else—like truth or justice—is nothing more than a ploy to gain power.

Harari warns that when populism uses information purely as a weapon, it ends up eroding the very concept of language itself. Words like ‘facts,’ ‘accurate,’ and ‘truthful’ lose their meaning, as any mention of ‘truth’ prompts the question, ‘Whose truth?’ This theme feels especially relevant today, with misinformation and propaganda shaping public opinion in big ways.

Harari gives a sobering take on the rise of AI and how it could impact our information networks. He says, “silicon chips can create spies that never sleep, financiers that never forget and despots that never die” and goes on to warn that AI, with its power for massive surveillance and data processing, could lead to levels of control and manipulation we’ve never seen before—potentially an existential threat we need to face.

For me, Nexus was a thought-provoking and engaging read, though at times it felt very alarmist. While Harari’s concerns are definitely worth thinking about, I think adaptation is key: these AI systems and tools are here, and we have to learn how to use them and live with them — like right now — today!

Overall, I’d give Nexus 4 out of 5 stars. Harari offers a sweeping narrative that makes you think about the role of information in our lives, and the choices we need to make as we stand on the brink of the AI era. It’s a worthy read for anyone interested in understanding the historical roots of our current information age and what it might mean for our future.