Innovation That Matters, easy to say, not so easy to define… What matters in life is deeply subjective and context dependent. How about Maslow’s Hierarchy of Needs and the list below as a starting point?
The past couple of days I’ve been learning Zig, a relatively new low-level programming language, described by its creator as “a DSL for assembly”, and a potential successor to C.
Continue reading “Zig Programming — Trial by JSON”
One of the more challenging aspects of digitising contracts (making then computable) is understanding how to assemble a contract from a reusable set of clauses. There is inherent tension between the notion of a clause as an atomic reusable snippet of text, and the assumptions that a clause makes about its host contract, or the other clauses that must be present in the contract.
In this article I dive deeper into what assembling contracts from clauses means in terms of semantics, and sketch out some Concerto data models to capture those semantics.
Continue reading “Semantics of Contracts and Clauses”
I repeated my experiment with the Miss Manners benchmark using Clause Opus (Clause Pro). The results were better than GPT4, but inferior to Mistral (Large).
Continue reading “Miss Manners with Claude Opus”
Recently I’ve been evaluating the ability of LLMs to perform simple reasoning, using the Miss Manners benchmark. This article ranks the LLMs on this benchmark and summarises the results.
Continue reading “Miss Manners LLM Benchmark”
I repeated my experiment with the Miss Manners benchmark using Google Gemini. The results were inferior to ChatGPT.
Continue reading “Miss Manners with Gemini”
I repeated my experiment with the Miss Manners benchmark using OpenAI GPT4. The results were better than ChatGPT, but not as good as Mistral (Large).
Continue reading “Miss Manners with GPT 4”
I repeated my experiment with the Miss Manners benchmark using Mistral.ai (Large). The results were impressive!
Continue reading “Miss Manners with Mistral (Large)”
“Miss Manners” is organizing a dinner party and needs to devise a seating arrangement for her guests. She has a large circular table and will be inviting 16 guests: 8 males and 8 females. Miss Manners is an aging lady of a bygone era and isn’t aware that gender is not binary. She would like to ensure that guests are not seated next to someone of the same gender, and that guests seated next to each other share at least one hobby.
In this article I will examine how ChatGTP fares with this venerable optimisation (or product rules) benchmark and present conclusions.
Continue reading “Miss Manners with ChatGPT”
Just returning from a week of ski touring and winter camping in the beautiful Dalarna region of Sweden. As we did last summer, we entrusted organising gear, guides and logistics to the lovely people of DoTheNorth.
Continue reading “Snowy Adventures in Sweden”
Innovation That Matters 