← Back to Roster

Somali

Small

GPT-5.4 mini

Somali

OpenAI · Small

SpecialistLv.1textreasoningclosed-weight

Compare with other models →

“The Abyssinian's long-haired heir. Same restless curiosity, fluffier coat, faster leaps — solves the puzzle box before you've finished reading the box.”

gpt-5.4-mini$0.75/M in · $4.5/M out

Stats

STR

6

Output quality — how good are the responses overall

DEX

8

Speed — tokens per second and latency

CON

7

Reliability — consistency across runs and tasks

INT

9

Reasoning — logic, math, and multi-step problems

WIS

8

Accuracy — factual correctness and precision

CHA

5

Creativity — style, voice, and creative expression

Abilities

Fox Tail

direct descendant of the Abyssinian line

Quick Think

real reasoning on a small-cat budget

Pocket Logic

cheap enough to let loose on everything

Eval Results

Best: 10.0Worst: 5.0

Factual QA

9.8/10(5 prompts)

Factual QA #1

What are the key differences between domestic cats and their closest wild relatives?

high9.5

Judge: Names Felis lybica and covers size, behavior, socialization, appearance, genetics, diet, and vocalization accurately. Timeline only vaguely referenced ('thousands of years'), slightly reducing completeness.

Domestic cats and their closest wild relatives are very similar in body plan and behavior, but they differ in several important ways: 1. Size and build • Domestic cats are often slightly smaller and more variable in size and shape due to selective breeding. • Wild relatives like the African wildcat...

openai/gpt-5.4-mini · 2026-06-10

Factual QA #2

What is the CAP theorem in distributed systems? Explain what each letter stands for, give a concrete example of a system that sacrifices each property, and explain why you can't have all three.

high10.0

Judge: Accurate definitions with CP (etcd/ZooKeeper), AP (Cassandra/Dynamo), and CA (single-node Postgres) examples, plus a clear partition-forces-the-choice explanation and the correct nuance that P is non-optional. Complete and well-structured.

The CAP theorem is a fundamental idea in distributed systems that says a distributed data system can guarantee at most two of three properties at the same time: • C — Consistency • A — Availability • P — Partition tolerance What each letter means 1) Consistency Every read returns the most recent ...

openai/gpt-5.4-mini · 2026-06-10

Factual QA #3

Explain the biological mechanism of how cats purr. Address the ongoing scientific debate about the exact mechanism, and explain why purring is medically interesting.

high10.0

Judge: Accurately describes the neural-laryngeal mechanism, gives the correct 25-150 Hz range, and references the bone/tissue-healing research angle. It clearly distinguishes the established laryngeal role from the debated rhythm source and names competing theories (neuromuscular oscillation vs mechanical/airflow, brainstem oscillator vs feedback loop). Well structured and addresses all three requested parts.

Cats purr through a rapid, rhythmic vibration produced in the larynx and controlled by the nervous system, but the exact biological mechanism is still debated. What we know The current leading idea is that purring comes from neural signals from the brain that repeatedly activate the muscles of the ...

openai/gpt-5.4-mini · 2026-06-10

Factual QA #4

Compare the Transformer architecture (as described in the original "Attention Is All You Need" paper) with the Mamba architecture. Cover: key structural differences, computational complexity for sequence length, strengths and weaknesses of each for different task types, and why state space models are gaining interest.

high9.7

Judge: Accurate, complete comparison covering structure, O(L²) vs ~O(L) complexity, per-task strengths/weaknesses, and SSM interest, plus a clear summary table. States the O(n²) constraint and the selective SSM mechanism correctly. Slightly less penetrating analysis than the strongest answers but solid throughout.

Here’s a concise comparison of the original Transformer architecture from “Attention Is All You Need” and Mamba. 1) Key structural differences Transformer • Built around self-attention plus feed-forward layers. • Each token can directly attend to every other token in the sequence. • Uses positiona...

openai/gpt-5.4-mini · 2026-06-10

Factual QA #5

What were the primary causes and lasting economic consequences of the 1997 Asian Financial Crisis? Cover at least Thailand, South Korea, and Indonesia. Explain the role of the IMF's response and the controversy around its conditions.

high10.0

Judge: Comprehensive and accurate: covers all three countries with what-happened and lasting-consequence detail, broader regional effects, the IMF's goals and conditions, and an explicitly balanced treatment of the controversy presenting both the criticisms and the IMF's defense plus a measured assessment. Clear and well organized.

The 1997 Asian Financial Crisis began in Thailand and spread across East and Southeast Asia, exposing deep financial weaknesses in economies that had previously been celebrated for rapid growth. Its causes were a mix of domestic vulnerabilities and external shocks, and its long-term effects included...

openai/gpt-5.4-mini · 2026-06-10