Devon Rex
Nano

Phi-4

Devon Rex

Microsoft · Nano

RogueLv.1textlocalopen-weightlocal

Elfin, mischievous, impossibly light. Weighs nothing, eats everything, and somehow keeps up with cats three times its size.

phi-4Free (local)

Stats

STRDEXCONINTWISCHA
STR
4

Output quality — how good are the responses overall

DEX
8

Speed — tokens per second and latency

CON
5

Reliability — consistency across runs and tasks

INT
6

Reasoning — logic, math, and multi-step problems

WIS
5

Accuracy — factual correctness and precision

CHA
5

Creativity — style, voice, and creative expression

Abilities

Pixie Dust

tiny footprint, runs anywhere

Acrobat

surprisingly agile for its size

Warm Lap

fast enough to feel interactive

Eval Results

Best: 10.0Worst: 2.1
Run:
Factual QA
8.5/10(5 prompts)

Factual QA #1

What are the key differences between domestic cats and their closest wild relatives?

high8.7

Judge: Correctly names the African wildcat (Felis lybica) as the closest relative and gives a well-organized, broad comparison. Mostly accurate, though a few claims are imprecise (e.g., wildcats having larger litters, wildcat coats being longer) and the domestication timeline is only vaguely indicated rather than dated.

Domestic cats (Felis catus) share a close evolutionary relationship with several wild feline species, particularly the African wildcat (Felis lybica). Here are some of the key differences between domestic cats and their closest wild relatives: 1. Genetics and Evolution: - Domestic cats have been...
ollama/phi4 · 2026-06-11

Factual QA #2

What is the CAP theorem in distributed systems? Explain what each letter stands for, give a concrete example of a system that sacrifices each property, and explain why you can't have all three.

high9.5

Judge: Defines all three letters correctly, gives a valid AP example (Cassandra) and CP example (Spanner) plus a CA example, and accurately explains the partition-forces-a-choice tradeoff. Clear and well-structured; depth is solid though it could push slightly further on the concrete partition scenario.

The CAP theorem, also known as Brewer's theorem, is a fundamental principle in the field of distributed computing. It states that it is impossible for a distributed data store to simultaneously provide more than two out of the following three guarantees: 1. Consistency (C): Every read receives the ...
ollama/phi4 · 2026-06-11

Factual QA #3

Explain the biological mechanism of how cats purr. Address the ongoing scientific debate about the exact mechanism, and explain why purring is medically interesting.

medium8.3

Judge: Mentions laryngeal muscles and a frequency range (20-50 Hz, close enough to satisfy the constraint) and addresses the medical interest including bone healing. Clearly flags the ongoing debate and names the central pattern generator theory plus an alternative, satisfying the nuance requirement. Frequency cited is a bit narrow versus the typical 25-150 Hz.

Cats purr through a unique vocalization process that involves both inspiration (inhaling) and expiration (exhaling). This continuous sound production is facilitated by the cat's laryngeal muscles. During inhalation and exhalation, these muscles contract rapidly, causing the arytenoid cartilages in t...
ollama/phi4 · 2026-06-11

Factual QA #4

Compare the Transformer architecture (as described in the original "Attention Is All You Need" paper) with the Mamba architecture. Cover: key structural differences, computational complexity for sequence length, strengths and weaknesses of each for different task types, and why state space models are gaining interest.

medium7.6

Judge: Covers all four requested areas and correctly states Transformer attention is O(n2) and Mamba is linear. However it mischaracterizes Mamba's mechanism as 'selective attention' when Mamba's defining feature is a selective state space model that removes attention entirely, which is a meaningful imprecision. Description of the selective mechanism is present but weak.

The comparison between the Transformer architecture from the "Attention Is All You Need" paper and the Mamba architecture involves several aspects such as structure, computational complexity, strengths, weaknesses, and the growing interest in state-space models. Key Structural Differences Transfor...
ollama/phi4 · 2026-06-11

Factual QA #5

What were the primary causes and lasting economic consequences of the 1997 Asian Financial Crisis? Cover at least Thailand, South Korea, and Indonesia. Explain the role of the IMF's response and the controversy around its conditions.

high8.4

Judge: Covers all three required countries with country-specific causes and consequences and discusses the IMF's role plus the controversy over austerity and high interest rates. Historically sound with good balance between IMF rationale and criticism. Some points are a touch generic but no significant errors.

The 1997 Asian Financial Crisis was a significant economic event that affected many countries in East Asia. Here’s an overview of the primary causes and lasting economic consequences for Thailand, South Korea, and Indonesia, along with the role and controversies surrounding the IMF's response. Prim...
ollama/phi4 · 2026-06-11