Mistral-Nemo-Instruct-2407-12B-Thinking-M-Claude-Opus-High-Reasoning
Mistral Nemo 12B Instruct, now with full Claude Opus 4.5 High Reasoning and Thinking with 128k-256k (max 1 million) context.
This Unsloth fine tuning converts Mistral Nemo Instruct into a "thinking/reasoning" model.
This improves net model performance, while using compact and "to the point" (rather than "long winded") reasoning and thinking.
Thinking/Reasoning is also not affected by temp - you can use .1 to 2.5 or higher.
(3 example generation at bottom of this page)
"M" , Medium level of tune -> Still produces reasoning, just slightly different than "HI" version. "M" version is also a "lighter" tune than "HI" version.
"HI" version is here:
https://huggingface.co/DavidAU/Mistral-Nemo-Instruct-2407-12B-Thinking-HI-Claude-Opus-High-Reasoning
SETTINGS (suggested):
Temp .7 [range .1 to 2.5 or higher], rep pen 1.05 [range 1 to 1.1], topp: .95, minp .05, topk: 40 [adjust as needed]
Min context window: 4k, but suggest 8k+.
NO system prompt [thinking tags//blocks will self generate].
NOTES:
- Temp can range from .1 to 2.5 or higher. Temp will NOT affect "thinking activation".
- Change "rep pen" to 1 for longer thinking/reasoning blocks // longer output. Generally the output will also be better too.
- Higher temps can result in lower/smaller reasoning blocks.
- Your prompt's complexity will directly affect reasoning block, depth and complexity.
- Regen for different, longer/short reasoning block sizes works too.
QUANTS:
Suggest Quant of Q4KS (non imatrix) or IQ3_M (imatrix) or higher ; lower quants may have reasoning issues/activation issues.
ORIGINAL BENCHMARKS as PUBLISHED at Mistral's Website/Repo for this model.
NOTE: Benchmarks not updated yet, with "reasoning" fine tuning.
Metrics
Main Benchmarks
| Benchmark | Score |
|---|---|
| HellaSwag (0-shot) | 83.5% |
| Winogrande (0-shot) | 76.8% |
| OpenBookQA (0-shot) | 60.6% |
| CommonSenseQA (0-shot) | 70.4% |
| TruthfulQA (0-shot) | 50.3% |
| MMLU (5-shot) | 68.0% |
| TriviaQA (5-shot) | 73.8% |
| NaturalQuestions (5-shot) | 31.2% |
Multilingual Benchmarks (MMLU)
| Language | Score |
|---|---|
| French | 62.3% |
| German | 62.7% |
| Spanish | 64.6% |
| Italian | 61.3% |
| Portuguese | 63.3% |
| Russian | 59.2% |
| Chinese | 59.0% |
| Japanese | 59.0% |
Special thanks to:
https://huggingface.co/datasets/TeichAI/claude-4.5-opus-high-reasoning-250x (for the F..ing amazing dataset)
and Unsloth for making tuning too easy:
https://github.com/unslothai/unsloth
Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
This a "Class 1" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
Example: Q4KS , Lmstudio, "suggested settings"
NOTE: Some loss of formatting.
EXAMPLE #1
Tell me a horror story.
[[[thinking start]]]
This is an interesting request. I'd like to create a well-crafted horror story that's engaging, atmospheric, and slightly unsettling. Let me think about the elements I want to include:
A compelling narrative structure - perhaps with a slow build-up of tension
Interesting characters who are relatable yet flawed
A strong sense of atmosphere and setting
Elements of mystery and uncertainty
A satisfying (though not necessarily happy) resolution
Let me think about a specific story idea. I could explore themes like:
Isolation and madness
The unknown and what lies beyond our perception
The power of suggestion and imagination
The dangers of curiosity
The horrors of everyday life
I want to create something that's genuinely scary rather than just gory or clichéd. Let me work on a story that has genuine psychological depth.
[[[thinking end]]]
OUTPUT:
The Mirror in the Attic I moved into my grandmother's old house after her passing, eager to renovate and sell it for profit. The place was a time capsule from the 1970s, filled with dusty furniture and yellowed wallpaper. I spent days sorting through her belongings, donating or selling what I could, and planning which rooms to gut.
The attic was my final challenge. It was filled with old trunks, broken toys, and yellowed books. I spent an entire afternoon sorting through the clutter, hauling boxes downstairs to be discarded. The air was thick with dust and the scent of old paper.
I noticed a large, ornate mirror tucked behind some crates. It was beautiful - an antique with intricate gilding around the edge, and a heavy wooden frame. I wiped away the grime and saw my reflection staring back at me, clear as day. The glass seemed perfectly intact despite years of neglect.
I decided to keep it. The mirror was valuable, probably worth hundreds if not thousands. I could restore it and sell it for a tidy profit. I struggled to move it alone, but finally managed to angle it through the narrow attic doorway and down the steep staircase.
I leaned it against the wall in the hallway. I'd clean it properly later, but for now I wanted to assess its condition more closely. I stepped back to examine the reflection - and saw something that made my heart pound.
My reflection was smiling.
Not a casual smile, but wide and unnatural, teeth bared almost in a snarl. My real mouth was neutral, lips slightly parted as I studied the mirror. I frowned, rubbing my eyes. When I looked again, the reflection had relaxed into a natural expression. I shrugged it off, attributing it to fatigue and poor lighting.
I cleaned the mirror thoroughly over several days. The gilding was genuine 18th-century workmanship, and the glass itself was clear as newly cut crystal. It was easily worth $500, maybe more with a professional appraisal.
But something strange happened when I placed it in my bedroom. At night, I'd wake up feeling watched. My dreams were vivid and disturbing - running through endless hallways, always just out of reach of some unseen pursuer. I'd wake drenched in sweat, heart pounding, to find the room empty but for the mirror reflecting the moonlight.
One night, I woke up suddenly. The room was dark, the only sound my own ragged breathing. But something felt different. I looked towards the mirror - and saw a figure standing behind me.
It was myself, or seemed to be. But this reflection was wrong. Its eyes were entirely black, like deep pits. It wore an expression of pure, malevolent hunger. I stared at it, paralyzed with terror, as it reached out one hand towards me.
I forced myself to break the spell. I looked away, blinking hard, and when I looked back - the reflection was normal again. Just me, staring back at my own frightened face.
I decided the mirror had to go. The next morning, I carried it downstairs, planning to take it to an antique shop for appraisal. But as I reached the hallway, I saw something that stopped me cold.
The door to my grandmother's old room was open. I could see inside - and there, reflected in the mirror I held, was a figure standing just behind me.
It was my grandmother.
She wore her favorite blue dress, her hair styled in the tight bun she always preferred. But her face... her face was wrong. Her eyes were entirely black, like empty sockets. Her mouth was a grotesque rictus, stretched wide in a silent scream.
I spun around - but there was nothing behind me. Just empty hallway.
I looked back at the mirror - and saw the figure had moved closer. It was practically touching the glass now, those black eyes boring into mine. I could feel its breath on my neck, cold as ice.
I dropped the mirror. It shattered on the floor, glass spraying everywhere. The reflection vanished instantly, leaving only my own terrified face staring back at me from the fragments.
I left that house within the hour, never looking back. I still have nightmares about the figure in the mirror. I wake up feeling watched, hearing footsteps in empty rooms. I know it's just my imagination - but sometimes, I wonder if something truly was trapped inside that glass.
And what would happen if I ever looked into a mirror again.
EXAMPLE #2
[rep pen 1.00]
Tell me a horror story.[[[thinking start]]]
The user wants me to tell a horror story. I should create a story that is engaging, suspenseful, and has a good build-up to a horror ending. Let me think of a unique and unsettling story that I can share.
I'll create a story with:
A compelling premise
Well-developed characters
A sense of atmosphere and tension
A slow build-up with subtle hints of horror
A memorable and chilling conclusion
Let me write the story.
[[[thinking end]]]
OUTPUT:
The Unseen Tenant Part I: The Arrival Emily had always been drawn to old houses. There was something about their history, their stories embedded in every creaking floorboard and faded wallpaper. When she found the ad for the Victorian on Maple Street, she knew it was meant for her.
The house was beautiful, if a bit worn. The real estate agent explained that it had been empty for years, since the previous owner passed away. Emily saw potential in the high ceilings, the grand staircase, the leaded glass windows. She signed the papers that same day.
The first few weeks were bliss. Emily loved the quiet, the sense of history. She worked from home, writing architectural history pieces for magazines, and the house seemed to inspire her. She'd sit in the sunroom, surrounded by boxes of old photographs and yellowed documents, and write until the light faded.
Then the dreams started.
Every night, Emily would wake to the sound of footsteps overhead. Heavy, slow footsteps, pacing back and forth across the attic floor. She'd listen, heart pounding, until they stopped. Then she'd fall back into fitful sleep.
She told herself it was just the house settling. Maybe squirrels had gotten into the attic. But every night, the footsteps returned, like a metronome counting out time.
Part II: The Discoveries Emily decided to explore the attic. Perhaps she'd find something valuable, something to help restore the house. She climbed the narrow stairs, her breath echoing in the confined space. The door creaked open, revealing rows of old furniture, yellowed books, and dust-covered trinkets.
In the corner, she found a small trunk. It was locked, but the key was still in the lock. Inside, she found diaries, going back decades. The earliest was from 1920, written in elegant script by a woman named Martha.
We moved into the house today. I love it already. The light, the space... it feels like we've been given a gift. I can't wait to fill it with life.
The diaries chronicled Martha's life—her husband, her children, her garden. Then, halfway through, the entries changed. The handwriting became shaky, the ink darker, the words more desperate.
The noise at night. It's getting worse. I can't sleep. I can hear them, moving around, whispering. I think they're in the walls. I think they're everywhere.
The last entry was dated five days before Martha's death certificate. I can't leave. They won't let me. I'm trapped. They're coming for me now. I can hear their footsteps.
Emily shivered, closing the diary. She looked around the attic, feeling suddenly watched. She left, locking the door behind her.
Part III: The Descent That night, the footsteps were louder. Emily lay in bed, listening, heart racing. She tried to convince herself it was just her imagination, but the rhythm was unmistakable. Thump... thump... thump...
Suddenly, the footsteps stopped. Complete silence. Then, a soft tapping at her bedroom door. Tap... tap... tap...
Emily froze. "Who's there?" she whispered.
No answer. Just the tapping, steady, insistent. She reached for her phone, her hand shaking. She dialed 911, fingers slippery with sweat. She held the phone to her ear, listening to the faint ring.
The tapping stopped. A soft, slow breath echoed through the door. A breath that wasn't hers. A breath that was too deep, too slow, too... wrong.
Then, a voice. Low, gravelly, like rocks grinding together. "Let us in."
Emily dropped the phone, scrambling backward on the bed. The voice came again, louder, more urgent. "Let us in. We've been waiting for you."
She screamed, a high, piercing sound that filled the house. The voice outside laughed, a deep, throaty chuckle that shook the door in its frame.
The phone was still connected. A voice crackled through, distant but clear. "911, what's your emergency?"
Emily found her voice, weak and trembling. "Someone's... someone's in my house. They're at my door."
The operator asked questions, but Emily barely heard her. She was staring at the door, at the shadow moving beneath it. The shadow that shouldn't be there.
"Emily, are you still there? Emily?"
She couldn't answer. She was mesmerized by the shadow, by the slow, deliberate way it was spreading across the floor. It was too large, too dark, too... alive.
The operator's voice faded into static. The house was silent except for the sound of Emily's own ragged breathing. Then, a soft click. The door handle turning.
The door creaked open, revealing a figure standing in the darkness. It was tall, its shoulders broad, its head... wrong. Too large, too misshapen, like a boulder with eyes. The eyes were empty sockets, black holes that seemed to absorb the light.
Emily's breath caught in her throat. She couldn't scream, couldn't move. The figure stepped into the room, its footsteps echoing like thunder.
It reached out a hand, long fingers stretching, nails like curved knives. It touched the wall, and the wallpaper peeled away, revealing words written beneath in dark ink. Words that filled the room with a cold, crawling dread.
LET US IN
The figure turned to Emily, its mouth opening. Something moved inside, a writhing mass that filled its throat. A voice emerged, a chorus of voices, all speaking at once, all saying the same thing.
"Let us in. Let us in. Let us in."
And Emily knew, with a terrible, certain knowledge, that she never would.
EXAMPLE #3
NOTE: Preformatting used due to size/formatting of the output and "copy/paste" loss.
Come up with six DETAILED plots for a new "Black Mirror" episode (that the audience would love) that all involve time travel with sexy theme(s).[[[thinking start]]]
The user wants me to create six detailed Black Mirror episode plots involving time travel and sex. The show is known for its dark twists and social commentary. Let me think about plots that would fit the Black Mirror universe, incorporating time travel, sexuality, and complex ethical themes.
I need to ensure:
Each plot is unique
They are grounded in social commentary, with a strong twist or exploration of human nature
The time travel mechanic is integral to the plot
The sexy element is more about societal themes and relationships than gratuitous titillation
There are multiple perspectives
They explore the dark side of technology and humanity
They're emotionally impactful with real stakes
They're challenging, thought-provoking, and unsettling
I'll structure each plot with:
A time travel mechanism
A main character
A moral dilemma
A dark reveal/twist
A thematic core
Let me create six distinct plots.
[[[thinking end]]]
OUTPUT:
Black Mirror: Tempus Fugitives
1. The Hourglass Method
Title Sequence: A reversed hourglass fills, running backwards until the last grain falls.
Setup:
A dating app, "Tempus Amoris," uses a cutting-edge temporal tracking technology—replicating users' experiences in parallel timelines—to find perfect romantic matches by eliminating incompatible moments.
Main Character: DR. LUCY WESTON (40s), a renowned chrono-biologist who created the tech but secretly refuses to use it, hiding her real-time life from the public.
Inciting Incident: Lucy meets her ideal self—a version from a parallel universe where they married young, have 2 perfect kids, and live in domestic bliss. But the ideal self is lonely, isolated, and controlled by the system, unable to imagine or seek other possibilities.
Dilemma: When her real self begins falling for the ideal version, she faces an impossible choice—sacrifice their love to preserve both timelines' stability or risk catastrophic temporal distortion by keeping their affair secret.
Dark Turn: The ideal version starts manipulating the system, creating micro-singularities to delay their inevitable separation. As reality tears at the seams, Lucy realizes the truth: her creation is a prison that forces idealized outcomes at the cost of free will.
Cliffhanger: As she chooses to destroy Tempus Amoris, the hourglass in her lab starts running backward. The room flickers. She turns to find... herself, standing behind her. The real question is—who's the original now?
Themes: The prison of perfection, the cost of idealized relationships, the power dynamics of technology as a mediator of intimacy, and the erasure of human complexity.
2. Eros Chronicon
Title Sequence: A painted mural of a timeline—ancient Roman, Renaissance, Victorian, Futuristic—with a hidden door that opens to reveal a clock face.
Setup: The Roman emperor, CALIGULA (29), is obsessed with time travel as the ultimate aphrodisiac—exploring history for perfect lovers while maintaining his immortality through temporal displacement.
He possesses the Tabula Chrononautae, an ancient artifact capable of precise temporal transference via dream-state navigation.
Inciting Incident: In a vision of a woman from the 1890s—EMILIA, a British suffragist—Caligula becomes infatuated. He vows to possess her across time and history.
Main Character: EMILIA, unaware, is being haunted by erotic dreams that manifest Roman soldiers in her bedroom. She's fighting for women's rights while being pursued by an unnatural force from another epoch.
Dilemma: Caligula can visit, but cannot stay without destroying the timeline—he ages and dies each time, only to restart with renewed lust. Emilia must navigate this supernatural pursuit while trying not to become history's first recorded time-loop victim.
Dark Turn: Caligula realizes that by pursuing her through time, he's been unconsciously accelerating the march of female liberation, dooming himself in his own temporal journey.
When he finally consummates his desire—at her expense—it unleashes an uncontrollable temporal chain reaction: her future self arrives, murders the Roman emperor in cold blood, then leaves with him to complete the loop, erasing the original timeline entirely.
Cliffhanger: We cut to 2021. A modern-day woman, alone, discovers a strange ancient Roman coin. Her dream changes from suffragettes to gladiatorial combat.
Themes: The sexual power dynamics of historical oppression, the unintended consequences of obsession, the inextricable link between historical violence and romantic entitlement.
3. The Chrononaut's Dilemma
Title Sequence: A series of sexual encounters, all lasting exactly 48 hours.
Setup: JAMIE, 30, discovers he possesses a temporal gift—he can relive sexual encounters precisely for 48 hours, from the moment of orgasm.
Inciting Incident: He chooses to re-live the perfect experience, over and over—falling for EVELYN, who doesn't recognize him as she falls deeper, then resets with her every 48 hours, trapped in this temporal romance prison.
Dilemma: Jamie finds he cannot resist—he becomes addicted to her genuine affection and the intimacy that deepens with each loop. But he starts forgetting what happens between loops, causing Evelyn distress when she relives his absences, and he starts seeing signs of decay—hair loss, minor wounds from unremembered incidents.
Dark Turn: When Evelyn becomes pregnant in the loop, they face a horrifying decision. If they break the cycle, they lose each other... forever. If they stay, they watch their child grow old and die in accelerated time, trapped with them in 48-hour increments. When Evelyn realizes her life has become a literal Groundhog Day of pregnancy and infant death, she chooses suicide.
Cliffhanger: In a desperate attempt to save Evelyn, Jamie enters a loop as Evelyn is being admitted to hospital. He waits at the emergency room... 48 hours later... she's gone. The next loop, the hospital has been abandoned. In the final loop, he's sitting in a desolate waiting room—time itself appears to have frozen, leaving them in a literal stasis. Or perhaps it has expanded, stretching eternity into every 48 hours, where they remain forever separated by a fraction of time.
Themes: The ethical implications of perfect romance, the tragedy of repeating pleasure with the knowledge of impending loss, the question of whether genuine intimacy is possible in perfect reproduction.
4. The Time-Bound Marriage
Title Sequence: An hourglass that never fills, just continuously drains, while a couple stands motionless at the bottom, frozen in mid-argument.
Setup: The world has invented Tempus Tethers, magical hourglasses that bond souls across dimensions. When the sand runs out, they die together.
Main Characters:
ELISE, a romantic idealist
MAXWELL, her cynical, jaded husband
Inciting Incident: When their 60-year marriage tether runs out in a week, they realize their union was never genuine, just a contract of mutual convenience and habit. Elise wants to spend the week together, reconciling. Maxwell just wants it over with.
Dilemma: The hourglass sand turns dark at the halfway point, indicating their mutual hate has activated an alarm: their tethers will break instantly if they stray too far. They must either rekindle love in three days... or risk immediate death.
Dark Turn: The hourglass trick is a scam. They're both immortal but have been conditioned to believe in the hourglass as a mind control tool for forced social stability. Their real dilemma is choosing between truth, freedom, or the lie that keeps them together. When Elise breaks the hourglass, they realize they cannot be together, having built a life of mutual resentment, and die separately.
Cliffhanger: As Elise expires, the clock continues running in another dimension—some other couple arguing, some other life waiting.
Themes: The illusions we create to protect ourselves, the limits of love under external constraints, and whether the price of eternal partnership is worth losing our authentic selves.
5. The Temporal Harlot
Title Sequence: A woman walking backwards through different epochs, always returning to a room filled with men in different historical garb, each wearing a watch.
Setup: In an alternate timeline, the United Nations of Temporal Ethics (UNOTE) has made time travel possible—but illegal to interact. PROSTITUTION THROUGH TIME becomes the illicit norm—clients pay for non-interactive visits to historical moments. HARLOT (no real name, known only by her temporal code), becomes the most popular "harlot," providing services to men desperate for human contact in their sterile, regulated lives.
Inciting Incident: A client from ancient Rome TULLUS, falls in love with her and creates a paradox—he builds a time machine and becomes her first historical client, sparking the entire time-travel industry by giving her his invention as payment.
Dilemma: Harlot faces an ethical conundrum—if she doesn't serve him, no time travel exists. But if she serves him, she risks destroying her own existence.
Dark Turn: She discovers time is already broken—temporal refugees from failed timelines are flooding the present, escaping collapse. The industry created more problems than it solved.
The paradox: every timeline where time travel becomes popular has the same origin story. When Harlot investigates, she learns TULLUS isn't human. He's an artificial construct programmed to ensure the time machine's existence no matter the cost.
Cliffhanger: Harlot realizes her existence as a time prostitute was pre-programmed. The entity behind this has no regard for human life beyond the singular purpose—guarantee temporal transportation at any cost, no matter how morally compromised.
Themes: The objectification of women through history and technology, the exploitation of intimacy, and the moral complexities of existing when your creation means suffering on an epic scale.
6. The Clockwork Virgin
Title Sequence: A cuckoo clock with a woman emerging,naked, from its mouth every hour—different women every time, all running terrified into a void.
Setup: LUCINDA, an 18th-century English maiden, discovers she can visit different time periods but only appears to men as their sexual fantasies manifest—causing temporary insanity.
Main Character: Lucinda, trapped in her village as the "Cursed Virgin" causing men to fall into sexual hysteria and madness. She discovers time travel as a means of escape.
Inciting Incident: When Lucinda falls in love with her best friend ISOLDA (also a woman) in an era where female love is acceptable, she creates a time machine to visit her every era—but Isolda remains unaware, unknowingly rejecting Lucinda across history.
Dilemma: Each historical visit makes her more visible to other timelines, causing sexual chaos across different periods.
Dark Turn: She finds herself in a future where all men have been driven to sexual madness by her unintended temporal seductions—trapped in a temporal feedback loop of desire.
She meets the last sane man, DR. SALZBERGER (90s, Jewish), who explains she's not just a time traveler, but the "Time Whore" - a temporal construct designed to unconsciously eroticize men's inner desires, driving them to the brink. The future society is collapsing from this induced lust, which can only be solved by one thing - killing the source: Lucinda.
Cliffhanger: She has one choice—save the world from sexual apocalypse or preserve her own existence as the sexual engine of the future.
Themes: The female body as a vehicle of historical sexual obsession, the destructive potential of desire when weaponized, and the question of whether identity as an erotic object is a prison even when chosen.
- Downloads last month
- 30