Claude 3 Haiku vs Sonnet vs Opus for Writing

anthropic has finally after a slight

delay anthropic has released Claude 3

Hau the fastest and cheapest of the new

Claude 3 models we're going to be

testing it with against Claude 3 Sonet

and Claude 3 Opus today to see how they

compare in addition to its lower price

point so let's get into it all right so

there are two main ways that those of

you who follow my channel probably want

to access Claude the first is through

claude's own interace here through they

have a free version which gives you

access to the cheaper models I'm not

sure yet if it gives you access to Cloud

3 Hau I assume it would uh but since I

don't have a free account I can't

actually verify that but if you have a

paid account it gives you access to claw

3 Opus which is their most powerful

model we're going to be testing all

three with a couple of different prompts

to so we can see the difference the

other way that you might be accessing it

is through novel crafter or through by

extension open router if you access

through open router that gets pulled

into novel crafter and so that basically

when you go to generate Pros you have

access to different Cloud models we have

Cloud 3 Opus and Sonet here Additionally

you can go and find CLA 3 hiu here as

well so all three are accessible inside

of Novel crafter this time but before we

get to novel crafter let's go back to

Claud Pro and test all three using just

a simple brainstorming prompt so this is

the prompt we're going to use give me 20

log lines for lit RPG novel using the

log line template from Blake Snider save

the cat make sure the log line has a

sense of irony we're going to go ahead

and run it with Haiku first to see how

it does all right Haiku gave us this

response and it was very fast you didn't

see it but it generated this extremely

quickly and we have options like a down

on his luck office worker with no gaming

skills must become a legendary gamer to

save his virtual world from a tyrannical

AI Overlord despite his crippling carpal

tunnel syndrome okay that's got a good

sense of irony there for sure a group of

hapless office friends find themselves

trapped in a realistic MMO RPG where the

real world weaknesses become their only

path to Victory a shy bookish student

inadvertently becomes the most powerful

image in a virtual Fantasy Realm but

must learn to embrace her Inner Warrior

to defeat a horde of treacherous NE neck

beards okay so not bad actually it

followed the prompt very carefully it

included the irony I was testing this

without that mention of irony in the

past and it did okay but not super

amazing adding just that sentence of

making sure it has irony really changed

the output quite significantly which

goes to show that prompt engineering is

still super important as you can get

much better results with just tweaking

your prompt here and there but let's go

ahead and do another chat run the exact

same message this time we're going to

use Claude 3 Sonet all right so it gave

us a couple these are a little bit

shorter and it was fast not as fast as

haou but still pretty good a hardcore

gamer who mocks lit RPG novels gets

trapped in one forcing him to embrace

the genre he ridiculed to survive that's

kind of cool I like the irony there when

a struggling author's experimental lit

RPG novel becomes a reality reality

bending Cosmic glitch he must embark on

the adventure he created to fix the

universe a brilliant programmer's lit

RPG game unexpectedly traps her inside

her own creation leaving her to navigate

a world she designed but never truly

understood okay so these are fine I

wouldn't say these are any better or

worse than what we got with Haiku so so

that's pretty cool let's see if we see

any better results from using claw 3

Opus so we'll use the same prompt here

and see what it gives us all right so we

have number one here on the verge of

losing his job a struggling accountant

must become the hero of a fantasy world

to save his company only to discover the

game is more real than he ever imagined

not actually that great a pacifist is

forced to play a hyperviolet VR game to

pay off her student loans oh I like that

I like that but her unconventional

approach to problem solving turns her

into an un likely Champion I actually

like this one quite a bit it's very

unique in a world where gaming

determines social status a noob must

navigate a treacherous virtual landscape

to rescue his sister who's been

kidnapped by an elite Guild H that one's

pretty generic so looking through these

like there are some hidden gems in this

but I actually think that Haiku and Sona

did slightly better for the

brainstorming prompt which is

interesting to me that it would do that

okay so that's interesting let's try

something a little bit more on the

marketing side let's do something

something like some email headlines I'm

going to take this second option that I

got from claw 3 Opus that I actually

really liked and we're going to take

this and try to generate a few headlines

for that all right and this is the

prompt we're going to use using the

following book description come up with

20 headlines for a Facebook ad trying to

convince people to buy this book the

headline must have a strong hook and be

interesting and then we have the book

description below so let's try this

first with Claude 3 hiou and see what it

gives

us

okay so it gave us some headlines for

sure but these are very generic

headlines so drowning a debt this

pacifist crazy VR hack will change your

life that's not even like making it

sound like it's a fictional thing

pacifist forced to play brutal VR game

you won't believe what happened next

that's like a parody of a headline so

this is actually kind of making it sound

like this is like we're trying to draw

in real people here that may be an issue

with the prompt but let's go ahead and

try it with CLA 3 Sonic and see if it

gives us something similar okay this is

definitely much more understanding that

this is a book that we're trying to sell

we're not actually trying to sell the

whole VR thing so it's recognizing that

this is a fictional thing pacifist

battles bloody virtual reality to escape

student loan hell that's actually not

too bad I would use that in a Facebook

ad her only weapons were wits one

woman's unconventional path to gaming

Glory when Peacemaker met Deathmatch an

unlikely tale of virtual Triumph loaning

for survival how a passive conquered the

violent VR realm I don't know why so

many of the headlines that AI generates

have this you know quick headline here

then a colon then like a subtitle uh I

don't actually think those are that

makes a good headline but it does it a

lot flowery child wins championship by

playing murderously uh that's like I'm

not really sure what that's saying but

it's it's a better headline for sure so

okay Sonic definitely wins over haiku

for headlines let's try one more time

with opus okay so something interesting

I see about Opus is it's creating

shorter headlines for one slightly

shorter which is usually a good thing

you want your headlines to be short and

quick and to the point and they're very

similar to Sonet but I'd say maybe a

little more succinct so we have pacifist

turn gaming Champion a thrilling tale of

survival that one's not really good but

this one is okay unconventional problem

solving in a hyper violent World student

debt drives pacifist to conquer virtual

reality battling student loans in a

brutal virtual reality like that's Cur

that makes me that's a hook that makes

me want to read that so yeah there's

some good ones in here certainly not all

of them I'd say there there has been a

progression in quality on all three of

these models IU definitely didn't work

for this particular use case but sonnet

was good and Opus was maybe slightly

better but still sonnet was probably

good enough here to get the idea and to

get you going but let's test one more

specifically let's go to novel crafter

to do this one we're going to test

basically a super prompt and in in

because in novel crafter the way it

works is it's pulling information about

your characters it's pulling information

about the the story so far in your book

everything that you've done so far brief

summary of of the story it's pulling in

the last couple hundred words of your

story so it's able to write in a

consistent style and one thing that

we've actually discovered from testing

Opus I've actually noticed a lot of

people have come to me saying that it

doesn't that CLA 3 Opus hasn't been that

phenomenal

and yet for me like it's night and day

different but a lot of people are saying

that it's like just like gp4 and I

cannot for the life of me understand

that but I think I got it when you are

just asking it to write a story just

verbatim and and not give it a whole lot

of context and samples of your work yes

the writing is not great it's pretty

generic it has a lot of the sort of chat

GPT isms that I've come to expect in AI

writing but Claude 3 especially CLA 3

Opa seems to be very good at responding

to prompts in a way that gp4 is not for

instance if I give it a sample chapter

of my writing it writes much more

closely to my style than if I didn't

give it a sample chapter of my writing

additionally if you give it your style

prompts and everything it's much more

respondent to style prompts and actually

changes things

significantly based on your style prompt

adding in all of the context that novel

crafter just automatically dumps in

there really seems to help everything

move along so we're going to be using

this prompt it's basically continuing

this scene that is half written right

here so this is all this is all

automatically been written and edited

heavily by me so it's much more in

consistency with my style it was

originally generated with AI but I

edited it enough that I'm pretty

confident that it sounds like me and

like I would want it to sound so we'll

see if the result from these three

models end up being significantly

different from each other that we're

going to be using now of course it's

creating a huge super prompt on the back

end but this is ultimately what I wanted

to write the officers are shocked when

Mina explains stopping the Smugglers

when she insists the police assure her

that the children will be taken care of

ideally finding their original home so

they can be returned or finding them new

homes among benefactors in London so

let's go ahead and generate this with

Hau first of all it's generating

extremely quickly here which is awesome

and the beauty about this is if you're

using clae 3 through open router you're

paying it for it by the word which means

that if you're using a model like Haiku

or sonic you're going to be paying a lot

less than if you're using Opus so there

is an advantage to using these smaller

all right so this is what we got from

Haiku I'm just going to label this hiu

Mina Harker stroe through the police

station doors a small girl clutched in

her arms and the other rescued children

trailing behind her the officer at the

front desk stared eyes wide as Mina

approached please you must help Mina

said her voice urgent I've stopped a

group of child smugglers in the alley

just down the street these poor children

were trapped in crates waiting to be

taken away the officer blinked

processing her words child Smugglers you

say he glanced at the group of

frightened children gathering around

Mina yes you please you must send

someone to apprehend them at once Mina

insisted there were at least half a

dozen men all working to load the

children into a wagon okay so it's not

too bad honestly like and considering

how cheap this model is it's actually

really good it's a little bit blockish

like you know this person says something

then this person says something and

there's no like really good flow of the

text so we're going to go ahead and try

this with Claude 3 Sonet see if it gets

any better Mina stro through and this is

what we got from Sonet Mina stroe into

the police station a small girl clutched

in her arms and a trail of wide-eyed

children following behind her the

officer at the front desk looked up his

eyes widening at the bizarre procession

I need to report a group of Smugglers

Mina said calmly Shifting the girl to

her other hip they were transporting

these children and great likely to sell

them into servitude or Worse the

officer's mouth hung open for a moment

before he regained his composure M Miss

are you saying you stopped a gang of

kidnappers single

single-handedly Mina simply nodded I

left the man in an alley a few blocks

from here you want to send officers to

collect them definitely way better than

haiku for sure there's there's things

that kind of just make it feel like the

scene is coming alive like how Mina

shifts the girl to the other hip right

like that's great um the dialogue is not

quite so forced you you can tell Mina

has a certain emotion she's much more

calm and collected like she should be so

definitely 100% will take Sonic Sonet

over Haiku although I'm sure Haiku is

great for certain things so last but not

least let's compare this against CLA 3

Opus all right all right and this is

what Opus gave us the officer at the

front desk stared at Mina his eyes

widening as he took in the Ragged

children clustered around her good

Heavens madam what is the meaning of

this now already I can tell it's

followed the prompt a little bit better

if you look at what Sonic gave us it

started us with Mina strode into the

police station a small girl clutched in

her arms and a trail of wide-eyed

children following behind her whereas

actually the sentence before this says

the nearest police station was only a

few blocks away and Mina was soon

striding through its door so she's

already St striden striding whatever

through the doors the officer at the

front stared at her so we've already

established the scene a little bit and

Opus did a better job at sort of

starting where the scene just left off

so then it goes on Mina met his gaze

steadily I discovered these children

being smuggled in crates by groups of

men I incapacitated the Smugglers and

brought the children here for safety the

officer blinked clearly taken a you

stopped them yourself but how he shook

his head never mind that now let's get

these little ones settled and you can

give me the full story as the other

officers began gently ushering the

children into a back room providing them

with blink and some warm drinks Mina

recounted the events in the alley she

was careful to leave out details of her

vampiric abilities simply stating that

she had caught the Smugglers by surprise

so this definitely feels like a more

fleshed out scene there's more details

the officers are like providing the

children with blankets and warm drinks

the dialogue maybe still a little bit

aiish uh but that would be easily

remedied I'd say um on the whole I'd say

this is an improvement on sonnet but not

by a whole lot not as much as sonnet was

an improvement on Hau but definitely an

improvement so you could probably get

away with using Sonet if you're

concerned about the cost but I would say

Opus is still a little bit better on the

whole so clearly we've established that

Haiku is not as powerful as the other

two which was expected right it's

cheaper it's faster but what would

actually be a situation where we might

want to use Haiku instead of say Opus

well for instance all three of these hiu

included have a 200,000 token limit

which means it can process about 150 000

words so if you needed to do stuff that

processes large amounts of material and

you're not so concerned about the

quality of the pros that it gives out

then you might want to use Hau instead

because it'll be a lot cheaper and a lot

faster for instance I have a prompt that

takes a chapter and turns it into a

summary plus some information about

characters and World building it's one

of my prompts that I use to summarize a

book into all of the component parts I

need to create a story Bible

uh I've done videos on this in the past

so if I wanted to take this whole

chapter for example and summarize it

into a story Bible summary which I have

already created here as a prompt and

again go find that video on creating

story Bibles in novel crafter so now I

click on story Bible summary to do this

prompt and I select

haou and because this is a summarization

prompt which even the lower-end models

tend to be pretty good at I can go ahead

and use that and save a lot of money

doing that whole summarization so now

I've got this whole thing here the scene

depicts the final confrontation between

van heling Quincy and Dracula summarizes

everything correctly here the characters

we have van heling the Viewpoint

character and it's yeah it did the job

perfectly here scene takes place in the

courtyard of Dracula's castle so it got

everything that I wanted it to catch in

here and that's the the perfect example

of where you might want to use Haiku as

opposed to Sonet or Opus because while

Sonet and Opus could probably do this

just as well it would cost a lot more to

do so so that is just a brief Glimpse at

why you would want to use a cheaper and

faster model because there are certain

things that it is better at and if you

wanted you could take your whole book

and summarize it this way and then you

have a pretty cheaply made template to

use in your story Bible so that's the

general idea there I hope that gives you

a decent look at Haiku and these other

models and gives you an idea of which

one you want to use for which now before

I go on I want to also mention that my

membership is actually it's not closing

down I've decided not to close it down

anymore uh but I am raising the price as

of tonight so the moment you see this go

check that out I have basically if you

join the membership now you will get two

of my books for free I have complete

this is the only way to get those books

they are not published anywhere else you

will also get a fine to model and I'm

preparing a couple of other fine tune

models of my own that I'm just going to

share with my membership and those you

can get for free inside the membership

along with instructions on how to

install it and use it in a tool like

novel crafter you'll also get a whole

bunch of courses and then every week now

uh I've made a change to the membership

so every week I'm going live and

answering your questions and giving you

some pretty awesome information in those

presentations so if you want to check

that out go ahead the link is down below

and again that ends tonight at the

current price so if you want to get in

at the current price and keep that price

for as long as you keep the membership

so basically forever then you can you

can do that otherwise tomorrow it will

be up in price so definitely check that

out and I will see you in the next

video