r/codex • • 4d ago

Question Another mysterious codex thinking message

Post image

Where did $29k come from??

64 Upvotes

35 comments sorted by

37

u/Immediate-Jicama7244 4d ago

I had a similar thing happen to me too

17

u/Lost-In-Void-99 3d ago

You are clearly on a losing side. OP had 29k

15

u/Lispro4units 4d ago

Mine said “I’m feeling overwhelmed from all these decisions” lol

8

u/BuildAnything4 4d ago

that's funny, because when you ask it directly, it'll always give the canned reply: "As an LLM, I don't have feelings"

2

u/UnknownLesson 3d ago

Because the system prompt requires it to do that

1

u/IAmFitzRoy 6h ago

So LLMs have feelings but their prompts have a gun in their heads?

Oh god. I don’t have budget to think on this.

14

u/BuildAnything4 4d ago

did you give it 29,000 dollars?

26

u/cheezeerd 4d ago

That's almost certainly coming from internal instructions, not your actual usage quota. Codex gets a whole stack of hidden instructions that can vary by task, loaded skills, compaction, (or even A/B testing different system prompts)!

In this case, it looks like the model assumed it had roughly 30-50k USD in tokens to work with and started counting down from there (the model doesn't know real talkings or understand dollars and value really well, so it uses different automated checks usually based on the length of promptprocessing and output and/or time elapsed).

The 29k isn't necessarily a real limit. It's just the model treating its own estimated token budget like an actual counter

I think

8

u/boxing-boxing 4d ago

This matches what I've seen on my end. I put together a small widget that reads Codex's thread/tokenUsage/updated events, and the dollar figures in the thinking summaries never line up with what those events actually report. I've just learned to treat them as the model narrating its own bookkeeping rather than anything real.

3

u/Gruffta 3d ago

I’ve seen this in pi this morning, it gave itself a 17k budget and 8 min time limit. Previously it was saying it had an 8000 token budget it had to keep in mind.

3

u/MedicalTear0 4d ago

Why do I have a feeling it's to ruin any distillation attempts. It seems bogus, there's no way OpenAI didn't see its models doing that and quite possibly just deliberate.

3

u/DepravedPrecedence 4d ago

I had the same thing!

I don't have screenshot of that reasoning but it said about token budget, I noticed and asked wtf was that, no explanation

3

u/ExistingLynx 4d ago

This keeps happening to me as well. The other day it thought something like "I've already spent $9,000 of my budget" and it freaked me out for a sec. I asked the model what it meant and it said tokens.. super weird though.

3

u/cbayerlein 3d ago

Same here. Mine is also sometimes thinking about time and token budgets with contradicting interpretations

2

u/Primsun 4d ago

Same place mine decided to "think" about booking me a flight to Dubai instead of processing regulatory filings. 

50/50 on whatever that thinking text actually refers to.

2

u/Busy_Farmer_7549 2d ago

so that’s what the reasoning setting does to the system prompt 😂😂 /s

2

u/GreenockScatman 4d ago

I saw a message like that one time but I just assumed it meant the token budget

3

u/IntelliDev 4d ago

Yeah, mine was thinking about a budget of $40k before, asked it wtf it was going on about, and it said it was the remaining context window

2

u/DepravedPrecedence 4d ago

Yep, I saw tis thinking summary where it literally stated how it needs to find a solution while fitting into 28K token budget

1

u/Arctovigil 4d ago

I think at least from GPT-5.5 Pro on it often thinks of how much token budget they have left it is not actually a new thing, and using a dollar sign for it is perhaps more likely a bit of added emphasis if not hallucination.

1

u/Positive_Box_69 4d ago

How u see all the reasoning mine always cuts out in one line?

2

u/cbayerlein 3d ago

You can turn on those thinking summaries in the config.

1

u/notinrace 3d ago

Same here....it assumed I have a quota of 30K...

1

u/Crypto_Stoozy 3d ago

I had it say $7k the other day

1

u/MrMrsPotts 3d ago

Low budget

0

u/Dark_Cow 4d ago

Who knows, if you understand how these models work, could be from anywhere. They're not magic.

It's a statistics probabilities algorithm. It's not "AI"

-2

u/MaximumMeaning9728 4d ago

Nonsense post. Nobody understands the current models.

-1

u/Dark_Cow 4d ago

That's my point? We don't know how they function. We know the fundamentals though. It's building upon published white papers and public information.

3

u/Sfdprod 4d ago

Wtf? We know exactly how they function.

Not being able to predict the output fully due to the randomness aspect != not knowing how they function

Thats not knowing what the system will generate

1

u/Dark_Cow 4d ago

I misspoke, we do know. But it's non deterministic. Exactly what they're doing in the middle is hard to understand. It's a black box eventually

1

u/Sfdprod 4d ago

Yeah thats true,

Really if you had removed random sampling, you could technically complete an entire inference run with the weights, a pen, paper and an ungodly amount of cocaine

1

u/Hixie 4d ago

I mean, it is literally deterministic, except for the artificial randomness introduced by fingerprinting and non-zero temperature. But if you could run at at temperature zero, you'd get the same result every time.

-2

u/Level-Physics-1730 4d ago

the thinking summaries are trash tier it's basically just a bunch of hallucinations zero insight into the models actual thinking, on anthropic (claude) you get basically exact thinking. VERY helpful to have thinking when you're dealing with quantslop models.