2026.11.12

I had Claude and Codex produce refactoring implementation plans and evaluate them: Claude is "good at finding problems," Codex is "good at making the steps to implementation concrete"

I had Claude and Codex produce refactoring implementation plans and evaluate them. In a word, it came out as Claude being "good at finding problems" and Codex being "good at making the steps to implementation concrete." As for the evaluations, too, they split: Claude, which emphasizes the importance of the problem, favored Claude's plan, and Codex, which emphasizes the concreteness of the steps, favored Codex's plan. It looks like a good idea to use Claude when finding problems and Codex when creating implementation plans.

I had Claude and Codex produce refactoring implementation plans and evaluate them, so I’m sharing the results In a word, it came out as Claude being “good at finding problems” and Codex being “good at making the steps to implementation concrete.”

As for the evaluations, too, they split: Claude, which emphasizes the importance of the problem, favored Claude’s plan, and Codex, which emphasizes the concreteness of the steps, favored Codex’s plan.

Claude’s evaluation: Claude’s plan 86 points / Codex’s plan 74 points Codex’s evaluation: Claude’s plan 87 points / Codex’s plan 92 points

Below are the details of each plan. Claude’s plan found an inconsistency in the state updates of the voice consultation and was designed to consolidate them into an existing model; its strength was the concreteness of the problem. On the other hand, the migration design and the test scope still needed more work.

Codex’s plan is designed to extract the context building for regular consultations into a dedicated class. The steps for preserving the retrieval order, exceptions, and save timing were concrete, which made it easy to move on to implementation. On the other hand, the improvement it brings is limited, and it was weak on the necessity and priority of adding a new class.

(Voice consultation is the name of the feature targeted in this refactoring)

So it looks like a good idea to use Claude when finding problems and Codex when creating implementation plans!

https://x.com/suna_gaku/status/2120057888961929474