What It Does
Preference Optimization packages a focused coding & development workflow for an AI agent. Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debugging. It is best suited to users who can review the resulting actions and provide only the accounts, files, or command access needed for the task. It is not a substitute for human approval on destructive, financial, security-sensitive, or public-facing actions.
Popular Use Cases
- Review and improve a code change
- Automate a repeatable development task
- Investigate failures and prepare a fix
- Work with repositories and developer tooling
Install this Agent Skill
Claude Code
npx skills add https://github.com/wshobson/agents --skill preference-optimizationCommands derived from the public GitHub SKILL.md record. Checked 2026-10-18. Review the source before running them.
Requirements
| Claude Code | Required / review |
| Codex | Required / review |
| Public SKILL.md source | Required / review |
| Review instructions and requested permissions before installation | Required / review |
| Paid service | Check source |
| Supported system | Check source |
Why It’s Popular
Preference Optimization is a verified Agent Skill from wshobson with a public SKILL.md, compatible with Claude Code, Codex.
