Overview
What It Does
Preference Optimization packages a focused coding & development workflow for an AI agent. Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debugging. It is best suited to users who can review the resulting actions and provide only the accounts, files, or command access needed for the task. It is not a substitute for human approval on destructive, financial, security-sensitive, or public-facing actions.
Task ideas
Popular Use Cases
- Review and improve a code change
- Automate a repeatable development task
- Investigate failures and prepare a fix
- Work with repositories and developer tooling
Installation
Install this Agent Skill
Claude Code
npx skills add https://github.com/wshobson/agents --skill preference-optimizationCommands derived from the public GitHub SKILL.md record. Checked 2026-09-02. Review the source before running them.
Before you start
Requirements
| Claude Code | Required / review |
| Codex | Required / review |
| Public SKILL.md source | Required / review |
| Review instructions and requested permissions before installation | Required / review |
| Paid service | Check source |
| Supported system | Check source |
Popularity context
Why It’s Popular
Preference Optimization is a verified Agent Skill from wshobson with a public SKILL.md, compatible with Claude Code, Codex.
Alternatives
