技能包Skill
skill 回测:过去的 Codex 会话
凭记忆写的 skill 和实际做法对不上:拿过去的 Codex 会话回测,先出 dry run 的 diff,再定期复查。
554 X 收藏,截至 发帖日期
提示词
read [skill name, workflow file, or folder path] and run a backtest against my past sessions related to it.
prefer sessions from the same project and same task type. first list the samples you plan to use and why you picked them. if you can't access enough sessions, say so directly instead of guessing.
compare what the skill assumes vs how i actually work. focus on:
- steps i often skip, rewrite, or run more than once
- work i still do manually that the skill never covers
- the order i actually do things in
- spots that keep causing rework, getting stuck, or needing extra clarification
separate stable patterns from one-off exceptions. never rewrite a rule over a single anomaly.
output a dry run first, nothing else:
- keep / modify / add / remove
- session evidence for each item
- proposed diff and reasoning
do not modify any files until i confirm.
after i confirm, update the skill, run existing checks, and summarize before / after. if there's no existing way to verify, say so.
finally, based on how fast new sessions accumulate, suggest a weekly or biweekly review. show me the schedule, scope, and trigger conditions first, then create the recurring task after i confirm.
every scheduled review outputs a dry run only. no auto-modifying the skill without confirmation.下一步 把它发给 Codex,它会读你过去的 Codex 会话。
拿一个你已经写好的 skill 或自动化流程,丢回给 Codex,让它拿你过去的会话做一次回测。它会把 skill 改成你实际干活的样子。
- skill 写好后,让 Codex 对照相关的会话评估它
- 它会找出你总是跳过的步骤、一直手动补的活,以及你实际做事的顺序
- 每隔几周重跑一次,skill 就能跟上你工作方式的变化
凭记忆写下的是流程图。会话记录的是你实际怎么做的,以及在哪里返了工。会话日志现在也能当 skill 的评测集用。
