跳到主要内容Skip to main content

课堂-选型决策与安全评审Lesson - Selection Decisions and Security Review

课堂教案 · 约 15 分钟Lesson plan · about 15 min · 引用核验 2026-11-07(仅引用链接与日期) · refs checked 2026-11-07 (reference links and dates only)

学员把前五个单元的证据汇成一页决策记录,按官方风险框架与提示注入条目做一次评审,写清未验证项与复核日。Learners consolidate evidence from the first five units into a one-page decision record, review it against an official risk framework and prompt-injection guidance, and write unverified items and a review date.

课时目标Lesson objectives

能写出一页决策记录:任务、候选、证据、风险与缓解、未验证项、复核日。

能按模型卡口径核对候选的用途、限制、训练数据与评测条件,缺项写未知。

能把记录按 GOVERN、MAP、MEASURE、MANAGE 四个功能归类,指出哪一栏还空着。

能给出提示注入的缓解动作,含最小权限与高风险动作的人工批准。

Write a one-page decision record: task, candidates, evidence, risks and mitigations, unverified items, review date.

Check candidate use, limits, training data and evaluation conditions in model-card terms, writing unknown for missing items.

Classify the record under GOVERN, MAP, MEASURE and MANAGE, and identify which column is still empty.

Give prompt-injection mitigations including least privilege and human approval for high-risk actions.

材料Materials

NIST AI RMF 官方页与 AI RMF 1.0 正文:Part 2 的四个功能。

OWASP GenAI《LLM01:2025 Prompt Injection》官方条目:注入成因与缓解措施。

arXiv 1810.03993《Model Cards for Model Reporting》摘要:模型卡该写什么。

本站《怎么读模型卡》《怎么防提示注入》两篇指南作为课前阅读。

一页决策记录模板,六栏同课时目标第一条。

NIST AI RMF official page and AI RMF 1.0 text: the four functions in Part 2.

OWASP GenAI LLM01:2025 Prompt Injection entry: causes and mitigations.

arXiv 1810.03993 Model Cards for Model Reporting abstract: what model cards should contain.

This site’s guides on reading model cards and preventing prompt injection as pre-class reading.

A one-page decision-record template with the six columns from the first objective.

步骤Steps
  1. 3 分钟定任务:写成可判定条件,含输入、输出、允许出错范围与复核人角色。
  2. 4 分钟填证据:每个候选只写能回连来源的内容,缺项写未知。
  3. 4 分钟做评审:按四个功能与提示注入条目列风险、缓解动作与责任角色。
  4. 4 分钟写退出:给出退出条件与复核日,小组互评哪一栏最容易被跳过。
  1. 3-minute task definition: write decidable conditions including inputs, outputs, acceptable error range and reviewer role.
  2. 4-minute evidence: for each candidate write only content that links to a source; write unknown for missing items.
  3. 4-minute review: list risks, mitigations and responsible roles under the four functions and the prompt-injection entry.
  4. 4-minute exit: give exit conditions and a review date; groups peer-review which column is most often skipped.
常见误解Common misconceptions

以为评测分数高就可以上线;评测条件与自己的任务条件可能不同。

以为加了护栏就没有风险;权限、日志与人工复核仍在护栏之外。

以为合规框架能替自己做决定;NIST AI RMF 是自愿使用的框架,给结构不给结论。

以为开源或本地部署天然更安全;许可、数据路径与访问控制仍要逐项看。

Assuming a high evaluation score means ready to launch; evaluation conditions may differ from your task conditions.

Assuming guardrails remove risk; permissions, logs and human review still sit outside the guardrail.

Assuming a compliance framework decides for you; NIST AI RMF is a voluntary framework that gives structure, not conclusions.

Assuming open source or local deployment is naturally safer; licence, data path and access control still need item-by-item checks.

评分核对Assessment checks

决策记录六栏齐全,未验证项明确写出,复核日可执行。

每条风险都有缓解动作与验证方式,至少一条涉及权限或人工批准。

能说明这份记录的边界:课堂评审不替代法律意见,也不构成上线批准。

The decision record has all six columns, unverified items are explicit, and the review date is actionable.

Every risk has a mitigation and verification method, with at least one involving permissions or human approval.

Learners can state the record’s boundary: classroom review does not replace legal advice and is not launch approval.

例子与判断Example and interpretation

以下是教学情境,不是本站运行或实测记录。A teaching scenario, not a measured or executed site test.

课堂练习:候选工具评测分数很高,但模型卡缺训练数据与评测条件。决策记录写「未知」,并把最小权限与高风险动作人工批准列为缓解项。Class exercise: a candidate tool has a high evaluation score but its model card lacks training data and evaluation conditions. Write unknown in the decision record and list least privilege plus human approval for high-risk actions as mitigations.

做完例子后怎么检查How to check your practice

先用自己的话解释上面的判断,再检查输入条件,最后回原文验证。说不清原因时回概念;缺日期、字段或权限时补输入;结论无出处时先撤回结论。Explain the example in your own words, inspect input constraints, then verify against the source. Revisit concepts if you cannot explain why; supply missing dates, fields or permissions; withdraw unsupported conclusions.

按这篇主题,先从“概念没分清”练习查起For this topic, start with concept confusion · 查看全部六个情境与理由See all six scenarios and their reasoning

出处Sources
  • NIST AI 风险管理框架(官方页)NIST AI Risk Management Framework ↗
  • NIST AI 100-1:AI RMF 1.0 正文(官方 PDF)NIST AI 100-1: AI RMF 1.0 (official PDF) ↗
  • OWASP GenAI:LLM01:2025 提示注入OWASP GenAI: LLM01:2025 Prompt Injection ↗
  • Mitchell 等《Model Cards for Model Reporting》(arXiv 1810.03993)Mitchell et al., Model Cards for Model Reporting (arXiv 1810.03993) ↗