-
Notifications
You must be signed in to change notification settings - Fork 37
Expand file tree
/
Copy pathquiz.json
More file actions
78 lines (78 loc) · 3.05 KB
/
Copy pathquiz.json
File metadata and controls
78 lines (78 loc) · 3.05 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
{
"lesson": "21-fairness-criteria-group-individual-counterfactual",
"title": "公平性标准 —— 群体、个体、反事实",
"questions": [
{
"stage": "pre",
"question": "对于群体 A=a 和 A=a',哪一项最符合人口统计均等(demographic parity)的定义?",
"options": [
"各群体的真阳性率和假阳性率相等",
"各群体的预测值(predictive value)相等",
"各群体的 Lipschitz 常数相等",
"接受率相等:P(Y=1 | A=a) = P(Y=1 | A=a')"
],
"correct": 3,
"explanation": ""
},
{
"stage": "check",
"question": "Chouldechova / Kleinberg-Mullainathan-Raghavan 2017 的不可能性结果说了什么?",
"options": [
"群体公平总能通过重新加权来实现",
"在基率不等的情况下,人口统计均等、等化几率(equalized odds)和条件使用准确率均等无法同时成立",
"反事实公平蕴含人口统计均等",
"对任意 DAG,个体公平都蕴含反事实公平"
],
"correct": 1,
"explanation": ""
},
{
"stage": "check",
"question": "Dwork 等人 2012 通过什么来定义个体公平(individual fairness)?",
"options": [
"个体层面的人口统计均等",
"跨受保护群体的准确率相等",
"决策映射相对于一个任务专属相似度度量满足 Lipschitz 条件,使相似的个体得到相似的决策",
"一个带敏感属性干预的因果 DAG"
],
"correct": 2,
"explanation": ""
},
{
"stage": "check",
"question": "反事实公平(Kusner 等人 2017)要求:",
"options": [
"无需任何因果假设",
"所有群体的 Lipschitz 常数相等",
"仅群体层面的统计量",
"一个因果 DAG;当个体的敏感属性被反事实地改变时,决策保持不变"
],
"correct": 3,
"explanation": ""
},
{
"stage": "post",
"question": "为什么回溯反事实(backtracking counterfactuals,arXiv:2401.13935)对法律合规很重要?",
"options": [
"它们不在受保护属性上做干预(那在法律上有问题),而是追问:哪一组实际特征本会产生该反事实结果",
"它们消除了对任何因果模型的需求",
"它们取代了基于嵌入的偏见度量",
"它们证明了不可能性定理是错的"
],
"correct": 0,
"explanation": ""
},
{
"stage": "post",
"question": "ICLR Blogposts 2024 的哲学性调和论点是什么?",
"options": [
"不可能性定理可通过重新加权来化解",
"在有显式因果图的情况下,满足某些群体公平度量就蕴含反事实公平,因此两类之间看似的对立,部分是因为让因果模型保持隐式而造成的假象",
"群体公平与反事实公平互不相关",
"只有个体公平是站得住脚的"
],
"correct": 1,
"explanation": ""
}
]
}