wcag-act/act-implementations.html at main · w3c/wcag-act · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
<!doctype html><html lang="en">
 <head>
  <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  <title>Accessibility Conformance Testing (ACT) Rules Implementations</title>
  <meta content="width=device-width, initial-scale=1, shrink-to-fit=no" name="viewport">
  <meta content="w3c/ED" name="w3c-status">
  <link href="https://www.w3.org/StyleSheets/TR/2016/W3C-ED" rel="stylesheet" type="text/css">
  <link href="https://w3c.github.io/wcag-act/act-implementations.html" rel="canonical">
 </head>
<body>

<h1 id="top">Accessibility Conformance Testing (ACT) Rules Implementations</h1>

<p><strong>Status: DRAFT 11 July 2019</strong></p>

<p>This page tracks implementations of the <a href="https://www.w3.org/TR/act-rules-format/">Accessibility Conformance Testing (ACT) Rules Format 1.0</a> for the Candidate Recommendation (CR) phase.</p>

<h2 id="summary">Summary</h2>

<p>As part of the <a href="https://www.w3.org/WAI/GL/">W3C Accessibility Guidelines Working Group (AGWG)</a>, the <a href="https://www.w3.org/WAI/GL/task-forces/conformance-testing/">Accessibility Conformance Testing (ACT) Task Force</a> documents at least <strong>11 test rules</strong> that meet the <a href="https://www.w3.org/TR/2019/CR-act-rules-format-1.0-20190416/#Exit_Criteria">'Exit Criteria' of the ACT Rules Format 1.0 CR specification</a>:</p>
<ul>
  <li><a href="https://act-rules.github.io/rules/5c01ea/">ARIA state or property allowed (5c01ea)</a></li>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://github.com/daisy/epub-act-rules/blob/master/rules/metadata-accessMode-is-defined.md">EPUB Metadata 'schema:accessMode' is defined</a></li>
  <li><a href="https://act-rules.github.io/rules/e086e5/">Form field has accessible name (e086e5)</a></li>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/ebe86a/">No keyboard trap non-standard navigation (ebe86a)</a></li>
  <li><a href="https://act-rules.github.io/rules/a1b64e/">No keyboard trap standard navigation (a1b64e)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
  <li><a href="https://act-rules.github.io/rules/c5a4ea/">Video with audio has audio descriptions or transcript (c5a4ea)</a></li>
</ul>

<p>This set of 11 test rules is a subset of a lerger set currently being developed by the <a href="https://www.w3.org/community/act-r/">W3C ACT Rules Community Group (CG)</a>. Thier development includes review, involvement, and other contribution from a broad representation of the community, including:</p>
<ul>
  <li>Access42</li>
  <li>Accessibility Foundation</li>
  <li>Agency for Public Management and eGovernment (Difi)</li>
  <li>British Broadcasting Corporation</li>
  <li>DAISY Consortium</li>
  <li>Deque Systems Inc.</li>
  <li>IBM Corporation Inc.</li>
  <li>Level Access</li>
  <li>Power Mapper</li>
  <li>Siteimprove</li>
  <li>Universidade de Lisboa</li>
  <li>US Access Board</li>
</ul>

<p>In addition to completing the <a href="https://act-rules.github.io/pages/design/process/">'Review Process' of the ACT Rules Community Group</a>, some of these test rules have <a href="https://act-rules.github.io/pages/implementations/overview/">documented use</a> by automated testing tools and manual methodologies, including:</p>
<ul>
  <li>Access Engine, automated testing tool by Level Access</li>
  <li>Alfa, automated testing tool by Siteimprove </li>
  <li>Axe-Core, automated testing tool by Deque Systems Inc.</li>
  <li>RGAA, manual methodology from the French government</li>
  <li>Trusted Tester, manual methodology from the US government</li>
  <li>QualWeb, automated testing tool by Universidade de Lisboa</li>
</ul>

<p>This initial set of test rules developed through an open and consensus-based process as well as implementations of these test rules in automated testing tools and manual methodologies demonstrates that the ACT Rules Format 1.0 CR specification is sufficiently mature and supported by a variety of stakeholders, to meet the CR requirements. Other test rules are currently in development, and active involvement and uptake has been increasing since the CR publication. To date, there have been no objections to the specification.</p>

<h2 id="implementations">Implementations</h2>
<p>The following sections list the 'Exit Criteria' that reflect the normative requirements defined by the ACT Rules Format 1.0 specification. For each exit criterion there is a list of test rules that meet this criterion.</p>

<h3>General</h3>

<h4>(C1) All rules must conform to the ACT Rules Format</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/5c01ea/">ARIA state or property allowed (5c01ea)</a></li>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://github.com/daisy/epub-act-rules/blob/4b04166e378607073f1c031dd8caff4b3199ac7e/rules/metadata-accessMode-is-defined.md">EPUB Metadata 'schema:accessMode' is defined</a></li>
  <li><a href="https://act-rules.github.io/rules/e086e5/">Form field has accessible name (e086e5)</a></li>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/ebe86a/">No keyboard trap non-standard navigation (ebe86a)</a></li>
  <li><a href="https://act-rules.github.io/rules/a1b64e/">No keyboard trap standard navigation (a1b64e)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
  <li><a href="https://act-rules.github.io/rules/c5a4ea/">Video with audio has audio descriptions or transcript (c5a4ea)</a></li>
</ul>

<h3>Mapping</h3>

<h4>(C2) At least one atomic rule that has a requirement in WCAG 2</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
</ul>

<h4>(C3) At least one composite rule that has a requirement in WCAG 2</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/c5a4ea/">Video with audio has audio descriptions or transcript (c5a4ea)</a></li>
</ul>

<h4>(C4) At least one rule that is a satisfying test, and one rule that is not</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/5c01ea/">ARIA state or property allowed (5c01ea)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
</ul>

<h4>(C5) At least one rule that has an accessibility requirement mapping that is not part of WCAG</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/5c01ea/">ARIA state or property allowed (5c01ea)</a></li>
</ul>

<h4>(C6) At least one atomic rule has no accessibility requirement mapping, but is used in a composite rule that has</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/ebe86a/">No keyboard trap non-standard navigation (ebe86a)</a></li>
  <li><a href="https://act-rules.github.io/rules/a1b64e/">No keyboard trap standard navigation (a1b64e)</a></li>
</ul>

<h3>Rule input</h3>

<h4>(C7) At least two different input aspects are used</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h4>(C8) At least two different web content technologies</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/5c01ea/">ARIA state or property allowed (5c01ea)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://github.com/daisy/epub-act-rules/blob/4b04166e378607073f1c031dd8caff4b3199ac7e/rules/metadata-accessMode-is-defined.md">EPUB Metadata 'schema:accessMode' is defined</a></li>
</ul>
<p>Note: rules <a href="https://github.com/act-rules/act-rules.github.io/pull/408">for CSS</a> and <a href="https://github.com/act-rules/act-rules.github.io/pull/419">for SVG</a> are currently in development too.</p>

<h3>Applicability</h3>

<h4>(C9) At least one atomic rule has an applicability different from the composite rule it is used in</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/ebe86a/">No keyboard trap non-standard navigation (ebe86a)</a> (part of <a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
</ul>

<h3>Expectations</h3>

<h4>(C10) At least one rule with one expectation</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
</ul>

<h4>(C11) At least one rule with more than one expectation</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
  <li><a href="https://act-rules.github.io/rules/ebe86a/">No keyboard trap non-standard navigation (ebe86a)</a></li>
</ul>

<h3>Assumptions</h3>

<h4>(C12) At least one rule without assumptions</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/e086e5/">Form field has accessible name (e086e5)</a></li>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
</ul>

<h4>(C13) At least one rule where exceptions are documented in an assumption</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/c5a4ea/">Video with audio has audio descriptions or transcript (c5a4ea)</a></li>
</ul>

<h4>(C14) At least one rule where interpretation is documented in an assumption</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
</ul>

<h3>Accessibility support</h3>

<h4>(C15) At least one rule where no accessibility support information was necessary</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e6952f/">Attributes are not duplicated (e6952f)</a></li>
  <li><a href="https://act-rules.github.io/rules/2779a5/">HTML Page has a title (2779a5)</a></li>
</ul>

<h4>(C16) At least one rule where accessibility support information was included</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/e086e5/">Form field has accessible name (e086e5)</a></li>
  <li><a href="https://act-rules.github.io/rules/c5a4ea/">Video with audio has audio descriptions or transcript (c5a4ea)</a></li>
</ul>

<h3>Change log</h3>

<h4>(C17) At least two rules that include a changelog</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h3>Glossary</h3>

<h4>(C18) At least two rules with more than one definition</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h3>Issues list</h3>

<h4>(C19) At least two rules that include an issues list</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/e086e5/">Form field has accessible name (e086e5)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
</ul>

<h3>Test cases</h3>

<h4>(C20) Every applicability must have at least one inapplicable test case</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h4>(C21) Every expectation must have at least one pass and one fail test case</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h3>Background</h3>

<h4>(C22) At least two rules with a background section</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h3>Acknowledgements</h3>

<h4>(C23) At least two rules with an acknowledgements section</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1/">Buttons have an accessible name (97a4e1)</a></li>
  <li><a href="https://act-rules.github.io/rules/80af7b/">No keyboard trap (80af7b)</a></li>
  <li><a href="https://act-rules.github.io/rules/1a02b0/">Video element transcript (1a02b0)</a></li>
</ul>

<h3>Implementations and data format</h3>

<h4>(C24) At least two fully automated independent implementations of the same ACT rule (All test cases that should pass are passing, all test cases that should fail are failing)</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/97a4e1">Buttons have an accessible name (97a4e1)</a>
    <ul>
      <li>Access Engine (Level Access)</li>
      <li>Alfa (Siteimprove)</li>
      <li>Axe-core (Deque Systems)</li>
    </ul>
  </li>
  <li><a href="https://act-rules.github.io/rules/2779a5">HTML Page has a title (2779a5)</a>
    <ul>
      <li>Alfa (Siteimprove)</li>
      <li>Axe-core (Deque Systems)</li>
      <li>QualWeb (Universidade de Lisboa) <a href="https://github.com/act-rules/act-rules-implementation-qualweb/blob/master/reports/qualweb-2779a5.json">External report</a></li>
    </ul>
  </li>
</ul>

<h4>(C25) At least two semi-automated independent implementations of the same ACT rule (Some results running against test cases are inconclusive, none of the results contradict the test cases)</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/f51b46">Video has captions (f51b46)</a>
    <ul>
      <li>Alfa (Siteimprove) <a href="https://raw.githubusercontent.com/act-rules/act-rules-implementation-alfa/master/report.json">External report</a></li>
      <li>Axe-core (Deque Systems)</li>
    </ul>
  </li>
</ul>

<h4>(C26) At least two independent implementations of the same ACT rule in manual testing methodologies</h4>
<ul>
  <li><a href="https://act-rules.github.io/rules/ebe86a">No keyboard trap non-standard navigation (ebe86a)</a>
    <ul>
      <li>RGAA 2 (Tested by Access42)</li>
      <li>Trusted Tester version 5 <a href="https://github.com/act-rules/act-rules-implementation-trusted-tester/blob/master/reports/no-keyboard-trap-evaluation-report.json">External report</a></li>
    </ul>
  </li>
</ul>

</body>
</html>