File tree Expand file tree Collapse file tree 1 file changed +23
-0
lines changed
Expand file tree Collapse file tree 1 file changed +23
-0
lines changed Original file line number Diff line number Diff line change 2222"Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks"
2323http://arxiv.org/abs/1502.05698
2424
25+ Task Number | FB LSTM Baseline | Keras QA
26+ --- | --- | ---
27+ QA1 - Single Supporting Fact | 50 | 52.1
28+ QA2 - Two Supporting Facts | 20 | 37.0
29+ QA3 - Three Supporting Facts | 20 | 20.5
30+ QA4 - Two Arg. Relations | 61 | 62.9
31+ QA5 - Three Arg. Relations | 70 | 61.9
32+ QA6 - Yes/No Questions | 48 | 50.7
33+ QA7 - Counting | 49 | 78.9
34+ QA8 - Lists/Sets | 45 | 77.2
35+ QA9 - Simple Negation | 64 | 64.0
36+ QA10 - Indefinite Knowledge | 44 | 47.7
37+ QA11 - Basic Coreference | 72 | 74.9
38+ QA12 - Conjunction | 74 | 76.4
39+ QA13 - Compound Coreference | 94 | 94.4
40+ QA14 - Time Reasoning | 27 | 34.8
41+ QA15 - Basic Deduction | 21 | 32.4
42+ QA16 - Basic Induction | 23 | 50.6
43+ QA17 - Positional Reasoning | 51 | 49.1
44+ QA18 - Size Reasoning | 52 | 90.8
45+ QA19 - Path Finding | 8 | 9.0
46+ QA20 - Agent's Motivations | 91 | 90.7
47+
2548For the resources related to the bAbI project, refer to:
2649https://research.facebook.com/researchers/1543934539189348
2750
You can’t perform that action at this time.
0 commit comments