Skip to content

Commit 342f2bc

Browse files
committed
babi_rnn: Adding results for all tasks in bAbi tasks dataset
1 parent dbc0c27 commit 342f2bc

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

examples/babi_rnn.py

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,29 @@
2222
"Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks"
2323
http://arxiv.org/abs/1502.05698
2424
25+
Task Number | FB LSTM Baseline | Keras QA
26+
--- | --- | ---
27+
QA1 - Single Supporting Fact | 50 | 52.1
28+
QA2 - Two Supporting Facts | 20 | 37.0
29+
QA3 - Three Supporting Facts | 20 | 20.5
30+
QA4 - Two Arg. Relations | 61 | 62.9
31+
QA5 - Three Arg. Relations | 70 | 61.9
32+
QA6 - Yes/No Questions | 48 | 50.7
33+
QA7 - Counting | 49 | 78.9
34+
QA8 - Lists/Sets | 45 | 77.2
35+
QA9 - Simple Negation | 64 | 64.0
36+
QA10 - Indefinite Knowledge | 44 | 47.7
37+
QA11 - Basic Coreference | 72 | 74.9
38+
QA12 - Conjunction | 74 | 76.4
39+
QA13 - Compound Coreference | 94 | 94.4
40+
QA14 - Time Reasoning | 27 | 34.8
41+
QA15 - Basic Deduction | 21 | 32.4
42+
QA16 - Basic Induction | 23 | 50.6
43+
QA17 - Positional Reasoning | 51 | 49.1
44+
QA18 - Size Reasoning | 52 | 90.8
45+
QA19 - Path Finding | 8 | 9.0
46+
QA20 - Agent's Motivations | 91 | 90.7
47+
2548
For the resources related to the bAbI project, refer to:
2649
https://research.facebook.com/researchers/1543934539189348
2750

0 commit comments

Comments
 (0)