testing class LanguageModelXML diagnosing class LanguageModelXML: testing required public methods... testing debug method... testing clear method... testing eq method... testing assign method... testing class-specific protected methods: i/o methods... Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_combined.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: unimportant junk author: Dhruva symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | symbol0 |4 |2 | |5 |2 | symbol1 |6 |3 | |7 |4 | |8 |4 | symbol1 |9 |5 | |10 |6 | |11 |6 | |12 |5 | |13 |4 | |14 |4 | symbol3 |15 |3 | |16 |4 | |17 |4 | |18 |3 | |19 |2 | |20 |2 | symbol1 |21 |1 | |22 |2 | |23 |3 | |24 |3 | symbol2a |25 |2 | |26 |3 | |27 |3 | symbol2b |28 |2 | |29 |3 | |30 |3 | symbol2c |31 |2 | |32 |1 | |33 |2 | |34 |2 | symbol6 |35 |3 | |36 |4 | |37 |5 | |38 |5 | symbol4 |39 |4 | |40 |5 | |41 |5 | symbol5 |42 |4 | |43 |3 | |44 |2 | |45 |2 | symbol7 |46 |1 | |47 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> ((symbol0) symbol1 (((symbol1 (RULE2) symbol3)+)|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_grammar_empty.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: XMLParser: parsed token information: |input |depth | xml form of input |0 |0 | The document after removal of unwanted tags: reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 0 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM Level 0 performing XML->ABNF conversion level 0 Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_nesting.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol6 symbol4 symbol5 symbol7 symbol1 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | symbol0 |4 |2 | |5 |3 | |6 |3 | symbol1 |7 |2 | |8 |3 | |9 |4 | |10 |5 | |11 |5 | symbol1 |12 |4 | |13 |5 | |14 |6 | |15 |6 | symbol2a |16 |5 | |17 |6 | |18 |6 | symbol2b |19 |5 | |20 |6 | |21 |6 | symbol2c |22 |5 | |23 |4 | |24 |5 | |25 |5 | symbol3 |26 |4 | |27 |3 | |28 |4 | |29 |5 | |30 |5 | symbol6 |31 |4 | |32 |5 | |33 |6 | |34 |7 | |35 |7 | symbol4 |36 |6 | |37 |7 | |38 |7 | symbol5 |39 |6 | |40 |5 | |41 |4 | |42 |5 | |43 |5 | symbol7 |44 |4 | |45 |3 | |46 |2 | |47 |3 | |48 |3 | symbol1 |49 |2 | |50 |1 | |51 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol6 symbol4 symbol5 symbol7 symbol1 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol6 symbol4 symbol5 symbol7 symbol1 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol6 symbol4 symbol5 symbol7 symbol1 performing conversion ABNF equivalent: word -> ((symbol0) (symbol1) (((symbol1) ((symbol2a)|(symbol2b)|(symbol2c)|(symbol3)) (symbol3))|((symbol6) (((symbol4)|(symbol5))) (symbol7))|(symbol1)) (symbol1)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_nesting_2.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol4 symbol5 symbol6 symbol7 symbol1 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | symbol0 |4 |2 | |5 |3 | |6 |3 | symbol1 |7 |2 | |8 |3 | |9 |4 | |10 |5 | |11 |5 | symbol1 |12 |4 | |13 |5 | |14 |6 | |15 |6 | symbol2a |16 |5 | |17 |6 | |18 |6 | symbol2b |19 |5 | |20 |6 | |21 |6 | symbol2c |22 |5 | |23 |4 | |24 |5 | |25 |5 | symbol3 |26 |4 | |27 |3 | |28 |4 | |29 |5 | |30 |6 | |31 |7 | |32 |7 | symbol4 |33 |6 | |34 |7 | |35 |7 | symbol5 |36 |6 | |37 |5 | |38 |4 | |39 |5 | |40 |5 | symbol6 |41 |4 | |42 |5 | |43 |5 | symbol7 |44 |4 | |45 |3 | |46 |2 | |47 |3 | |48 |3 | symbol1 |49 |2 | |50 |1 | |51 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol4 symbol5 symbol6 symbol7 symbol1 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol4 symbol5 symbol6 symbol7 symbol1 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol2a symbol2b symbol2c symbol3 symbol4 symbol5 symbol6 symbol7 symbol1 performing conversion ABNF equivalent: word -> ((symbol0) (symbol1) (((symbol1) ((symbol2a)|(symbol2b)|(symbol2c)|(symbol3)) (symbol3))|((((symbol4)|(symbol5))) (symbol6) (symbol7))|(symbol1)) (symbol1)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_nesting_3.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: worda wordb wordc XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |4 | |4 |4 | worda |5 |3 | |6 |4 | |7 |4 | wordb |8 |3 | |9 |4 | |10 |4 | wordc |11 |3 | |12 |2 | |13 |1 | |14 |0 | The document after removal of unwanted tags: worda wordb wordc reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 3 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 Level 0 Graph 0 worda wordb wordc performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: worda wordb wordc performing conversion ABNF equivalent: word -> (((worda)|(wordb)|(wordc))) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((symbol1 (RULE2) symbol3)+)|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_0-.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((((epsilon))|(symbol1 (RULE2) symbol3)))+|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_0-N.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((((epsilon))|(symbol1 (RULE2) symbol3)|((epsilon))|(symbol1 (RULE2) symbol3)) (((epsilon))|(symbol1 (RULE2) symbol3)))|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_M.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 symbol3 symbol1 symbol3 symbol1 symbol3 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3))|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_M-.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3)+)|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_M-N.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 symbol3 symbol1 symbol3 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((symbol1 (RULE2) symbol3) (symbol1 (RULE2) symbol3) (((epsilon))|(symbol1 (RULE2) symbol3)|((epsilon))|(symbol1 (RULE2) symbol3)) (((epsilon))|(symbol1 (RULE2) symbol3)))|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_repeat_prob.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | symbol0 |3 |2 | symbol1 |4 |3 | |5 |4 | |6 |4 | symbol1 |7 |5 | |8 |6 | |9 |6 | |10 |5 | |11 |4 | |12 |4 | symbol3 |13 |3 | |14 |4 | |15 |4 | |16 |3 | |17 |2 | |18 |2 | symbol1 |19 |1 | |20 |2 | |21 |3 | |22 |3 | symbol2a |23 |2 | |24 |3 | |25 |3 | symbol2b |26 |2 | |27 |3 | |28 |3 | symbol2c |29 |2 | |30 |1 | |31 |2 | |32 |2 | symbol6 |33 |3 | |34 |4 | |35 |5 | |36 |5 | symbol4 |37 |4 | |38 |5 | |39 |5 | symbol5 |40 |4 | |41 |3 | |42 |2 | |43 |2 | symbol7 |44 |1 | |45 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> (symbol0 symbol1 (((symbol1 (RULE2) symbol3)+)|(RULE3)) symbol1) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> (symbol6 (((symbol4)|(symbol5))) symbol7) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_ruleref.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | symbol0 |4 |2 | |5 |3 | |6 |3 | symbol1 |7 |2 | |8 |3 | |9 |4 | |10 |5 | |11 |5 | symbol1 |12 |4 | |13 |5 | |14 |6 | |15 |6 | |16 |5 | |17 |4 | |18 |5 | |19 |5 | symbol3 |20 |4 | |21 |3 | |22 |4 | |23 |4 | |24 |3 | |25 |2 | |26 |3 | |27 |3 | symbol1 |28 |2 | |29 |1 | |30 |2 | |31 |3 | |32 |3 | symbol2a |33 |2 | |34 |3 | |35 |3 | symbol2b |36 |2 | |37 |3 | |38 |3 | symbol2c |39 |2 | |40 |1 | |41 |2 | |42 |3 | |43 |3 | symbol6 |44 |2 | |45 |3 | |46 |4 | |47 |5 | |48 |5 | symbol4 |49 |4 | |50 |5 | |51 |5 | symbol5 |52 |4 | |53 |3 | |54 |2 | |55 |3 | |56 |3 | symbol7 |57 |2 | |58 |1 | |59 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 10 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 ::4> index_d = 0 ::4> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 4 value_d = 4 ::5> index_d = 0 ::5> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 5 value_d = 5 ::6> index_d = 0 ::6> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 6 value_d = 6 ::7> index_d = 0 ::7> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 7 value_d = 7 ::8> index_d = 0 ::8> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 8 value_d = 8 ::9> index_d = 0 ::9> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 9 value_d = 9 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol3 symbol1 symbol2a symbol2b symbol2c symbol6 symbol4 symbol5 symbol7 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol3 symbol1 Handling repeat requests... The modified grammar: symbol2a symbol2b symbol2c Handling repeat requests... The modified grammar: symbol6 symbol4 symbol5 symbol7 performing conversion ABNF equivalent: word -> ((symbol0) (symbol1) (((symbol1) ((RULE2)|(symbol3)) (symbol3))|(RULE3)|(symbol1)) (symbol1)) ABNF equivalent: rule2 -> ((symbol2a) (symbol2b) (symbol2c)) ABNF equivalent: rule3 -> ((symbol6) (((symbol4)|(symbol5))) (symbol7)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_ruleref_null.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: symbol0 symbol1 symbol1 symbol2 symbol3 symbol1 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | symbol0 |4 |2 | |5 |3 | |6 |3 | symbol1 |7 |2 | |8 |3 | |9 |4 | |10 |5 | |11 |5 | symbol1 |12 |4 | |13 |5 | |14 |6 | |15 |6 | |16 |5 | |17 |6 | |18 |6 | symbol2 |19 |5 | |20 |4 | |21 |5 | |22 |5 | symbol3 |23 |4 | |24 |3 | |25 |2 | |26 |3 | |27 |3 | symbol1 |28 |2 | |29 |1 | |30 |0 | The document after removal of unwanted tags: symbol0 symbol1 symbol1 symbol2 symbol3 symbol1 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 4 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 Level 0 Graph 0 symbol0 symbol1 symbol1 symbol2 symbol3 symbol1 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: symbol0 symbol1 symbol1 symbol2 symbol3 symbol1 performing conversion ABNF equivalent: specials -> ((symbol0) (symbol1) (((symbol1) (((epsilon))|(symbol2)|(symbol3)) (symbol3))|(symbol1)) (symbol1)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_simple.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: worda wordb wordc XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | worda |4 |2 | |5 |3 | |6 |3 | wordb |7 |2 | |8 |3 | |9 |3 | wordc |10 |2 | |11 |1 | |12 |0 | The document after removal of unwanted tags: worda wordb wordc reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 3 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 Level 0 Graph 0 worda wordb wordc performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: worda wordb wordc performing conversion ABNF equivalent: word -> ((worda) (wordb) (wordc)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_weights.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: worda wordb wordc wordz XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |4 | |4 |4 | worda |5 |3 | |6 |4 | |7 |4 | wordb |8 |3 | |9 |4 | |10 |4 | wordc |11 |3 | |12 |2 | |13 |3 | |14 |3 | wordz |15 |2 | |16 |1 | |17 |0 | The document after removal of unwanted tags: worda wordb wordc wordz reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 4 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 ::3> index_d = 0 ::3> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 3 value_d = 3 Level 0 Graph 0 worda wordb wordc wordz performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: worda wordb wordc wordz performing conversion ABNF equivalent: word -> (((worda)|(wordb)|(wordc)|(wordz)) (wordz)) Processing file: /cavs/hse/ies/d002/isip/users/wholland/new_tools/class/pr/LanguageModelXML/diagnose_input_state.sof reading model reading levels reading grammars Parsing the grammar... The parsed document: S12 S13 S14 XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |3 | |3 |3 | S12 |4 |2 | |5 |3 | |6 |3 | S13 |7 |2 | |8 |3 | |9 |3 | S14 |10 |2 | |11 |1 | |12 |0 | The document after removal of unwanted tags: S12 S13 S14 reading level tag Parsing the grammar... The parsed document: word XMLParser: parsed token information: |input |depth | xml form of input |0 |1 | |1 |2 | |2 |2 | word |3 |1 | |4 |0 | The document after removal of unwanted tags: word reading symbols reading context mapping ::dummy context hash table:> num_items_d = 3 ::dummy context hash table:> load_factor_d = 0.75 ::dummy context hash table:> capacity_d = 128 ::dummy context hash table:> alloc_d = SYSTEM ::0> index_d = 0 ::0> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 0 value_d = 0 ::1> index_d = 0 ::1> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 1 value_d = 1 ::2> index_d = 0 ::2> debug_level_d = none delay line: ::v_d> length_d = 1 ::v_d> capacity_d = 1 ::v_d> v_d[0] value_d = 2 value_d = 2 Level 0 Graph 0 S12 S13 S14 performing XML->ABNF conversion level 0 graph 0 preprocessing Handling repeat requests... The modified grammar: S12 S13 S14 performing conversion ABNF equivalent: word -> (((s12)+) ((s13)+) ((s14)+)) performing BNF->XML conversion level 0 graph 0 XML equivalent: one two diagnostics passed for class LanguageModelXML tests passed for class LanguageModelXML