Learning algorithm's Implementation


I want to implement Dana Angluin’s learning algorithm. I have a problem in understanding an Observation Table. I can’t understand how this table is filling. Any one can help me in this way?
this is the angluin’s paper. Table is explained in page 10.

cse.iitk.ac.in/users/chitti/ … amples.pdf