Refining Automatically Extracted Knowledge Bases Using Crowdsourcing

Algorithm 5

Question selection: TopologicalSorting.

Input:

Output: All vertices in are colored as Green or Red

  while  there exist uncolored vertices in   do

Do a topological sorting on the uncolored vertices in and obtain sets, ;

if    then

vertices in ;

else

select the optimal vertices according to ;

end if

Crowdsourcing in parallel and color ;

Remove the colored vertices;

 end while

 return colored