Unregistered Biological Words Recognition by Q-Learning with Transfer Learning

Algorithm 2

Unregistered biological terms identification by Q-learning with transfer learning.

Input: action table from Table 1, state table from Table 2

Output: identification policy

(1) initialize 𝑄(𝑥,𝑢) arbitrarily

(2) repeat

(3) for  each episode

(4)  initialize x arbitrarily from Table 1

(5)  initialize u arbitrarily from Table 2

 with transfer learning version

(6)  select u from 𝑥^′ using ε-greedy policy with maximal identification precision by (7)

 without transfer learning version

(7)  select u from 𝑥^′ using ε-greedy policy with maximal identification precision by (4)

(8)  take action u, and observe r, 𝑥^′

(9)  𝑄𝑥_𝑘,𝑢_𝑘←𝑄𝑥_𝑘,𝑢_𝑘+𝛼𝑟_𝑘+1+𝛾max_𝑢𝑄𝑥_𝑘+1,𝑢−𝑄𝑥_𝑘,𝑢_𝑘

(10)   x ←𝑥^′

(11)  end for

(12) until terminated

(13) return identification policy