Three-Step Epipolar-Based Visual Servoing for Nonholonomic Robot with FOV Constraint

<table class="table-group" width="800px"><tr class="fig-image" id="a"><td><img alt="638539.fig.009a" src="https://static.hindawi.com/articles/jam/volume-2014/638539/figures/638539.fig.009a.jpg"/></td></tr><tr class="fig-caption"><td align="center"><table><tr><td><b>(a) </b>The epipole of current configuration <svg height="9.44714pt" id="M248" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 15.6524 9.44714" width="15.6524pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M490 97L476 124C442 96 405 70 398 70C392 70 390 78 396 114C419 243 448 379 463 432L457 436C446 436 431 439 418 442C393 447 368 451 343 451C281 451 204 418 155 381C74 320 24 206 24 107C24 23 59 -12 88 -12C118 -12 155 5 191 34C236 70 290 122 328 177H330L312 84C296 0 311 -12 331 -12C355 -12 425 24 490 97ZM374 387C371 367 360 299 347 264C323 202 187 53 142 53C128 53 113 73 113 120C113 224 157 332 221 380C241 395 274 403 303 403C330 403 360 395 374 387Z" id="g50-98"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="514" vert-adv-y="514"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.417,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg> and desired configuration <svg height="9.44714pt" id="M249" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 16.1252 9.44714" width="16.1252pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M538 684C542 703 539 710 529 710C512 710 455 682 363 674L361 644H396C444 644 448 642 438 594L405 438C373 450 347 451 336 451C288 451 200 416 147 374C69 312 24 207 24 113C24 29 60 -12 94 -12C126 -12 156 4 196 30C231 53 296 100 346 166H348L328 81C311 10 325 -12 348 -12C380 -12 450 24 512 98L495 125C466 97 431 70 417 70C408 70 408 80 411 98L538 684ZM390 373L361 240C336 196 210 56 145 56C132 56 113 73 113 131C113 216 156 338 220 379C243 394 266 402 303 402C331 402 375 388 390 373Z" id="g50-101"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="564" vert-adv-y="564"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.89,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg></td></tr></table></td></tr><tr class="fig-image" id="b"><td><img alt="638539.fig.009b" src="https://static.hindawi.com/articles/jam/volume-2014/638539/figures/638539.fig.009b.jpg"/></td></tr><tr class="fig-caption"><td align="center"><table><tr><td><b>(b) </b>The linear velocity of the robot <svg height="9.3561pt" id="M250" style="vertical-align:-3.26375pt" version="1.1" viewbox="0 -6.09235 10.6746 9.3561" width="10.6746pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0136,0,0,-0.0136,0,0)"><path d="M219 86C216 168 211 250 206 337C201 410 189 448 163 448C131 448 79 396 43 344L60 322C91 359 110 375 118 375S132 358 136 298C141 238 152 81 155 -12H182C242 62 331 177 390 258C435 321 451 360 451 391C450 424 432 448 408 448C390 448 372 435 366 419C362 410 362 401 366 394C373 383 376 367 376 350C376 283 262 138 221 86H219Z" id="g185-40"></path><glyph.data ascent="989" descent="-303" horiz-adv-x="447" vert-adv-y="447"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,6.056,3.264)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z" id="g50-50"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="487" vert-adv-y="487"></glyph.data></g></svg> and angular velocity of the robot <svg height="9.3561pt" id="M251" style="vertical-align:-3.26375pt" version="1.1" viewbox="0 -6.09235 10.6746 9.3561" width="10.6746pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0136,0,0,-0.0136,0,0)"><path d="M219 86C216 168 211 250 206 337C201 410 189 448 163 448C131 448 79 396 43 344L60 322C91 359 110 375 118 375S132 358 136 298C141 238 152 81 155 -12H182C242 62 331 177 390 258C435 321 451 360 451 391C450 424 432 448 408 448C390 448 372 435 366 419C362 410 362 401 366 394C373 383 376 367 376 350C376 283 262 138 221 86H219Z" id="g185-40"></path><glyph.data ascent="989" descent="-303" horiz-adv-x="447" vert-adv-y="447"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,6.056,3.264)"><path d="M414 144C384 79 371 75 317 75H135L276 221C367 316 408 376 408 465C408 570 327 635 237 635C179 635 131 609 100 575L42 494L67 471C94 510 138 565 205 565C277 565 321 517 321 435C321 348 258 270 195 195C146 137 88 81 33 26V0H411C423 44 433 88 446 135L414 144Z" id="g50-51"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="487" vert-adv-y="487"></glyph.data></g></svg></td></tr></table></td></tr></table>

<table>The second step. (a) The epipole of current configuration <svg height="9.44714pt" id="M242" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 15.6524 9.44714" width="15.6524pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M490 97L476 124C442 96 405 70 398 70C392 70 390 78 396 114C419 243 448 379 463 432L457 436C446 436 431 439 418 442C393 447 368 451 343 451C281 451 204 418 155 381C74 320 24 206 24 107C24 23 59 -12 88 -12C118 -12 155 5 191 34C236 70 290 122 328 177H330L312 84C296 0 311 -12 331 -12C355 -12 425 24 490 97ZM374 387C371 367 360 299 347 264C323 202 187 53 142 53C128 53 113 73 113 120C113 224 157 332 221 380C241 395 274 403 303 403C330 403 360 395 374 387Z" id="g50-98"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="514" vert-adv-y="514"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.417,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg> and the epipole of desired configuration <svg height="9.44714pt" id="M243" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 16.1252 9.44714" width="16.1252pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M538 684C542 703 539 710 529 710C512 710 455 682 363 674L361 644H396C444 644 448 642 438 594L405 438C373 450 347 451 336 451C288 451 200 416 147 374C69 312 24 207 24 113C24 29 60 -12 94 -12C126 -12 156 4 196 30C231 53 296 100 346 166H348L328 81C311 10 325 -12 348 -12C380 -12 450 24 512 98L495 125C466 97 431 70 417 70C408 70 408 80 411 98L538 684ZM390 373L361 240C336 196 210 56 145 56C132 56 113 73 113 131C113 216 156 338 220 379C243 394 266 402 303 402C331 402 375 388 390 373Z" id="g50-101"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="564" vert-adv-y="564"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.89,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg> in the second step. The <svg height="9.44714pt" id="M244" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 15.6524 9.44714" width="15.6524pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M490 97L476 124C442 96 405 70 398 70C392 70 390 78 396 114C419 243 448 379 463 432L457 436C446 436 431 439 418 442C393 447 368 451 343 451C281 451 204 418 155 381C74 320 24 206 24 107C24 23 59 -12 88 -12C118 -12 155 5 191 34C236 70 290 122 328 177H330L312 84C296 0 311 -12 331 -12C355 -12 425 24 490 97ZM374 387C371 367 360 299 347 264C323 202 187 53 142 53C128 53 113 73 113 120C113 224 157 332 221 380C241 395 274 403 303 403C330 403 360 395 374 387Z" id="g50-98"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="514" vert-adv-y="514"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.417,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg> and <svg height="9.44714pt" id="M245" style="vertical-align:-3.37755pt" version="1.1" viewbox="0 -6.06959 16.1252 9.44714" width="16.1252pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,5.541,3.264)"><path d="M538 684C542 703 539 710 529 710C512 710 455 682 363 674L361 644H396C444 644 448 642 438 594L405 438C373 450 347 451 336 451C288 451 200 416 147 374C69 312 24 207 24 113C24 29 60 -12 94 -12C126 -12 156 4 196 30C231 53 296 100 346 166H348L328 81C311 10 325 -12 348 -12C380 -12 450 24 512 98L495 125C466 97 431 70 417 70C408 70 408 80 411 98L538 684ZM390 373L361 240C336 196 210 56 145 56C132 56 113 73 113 131C113 216 156 338 220 379C243 394 266 402 303 402C331 402 375 388 390 373Z" id="g50-101"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="564" vert-adv-y="564"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,10.89,3.264)"><path d="M528 97L513 125C484 95 440 68 431 68C425 68 421 76 427 107C449 227 476 342 505 451H495L418 424L385 278C338 191 220 62 157 62C145 62 133 76 145 130L200 368C215 434 210 451 183 451C157 451 92 418 24 352L37 324C78 356 106 377 115 377C123 377 122 364 116 340L64 115C58 89 56 68 56 52C56 2 78 -12 103 -12C127 -12 159 -4 190 18C247 59 309 113 366 187H368L351 108C328 1 348 -12 368 -12C403 -12 472 33 528 97Z" id="g50-118"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="552" vert-adv-y="552"></glyph.data></g></svg> will be zero in finite time. (b) The linear velocity of the robot <svg height="9.33334pt" id="M246" style="vertical-align:-3.26375pt" version="1.1" viewbox="0 -6.06959 11.8397 9.33334" width="11.8397pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M515 96L502 119C471 88 431 62 423 62C416 62 411 70 417 101C440 223 469 341 497 448H486L412 422L380 277C330 188 210 57 152 57C137 57 126 69 139 124L195 366C210 431 205 448 182 448C155 448 89 413 23 350L36 326C73 354 103 376 112 376C118 376 118 365 113 340L61 118C54 90 52 68 52 51C52 0 75 -12 98 -12S151 -3 181 17C242 58 305 119 362 193H364L345 104C323 3 339 -12 359 -12C390 -12 464 35 515 96Z" id="g113-118"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="538" vert-adv-y="538"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,7.221,3.264)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z" id="g50-50"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="487" vert-adv-y="487"></glyph.data></g></svg> and angular velocity of the robot <svg height="9.33334pt" id="M247" style="vertical-align:-3.26375pt" version="1.1" viewbox="0 -6.06959 11.8397 9.33334" width="11.8397pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0135,0,0,-0.0135,0,0)"><path d="M515 96L502 119C471 88 431 62 423 62C416 62 411 70 417 101C440 223 469 341 497 448H486L412 422L380 277C330 188 210 57 152 57C137 57 126 69 139 124L195 366C210 431 205 448 182 448C155 448 89 413 23 350L36 326C73 354 103 376 112 376C118 376 118 365 113 340L61 118C54 90 52 68 52 51C52 0 75 -12 98 -12S151 -3 181 17C242 58 305 119 362 193H364L345 104C323 3 339 -12 359 -12C390 -12 464 35 515 96Z" id="g113-118"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="538" vert-adv-y="538"></glyph.data></g><g transform="matrix(.0095,0,0,-0.0095,7.221,3.264)"><path d="M414 144C384 79 371 75 317 75H135L276 221C367 316 408 376 408 465C408 570 327 635 237 635C179 635 131 609 100 575L42 494L67 471C94 510 138 565 205 565C277 565 321 517 321 435C321 348 258 270 195 195C146 137 88 81 33 26V0H411C423 44 433 88 446 135L414 144Z" id="g50-51"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="487" vert-adv-y="487"></glyph.data></g></svg> in the second step.</table>

Journal of Applied Mathematics

fig9

Figure 9

Figure 9: Three-Step Epipolar-Based Visual Servoing for Nonholonomic Robot with FOV Constraint 