A New Algorithm for Sketch-Based Fashion Image Retrieval Based on Cross-Domain Transformation

<div>An overview of our proposed sketch-based fashion image retrieval model based on cross-domain transformation.<svg height="11.8161pt" id="M5" style="vertical-align:-3.291121pt" version="1.1" viewbox="-0.0498162 -8.52498 27.1559 11.8161" width="27.1559pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,2.175,0)"><path d="M517 162C503 123 484 88 467 68C445 42 417 34 341 34C291 34 256 34 237 47C219 59 213 81 213 128V317H308C395 317 402 311 415 240H444V431H415C403 364 398 356 307 356H213V584C213 613 215 616 246 616H322C394 616 421 609 435 587C448 566 458 544 467 502L496 506C493 557 488 625 488 650H42V622C120 616 128 612 128 523V125C128 43 120 35 29 28V0H511C520 31 540 125 546 158L517 162Z"></path></g><g transform="matrix(.013,0,0,-0.013,9.559,0)"><path d="M524 0V26C466 32 460 36 460 104V297C460 393 411 449 331 449C302 449 276 437 248 419C223 402 201 387 181 372V451C137 432 90 420 42 411V388C96 378 102 374 102 310V104C102 38 97 33 29 26V0H246V26C187 32 181 36 181 104V339C211 365 250 390 290 390C357 390 381 345 381 276V109C381 40 374 32 315 26V0H524Z"></path></g><g transform="matrix(.013,0,0,-0.013,16.618,0)"><path d="M390 111C344 68 312 56 269 56C212 56 118 102 118 241C118 346 175 401 241 401C277 401 312 388 342 360C350 352 355 349 361 349C372 349 394 371 394 392C394 403 391 411 378 422C362 436 329 449 288 449H287C250 449 190 432 138 392C71 341 37 274 37 197C37 90 112 -12 238 -12C297 -12 363 32 407 90L390 111Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.192,3.132)"><path d="M463 633C453 636 427 644 417 648C388 660 349 667 316 667C183 667 100 592 100 483C100 398 176 335 223 305L259 282C321 242 358 203 358 149C358 66 301 22 234 22C110 22 70 131 57 208L24 205L28 48C51 23 128 -17 215 -17C342 -17 446 60 446 174C446 262 394 310 317 361L284 383C229 420 183 455 183 515C183 569 222 628 298 628C384 628 418 563 428 481L461 487C459 527 458 593 463 633Z"></path></g></svg> and <svg height="11.7065pt" id="M6" style="vertical-align:-3.18152pt" version="1.1" viewbox="-0.0498162 -8.52498 26.2959 11.7065" width="26.2959pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M517 162C503 123 484 88 467 68C445 42 417 34 341 34C291 34 256 34 237 47C219 59 213 81 213 128V317H308C395 317 402 311 415 240H444V431H415C403 364 398 356 307 356H213V584C213 613 215 616 246 616H322C394 616 421 609 435 587C448 566 458 544 467 502L496 506C493 557 488 625 488 650H42V622C120 616 128 612 128 523V125C128 43 120 35 29 28V0H511C520 31 540 125 546 158L517 162Z"></path></g><g transform="matrix(.013,0,0,-0.013,7.384,0)"><path d="M524 0V26C466 32 460 36 460 104V297C460 393 411 449 331 449C302 449 276 437 248 419C223 402 201 387 181 372V451C137 432 90 420 42 411V388C96 378 102 374 102 310V104C102 38 97 33 29 26V0H246V26C187 32 181 36 181 104V339C211 365 250 390 290 390C357 390 381 345 381 276V109C381 40 374 32 315 26V0H524Z"></path></g><g transform="matrix(.013,0,0,-0.013,14.443,0)"><path d="M390 111C344 68 312 56 269 56C212 56 118 102 118 241C118 346 175 401 241 401C277 401 312 388 342 360C350 352 355 349 361 349C372 349 394 371 394 392C394 403 391 411 378 422C362 436 329 449 288 449H287C250 449 190 432 138 392C71 341 37 274 37 197C37 90 112 -12 238 -12C297 -12 363 32 407 90L390 111Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,20.017,3.132)"><path d="M622 479C622 589 545 650 400 650H146L140 618C229 609 230 602 215 527L135 132C117 43 112 41 27 32L18 0H305L313 32C213 40 205 44 222 132L251 284L324 262H365C484 269 622 333 622 479ZM528 477C528 356 420 305 344 305C300 305 276 314 259 321L303 554C311 597 313 600 331 606C345 611 361 614 379 614C463 614 528 580 528 477Z"></path></g></svg> are encoders. <svg height="12.0444pt" id="M7" style="vertical-align:-3.29106pt" version="1.1" viewbox="-0.0498162 -8.75334 27.0815 12.0444" width="27.0815pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M692 302H438V274C537 267 543 260 543 188V103C543 61 531 48 511 37C489 26 458 20 424 20C231 20 146 188 146 333C146 517 258 630 411 630C507 630 582 597 606 474L634 480C627 546 622 601 619 636C586 643 510 665 426 665C230 665 44 552 44 321C44 122 191 -15 411 -15C491 -15 573 7 635 21C629 49 628 81 628 116V202C628 261 632 266 692 274V302Z"></path></g><g transform="matrix(.013,0,0,-0.013,9.399,0)"><path d="M380 106C343 72 306 56 265 56C195 56 116 112 115 248C235 252 361 262 377 265C396 269 400 277 400 297C400 374 333 449 250 449H249C198 449 144 421 103 376S37 269 37 201C37 88 109 -12 232 -12C263 -12 332 6 395 84L380 106ZM225 412C281 412 315 364 314 312C314 297 308 292 290 292C232 290 176 289 120 289C135 370 180 412 225 412Z"></path></g><g transform="matrix(.013,0,0,-0.013,14.924,0)"><path d="M524 0V26C466 32 460 36 460 104V297C460 393 411 449 331 449C302 449 276 437 248 419C223 402 201 387 181 372V451C137 432 90 420 42 411V388C96 378 102 374 102 310V104C102 38 97 33 29 26V0H246V26C187 32 181 36 181 104V339C211 365 250 390 290 390C357 390 381 345 381 276V109C381 40 374 32 315 26V0H524Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.118,3.132)"><path d="M463 633C453 636 427 644 417 648C388 660 349 667 316 667C183 667 100 592 100 483C100 398 176 335 223 305L259 282C321 242 358 203 358 149C358 66 301 22 234 22C110 22 70 131 57 208L24 205L28 48C51 23 128 -17 215 -17C342 -17 446 60 446 174C446 262 394 310 317 361L284 383C229 420 183 455 183 515C183 569 222 628 298 628C384 628 418 563 428 481L461 487C459 527 458 593 463 633Z"></path></g></svg> and <svg height="11.9348pt" id="M8" style="vertical-align:-3.18146pt" version="1.1" viewbox="-0.0498162 -8.75334 28.3968 11.9348" width="28.3968pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M692 302H438V274C537 267 543 260 543 188V103C543 61 531 48 511 37C489 26 458 20 424 20C231 20 146 188 146 333C146 517 258 630 411 630C507 630 582 597 606 474L634 480C627 546 622 601 619 636C586 643 510 665 426 665C230 665 44 552 44 321C44 122 191 -15 411 -15C491 -15 573 7 635 21C629 49 628 81 628 116V202C628 261 632 266 692 274V302Z"></path></g><g transform="matrix(.013,0,0,-0.013,9.399,0)"><path d="M380 106C343 72 306 56 265 56C195 56 116 112 115 248C235 252 361 262 377 265C396 269 400 277 400 297C400 374 333 449 250 449H249C198 449 144 421 103 376S37 269 37 201C37 88 109 -12 232 -12C263 -12 332 6 395 84L380 106ZM225 412C281 412 315 364 314 312C314 297 308 292 290 292C232 290 176 289 120 289C135 370 180 412 225 412Z"></path></g><g transform="matrix(.013,0,0,-0.013,14.924,0)"><path d="M524 0V26C466 32 460 36 460 104V297C460 393 411 449 331 449C302 449 276 437 248 419C223 402 201 387 181 372V451C137 432 90 420 42 411V388C96 378 102 374 102 310V104C102 38 97 33 29 26V0H246V26C187 32 181 36 181 104V339C211 365 250 390 290 390C357 390 381 345 381 276V109C381 40 374 32 315 26V0H524Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.118,3.132)"><path d="M622 479C622 589 545 650 400 650H146L140 618C229 609 230 602 215 527L135 132C117 43 112 41 27 32L18 0H305L313 32C213 40 205 44 222 132L251 284L324 262H365C484 269 622 333 622 479ZM528 477C528 356 420 305 344 305C300 305 276 314 259 321L303 554C311 597 313 600 331 606C345 611 361 614 379 614C463 614 528 580 528 477Z"></path></g></svg> are generators. <svg height="11.8161pt" id="M9" style="vertical-align:-3.291121pt" version="1.1" viewbox="-0.0498162 -8.52498 22.8015 11.8161" width="22.8015pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M43 650V622C120 616 128 612 128 526V124C128 39 120 33 34 27V0H270C392 0 492 25 567 83C643 141 690 230 690 350C690 444 655 517 605 565C543 625 450 650 323 650H43ZM213 547C213 587 217 598 226 604C236 612 262 617 304 617C371 617 429 604 474 576C554 529 592 439 592 336C592 176 505 36 319 36C246 36 213 55 213 131V547Z"></path></g><g transform="matrix(.013,0,0,-0.013,9.555,0)"><path d="M135 536C164 536 186 560 186 587C186 617 164 639 136 639C109 639 85 617 85 587C85 560 109 536 135 536ZM252 0V26C188 32 181 38 181 106V451C138 433 90 420 39 412V388C99 379 102 374 102 312V106C102 38 95 32 32 26V0H252Z"></path></g><g transform="matrix(.013,0,0,-0.013,13,0)"><path d="M319 325C317 349 306 409 297 431C277 440 250 449 209 449C117 449 57 389 57 319C57 243 122 209 182 182C232 159 261 135 261 91C261 48 227 21 190 21C130 21 85 79 68 145L41 140C41 104 51 36 58 22C75 7 121 -12 172 -12C252 -12 337 35 337 126C337 195 286 231 210 262C166 281 126 304 126 348C126 388 152 417 191 417C240 417 274 378 294 318L319 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,17.838,3.132)"><path d="M463 633C453 636 427 644 417 648C388 660 349 667 316 667C183 667 100 592 100 483C100 398 176 335 223 305L259 282C321 242 358 203 358 149C358 66 301 22 234 22C110 22 70 131 57 208L24 205L28 48C51 23 128 -17 215 -17C342 -17 446 60 446 174C446 262 394 310 317 361L284 383C229 420 183 455 183 515C183 569 222 628 298 628C384 628 418 563 428 481L461 487C459 527 458 593 463 633Z"></path></g></svg> and <svg height="11.7065pt" id="M10" style="vertical-align:-3.18152pt" version="1.1" viewbox="-0.0498162 -8.52498 24.1168 11.7065" width="24.1168pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M43 650V622C120 616 128 612 128 526V124C128 39 120 33 34 27V0H270C392 0 492 25 567 83C643 141 690 230 690 350C690 444 655 517 605 565C543 625 450 650 323 650H43ZM213 547C213 587 217 598 226 604C236 612 262 617 304 617C371 617 429 604 474 576C554 529 592 439 592 336C592 176 505 36 319 36C246 36 213 55 213 131V547Z"></path></g><g transform="matrix(.013,0,0,-0.013,9.555,0)"><path d="M135 536C164 536 186 560 186 587C186 617 164 639 136 639C109 639 85 617 85 587C85 560 109 536 135 536ZM252 0V26C188 32 181 38 181 106V451C138 433 90 420 39 412V388C99 379 102 374 102 312V106C102 38 95 32 32 26V0H252Z"></path></g><g transform="matrix(.013,0,0,-0.013,13,0)"><path d="M319 325C317 349 306 409 297 431C277 440 250 449 209 449C117 449 57 389 57 319C57 243 122 209 182 182C232 159 261 135 261 91C261 48 227 21 190 21C130 21 85 79 68 145L41 140C41 104 51 36 58 22C75 7 121 -12 172 -12C252 -12 337 35 337 126C337 195 286 231 210 262C166 281 126 304 126 348C126 388 152 417 191 417C240 417 274 378 294 318L319 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,17.838,3.132)"><path d="M622 479C622 589 545 650 400 650H146L140 618C229 609 230 602 215 527L135 132C117 43 112 41 27 32L18 0H305L313 32C213 40 205 44 222 132L251 284L324 262H365C484 269 622 333 622 479ZM528 477C528 356 420 305 344 305C300 305 276 314 259 321L303 554C311 597 313 600 331 606C345 611 361 614 379 614C463 614 528 580 528 477Z"></path></g></svg> are discriminator. The red solid arrows represent the sketch-based fashion sketch retrieval stream, and the blue dotted arrows represent the sketch-based fashion photo retrieval stream.</div>

Wireless Communications and Mobile Computing

fig2

Figure 2

Figure 2: A New Algorithm for Sketch-Based Fashion Image Retrieval Based on Cross-Domain Transformation 