An Efficient Algorithm for Overcomplete Sparsifying Transform Learning with Signal Denoising

<div>Distribution of singular values of reference dictionary <svg height="8.68572pt" id="M499" style="vertical-align:-0.0498209pt" version="1.1" viewbox="-0.0498162 -8.6359 9.97754 8.68572" width="9.97754pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M719 146L691 147C666 77 657 72 612 72H528C572 125 688 224 688 364C688 546 558 665 384 665C212 665 77 541 77 361C77 221 188 124 239 72H150C110 72 97 80 73 147L46 146L63 0H307L314 18C284 71 178 203 178 360C178 529 256 631 383 631C509 631 588 523 588 363C588 197 485 67 453 18L458 0H701L719 146Z" id="g113-153"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="757" vert-adv-y="757"></glyph.data></g></svg>, <svg height="11.9316pt" id="M500" style="vertical-align:-3.2957pt" version="1.1" viewbox="-0.0498162 -8.6359 40.9196 11.9316" width="40.9196pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M719 146L691 147C666 77 657 72 612 72H528C572 125 688 224 688 364C688 546 558 665 384 665C212 665 77 541 77 361C77 221 188 124 239 72H150C110 72 97 80 73 147L46 146L63 0H307L314 18C284 71 178 203 178 360C178 529 256 631 383 631C509 631 588 523 588 363C588 197 485 67 453 18L458 0H701L719 146Z" id="g113-153"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="757" vert-adv-y="757"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,9.841,3.132)"><path d="M682 0V33C615 38 603 49 571 134C507 305 441 494 378 665L343 655L136 136C101 48 86 41 22 33V0H246V33C170 41 161 50 183 112C196 152 209 192 224 232H441C461 176 478 126 493 87C504 49 499 41 433 33V0H682ZM425 279H242C273 363 303 448 335 533H337L425 279Z" id="g58-63"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="703" vert-adv-y="703"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,16.238,3.132)"><path d="M676 0V33C628 38 606 47 555 101S396 279 321 373C388 440 457 509 495 545C556 601 582 609 660 617V650H412V617L436 615C479 608 479 601 452 566C405 510 345 447 289 394C258 366 239 353 216 348V518C216 605 226 612 305 617V650H40V617C123 612 130 605 130 518V131C130 46 121 38 44 33V0H310V33C226 38 216 46 216 131V318C235 322 249 319 274 290C367 181 444 84 520 0H676Z" id="g58-73"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="685" vert-adv-y="685"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,22.472,3.132)"><path d="M416 501L399 642C356 655 314 665 271 665C140 665 63 582 63 486C63 372 163 325 229 290C304 250 359 217 359 142C359 70 316 25 240 25C138 25 94 125 78 186L44 178C52 123 64 45 72 21C81 16 96 8 121 0S179 -15 220 -15C353 -15 445 68 445 176C445 289 350 335 270 375C191 414 143 449 143 520C143 572 177 627 253 627C340 627 366 556 382 495L416 501Z" id="g58-81"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="484" vert-adv-y="484"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,26.876,3.132)"><path d="M698 650H468V617C551 609 555 599 536 543C506 457 432 264 379 129H377C311 297 238 488 212 560C196 604 198 609 271 617V650H21V617C80 612 98 603 127 532C183 396 268 173 335 -9H370C445 196 551 450 578 511C615 602 630 609 698 617V650Z" id="g58-84"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="717" vert-adv-y="717"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,33.401,3.132)"><path d="M43 650V617C122 612 130 606 130 522V128C130 44 122 37 34 32V0H275C400 0 497 25 573 82C652 142 698 229 698 350C698 445 662 518 613 565C549 625 456 650 327 650H43ZM217 544C217 580 220 591 229 599C240 607 264 613 311 613C380 613 437 599 482 570C561 523 598 436 598 336C598 177 511 40 324 40C248 40 217 61 217 135V544Z" id="g58-66"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="744" vert-adv-y="744"></glyph.data></g></svg>, and <svg height="13.9365pt" id="M501" style="vertical-align:-5.3006pt" version="1.1" viewbox="-0.0498162 -8.6359 45.7697 13.9365" width="45.7697pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M719 146L691 147C666 77 657 72 612 72H528C572 125 688 224 688 364C688 546 558 665 384 665C212 665 77 541 77 361C77 221 188 124 239 72H150C110 72 97 80 73 147L46 146L63 0H307L314 18C284 71 178 203 178 360C178 529 256 631 383 631C509 631 588 523 588 363C588 197 485 67 453 18L458 0H701L719 146Z" id="g113-153"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="757" vert-adv-y="757"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,9.841,3.132)"><path d="M46 650V618C122 613 130 611 130 522V128C130 46 123 40 40 32V0H319V32C227 40 217 42 217 128V279L292 260C303 259 322 258 338 261C436 272 534 337 534 467C534 534 508 580 469 609C428 640 371 650 299 650H46ZM217 558C217 585 220 596 228 603C235 610 256 615 284 615C367 615 435 571 435 463C435 339 358 304 291 304C256 304 229 310 217 317V558Z" id="g58-78"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="573" vert-adv-y="573"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,14.982,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z" id="g58-112"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="380" vert-adv-y="380"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,18.331,3.132)"><path d="M262 451C169 451 38 375 38 210C38 98 121 -12 261 -12C360 -12 481 64 481 227C481 351 386 451 262 451ZM249 414C337 414 385 320 385 204C385 70 333 25 272 25C189 25 134 117 134 241C134 355 189 414 249 414Z" id="g58-109"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="519" vert-adv-y="519"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,22.953,3.132)"><path d="M173 382V461C125 442 68 425 25 418V390C88 382 92 382 92 317V-127C92 -191 84 -199 18 -204V-235H259V-204C180 -196 173 -192 173 -120V7C188 -1 212 -11 243 -12C375 12 495 109 495 261C495 361 427 451 316 451C303 451 283 446 266 435L173 382ZM173 345C200 365 243 388 274 388C346 388 409 329 409 222C409 111 353 40 266 40C231 40 196 56 173 79V345Z" id="g58-110"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="534" vert-adv-y="534"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,27.895,3.132)"><path d="M262 451C169 451 38 375 38 210C38 98 121 -12 261 -12C360 -12 481 64 481 227C481 351 386 451 262 451ZM249 414C337 414 385 320 385 204C385 70 333 25 272 25C189 25 134 117 134 241C134 355 189 414 249 414Z" id="g58-109"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="519" vert-adv-y="519"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,32.618,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z" id="g58-113"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="376" vert-adv-y="376"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,36.112,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z" id="g58-99"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="434" vert-adv-y="434"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,40.107,3.132)"><path d="M526 56L493 58C457 61 448 68 448 119V710C411 697 344 682 288 675V646C362 641 367 639 367 573V439C344 448 315 451 300 451C164 451 40 342 40 202C40 61 147 -12 227 -12C239 -12 266 -7 305 16L367 53V-12C427 10 505 21 526 26V56ZM367 88C342 69 306 54 271 54C207 54 133 111 133 229C133 373 219 409 264 409C301 409 342 394 367 359V88Z" id="g58-98"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="538" vert-adv-y="538"></glyph.data></g></svg> for the noisy case.</div>

Mathematical Problems in Engineering

fig5

Figure 5

Figure 5: An Efficient Algorithm for Overcomplete Sparsifying Transform Learning with Signal Denoising 