Abstract
Small agglomerative microphone array systems have been proposed for use with speech communication and recognition systems. Blind source separation methods based on frequency domain independent component analysis have shown significant separation performance, and the microphone arrays are small enough to make them portable. However, the level of computational complexity involved is very high because the conventional signal collection and processing method uses 60 microphones. In this paper, we propose a band selection method based on magnitude squared coherence. Frequency bands are selected based on the spatial and geometric characteristics of the microphone array device which is strongly related to the dodecahedral shape, and the selected bands are nonuniformly spaced. The estimated reduction in the computational complexity is 90% with a 68% reduction in the number of frequency bands. Separation performance achieved during our experimental evaluation was 7.45 (dB) (signal-to-noise ratio) and 2.30 (dB) (cepstral distortion). These results show improvement in performance compared to the use of uniformly spaced frequency band.
1. Introduction
Speech communication and recognition systems are widely used in the present-day world, generally under reverberant and noisy conditions. An acoustic sound field is described by source signals and impulse responses which correspond to source locations and reflections, in other words, virtual source locations. The voice terminals are usually equipped with microphones, which are used to observe speech signals. In general, the observed signals include some source speech signals, mixed with each other and with the acoustic sound field. Extracting source signals and their locations, which is called encoding an acoustic field, is an important technique for acoustic schemes such as highly realistic communication and speech recognition systems. Blind source separation (BSS) is a useful method used to extract the sound source signals, and frequency domain independent component analysis (FDICA) [1] is one of the most commonly used BSS methods. FDICA achieves significant separation performance; however a permutation problem is one of the fundamental drawbacks to the use of FDICA. Various methods have been proposed to solve this permutation ambiguity such as [2–7] and include using power envelopes of separated signals at neighboring frequency channels, similarity between directivity patterns formed by a separation matrix, and large microphone arrays which surround sound sources. A correlation of power envelopes of separated signals can be observed at neighboring frequency channels under a condition that their frequencies are very close to each other. For wideband sound sources, it is difficult that this assumption can be satisfied.
A blind source separation method using a dodecahedral microphone array (DHMA) system for the acoustic field encoding has been proposed by Ogasawara et al. [8]. This method introduces a permutation solver based on a combination of amplitude and phase similarities. Experimental results under reverberant conditions show that significant improvement in separation performance can be achieved by using a dodecahedral shaped microphone array, which can effectively use amplitude differences obtained from the surfaces of the array for a permutation correction. However, the BSS method for DHMA uses FDICA to separate the sound sources, which involves a high degree of computational complexity for two reasons. A DHMA can include up to 160 microphones, resulting in a large separation matrix. Estimating the separation matrix requires a very large matrix calculation, and, furthermore, it must be performed with an iterative update. Solving the permutation problem requires calculation of all of the possible combinations of transfer function similarities via hierarchical clustering. Since voice terminals are generally implemented in embedded systems, in order to realize implementation in practical systems, computational complexity must be low. Therefore, it is very important and useful to discover a way to reduce computational complexity while achieving nearly equivalent performance to conventional methods used by speech communication and recognition systems.
For a faster convergence to estimate the separation matrix of FDICA, only a limited number of frequency bands with uniformly spaced intervals can be selected for the estimation [9]. The other bands are interpolated by a direction of arrival estimation and a null beamformer method, and the number of the frequency bands is increased with iterations. Closed-form ICA using second-order statistics (SOS) is most effective method to obtain the separation matrix [10]; however the separation performance is lower than nonclosed-form higher-order ICA. Therefore, the closed-form ICA is used to obtain initial matrix for the higher-order ICA in [11]. These methods are more effective than other methods previously proposed, although they cannot reduce the computational complexity of the permutation correction. A permutation-free ICA has also been proposed [12, 13]. This method considers all of the frequency bands as a single vector in order to estimate the separation matrix; therefore it does not need a permutation solver; however, the size of the matrix of the iterative update is much larger than that of conventional FDICA methods. Joint diagonalization using SOS is known as an efficient BSS algorithm such as [14–16]. DFT transformations in the iterative update prevent a complete decoupling of bandwise frequency components; in other words, this means that permutation solver is not required [16]. However, the backward and forward transformation must be applied in each iteration. On the other hand, to cope with the issue of high computational complexity, a BSS method which restricts the number of frequency bands has been previously proposed by the authors, and it has shown almost equivalent performance to unmodified FDICA [17–19].
In this paper, we propose a BSS method with a frequency band selection method suitable for a DHMA, in order to reduce computational complexity. This method uses the spatial characteristics of a DHMA, and results show separation performance nearly equivalent to the method proposed in [8]. The rest of the paper is organized as follows. In Section 2, we briefly introduce the conventional method. In Section 3, we introduce the proposed method based on the magnitude squared coherence of a DHMA and perform an estimation of computational complexity. In Section 4, we show the results of a source separation experiment using our proposed method. Section 5 presents our conclusions and describes future work.
2. Dodecahedral Microphone Source Separation
2.1. Dodecahedral Microphone Array
Figure 1 shows the dodecahedral microphone array (DHMA). Microphones are installed on ten faces, excluding the top and bottom faces, and 16 holes appear on each face. This means that the DHMA is an agglomerative microphone array; it is small enough that its portability can be considered an advantage. In addition, at each face of array the observed signals have different acoustic features, such as sound pressure levels, arrival times, and influence of diffraction waves. Our DHMA uses small omnidirectional microphones (SONY ECM-77B); six microphones are installed on each face because it is difficult to adjust the characteristics of the microphones in relation to one another. In the conventional method, microphone gain is also adjusted manually.
Characteristics of the DHMA are fully described in [8]; thus here we introduce them only briefly. The DHMA has two remarkable merits: amplitude differences on different faces and spatial aliasing. Firstly, amplitude differences between the microphones installed on different faces can be enlarged, even though the structure of the DHMA is small. Secondly, spatial aliasing related to spatial sampling is not easily achieved, even at high frequencies. In order to obtain large differences in sound pressure using conventional microphone arrays, large distances are needed between microphones or microphone arrays. If the DHMA faces the sound source, acoustic pressure on one of the faces is high, while pressures on the opposite faces are low. When the acoustic pressure distribution observed by the whole surface of the DHMA is compared with a spherical microphone array, the acoustic pressure difference is greater when obtained with a DHMA at frequencies above 6 kHz. This shows the advantage of the DHMA from the viewpoint of acoustic pressure difference.
2.2. Blind Source Separation Using DHMA
The conventional method of BSS is based on FDICA. The permutation problem is solved by the physical characteristics of the DHMA, namely, its dodecahedral shape. In addition, this method does not require prior information, such as the number of sound sources or source locations.
The number of the source signals is estimated using the eigenvalue of the spatial covariance matrix. The number of dimensions of FDICA is reduced using a subspace method (PCA) from the number of microphones. The separation matrix is estimated by FDICA, the scaling problem is solved using the projection method [20], and the permutation problem is solved by acoustic transfer function clustering. In the case of a DHMA, the transfer function clustering method results in significantly improved permutation correction under reverberant conditions; however this method involves a high degree of computational complexity due to similarity comparisons between all of the transfer functions.
3. Proposed Method
In this paper, we propose a method involving less computational complexity than the conventional method [8]. A block diagram is shown in Figure 2.
3.1. Frequency Band Selection Based on Spatial Coherence
To improve the efficiency and effectiveness of the frequency domain BSS method, frequency band selection has been proposed by the authors in [17–19]. This method showed significant reduction of computational complexity and equivalent performance compared to the unmodified BSS method. Although the classical FDICA algorithm is used in the experiment [17–19], it can be replaced with any state-of-the-art FDICA method with the permutation solver. In other words, the band selection method is not restrained by the update rule of FDICA, so there is no loss of generality.
3.1.1. Magnitude Square Coherence
When estimating the separation matrix of FDICA, it is very important that the training of the separation matrix is performed on highly separable frequency bands when using band selection method. In this paper, magnitude squared coherence (MSC) is considered as a method of selecting the separable frequency bands. MSC corresponds to a measure of the interference between two signals and is formulated as follows: where and are the power spectrums of and , respectively, and is a cross-spectrum. and denote frequency band index and frame index, respectively. is the expectation operator over frame . is MSC between two signals and in the frequency band . The formulation of MSC is the normalized cross-spectrum on each frequency band, and thus the range of MSC shows . In the case of a diffused noise field, MSC is formulated as follows: where means the sinc function (), is a sampling frequency, is the FFT size, is a microphone distance, and is the velocity of sound. A theoretical formulation of the diffused noise field is used to evaluate characteristics of the noise field condition [21] or to model the noise field for the postfiltering of the microphone array processing [22]. BSS conducted under the condition of multiple sources can be considered as a diffused noise field. A diffused noise field means that sound waves are randomly arriving from every possible direction, so that observed signals at two microphones have a variety of phase differences according to the direction of the sound sources. In the high frequency region, larger phase differences can be observed than in the low frequency region, and phase differences vary more widely. Therefore, weaker coherence characteristics are observed in the high frequency region, which results in MSC assuming smaller values. Consequently, MSC can evaluate the phase difference between two signals, and we can assume that MSC can contribute to increasing separation performance by allowing us to select frequency bands with small MSC values.
3.1.2. Characteristics of Magnitude Squared Coherence for a DHMA
In this section, we experimentally evaluate the effectiveness of using MSC for a DHMA. As mentioned in Section 2.1, the acoustic pressure distribution of a DHMA is different from that of spherical microphone arrays. In [8], this comparison was made experimentally because the shape of a DHMA makes it too complicated to evaluate this characteristic theoretically. For the same reason, we use experimental evaluation in the current study. Two microphones are arbitrarily selected from the 60 microphones of the DHMA (6 microphones are installed on each face), and the MSC of these two microphones is calculated using the measured impulse responses. The conditions used to evaluate the experimental MSC are shown in Table 1, and the position of loudspeakers and the DHMA are shown in Figure 3.
Figure 4 shows the MSC between two microphones on the same face of the DHMA (microphone distance 7 (mm)). A dashed line shows an experimental characteristic from the measured impulse response, and a solid line shows a theoretical characteristic which is formulated using the sinc function. Figure 5 shows MSC on different faces of the DHMA (microphone distance 42 (mm)). According to Figure 4, when both microphones are on the same face, the experimental MSC is equivalent to the theoretical MSC. On the other hand, when the microphones are on different faces, the experimental MSC is different from the theoretical value. This is due to the shape of the DHMA and the spatial aliasing resulting from the large distance between microphones.
3.1.3. Frequency Band Selection Using Magnitude Squared Coherence
Figure 6 shows the averaged experimental MSC (AEMSC) on the same face of the microphone and on the different faces, respectively. In this paper, we propose a band selection method based on the AEMSC. Small MSC values correspond to large phase differences, and thus selection should occur mainly in regions with small MSC values. In order to prevent a bias in which bands are selected, we consider three frequency regions based on MSC, which leads to the selection of a large number of bands with small MSC values. Figure 7 shows frequency regions . Boundary frequencies correspond to a mean of the AEMSC shown in Figure 7. is determined by the crosspoint between the AEMSC for the same face and its mean, and is determined in the same manner as the AEMSC of the other face. The values of and in this paper are 1016 (Hz) and 5040 (Hz), respectively.
In Section 4, the number of bands in each frequency region is used as a parameter to evaluate the proposed method. For example, the bands and are selected in regions , and , respectively, and the total number of frequency bands is 77, reduced from 200 bands, which correspond to the target frequency region 0–8 (kHz), with a sample of FFT 1024.
3.2. Estimating the Number of Source Signals and Dimension Reduction
The source signals are transferred from their locations to the DHMA, and a mixing matrix is described in frequency domain which is an matrix where and are the number of sources and microphones, respectively. The observed signal is represented by for frequency band index and frame index . and represent the observed and source signal vectors, respectively.
The BSS method using a DHMA is conducted under an overdetermined condition, because a DHMA can include up to 160 microphones. FDICA assumes that the number of source signals is equal to the number of the microphones, and thus an estimation of the number of source signals and a reduction in the number of observed signals are needed to perform FDICA. In addition, the reduced dimensions must exceed the number of actual sound sources, because not only actual sound source signals but also reflection waves are used in FDICA. The spatial covariance matrix is calculated by an expectation of the observed signal , and it is decomposed into eigenvalues. The number of virtual sound sources that include direct sound sources and early-reflected sources is estimated from eigenvalue diagonal matrix as follows: where denotes the operator at which all of matrix elements except diagonal elements are set to zero and is the th eigenvalue. This corresponds to the estimation of the number of sound sources with directivity, because such sound sources are spatially correlated. Normalization, whose summation of the eigenvalues is 1, is calculated at each frequency as follows:
The threshold for the normalized eigenvalues evaluates the number of virtual sound sources in each frequency band, and the maximum estimated value in all frequencies is assumed to be , because the number of estimated sound sources is different in each frequency band. Following the estimation of the number of virtual sources, eigenvectors, which are estimated with eigenvalues, are employed to reduce the number of observed signals using the subspace method. A more detailed description of the process explained previously is given in [8].
3.3. Frequency Domain Independent Component Analysis
Following estimation of the number of virtual sound sources and band selection based on the MSC, the observed signal is reduced to the dimension using the subspace method, and FDICA estimates separation matrix , but only in the selected bands, via an update rule with iteration [23] based on the principle presented in [24]. Separation matrix for actual separation is obtained through a combination of a subspace matrix and separation matrix . The separated signal is obtained as follows: The scaling problem is solved using the projection method [20]. Next, the number of dominant source signals in each frequency band is calculated from the separated signals via a threshold operation.
3.4. Permutation Solver Based on Acoustic Transfer Function Clustering
Solution of the permutation problem affects separation performance significantly, and Ogasawara et al. have proposed a method which combines the acoustic pressure distribution and the relative phase distance [8]. As mentioned in Section 1, the correlation of the separated signals is one of the most common method to solve the permutation problem; however, this method can be applied to narrow band signals that each frequency channel has a very close frequency. In addition, for the acoustic field encoding, not only the direct sound sources but also the early-reflected sources are considered as the source signals, and this implies that similar time differences from different locations are included in the separated signals. The correlation of these signals is very high, and it is difficult to solve the permutation based on the power envelopes of the separated signals. The method proposed in [8] significantly improves our ability to solve the permutation problem for a DHMA; however it uses transfer function clustering, which leads to a high level of computational complexity. In this section, we explain the method proposed by Ogasawara et al. briefly, and estimation of computational complexity is described when the band selection method is applied.
3.4.1. Acoustic Transfer Function Clustering
The Moore-Penrose pseudoinverse of the separation matrix corresponds to the mixing matrix; in other words, it corresponds to the transfer functions between the source signals and the observed signals. The transfer function is estimated as the th column vector of pseudoinverse .
Two similarities, acoustic pressure distribution for amplitude similarity and relative phase distance for phase similarity , are considered. As mentioned in Section 2, a DHMA has an acoustic pressure difference between each face, and the acoustic pressure distribution shows the characteristics of the directions of the sources. The acoustic pressure distribution is formulated as follows: where represents the set of microphones on the th face and is the transfer function between source and the th microphone on face . Amplitude similarity is formulated using acoustic pressure distribution with the th centroid as follows: Phase similarity is calculated using the normalized phase difference between two microphones, calculated from normalized time difference as follows: where is a normalization constant and means the operator which obtain an argument of a complex number. Consequently, the phase similarity is formulated as follows: where represents the complex conjugate and represents the th centroid of the th microphone. After the normalization of and via their mean and variance, respectively, the combined similarity on each frequency band for hierarchical clustering is calculated as follows: where is a parameter to adjust the phase similarity weighting and is a parameter to adjust the boundary frequency between the amplitude and phase similarities.
The similarity described in (10) is calculated with hierarchical clustering as the permutation correction of the BSS method for a DHMA. As mentioned earlier, high computational complexity is one of the drawbacks to performing hierarchical clustering for DHMA BSS. The band selection method mentioned in Section 3.1.3 contributes to reducing computational complexity, not only during estimation of the separation matrix but also during hierarchical clustering for the permutation solution. After permutation correction, the separation matrix on the nonselected bands is linearly interpolated from the separation matrix in the neighboring frequency bands, which has already been estimated. An interpolation of the mixing matrices, which could be estimated from the inverse matrix of the separation matrix, should be appropriate. However, the inverse matrix, which consumes order complexity ( means a -by- square matrix) [25], leads to additional computational complexity. Since the aim of this paper is the reduction of computational complexity, we therefore determine the interpolation of the separation matrix in the neighboring frequency bands as the separation matrix for the non-selected bands.
3.4.2. Estimation of Computational Complexity
In this section, computational complexity is estimated from order . In our previous papers [17–19], the number of operations, which is calculated using the number of floating operations of multiplication and addition, is used to evaluate computational complexity. From a practical viewpoint, this criterion is valuable for estimating the possibility of implementation with embedded devices, and in addition it is useful to estimate system requirements for manufacturers. On the other hand, especially when there are a large number of microphones, it is difficult to estimate complexity precisely using this method. The scaling ambiguity must be solved when source separation is performed with ICA; the projection method based on the Moore-Penrose pseudoinverse is applied in this paper. The pseudoinverse is obtained using the singular value decomposition (SVD). In our previous research, the assumed number of microphones was only two, the same as the number of source signals; therefore, estimation of the complexity of the projection method was obtained using inverse matrix. However, a DHMA has many microphones, and the source separation algorithm is based on the subspace method and FDICA. Mathematically, this is an overdetermined problem, as the inverse matrix cannot be calculated and the pseudoinverse must be appropriate. In addition, the proposed method uses hierarchical clustering to solve the permutation problem. Consequently, in this paper, is used to estimate computational complexity instead of counting the floating operations.
In general, eigenvalue decomposition (EVD) is solved by the Householder method (HHM) and the implicit shifted QL method (ISQL) [25]. In [25], the numerical calculation method for SVD is also introduced and consists of HHM and ISQL. Therefore, in our estimation, the computational complexity of the EVD and pseudoinverse can be estimated by HHM and ISQL. The computational complexity of HHM and ISQL is introduced as and respectively, in [25]. For hierarchical clustering, an efficient algorithm is introduced in [26], and the computational complexity is .
Estimated computational complexity is shown in Table 2 where (i): number of microphones, (ii): number of frames, (iii): FFT size, (iv): number of bands which correspond to the Nyquist frequency of speech signals, (v): number of subspaces, (vi): averaged number of separated source signals in each frequency band, (vii): number of iterations. An example, estimation is shown in Table 3 which is calculated from the order of in Table 2 using concrete numbers. is 60 as described in Section 2.1; six microphones are installed on each face, and the DHMA has ten faces for microphone arrays. In our experiments described in Section 4, some numbers are given in Table 1; is 625, which corresponds to the length of the source signals as 4 (sec) and is 1024. is 200 in the case of the full band (0–8 (kHz)) and 80 in the case of the proposed method (e.g., estimation). We assume that and are 25 and 15, respectively, via preliminary experiment. To simplify estimation, is not varied in every frequency band. Actual iteration is terminated by a convergence test; however to simplify the estimation, we consider that each iteration is 200 times. As shown in Table 3, total estimated complexity has the same order of complexity as hierarchical clustering. The proposed method results in an 84% reduction in computational complexity as a result of reducing number of frequency bands from 200 to 80; however, the number of frequency bands has only been reduced 60%. Hierarchical clustering is based on a bottom-up algorithm, and this is the reason for the large reduction in complexity. Hierarchical clustering needs to calculate similarities between all of the transfer functions, and thus computational complexity depends on the number of initial elements. The reduced complexity of the hierarchical clustering process results in a power of two reduction in complexity compared to reduction of the number of frequency bands.
3.4.3. Comparison to SOS-ICA
In Section 1, the joint diagonalization using SOS, TRINICON [15, 16] is one of the most common methods in this field, is introduced, and it has an advantage to prevent the complete decoupling of the bandwise frequency components; which means that the permutation solver is not required. This is a general way that in each iteration the update equation involves the backward and forward DFT transformation, equation (53) in [16]. This equation also includes a restricting operation for the time sequence of the separation filter, and this is due to the prevention of the complete decoupling of the bandwise frequency components by considering the linear convolution. Using the DFT transformations in the iterative update corresponds to using all of the frequency bands to estimate the separation matrix for linear convolution, even though the speech signal is limited up to 8 (kHz). In contrast, the proposed method allows circular convolution for the efficiency of the computational complexity. Equation (67) in [16] is the simplest update rule of TRINICON with some approximations. Under the same configuration of the estimation in Section 3.4.2, additional parameters for TRINICON are considered that FFT size is four times , the number of bands for the separation matrix is , the number of blocks for the joint diagonalization is , and the number of iterations . The computational complexity of the update rule equation (67) in [16] is , and it is predominant complexity of TRINICON as shown in Table 3. No permutation solver contributes to reduce the total computational complexity; however considering the separation filter in the time domain increases the computational complexity in the iterative update. Note that the author in [15] mentioned necessity of the permutation solver under the independent bandwise separation matrix estimation, and in addition they mentioned in [16] that the applied approximation to the update equation disturbs the perfect permutation correction; in other words, this means that the separation performance is degraded by these approximations. The proposed band selection method is evaluated in the following section, and this method contributes to the reduction of the computational complexity for the permutation solver in which the shape of DHMA is significantly reflected.
4. Experimental Evaluation
In this paper, we compare our proposed method with the conventional method because it is important to evaluate feasibility of the proposed method, which might represent a balance between separation performance and computational complexity.
4.1. Experimental Conditions and Evaluation Measures
The experimental conditions are the same as in Figure 3 and Table 1. The proposed band selection method might cause a degradation in separation performance as a result of the limited number of frequency bands. Separation performance is evaluated by improvement in the signal-to-interference ratio (): where represents the observed source signal on the th microphone and represents the output signal which corresponds to source signal . is averaged over all of the source signals. The other important factor is the quality of the separated sound. Segmental signal-to-noise ratio () is a very common measure for evaluating noise suppression. In general is known to have a better correlation with the perception of noisy speech by humans than entire interval [27]. The proposed method needs to obtain the separation matrix in the nonselected bands through interpolation from the estimated separation matrix in the selected bands, and the degradation of the separated signals can be estimated. Cepstral distortion () [28] is another measure of the degree of distortion via the cepstrum domain, and this can evaluate distortion of a spectral envelope. is formulated as follows: where is a frame number and is the number of frames used to evaluate . We calculate from speech components, and it is defined as follows: where is a frame number, is the index of the cepstrum coefficient and is the number of frames for . is the cepstrum coefficient, and is the number of dimensions of the cepstrum used in the evaluation; we set . and are also averaged over all of the source signals.
4.2. Experimental Results and Discussion
Results for each performance criterion are shown in Table 4. The first column shows the ratio of selected bands in each frequency region, for example, “(1/5,1/3,1/2)” means one-fifth for lowest frequency region , one-third for middle frequency region , and one-half for highest frequency region . Each region is divided into 1016 (Hz) and 5040 (Hz), respectively. The number of selected bands means the total number of selected frequency bands. Computational complexity is the ratio compared to using the full band, and the method of estimation of computational complexity is described in Section 3.4.2. Therefore, computational complexity is a feature of the number of selected bands in this paper. Figures 8, 9, and 10 show the performance of the proposed method. The -axis of each figure represents the ratio of computational complexity, and the -axis represents the evaluation criterion.
The configuration “(1,1,1)” in Table 4 corresponds to the conventional method proposed by Ogasawara et al. [8], and these results are shown at ratio 1.0 () point on the -axis of Figures 8–10. The shows the contribution to separation performance of a large number of selected bands. This result is assumed before the experiment. degrades as the number of selected bands decreases, and and show different characteristics of this degradation. They show that only a small degradation occurs under 1 (dB); in other words, and show almost equivalent performance using limited number of frequency bands. The proposed method is focused on a nonuniformly spaced selection of frequency bands. In addition, the aim of this nonuniformly spaced selection is to utilize the characteristics of the dodecahedral shape of the microphone array. When 64 bands were selected, of the proposed method shows almost 1 (dB) higher than in the case of uniformly spaced band selection. In particular, shows significant improvement. On the other hand, shows almost equivalent distortion to uniformly spaced band selection. The magnitude squared coherence, theoretically and experimentally described in Section 3.1, reflects this characteristic, which was confirmed by the separation performance results of the experiments; lower values of MSC contribute to separation performance, particularly in the high frequency region that the number of selected bands is larger than the others. Even though computational complexity is reduced by around 90% as compared to using the full band, the acoustic characteristics of the proposed method contribute to improving not only the separation performance but also the quality of the separated sound.
The proposed band selection method for the frequency domain BSS method is advantageous to achieve the trade-off between the separation performance with the significantly low degradation of the sound quality and the computational complexity. On the other hand, the degradation of the separation performance shows a disadvantage of the proposed method compared to the conventional method which uses all of the frequency bands. The joint diagonalization using SOS such as TRINICON shows less computational complexity, around 20% reduction in Section 3.4.3, than the BSS method using the permutation solver. When the number of microphones is small or the voice terminals have a high computation power, it is easy to perform TRINICON. However, the constraint of the linear convolution does not allow to reduce further computational complexity. The voice terminals are generally implemented in the embedded systems as mentioned in Section 1; the lower computational complexity is required to perform the BSS method. The proposed band selection method can reduce further computational complexity, and it is easy to achieve over 50% reduction.
5. Conclusion
A blind source separation method with efficient computational complexity for use with an agglomerative DHMA which can encode the acoustic field is proposed. The proposed band selection method uses the spatial characteristics of a DHMA, and a preliminary experiment on magnitude squared coherence describes the criterion of the band selection process. The proposed method uses nonuniformly spaced selection of frequency bands, which contributes to improved separation performance versus uniformly spaced band selection in experiments. Estimated computational complexity was greatly reduced during hierarchical clustering, and thus the total reduction in complexity achieved exceeds the reduction due to limitation of the number of the frequency bands. For example, if the number of frequency bands is reduced by 60%, the total reduction in computational complexity achieved is 84%. Experimental results of the proposed method show practical separation performance compared to the conventional method. In addition, equivalent signal distortion compared with the conventional method is maintained. Band selection is simply based on the spatial characteristics of the DHMA, and therefore any state-of-the-art frequency domain BSS method with the permutation solver can be applied to the proposed method without a loss of generality. However, the method proposed in this paper is only considered for use with an off-line algorithm; therefore future work includes developing an on-line causal method to reduce computational complexity.