Table of Contents Author Guidelines Submit a Manuscript
Computational and Mathematical Methods in Medicine
Volume 2013 (2013), Article ID 628036, 11 pages
Research Article

Structural Complexity of DNA Sequence

Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan

Received 10 January 2013; Accepted 3 March 2013

Academic Editor: Carlo Cattani

Copyright © 2013 Cheng-Yuan Liou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


In modern bioinformatics, finding an efficient way to allocate sequence fragments with biological functions is an important issue. This paper presents a structural approach based on context-free grammars extracted from original DNA or protein sequences. This approach is radically different from all those statistical methods. Furthermore, this approach is compared with a topological entropy-based method for consistency and difference of the complexity results.

1. Introduction

DNA sequence analysis becomes important part in modern molecular biology. DNA sequence is composed of four nucleotide bases—adenine (abbreviated A), cytosine (C), guanine (G), and thymine (T) in any order. With four different nucleotides, nucleotides could only code for maximum of amino acids, but nucleotides could code for a maximum amino acids. George Gamow was the first person to postulate that every three bases can translate to a single amino acid, called a codon. Marshall Nirenberg and Heinrich J. Matthaei were the first to elucidate the nature of a genetic code. A short DNA sequence can contain less genetic information, while lots of bases may contain much more genetic information, and any two nucleotides switch place may change the meaning of genetic messages.

Sequence arrangement can produce many different results, but only few codons exist in living bodies. Some sequences do not contain any information which is known as junk DNA. Finding an efficient way to analyze a sequence fragment corresponding to genetic functions is also a challenging problem.

In recent papers, methods broadly fall into two categories, sequence complexity [1, 2] and structural pattern analysis [38]. Koslicki [1] presented a method for computing sequence complexities. He redefined topological entropy function so that the complexity value will not converge toward zero for much longer sequences. With separate sequence into several segments, it can determine the segments where are exons or introns, and meaningful or meaningless. Hao et al. [7] given a graphical representation of DNA sequence, according to this paper, we can find some rare occurred subsequences. R. Zhang and C. T. Zhang [4] used four-nucleotide-related function drawing 3D curves graph to analyze the number of four-nucleotide occurrence probabilities. Liou et al. [9] had given a new idea in modeling complexity for music rhythms; this paper translated text messages into computable values, so computers can score for music rhythms.

In this paper, we propose a new method for calculating sequences different from other traditional methods. It holds not only statistical values but also structural information. We replace four nucleotides with tree structure presented in [9] and use mathematical tools to calculate complexity values of the sequences. So we can compare two sequences with values and determine dissimilarity between these two sequences. In biomedical section, we can use this technique to find the effective drugs for new virus with priority.

2. DNA Sequence Represented with Tree Structure

Our method uses Lindenmayer system [1012] property among calculated complexities from tree structure [9]; it is a different way of computing complexities of sequences. At first, we introduce DNA tree and convert DNA sequence to tree structure. A DNA tree is a binary tree of which each subtree is also a DNA tree. Every tree node is either a terminal node or a node with two childrens (branches or descendants).

Lindenmayer system is a powerful rewriting system used to model the growth processes of plant development. We will introduce it in Section 2.2 in detail. Lindenmayer system uses some initial and rewriting rules to construct beautiful graphs. Since it can construct a tree from rewriting rules, it also can extract rewriting rules from a tree. In this section, we will use tools to generate the rules from tree.

We use fixed tree representations for nucleotide bases A, T, C, and G (see Figure 1). When we apply this method to amino acid sequence, we can construct more tree representation for amino acids, respectively.

Figure 1: Nucleotide bases corresponding trees.

When we transfer a sequence to DNA tree, we will replace every word to tree elements step by step, and two consecutive trees can combine to a bigger tree. Following the previous steps, a DNA sequence will be transfer to a DNA tree (see Figure 2).

Figure 2: DNA sequence represented with tree structure.
2.1. Bracketed Strings for a DNA Sequence

For computing complexity of our DNA tree, we need some rules for converting tree to another structure. We use a stack similarly structure to represent the hierarchy of DNA tree, called bracketed string. DNA tree can transfer to a unique bracketed string by the following symbols, and it can transfer back to the original tree:(i) the current location of tree nodes; it can be replaced by any word or be omitted;(ii) the following string will express the right subtree;(iii) the following string will express the left subtree;(iv): this symbol is pairing with ; “” denotes a subtree where “”; indicates all the bracketed strings of its subtree;(v) see description.

Following the previous symbols, Figure 3 shows that nucleotide base A and T represented tree can transfer to and , respectively.

Figure 3: Bracketed strings representation for two trees.

And Figure 4 is the bracketed string of Figure 2. We can see that when the tree grows, string seems to be more redundant. Since we focus here only on DNA trees, we can simplify the bracketed string representations. First, our trees have only two subtrees. Second, the “” notation for the tree is trivial. With these two characteristics, we may omit the “” notation from the bracketed string and use only four symbols, , ], −, , to represent trees. In our cases, “” denotes a subtree where “” indicates all the bracketed strings of its subtrees. “−” indicated the next “” notation for a tree is a left subtree of current node, and “+” is a right subtree vice versa. Figure 5 is the simplified string of bracketed string shown in Figure 4.

Figure 4: Bracketed strings representation for Figure 2.
Figure 5: More simply bracketed strings representation for Figure 2.
2.2. DNA Sequence Represented with L-System

When we obtain DNA tree and bracketed string representation, we need rewriting rules for analyzing tree structure. There are some types of rewriting mechanism such as Chomsky grammar and Lindenmayer system (L-system for short). The largest difference between two string rewriting mechanisms lies in the technique used to apply productions. Chomsky grammar is suitable for applying productions sequentially, while L-system is for parallel. In our structure, applying L-system to our representations is better than Chomsky grammar.

The L-system was introduced by the biologist Lindenmayer in 1968 [13]. The central concept of the L-system is rewriting. In general, rewriting is a technique used to define complex objects by successively replacing parts of a simple initial object, using a set of rewriting rules or productions. In the next section, we will present how we use L-system to our DNA tree. The L-system is defined as follows.

Definition 1. L-system grammars are very similar to the Chomsky grammar, defined as a tuple [14]: where(i) is an alphabet,(ii) (start, axiom, or initiator) is a string of symbols from defining the initial state of the system,(iii) is defined by a production map with for each in . The identity production is assumed. These symbols are called constants or terminals.

2.3. Rewriting Rules for DNA Sequences

As discussed earlier, we want to generate the rules from DNA trees. In this section, we will explain how we apply rewriting rules to those trees. We can apply distinct variables to each node. Since the technique described previously always generates two subtrees for each node, for every nonterminal node, they always can be explained in the following format: where denotes the current node, denotes its left subtree, and denotes its right subtree, respectively. We give an example shown in Figure 6; left tree has three nodes and only root is nonterminal node, it can be rewritten as . Right tree has five nodes, root with left subtree and right subtree . Left subtree is terminal, but right is not. has two terminal subtrees and , so this tree can be rewritten as and .

Figure 6: Example of rewriting rules for trees.
2.4. Rewriting Rules for Bracketed Strings

Similarly, we can also use rewriting rules to generate bracketed strings. In rewriting rules for DNA trees shown in Section 2.3, we write for a tree with left and right subtrees. Note that we call and as the nonterminals. In this section, terminal nodes will be separated from trees, and we use “null” to represent a terminal. Such tree will have a corresponding bracketed string as follows: . “” represents the left subtree, while “” represents the right subtree. Therefore, we can replace the rewriting rules with where “” is the rewriting rule for the bracketed string of each subtree. For the sake of readability, we replace the words such as “” and “”. In Figure 7, we show the rewriting rules for the bracketed string of the tree in Figure 3.

Figure 7: Rewriting rules for the bracketed string of trees.

As we can see, there are “nulls" in the rules. Those “nulls” do not have significant effects to our algorithm, so we simply ignore the nulls. Now, Figure 3 can apply new rewriting rules without trivial nulls as Figure 8.

Figure 8: Rewriting rules for the bracketed string without nulls of trees.

When tree grows up, the rewriting rules may generate identical rules. Assume that we have the following rules: These rules can generate exactly one bracketed string and, thus, exactly one DNA tree. All these rules form a rule set that represents a unique DNA tree. When we look at and , they have the same structure since they both have a right subtree and do not have a left subtree. The only difference is that one of the subtrees is and that the other is . We will define two terms to express the similarity between two rewriting rules, and these terms can simplify complexity analysis.

2.5. Homomorphism and Isomorphism of Rewriting Rules

At the end of the previous section, we discussed that and are almost the same. How can we summarize or organize an effective feature to them? Liou et al. [9] gave two definitions to classify similar rewriting rules described before as follows.

Definition 2. Homomorphism in rewriting rules. We define that rewriting rule and rewriting rule are homomorphic to each other if and only if they have the same structure.

In detail, rewriting rule and rewriting rule in DNA trees both have subtrees in corresponding positions or both not. Ignoring all nonterminals, if rule and rule generate the same bracketed string, then they are homomorphic by definition.

Definition 3. Isomorphism on level in rewriting rules. Rewriting rule and rewriting rule are isomorphic on depth if they are homomorphic and their nonterminals are relatively isomorphic on depth . Isomorphic on level indicates homomorphism.

Applying to the bracketed string, we ignore all nonterminals in (4) as follows:

We find that , , , and are homomorphic to each other; they generate the same bracketed string, . But is not homomorphic to any of the other rules; its bracketed string is .

Let us recall DNA tree example in Figure 2; we will use this figure as an example to clarify these definitions. Now we marked some nodes shown in Figure 9; there are tree rooted at A, B, C, and D, respectively, tree A, tree B, tree C, and tree D. Tree A is isomorphic to tree C on depth 0 to 3, but they are not isomorphic on depth 4. Tree B is isomorphic to tree C on depth from 0 to 2, but they are not isomorphic on depth 3. D is not isomorphic to any other trees, nor is it homomorphic to any other trees.

Figure 9: Example of homomorphism and isomorphism.

After we define the similarity between rules by homomorphism and isomorphism, we can classify all the rules into different subsets, and every subset has the same similarity relation. Now we list all the rewriting rules of Figure 2 into Table 1 but ignore terminal rules such as “ null” and transfer rule’s name to class name (or class number). For example, we can give terminal rewriting rule a class, “ null”, and a rule link to two terminals; we can give them “"; here is the terminal class. After performing classification, we obtain not only a new rewriting rule set but also a context-free grammar, which can be converted to automata.

Table 1: Rewriting rules for the DNA tree in Figure 2.

In Table 1, rules such as , and and are isomorphic on depth 1 and assigned to Class 4. There are twenty such rules before classification, so we write “(20)”. Similar rules such as , , and are isomorphic on depth 0, and there are 47 such rules. They are all assigned to Class 1 by following a similar classification procedure. The classification of the all rules is listed in Table 2. Note that this section also presents a new way to convert a context-sensitive grammar to a context-free one.

Table 2: Classification based on the similarity of rewriting rules.

3. DNA Sequence Complexity

When we transfer the DNA sequence to the rewriting rules, and classify all those rules we attempt to explore the redundancy in the tree that will be the base for building the cognitive map [15]. We compute the complexity of the tree which those classified rules represent. We know that a classified rewriting rule set is also a context-free grammar, so there are some methods for computing complexity of rewriting rule as follows.

Definition 4. Topological entropy of a context-free grammar. The topological entropy of (context-free grammar) CFG can be evaluated by means of the following three procedures [16, 17].(1)For each variable with productions (in Greibach form), where are terminals and are nonterminals. The formal algebraic expression for each variable is (2)By replacing every terminal with an auxiliary variable , one obtains the generating function where is the number of words of length descending from .(3)Let be the largest one of , , for all . The previous series converges when . The topological entropy is given by the radius of convergence as

Our productions have some difference from the aforementioned definitions. First, our productions are written in Chomsky-reduced form instead of Greibach form. Second, DNA is finite sequence; it generates finite tree, but the previous formulas are applied on infinite sequences. For convenience in the DNA tree case, we rewrite the definition as follows [9].

Definition 5. Topological entropy of context free grammar for DNA tree.(1)Assume that there are classes of rules and that each class contains rules. Let , , and , where each has the following form: (2)The generating function of has a new form as follows: If does not have any nonterminal variables, we set .(3)After formulating the generating function , we intend to find the largest value of , at which converges. Note that we use to denote the rule for the root node of the DNA tree. After obtaining the largest value, , of , we set , the radius of convergence of . We define the complexity of the DNA tree as

Now we can do some examples of computation procedure for the complexity. According to our definition, the given values for the class parameters are listed in Table 3. There are five classes, so we obtain the formulas for , and successively. They are

Table 3: The values for the class parameters of Table 2.

Rearranging the previous equation for , we obtain a quadratic for :

Solving , we obtain the formula where

Finally, the radius of convergence, , and complexity, , can be obtained from this formula. But, computing the directly is difficult, so we use iterations and region tests to approximate the complexity; details are as follows.(1)Rewrite the generating function as (2)The value from to . When for all rules, we say that reach the convergence, but is not the we want. Here, we set for each iteration.(3)Now we can test whether is convergent or divergent at a number . We use binary search to test every real number between and ; in every test, when converges, we set bigger next time, but when diverges, we set smaller next time. Running more iterations will obtain more precise radius.

4. Results

In 2011, Koslicki [1] gave an efficient way to compute the topological entropy of DNA sequence. He used fixed length depending on subword size to compute topological entropy of sequence. For example, in Figure 10 (all DNA and amino acid data can be found in NCBI website,, the sequence length is characters, and there are three subword sizes , , and with blue, red, and green lines, respectively. For larger subword size, much larger fragment is required for complexity computation. The required fragment size grows exponentially, while the length of sequence is not dependent on the growth rate of subword size, so it is not a good method for us overall.

Figure 10: Koslicki method (topological entropy method, TE for short) example.

We present a new method called structural complexity in previous sections, and there are several benefits from using our method instead of Koslicki method, described as follows.(1)Our results are very different from those obtained by the topological entropy method; see the colored lines in Figures 1114. These figures showed that our method is much sensitive to certain arrangements of the elements in the sequence.(2)Two different characters that exchange position will change value since Koslicki method just calculates the statistical values without structural information. Result was shown in Figure 11 bottom chart; the test sequence repeats the same subword several times. For blue line, all complexity values from topological entropy are equal within the region of repeated subwords. For red line, complexity values depend on the structure of subword. When the fragment of sequence is different from each other, our method will evaluate to different values.(3)Our method can also calculate amino acid sequences. The Koslicki method depends on alphabet size and subword size, for example, in the basic length substring calculation; since standard amino acid types have up to , it requires a minimum length of to calculate, but the amino acid strings are usually very short. Sometimes, Koslicki method cannot compute the amino acid sequence efficiently. Figure 12 shows that complexity of amino acid sequence can also be calculated by our method.

Figure 11: Our method compared with TE using test sequences.
Figure 12: An amino acid sequence example, Bovine spongiform encephalopathy.

We also did experiments with lots of data, including fixed fragment size and fixed method on test sequences (see Figures 13 and 14). Here, we redefine the Koslicki method; the fragment size is no longer dependent on subword size. Instead, fixed length fragment like our method is applied. This change allows us to compare the data easier, and not restricted to the exponentially growing fragment size anymore. In Figure 13, we found that for larger fragment, the complexity curve will become smoothly because fragments for each data point contain more information. And we note that there is a common local peak value of those figures; the simple sequence region is big enough that our fragment size still contains the same simple sequence.

Figure 13: Compare with different methods.
Figure 14: Compare with different fragment sizes.

When we compare with the same method shown in Figure 14, we found the same situation more obviously. Thus, if we have many complexity values with different sizes, we have the opportunity to restore the portion of the DNA.

4.1. Application to Virus Sequences Database and Other Sequences

Now we can apply our technique to Chinese word sequences. Togawa et al. [18] gave a complexity of Chinese words, but his study was based on the number of strokes, which is different from our method. Here we use Big5 encoding for our system. Since the number of Chinese words is larger than , we cannot directly use words as alphabet, so we need some conversion. We read a Chinese word into four hexadecimal letters so that we can replace the sequence with tree representation and compute the complexity.

When it comes to biomedical section, we can create virus comparison database. Once a new virus or prion has been found, it will be easy to select corresponding drugs at the first time, according to cross comparison with each other by complexity in the database. We focus on most important viruses in recent years, such as Escherichia coli O157:H7 (E. coli o157), Enterovirus 71 (EV71), Influenza A virus subtype H1N1 (H1N1), Influenza A virus subtype H5N1 (H5N1), and severe acute respiratory syndrome (SARS). In recent years, these viruses have a significant impact and threat on the human world. We test these viruses and prions listed in Table 4. Here we can see that all prion regions cannot be analyzed by Koslicki method, but we can do it.

Table 4: Test data with topological entropy method and our method.

Finally, if any object can be written as a sequence, and there exists tree representation with alphabet of sequence, we can compute the complexity of the object.

5. Summary

In this paper, we give a method for computing complexity of DNA sequences. The traditional method focused on the statistical data or simply explored the structural complexity without value. In our method, we transform the DNA sequence to DNA tree with tree representations at first.

Then we transform the tree to context-free grammar format, so that it can be classified. Finally, we use redefined generating function and find the complexity values. We give a not only statistical but also structural complexity for DNA sequences, and this technique can be used in many important applications.


This work was supported by the National Science Council under project NSC 100-2221-E-002-234-MY3.


  1. D. Koslicki, “Topological entropy of DNA sequences,” Bioinformatics, vol. 27, no. 8, Article ID btr077, pp. 1061–1067, 2011. View at Publisher · View at Google Scholar · View at Scopus
  2. C. Cattani, G. Pierro, and G. Altieri, “Entropy and multi-fractality for the myeloma multiple tet 2 gene,” Mathematical Problems in Engineering, vol. 2012, Article ID 193761, 14 pages, 2012. View at Publisher · View at Google Scholar
  3. S. Manna and C. Y. Liou, “Reverse engineering approach in molecular evolution: simulation and case study with enzyme proteins,” in Proceedings of the International Conference on Bioinformatics & Computational Biology (BIOCOMP '06), pp. 529–533, 2006.
  4. R. Zhang and C. T. Zhang, “Z curves, an intutive tool for visualizing and analyzing the DNA sequences,” Journal of Biomolecular Structure and Dynamics, vol. 11, no. 4, pp. 767–782, 1994. View at Google Scholar · View at Scopus
  5. P. Tiño, “Spatial representation of symbolic sequences through iterative function systems,” IEEE Transactions on Systems, Man, and Cybernetics A, vol. 29, no. 4, pp. 386–393, 1999. View at Publisher · View at Google Scholar · View at Scopus
  6. C. K. Peng, S. V. Buldyrev, A. L. Goldberger et al., “Long-range correlations in nucleotide sequences,” Nature, vol. 356, no. 6365, pp. 168–170, 1992. View at Publisher · View at Google Scholar · View at Scopus
  7. B. L. Hao, H. C. Lee, and S. Y. Zhang, “Fractals related to long DNA sequences and complete genomes,” Chaos, solitons and fractals, vol. 11, no. 6, pp. 825–836, 2000. View at Publisher · View at Google Scholar · View at Scopus
  8. C. Cattani, “Fractals and hidden symmetries in DNA,” Mathematical Problems in Engineering, vol. 2010, Article ID 507056, 31 pages, 2010. View at Publisher · View at Google Scholar · View at Scopus
  9. C. Y. Liou, T. H. Wu, and C. Y. Lee, “Modeling complexity in musical rhythm,” Complexity, vol. 15, no. 4, pp. 19–30, 2010. View at Publisher · View at Google Scholar · View at Scopus
  10. P. Prusinkiewicz, “Score generation with lsystems,” in Proceedings of the International Computer Music Conference, pp. 455–457, 1986.
  11. P. Prusinkiewicz and A. Lindenmayer, The Algorithmic Beauty of Plants, Springer, New York, NY, USA, 1996.
  12. P. Worth and S. Stepney, “Growing music: musical interpretations of L-systems,” in Applications of Evolutionary Computing, vol. 3449 of Lecture Notes in Computer Science, pp. 545–550, Springer, Berlin, Germany, 2005. View at Google Scholar
  13. A. Lindenmayer, “Mathematical models for cellular interactions in development II. Simple and branching filaments with two-sided inputs,” Journal of Theoretical Biology, vol. 18, no. 3, pp. 300–315, 1968. View at Google Scholar · View at Scopus
  14. “Wikipedia: L-system—Wikipedia, the free encyclopedia,” 2012.
  15. H. Barlow, “Unsupervised learning,” Neural Computation, vol. 1, no. 3, pp. 295–311, 1989. View at Publisher · View at Google Scholar
  16. R. Badii and A. Politi, Complexity: Hierarchical Structures and Scaling in Physics, vol. 6, Cambridge University Press, Cambridge, UK, 1999.
  17. W. Kuich, “On the entropy of context-free languages,” Information and Control, vol. 16, no. 2, pp. 173–200, 1970. View at Google Scholar · View at Scopus
  18. T. Togawa, K. Otsuka, S. Hiki, and H. Kitaoka, “Complexity of chinese characters,” Forma, vol. 15, pp. 409–414, 2001. View at Google Scholar