Streaming Support for Data Intensive Cloud-Based Sequence Analysis

Figure 3

Software design pattern to support incremental data processing in the cloud. The client streams the data into the cloud cluster. The server monitors the received data buckets and manages the launch of analysis jobs on cluster nodes. After completion, the output data is either transferred back to the client machine or transferred to the user’s S3 account.