Image Enlargement Using Multiple SensorsView this Special Issue
Research Article | Open Access
RS485 Image Sensor for Digital Cinema System
To activate various devices using RS485, a repeater is generally used. In current digital cinema systems, each device is controlled with RS485 by mixing RS485 and DMX512. However, as today’s cinema equips hundreds of 4D chairs and the environmental directors, it is nearly infeasible for the legacy system to control. To this end, this paper designs and implements a new system which makes hundreds of 4D chairs and the environmental directors be controlled simultaneously exploiting RS485 network topology and its repeaters. The proposed approach is tested in a real-time system for assessing the performance by Paessler Router Traffic Grapher (PRTG) in Windows environment. Simulation results show that the tested system supports 4D chairs and their motions are well operated simultaneously with RS485.
A digital cinema indicates the usage of digital technology to deliver and present motion pictures in contrast to the historical usage of motion picture film . Movies can be delivered via internet and hard drives or devoted to web or satellite links or optical disks such as blu-ray disc . Digital movies are presented adopting a digital projector instead of a traditional film projector. Thus, digital cinema is different from HDTV (high-definition television) and does not rely on adopting SD or HDTV standards . In general, resolutions of digital cinema are represented by the horizontal pixel count, usually 2048 × 1080 (or 2.2 megapixels) to 4096 × 2160 (or 8.8 megapixels). As digital cinema technique was enhanced in early 2010s, most of the theaters across the world have transferred to digital .
Four dimensional (4D) film is a term of marketing for an entertainment presentation system which is advanced form of three dimensional (3D) film with physical possessions that transpire in the theatre in operation with the film . The accomplishments conducted in a 4D film may include lamp, wind, rain, and vibration. The seats in 4D place may oscillate or move a few inches during the movie . Some other effects contain water sprays, air jets, and leg and back ticklers. In addition, hall effects may include rain, smoke, lightning, and air bubbles, and scent can be considered for 4D effects. Since the physical effects are expensive to realize, 4D films are most often accomplished in custom-built theatres such as amusement or theme parks. Some examples of 4D films are “Journey to the Center of the Earth” and “Avatar,” which were presented at movie theatres with 4D versions .
Recently, research on IT convergence techniques for film production and film screening are widely studied. Analog-type theater is changing to digital-type theater, and interests in digital-type theater increase for 4D-type theater which yields reality that 3D movies did not provide . A 3D theater is giving a three-dimensional effect to viewers with special glasses such as polarized glasses . In addition, a future-oriented 4D theater helps viewers to try special effects affecting five senses such as wind, vapor, chair vibration, scent, and special lighting [10, 11].
In a traditional 4D digital theater, an environmental system that generates device controller of lamping system and a device controller of sensing of reality are separated . That is, DMX512 protocol is adopted to control lamping and RS45 image sensor is adopted to control motions, chair devices, and environments generating devices . To this end, two types of controllers must be realized to control each device and generally they cause high power consumption and complex communication lines . In addition, controlling all the subdevices precisely and simultaneously is hard to achieve [15–17]. Therefore, a stable device controller system is needed which can control all the subdevices precisely and provide autoinspection and calibration of real-time operation.
In this paper, RS485 image sensor based digital cinema system is proposed. The system is designed to integrate motion bases, chair devices, and other environmental rendering devices as well as lighting under RS485 image communication. This paper is organized as follows. Section 2 introduces 4D device control system. The proposed system is explained in Section 3. Section 4 provides simulation results and conclusion remarks are described in Section 5.
2. Proposed Design
2.1. Image Coding
The digital cinema architecture utilizes the JPEG standard to realize a real-time decoder. Due to the communication traffic and storage cost, interframe such as video coding can be better choice for movie compression. However, there are some reasons that we selected JPEG:(1)There is no global standard for RGB compression with 30 bits or more.(2)Intraframe coding methods remain significant due to their supporting of video editing.(3)JPEG is easier standard for editing.(4)JPEG decoder is more reliable in the error condition.
Therefore, we used JPEG for our digital cinema system.
2.2. Real-Time Decoder
The decoder is able to realize real-time decompression with higher speed of 3G pixels per minute using parallel approach. The decoder is comprised of two circuit blocks: PC/LINUX part with GbE interface and JPEG2000 decoder boards. Four boards are established on the PCI-X-bus for processing 24 frames of 8 M pixels with 36-bit RGB color images in a second. The color standards may be changed such as RGB, YCbCr, or HSV.
2.3. The 4D Device Control System
The 4D device control system is working for the environmental rendering of digital theater. To investigate 4D device control system, we tested some characteristics including chair vibration, wind, vapor, scent, special lighting, and spray in the hardware configuration. We also tested LED lighting, fan, and vibration among the various environmental rendering devices.
As RS485 image sensor only enables multiple connections of various masters and gives half duplex communication, two wires are exploited for sender and receiver. The ID is assigned to each device. If a master sends data “1” to master “,” all devices receive the data simultaneously. However, other devices except master “” ignore the data once they realize the data is not for them. Table 1 shows data configuration table of RS485 image sensor protocol.
Conventional studies performed simulations for LED lighting, fan, and vibration among the diverse environmental rendering device and displayed their accuracy in real-time data transmission. Although previous researches studied data transmission for RS485 image sensor, those studies did not fully provide comprehensive understanding of environmental rendering devices, motion, and chair devices. To alleviate this issue, we verify data transmission for RS485 image sensor and design digital cinema system which is able to provide all the environmental rendering devices, motion, and chair devices.
3. Configuration of the Proposed Digital Cinema System
Let us consider structure of conventional digital cinema system.
Step 1. Main PC supports connectivity between the Internet and sites based on Ethernet. Using 4D system interface shown in Figure 1, the entire system is controlled.
Step 2. This stage is for network server, which monitors devices. In addition, network server converts data between main PCs.
Step 3. This is the last step which belongs to physical layer devices. RS485 works for communication and is designed to expand. However, cinema has hundreds of 4D chairs; therefore compatibility with existing system is a big issue. In our system, we use RS485 network bus topology and repeater to control hundreds of 4D chairs and environmental productions.
Figure 2 shows the proposed digital cinema system configuration. When a data file is entered in a media server, a driving controller delivers data to each device through RS485 image sensor. Each device provides environmental rendering effect.
3.1. Design of Digital Cinema System
The driving controller of digital cinema system activates environmental rendering devices in synchronization with screen display as well as devices which are installed on a chair such as motion base. The driving controller of digital cinema system can be installed in automatic manner through touch screen and yields tests for some operations.
3.2. Protocol Definition of RS485 Image Sensor
To define RS485 image sensor protocol, we take into account motion, chair device, and environment devices simultaneously. To this end, we used separators for each two to four bytes to distinguish motion, chair device, and environment device commands. We also defined a protocol by taking into account the scalability of environment and chair devices. The basic function of each device is coded as a specific parameter in a command set. When a command is delivered to each device, it activates defined operation. The command is comprised of 12 bytes including 115,200 bps, 8 bit data, 1 stop bit, and 0 parity bit. Consider
To connect hundreds of chairs and servers, we design RS485 repeater. This is to ensure the stability of the communication between the isolated signals and to be able to play the best communication state through the embedded MCU. The designed system may have total of 4 channels; 1 input signal of each channel is reoutput after isolating via the SN75176.
3.3. Signal Processing
A multiple controller is executed to allot multiple signal processing among various devices, field-effect transistor (FET) board control, power check control, and multipoint control unit (MCU) monitoring, to raise stability. The controller is divided into main MCU, motor MCU, and monitor MCU to achieve mutual monitoring and help. The main MCU is responsible for signal processing and examines encoded signal, digital input/output signals. In addition, the main MCU generates pulse width modulation (PWM) signal which delivers an appropriate driving signal to the FBT board.
The FET board is controlled by the motor MCU. It stops motion base and reports possible errors to the main MCU when an error alert is delivered. The monitor MCU oversees power and monitors of other MCUs. The signals overseen by monitor MCU are significant to the safety of the entire system and can tune power supply to the system. The operation sequence of motor and monitor MCUs is shown in Figure 3.
Figure 4 shows the proposed digital cinema system. Step 1 is main PC which supports connectivity between the Internet and sites based on Ethernet. Step 2 is network server, which is able to monitor the devices. Step 3 is physical layer, which is comprised of devices, and commination between devices is RS485. In this paper, we propose a method with repeater which is free of problems on the network even when the number of 4D chairs increases. Figure 4 shows improved digital cinema system.
3.4. RS485 Repeater Design
Repeaters are used only when the network has the same structure, and they belong to physical layer. We designed RS485 repeater for multiple system communication. It can be connected to at least hundreds of 4D chair system and the server, which ensures the stability of the communication between insulated signals. The system has 4 channels; input signal of each channel is isolated via SN75176 and output again.
4. Experimental Results
Simulations of the improved digital cinema system must control hundreds of 4D chairs and a motion base to exactly and simultaneously operate through the RS485 image sensor. Therefore, our simulation was tested by installing 100 4D chairs under the corresponding motion base. The hardware environments are indicated in Table 3. The operating system (OS) of the software environment was Windows 8 and the program language we used is C++. The adopted network environment was Windows 8-based Paessler Router Traffic Grapher (PRTG) simulator.
In the previous works, 4D chair, motion, air injection, water spray, and vibration were considered as personal experience. However, in this study, we excluded group experience and only considered personal experience, that is, 4D chair and motion. Table 4 shows environmental device parameter sets for 4D chair and motion. The environments guided device parameter values are set in Table 4 and stored as a metadata image file. The main screen runs both image data on left and right to produce 3D effect simultaneously. The data transmission is divided by synchronous and asynchronous connections according to the time positions of the transmitting and receiving side. The synchronous data is transmitted in a noncharacter block unit such as frame. In other words, data is made by a predetermined number of strings between the transmitting side and the receiving side, with a format of packet at a time. The asynchronous transfer is motivated by sending information to noncharacter unit blocks. The synchronous transmission has character synchronization method, bit synchronization method, and the frame synchronization method. In this paper, we used character synchronous system which is the most reliable among all synchronous processing. To align characters we add STX in front of blocks and add ETX at the end of blocks to indicate beginning and the end of the transmission data.
The motion chairs and environmental production device parameter values that were set in Table 4 are shown in MOT and SOT. The reason our system starts with STX is that we adopted character synchronous system for its stability in high-speed processing. To inform the beginning and the end, the character synchronous system adds STX to the front and ETX to the end of transmitted data.
From the main screen it can be found that 15 Gbyte movie file is well transmitted to receiver through the 100 Mbps interface of repeater. This confirms that 4D motion and chair were correctly operated when server and each device node information is properly transmitted without loss. Figure 5 shows transition of motor torques and motor power for M1, M2, and M3. The M1 motor power was 280 W. Based on the simulation, we designed and produced motion base structure. Figure 6 shows a simulation for selected 3DOF motion base dimension.
The most representative tangible personal experience factors of 4D theaters are 4D chair and 4D cinema, and hands-on chairs, motion base, air injection, water spray, and vibration can be elements as well. In conventional studies, only personal experience was discussed for 4D element. In this paper, RS485 network topology, hundreds of 4D seats, and environment implementation were designed to be controlled using a repeater to RS485. Simulation results show that the improved digital cinema system is well designed for 4D chair and found to operate accurately under the condition of no traffic over the RS485.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
- T. Yamaguchi, M. Nomura, K. Shirakawa, and T. Fujii, “SHD movie distribution system using image container with pixel resolution and 36 bit color,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '05), pp. 5918–5921, Kobe, Japan, May 2005.
- Digital Cinema Initiatives, Digital Cinema System Specification V1.1, 2007, http://www.dcimovies.com/.
- Specific Targeted Research Project, “IST call 2, Layered compression technologies for digital cinema to graphy and cross media conversion,” WorldScreen, 2004, http://www.worldscreen.org.
- EDCine Project, “IST 6th framework program of the European Commission,” https://ec.europa.eu/research/fp6/pdf/fp6-in-brief_en.pdf.
- WiMAX Forum, “Mobile WiMAX—Part I: A Technical Overview and Performance Evaluation,” 2006, http://www.wimaxforum.org/.
- J. Leigh, L. Renambot, A. Johnson et al., “The global lambda visualization facility: an international ultra-high-definition wide-area visualization collaboratory,” Future Generation Computer Systems, vol. 22, no. 8, pp. 964–971, 2006.
- T. Shimizu and D. Shirai, “International real-time streaming of 4K digital cinema,” Future Generation Computer Systems, vol. 22, no. 8, pp. 929–939, 2006.
- A. J. Woods, “How are crosstalk and ghosting defined in the stereoscopic literature?” in Stereoscopic Displays and Applications XXII, vol. 7863 of Proceedings of SPIE, San Francisco, Calif, USA, 2011.
- W.-P. K. Yiu, X. Jin, and S.-H. G. Chan, “Challenges and approaches in large-scale P2P media streaming,” IEEE Multimedia, vol. 14, no. 2, pp. 50–59, 2007.
- H.-H. Yen, S. S. W. Lee, and B. Mukherjee, “Traffic grooming and delay constrained multicast routing in IP over WDM networks,” in Proceedings of the IEEE International Conference on Communications (ICC '08), pp. 5246–5251, Beijing, China, May 2008.
- L. H. Sahasrabuddhe and B. Mukherjee, “Light-trees: optical multicasting for improved performance in wavelength-router networks,” IEEE Communications Magazine, vol. 37, no. 2, pp. 67–73, 1999.
- T. Inoue and H. Ohzu, “Accommodative responses to stereoscopic three-dimensional display,” Applied Optics, vol. 36, no. 19, pp. 4509–4515, 1997.
- C. Wheatstone, “Contributions to the physiology of vision—part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision,” Philosophical Transactions of the Royal Society of London, vol. 128, pp. 371–394, 1838.
- N. A. Dodgson, A. J. Woods, J. O. Merritt, S. A. Benton, and M. T. Bolas, “Variation and extrema of human interpupillary distance,” in Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291 of Proceedings of SPIE, pp. 36–46, 2004.
- R. S. Allison, B. J. Gillam, and E. Vecellio, “Binocular depth discrimination and estimation beyond interaction space,” Journal of Vision, vol. 9, no. 1, article 10, 2009.
- N. S. Holliman, J. P. Dakin, and R. G. W. Brown, Handbook of Optoelectronics, vol. 2, Taylor & Francis, 2006.
- H.-J. Jia and Z.-H. Guo, “Research on the technology of RS485 over ethernet,” in Proceedings of the International Conference on E-Product E-Service and E-Entertainment (ICEEE '10), pp. 1–3, November 2010.
Copyright © 2016 Eunju Kim et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.