Multiple display examples

In the case, if we use two handset, one screen display is 30 columns and 15 lines, and the other handset is 35 columns and 20 lines, after open a documents about 80 columns and 25

Figure 2.6 Two handsets with different display size

Figure 2.7 Open document on master device

Figure 2.8 Master display the text in original display mode

Figure 2.9 Master initial the network layer

Figure 2.10 Slave initial the network layer

Figure 2.11 Master connect to slave

Figure 2.12 Master send HELLO message to slave

Figure 2.13 Slave response with HELLO message

Figure 2.14 Master query local display information

Figure 2.15 Slave query local display information

Figure 2.16 Master send data size message to slave

Figure 2.17 Master send raw data of text to slave

Figure 2.18 Slave send local display information to master

Figure 2.19 Master adjudge display area of each device

Figure 2.20 The result is Master: 30*15, and slave: 35*15

Figure 2.21 Master send display area message to slave

Figure 2.22 Master send CHANGEMODE message to slave

Figure 2.23 Slave response with CHANGEOK message to master

Figure 2.24 Master change to new display mode

Figure 2.24 Master display the partial text on the screen

Figure 2.25 Slave change to new display mode

Figure 2.26 Slave display partial text on the screen

Figure 2.27 User view and input with device

Figure 2.28 Master send CLOSE message to slave

Figure 2.29 Slave response with CLOSEOK message

Figure 2.30 Master close socket and network

Figure 2.31 Master change to original display mode

Figure 2.32 Master display in previous display mode

Figure 2.33 Slave close socket and network

Figure 2.34 Slave change to original display mode

Figure 2.35 Slave display in previous display mode

Figure 2.36 Another example of display text on multiple display devices

Chaper 3 Development Environment

In this chapter, our proposed protocol is implemented on real mobile phone and simulator.

We choose VC2005 and Windows Mobile 6 SDK to develop the application on the WM6 handset. With WM6 simulator and two real WM6 mobile phones, we implement our method on the real target device and verify the mechanism.

3.1 Software Architecture

The view of the software architecture, program first gather the display information, the information contains the local display size, and will negotiate in the later handshake. After gather information, program setup the wireless connection, it base on the windows socket API, the physical layer may be WIFI or Bluetooth, even the IR transmitter. To setup up network, also need to invoke BSD like socket API, such as listen(), bind(), accept() , send() and recv().

To catch command in a independent process, create a persistent thread, in the thread will send/receive command data, according to input command, master and slave handset will response to various action, like scroll page of text display, refresh screen. In the final step, when user requests to exit the protocol, send close command. When the thread receives close command, just finalize network functionality, and graceful exit the protocol.

Figure 3.1 Software architecture of the implementation

3.2 User Interface

To acquire user operation, program design a simple user interface, for the use to setup network connection, Bluetooth configuration, and a working area to output debug message, and the main window to display text on master and slave device.

Figure 3.3 Connection setting and load document on WM6 QVGA handset

Figure 3.4 AP Main UI and get network information on WM6 Landscape QVGA handset

3.3 Enhancements and Applications

In our protocol and the implementation, just process the simplest content about pure text data. But lot of multimedia contents, such as graphic data (BMP, JPEG, GIF), vector file (Flash) or movie clips (AVI, MPEG, 3GP) files. With applying our proposed protocol, we can communicate two handsets, negotiate display capability, and with a suitable engine to decode such multimedia contents, we can split the presentation on two or more heterogeneous mobile devices. And develop more fantasy applications, for example, a group mobile phones grouped as a huge TV wall, displaying a interesting movie synchronously, or design a funny mobile KTV service, using two handsets, one act as the master device, the other act as the slave device. They both playback the same music, but just display the different lyric on each device, and the users can held such device to sing a romantic love song with together.

Figure 3.6 Multiple display application – mobile KTV service

Chaper 4 Conclusion

In this thesis, we propose a novel method of displaying content on multiple devices, with the protocol we calculate two different handset display capabilities, and calculate the text content properties to figure out a best display dispatching on mobile phones, setup the connection between heterogeneous devices, display contents and operate with view/page-up/page-down, the content display action simultaneously on different devices. I also implement the server/client application on device to verify our mechanism work well on the real products.

In this thesis, we only consider loading single text content and display that on two heterogeneous mobile phones, we just prove the concept can be implemented on nowadays mobile phones with limited wireless connection capability, the protocol and mechanism can be extend to multiple device array and accepted as a transport module, to view more complicated multimedia content with a collection of mobile phones, event the hot application such as on-line game or movie show.

Reference

[1] Wai Yip Lum, and Francis C.M. Lau, “User-Centric Adaptation of Structured Web Documents for Small Devices, ” Advanced Information Networking and Applications 19th International Conference, pp. 507- 512, 2005.

[2] Vatsa, R. and Kumar, V, “Role of media transformation in multimedia messaging, ” Personal Wireless Communications, pp. 258-262, 2005.

[3] Hongjiang Zhang, and Wei-Ying Ma, “Adaptive content delivery on mobile Internet across multiple form factors, ” Multimedia Modelling Conference, pp. 5-7, 2004.

[4] Won-Ho Choi, Dong-Gi Im ,and Min-Soo Jung, “An advanced Java mobile browser using a box model to display the contents, ” Virtual Environments, Human-Computer Interfaces and Measurement Systems, pp. 31-35, 2004.

[5] US Patent, US 7242369 B2: Method of displaying text on multiple display devices, 2007.

[6] MSDN online help web page: http://msdn2.microsoft.com/en-us/default.aspx