Image Based Anti-Shake Techniques for Mobile Display

Mobile computing devices facilitate the completion of tasks in all aspects of our daily lives. However, the handheld shake and vibration have been recognized to have adverse impacts on our vision, and they may even cause severe injuries to our eyes. In our previous research project, we assessed the implementation of an anti-shake mechanism for mobile display. The overall process of implementing this mechanism includes analyzing the accelerometer data, predicting the device displacement, and adjusting the position of the display area to compensate for vibrations. The experimental results revealed that this anti-shake mechanism successfully decreased the magnitude of device displacements when applied to mobile devices used in dynamically changing environments. We thus applied for a patent on the proposed anti-shake mechanism. Then, we also presented the kernel techniques thereof, i.e., the system modeling based and the fuzzy inference based prediction models, on ACM CHI 2016 and FUZZ-IEEE 2016 conferences, respectively. In the follow-up study, we attempted to improve the stabilization performance of our anti-shake method. To this end, we must obtain the relative displacement of the head and the hand. We soon found that neither the accelerometer nor the front panel camera can work for this purpose - the accelerometer can only provide partial information of the relative motion; whereas the front panel camera was with the uncontrollable sampling error and serious problems of computational efficiency. Here in this project, we propose an experimental research plan, in which we attach a micro camera at the user's head and connect it to a laptop computer to conduct motion analysis and motion prediction of the mobile device. We then transmit the prediction results to the mobile device for performing the motion compensation. As for the system validation, we will carry out accuracy analysis and user evaluation, and we will also adjust system parameters in the meanwhile. We expect to achieve accurate display stabilization and to verify the feasibility in a term of two years. Thereafter, our method can be realized as a particular hardware unit for marketing. This unit will combine the motion capture and the motion prediction components, and connect to the mobile devices wirelessly. Customers can thus simply attach this unit to their glasses or the hat brims, and then, they can enable the anti-shake function of their mobile devices.

Project ID:PB10703-1487
External Project ID:MOST106-2221-E182-075