JoinSee

JoinSee is a real-time and collaborative hyper-media system that introduces database-enhanced collaborative models and multimedia processing models for creating improvised performances in the Opera of Meaning.

The system provides a main story media and a corresponding shared canvas that is shared among Internet-wide user communities. Our shared canvas mechanisms make it possible to describe and share users' ideas and impressions about the main story media.

The key technology of this system is a timeline-dependent and script-driven live performance engine, which provides users with Event-Condition-Action (ECA) rules to express and characterize the users' ideas and impressions by using existing multimedia data such as video files and image files. The system provides directors and participants of improvised performance with a set of database operators for controlling and contributing to the performance. The system motivates users to contribute to the performance by exploiting users' own media libraries and existing web services.

We have implemented the prototype system which is applicable to the existing video and image files on the Web.

This system offers new ways of connected collaboration, which are not possible with existing communication-oriented tools such as VoIP, Pub/Sub systems, and video hosting services. The contributions of this work are the following:

  • JoinSee provides a shared canvas system that consists of both a media player and a corresponding free-space. A media player is used for displaying a continuous media data, such as video data, as main story. The free-space is for displaying images and web snippets. The shared canvas makes it possible to describe and share users' ideas and impressions about the main story media. JoinSee provides a director and participants of improvised performance with a set of database operators for controlling and contributing to the performance.
  • JoinSee provides a timeline-dependent and script-driven live performance engine for the shared canvas. The live performance engine integrates existing databases according to the dynamic context of main story media and facilitate expressiing of users' ideas and impressions by using text and multimedia data such as video files and image files. The search can be performed using third-party search services like Flickr, YouTube or Google on legacy databases, or on local closed-world database, and combination of the two.

Our implementation contains a modular framework for integrating actual multimedia data including H.264 movies, JPEG
images, and web search results. Moreover, we show an implementation method to utilize Service-Oriented-Architecture (SOA) technologies for integrating existing web services into JoinSee system.

The system is developed by Shuichi KURABAYASHI and Prof. Yasushi KIYOKI in a collaboration with Graduate School of Media and Governance, Keio University Japan.

Keywords. Collaborative System, Multidatabase Systems, Active Database Systems

Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-Share Alike 2.5 License.