Techniques for retrieving multimedia information using a paper-based interface

Patent Citations (140)

Non-Patent Literature (122)

• “Computer Terms,” <http://www.park-meadow.org/computer—terms.htm>, pp. 1-8.Examiner
• “Glossary for computer hardware and micro scope,” <http://www.mumbaicyber.com/glossary—com—hardware—micro.asp>, pp. 1-11.Examiner
• “glossary,” <http://about.telus.com/investors/glossary.html>, pp. 1-7.Examiner
• “IT&T Talk,” <http://www.iib.qld.gov.au/itcareers/talk.asp>, pp. 1-4.Examiner
• “Glossary: What Does It Mean?,” <http://www.fairfield.k12.ct.us/fairfieldhs/crairfieldhs03/glossary.htm>, pp. 1-3.Examiner
• “Multimedia,” <http://en.wikipedia.org/wiki/Multimedia>, pp. 1-2.Examiner
• Adobe Premiere (video editing software) from Http://www.adobe.com (2002).Applicant
• Bobick et al. “A State Based Approach to the Representation and Recognition of Gesture,” IEEE Trans. on Pattern Analysis and Machine Intelligence, pp. 1325-1337 (1997).Applicant
• Boreczky, J. et al. “An Interactive Comic Book Presentation for Exploring Video,” Conference on Human factors in Computing Systems (CHI 2000), ACM Press, pp. 185-192, 2000.Applicant
• Boykin et al, “Improving Broadcast News Segmentation Processing,” IEEE Multimedia '99 (1999).Applicant
• Boykin et al. “Machine learning of Event Segmentation for News on Demand,” Communications of the ACM, 43:35-41(2000).Applicant
• Brown et al. “Automatic Content-Based Retrieval of Broadcast News,” ACM Multimedia 5, San Francisco, CA (1995).Applicant
• Caj et al. “Integrated Multimedia Publishing—Combining TV and Newspaper Content on Personal Channels,” WWW8 Conference, 1999.Applicant
• Chen et al. “Emotion Recognition from Audiovisual Information,” Proc. IEEE Workshop on Multimedia Signal Processing, Los Angeles, CA, USA, pp. 83-88 (1998).Applicant
• Chen et al. “VIBE: A Video Indexing and Browsing Environment,” Proceedings of the SPIE Conference on Multimedia Storage and Archiving Systems Sep. 20-22, 1999, Boston 3846:146-164 (1999).Applicant
• Chiu et al. “NoteLook: Taking Notes in Meetings with Digital Video and Ink,” ACM Multimedia 99 Orlando, (1999).Applicant
• Chiu et al. “Automatically linking multimedia meeting documents by image matching,” Proceedings of Hypertext '00. ACM, New York, pp. 244-245 (2000).Applicant
• Christel et al. “Evolving Video Skims into Useful Multimedia Abstractions,” Proceedings of the CHI '98 Conference on Human Factors in Computing Systems (Los Angeles, CA, Apr. 1998), pp. 171-178 (1998).Applicant
• Christel et al. “Information Visualization within a Digital Video Library,” Journal of Intelligent Information Systems 11:35-257 (1998).Applicant
• Dellaert et al. “Recognizing emotion in speech,” Proceedings ICSLP 96. Fourth International Conference on Spoken Language Processing New York (Cat. No. 96TH8206). IEEE. vol:1970-1973 (1996).Applicant
• Dimitrova et al. “Video Keyframe Extraction and Filtering: A Keyframe is not a Keyframe to Everyone,” CIKM 1997:113-120 (1997).Applicant
• Doermann et al. “Applying Algebraic and differential invarients for logo recognition,” Machine Vision and Applications 9:73-86 (1996).Applicant
• Donato et al. “Classifying Facial Actions”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 21:974-989 (1999).Applicant
• Essa et al. Coding Anaylsis Interpretation and Recognition of Facial Expressions, IEEE Trans. on Pattern Analysis and Machine Intelligence, 19:757-763 (1997).Applicant
• Face recognition techniques described at web site http://www.visionics.com (2002).Applicant
• Foote, Jonathan, et al. “An Intelligent Media Browser using Automatic Multimodal Analysis,” ACM Multimedia 8, Bristol, UK (1998).Applicant
• Furui et al. “Japanese Broadcast News Transcription and Information Extraction,” Communications of the ACM, 43(2):71-73, Feb. 2000.Applicant
• Gauvain et al. “Transcribing Broadcast News for Audio and Video Indexing,” Communications of the ACM, 43:64-70 (2000).Applicant
• Gibbon “Generating Hypermedia Documents from Transcriptions of Television Programs Using Parallel Text Alignment,” Handbook of Internet and Multimedia Systems and Applications, David C. Gibbon; CRC Press, (1998).Applicant
• Gordon “Using annotated video as an information retrieval interface,” ACM Proceedings of the 5th international Conference on Intelligent User Interfaces New Orleans pp. 133-140 (2000).Applicant
• Hauptmann et al. “Text, speech and vision for video segmentation: the information project,” Proc. AAAI Fall Symp. Computational Models for Integrating Language and Vision, Boston, MA, Nov. 10-12, 1995.Applicant
• Hauptmann et al. “Story Segmentation and Detection of Commercials in Broadcast News Video,” Advances in Digital Libraries Conference, Santa Barbara, CA, Apr. 22-23, 1998.Applicant
• He et al. “Comparing Presentation Summaries: Slides vs. Reading vs. Listening,” Conference on Human factors in Computing Systems (CHI 2000), Apr. 1-6, 2000.Applicant
• HECHT “Embedded data glyph Technology for Hardcopy Digital Documents,” Proc. SPIE 2171:341-352 (1994).Applicant
• HECHT “Printed Enbedded Data Graphical User Interfaces,” IEEE Computer, Mar. 2001.Applicant
• Hu et al. “Multimedia Description Framework (MDF) for content descriptions of Audio/Video Documents,” Fourth ACM Conference on Digital Libraries (DL '99) Aug. 11-14, 1999.Applicant
• Ioffe et al. “Finding people by sampling,” Proc. International Conference on Computer Vision, pp. 1092-1097 (1999).Applicant
• Jin et al. “Topic Tracking for Radio, TV Broadcast, and Newswire,” Proceedings of the DARPA Broadcast News Workshop, Feb. 28-Mar. 3, 1999, Herndon, VA.Applicant
• Komlodi et al. “Key Frame Preview Techniques for Video Browsing,” (Proceedings of the 3rd ACM International Conference on Digital Libraries, Jun. 23-26, 1998, Pittsburgh, pp. 118-125 (1998).Applicant
• Li et al. “Automatic Text Detection and Tracking in Digital Video,” IEEE Transactions on Image Processing—Special Issue on Image and Video Processing for Digital Libraries, 9:147-156 (2000).Applicant
• Li et al. “Text Extraction and Recognition in Digital Video,” Proceedings of Third IAPR Workshop on Document Analysis Systems, pp. 119-128, 1998.Applicant
• Li et al. “VISION: a digital video library,” Proceedings of the 1st ACM International Conference on Digital Libraries, pp. 19-27, 1996.Applicant
• Liang et al. Practical video indexing and retrieval system SPIE 3240:294-303, (1988).Applicant
• Lienhart et al. “On the Detection and Recognition of Television Commercials,” Proc. IEEE Conf. on Multimedia Computing and Systems, Ottawa, Canada, pp. 509-516, Jun. 1997.Applicant
• Ma et al. “An Indexing and Browsing System For Home Video,” Invited paper, EUSIPCO '2000, 10th European Signal Processing Conference, Sep. 5-8, 2000, Tampere, Finland.Applicant
• Maybury “News on Demand,” Communications of the ACM, 43:33-34 (2000).Applicant
• Maybury et al. “Segmentation, Content Extraction and Visualization of Broadcast News Video Using Multistream Analysis,” AAAI Paper (1997).Applicant
• Maybury et al. “Multimedia Summaries of Broadcast News,” International Conference on Intelligent Information Systems pp. 447-449 (1997).Applicant
• Maybury et al. “Multimedia Summaries of Broadcast News,” International Conference on Intelligent Information Systems, Dec. 8-10, 1997.Applicant
• Merialdo et al. “Automatic Construction of Personalized TV News Programs,” Seventh ACM International Multimedia Conference, Orlando Nov. 1999.Applicant
• Merlino et al. “Broadcast News Navigation using Story Segmentation,” Advanced Information Systems Center, The MITRE Corporation (1997).Applicant
• Merlino et al. “Broadcast News Processing Techniques,” MITRE Technical Report, MTR 9980000031, Apr. 1999.Applicant
• Mohan “Text-based search of TV news stories,” Proc. SPIE 2916:2-13 (1996 ).Applicant
• Myers et al. “Multi-View Intelligent Editor for Digital Video Libraries,” First ACM and IEEE Joint Conference on Digital Libraries, Jun. 24-28, 2001, Roanoke, VA, pp. 106-115.Applicant
• Oh et al. “Efficient and Cost-effective Techniques for Browsing and Indexing Large Video Databases,” SIGMOD Conference 2000: 415-426.Applicant
• Photina et al. “Improving acoustic models with captioned multimedia speech,” Proceedings IEEE International Conference on Multimedia Computing and Systems, 2:787-71 (1999).Applicant
• Rowley et al. “Neural network-based face detection,* IEEE Transactions on Pattern Analysis and Machine Intelligence,” 20:23-38 (1998).Applicant
• Shahraray et al. “Automated Authoring of Hypermedia Documents of Video Programs,” ACM Multimedia 95, Nov. 5-9, 1995, San Francisco, CA (1995).Applicant
• Shahraray et al. “Automatic generation of pictorial transcripts of video programs,” Proceedings of the SPIE- Int. Soc. Opt. Eng. 2417:512-518 (1995).Applicant
• Shahraray et al. “Pictorial transcripts: multimedia processing applied to digital library creation,” 1997 IEEE First Workshop on Multimedia Signal Processing pp. 581-586 (1997).Applicant
• Smith et al. “Video Skimming and Characterization through the Combination of Image and Language Understanding,” Computer Vision and Pattern Recognition IEEE 1997.Applicant
• Sonmez et al. “Multiple speaker tracking and detection: handset normalization and duration scoring,” Digital Signal Processing 10:133-143 (2000).Applicant
• Suda et al. “Logo and word matching using a general approach to signal registration,” Fourth International Conference on Document Analysis and Recognition, Ulm, Germany, Aug. 18-20, 1997, pp. 61-65.Applicant
• Tennenhouse et al. “A software-oriented approach to the design of media processing environments,” Proceedings of the IEEE International Conference on Multimedia Computing and Systems, pp. 435-444 (1994).Applicant
• Tonomura et al. “VideoMAP and VideoSpaceIcon: tools for anatomizing video content,” Proc. INTERCHI '93 ACM pp. 131-136 (1993).Applicant
• Uchihashi et al. “Summarizing Video Using a Shot Importance Measure and a Frame-Packing Algorithm,” Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (Pheonix, AZ) 6:3041-3044 (1999).Applicant
• Uchihashi et al. “Video-Manga: Generating Semantically Meaningful Video Summaries,” ACM Multimedia 99, Orlando, Florida, Oct. 30-Nov. 5, 1999.Applicant
• Video content management and publishing software from Virage http://www.virage.com (2002).Applicant
• “Video Mail Retrieval Using Voice” Cambridge Univeristy Engineering Department Computer Laboratory and Olivetti Research Laboratory summary of research found at http://svr-www.eng.cam.ac.uk/research/projects/vmr/ (1997).Applicant
• Wactlar et al. “Complementary Video and Audio Analysis for Braodcast News Archives,” Communicatins of the ACM, 43:42-47 (2000).Applicant
• Wactler et al. “Intelligent access to digital video: Informedia project,” Computer 29:46-52 (1996).Applicant
• Weiss et al. “Compostion and Search with a Video Algebra,” IEEE Multimedia 2:12-25 (1995).Applicant
• Wittenburg et al. “Browsing with Dynamic Key Frame Collages in Web-Based Entertainment Video Services,” In Proceedings of IEEE International Conference on Mulitmedia Computing and Systems, Jun. 7-11, 1999, Florence, Italy 2:913-918 (1999).Applicant
• Zhang et al. “Detection of text Captions in Compressed domain Video,” International Multimedia Conference Proceedings of the 2000 ACM workshops on Multimedia 2000 , Los Angeles, California, United States pp. 201-204.Applicant
• Acrobat Reader Version 2.0 (software application), Abode Systems Incorporated, screenshots Figures 1-10 (1994).Applicant
• Adobe Acrobat Reader 3.0 screen dumps (fig. 1-3), (1996).Applicant
• Adobe Systems, Inc., “Adobe Photoshop 4.0 User Guide for Macintosh and Windows,” pp. 30-31 (1996).Applicant
• Apple Macintosh system 7 reference manual, pp. 30-31 (1991).Applicant
• Ball et al. “Software Visualization in the Large”, IEEE Computer, 29: 33-43 (1996).Applicant
• Boguraev et al. “Salience-Based Content Characterisation of text Documents,” Proceedings of the ACL/EACL Workshop on Intelligent [Sic] Scalable Text Summarization, 1997. Topic identification, Discourse-based summarization. pp. 1-12 (1997).Applicant
• Brandow et al. “Automatic Condensation of Electronic Publications by Sentence Selection,” Information Processing and Management. 31(5):675-685 (1995).Applicant
• Gliedman “Virtual Managers,” Computer Shopper, 18:290 (1998).Applicant
• Greenberg et al., “Sharing fisheye views in relaxed-WYSIWIS groupware applications,” Proceedings of Graphics Interface, Toronto, Canada, May 22-24, 1995, Distributed by Morgan-Kaufmann, pp. 28-38, http://www.ucalgary.ca/grouplab/papers/1996/96-Fisheye.GI/gi98—fisheye.html.Applicant
• Hearst et al. “TileBars: Visualization of Term Distribution Information in Full Text Information Access,” Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), Denver, CO., May 1995, pp. 1-8, http://www.acm.org/sigchi/chi95/Electronic/documents/papers/mah—bdy.htm.Applicant
• Hill et al. “Edit Wear and Read Wear”, ACM, pp. 3-9 (May 3-7, 1992).Applicant
• Langley “An Analysis of Bayesian Classifiers,” Proceedings of the Tenth National Conference on Artificial Intelligence, pp. 223-228, 1992.Applicant
• Langley “Induction of Selective Bayesian Classifiers,” Proceedings of the Tenth National Conference on Uncertainty in Artificial Intelligence, pp. 400-406, (1994).Applicant
• Manber “The Use of Customized Emphasis in Text Visualization,” Proceedings of 1997 IEEE Conf. on Information Visualization, pp. 132-138, (1997).Applicant
• Schweighofer et al. “The Automatic Generation of Hypertext Links in Legal Documents,” Lecture Notes in Computer Science, vol. 1134, Wagner et al., from 7th Int. Conf., DEXA 96', held Sep. 1998 in Zurich, Switzerland (1996).Applicant
• Sumita et al. “Document Structure Extraction for Interactive Document Retrieval Systems,” Proceedings of SIGDOC 93. pp. 301-310, (1993).Applicant
• Taghva et al. “An Evolution of an Automatic Markup System,” SPIE, 2422:317-327 (1995).Applicant
• TAXT “Segmentation of Document Images,” IEEE 11:1322-1329 (1989).Applicant
• “c:\. . . \9149920c.wpd—unmodified” Screen Shots of document created in Corel WordPerfect, 4 pages, (Apr. 30, 2002).Applicant
• “Flexible JAMM Screenshots,” downloaded from internet site http://simon.cs.ct.edu/-jamm May 4, 2000.Applicant
• Begole et al., “Flexible Collaboration Transparency,” doc. ID: ncstrl.vatech—cs/TR-98-11, Virginia Polytechnic Institute and State University (1998).Applicant
• Begole et al., “Supporting Worker Independence in Collabloration Transparency,” doc. ID: nestrl.vatech—cs/TR-98-12, Virginia Polytechnic Institiute and State University (1998).Applicant
• Byrd, D., “A Scrollbar-based Visualization for Document Navigation,” doc. ID: xxx.cs.IR/9902028, Computing Research Repository: Information Retrieval (1999).Applicant
• Drucker et al. “SmartSkip: Consumer Level Browsing and Skipping of Digital Video Content,” Paper: Technology to Help People Find Information, vol. No. 4, Issue No. 1, pp. 219-226, Minneapolis, Minnesota, USA, (Apr. 20-25, 2002).Applicant
• “Fujitsu Markets Facsimile Connection System for Computer I/O,” Comline Telecommunications, November 1989, p. 5.Applicant
• Grunin, L., “Action,” PC Magazine, 12(15):240 (1993).Applicant
• “Hang on—Blue Sky's WinHelp is on the way,” PC Week, p. 59, Jul. 1995.Applicant
• IBM Technical Disclosure Bulletin, “Quick Selection of Window Environment Coordinates,” 35:57-60, ISS # 4B, (1992).Applicant
• “IBM, Partners Team On Web-Based Image Search, Printing Sep. 29, 1995,” Newsbytes News Network, Sep. 1995.Applicant
• IDENTITECH, “Identitech announces FYI 2.5.2 release with NT object server, SmartForm, and ODBC,” Business Editors, Jul. 1996.Applicant
• “Identitech Unysis: Unysis wins Florida Housing Finance Agency Contract; Identitech provides workflow software solution,” Business Editors/Computer Writers, Jun. 1995.Applicant
• Lam et al. “Automatic document classification based on probabilistic reasoning: model and performance anaylsis,” IEEE, 3:2719-2723 (1997).Applicant
• Lison et al., “Sight and Sound,” Unix Review, 7(10):76-86 (1989).Applicant
• Oakada et al., “Development of Application Programs for Distributed Processing Equipment,” Review of the Electrical Communication Laboratories, 34(4):465-471 (1986).Applicant
• Sodergard et al., “Integrated multimedia publishing—combining TV and newspaper content on personal channels,” downloaded from http:www8.org/w8-papers/1b-multimedia/integrated.html on Apr. 4, 2002, pp. 1-22.Applicant
• “Spry Inc.'S Internet Front End Picked For PSI Cable Internet Service,” Information & Interactive Services Report, 15(7), (1994).Applicant
• Strattner, A., “HP pioneers I-TV peripheral market,” Computer Shopper, 14(2):71 (1994).Applicant
• Van Horn-Christopher, “Have you talked to your computer today?” Business Forum, 19(3):10-11 (1994).Applicant
• “VNR firm offers Storyboards” PR News, Dec. 4, 1995, downloaded from http://proquest.umi.com/pqdlink?index=20&did=000000010830394&SrchMode=3&sid=1&F on Aug. 9, 2004.Applicant
• “WC3 issues first public draft of Synchronized Multimedia Integration Language (SMIL),” Information Today, 15(2):27, 30 (1998).Applicant
• Product Brochure, Shutterfly, downloaded from http://www.shutterfly.com on Mar. 15, 2005 (10 pages).Applicant
• Product Brochure, YesVideo, downloaded from http://www.yesvideo.com/code on Mar. 15, 2005 (20 pages).Applicant
• Choi et al., “An Integrated Data Model and a Query Language for Content-Based Retrieval of Video,” MIS '98 LNCS 1 508, Springer Verlag Berlin Heidelberg, pp. 192-198 (1998).Applicant
• Ohmori, Y., “A Tool for Programable Access to Organized Multimedia Data—Enhanced Multimedia Recorder (EMMR),” Joho Shori Gakkai Kenkyu Hokoku, 98(35[HI-78]):39-44 (1998).Applicant
• Phillips, R. L., “MediaView: A General Multimedia Digital Publication System,” Communications of the ACM, 34(7):75-83 (1991).Applicant
• Roschelle et al., “VideoNoter: A productivity too for video data analysis,” Behavior Research Methods, Instruments & Computers, 23(2):219-224 (1991).Applicant
• Saur et al., “Automated Analysis and Annotation of Basketball Video,” SPIE, 3022:176-187 (1997).Applicant
• Web pages from PaperClick.com printed from http://www.paperclip.com on Jun. 14, 2006.Applicant