System and method for linking streams of multimedia data to reference material for display

US RE43,633 E1
Filed: 06/08/2009
Issued: 09/04/2012
Est. Priority Date: 02/16/1994
Status: Expired due to Term

- Alert
- Pin

Associated Cases

Associated Defendants

First Claim

Patent Images

1. A system for linking source material to reference material for display comprising:

a source material image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information, said source material image stored in an electronic database;

means for determining an address on said electronic database for the beginning position of said source material image;

means for cutting said source material image into said discrete pieces;

means for determining an address on said electronic database for a start point and an end point of said discrete pieces of said image based upon said beginning position of said source material image;

means for recording said start and said end point addresses in a look-up table;

means for selecting a discrete portion of said source material image;

means for determining the address on said electronic database of said selected discrete portion;

means for converting said address of said selected discrete portion to an offset value from said beginning position address of said source material image;

means for comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;

means for selecting an external reference that corresponds to said look-up table start and end point addresses; and

means for reproducing said external reference.

View all claims

5 Assignments

Timeline View

Assignment View

Litigations

0 Petitions

Accused Products

Abstract

A system for indexing displayed elements that is useful for accessing and understanding new or difficult materials, in which a user highlights unknown words or characters or other displayed elements encountered while viewing displayed materials. In a language learning application, the system displays the meaning of a word in context; and the user may include the word in a personal vocabulary to build a database of words and phrases. In a Japanese language application, one or more Japanese language books are read on an electronic display. Readings (‘yomi’) for all words are readily viewable for any selected word or phrase, as well as an English reference to the selected word or phrase. Extensive notes are provided for difficult phrases and words not normally found in a dictionary. A unique indexing scheme allows word-by-word access to any of several external multi-media references.

252 Citations

184 Claims

1. A system for linking source material to reference material for display comprising:
- a source material image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information, said source material image stored in an electronic database;
  
  means for determining an address on said electronic database for the beginning position of said source material image;
  
  means for cutting said source material image into said discrete pieces;
  
  means for determining an address on said electronic database for a start point and an end point of said discrete pieces of said image based upon said beginning position of said source material image;
  
  means for recording said start and said end point addresses in a look-up table;
  
  means for selecting a discrete portion of said source material image;
  
  means for determining the address on said electronic database of said selected discrete portion;
  
  means for converting said address of said selected discrete portion to an offset value from said beginning position address of said source material image;
  
  means for comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;
  
  means for selecting an external reference that corresponds to said look-up table start and end point addresses; and
  
  means for reproducing said external reference.
- View Dependent Claims (2, 3, 4, 5, 6, 7)
- - 2. The system of claim 1, further comprising:
    - a linking engine for linking said source material to said reference information on any of a word-by-word and phrase-by-phrase basis.
  - 3. The system of claim 2, said linking engine further comprising:
    - word cut means for dividing said source material into discrete pieces;
      
      linking means for establishing at least one link between each of said discrete pieces and said reference information;
      
      compiler means for assembling an integrated source image from said discrete pieces;
      
      indexing means for linking said assembled discrete pieces to said reference information.
  - 4. The system of claim 3, said linking engine further comprising:
    - means for building an index to link each of said source material pieces to said reference information.
  - 5. The system of claim 4, wherein said index links said source material pieces to said reference information based upon the value of the offset of the starting and ending position addresses of said source material pieces from the beginning position address of said integrated source image.
  - 6. The system of claim 5, wherein said offset locates said reference information to a corresponding source material piece based upon offset occurrence within a range defined by the value of the offsets of the starting and ending point addresses of said source material pieces from said beginning position address of said integrated source image.
  - 7. The system of claim 1, further comprising:
    - means for manipulating said stored source material and reference information with at least two user keys.

8. A method for linking source material to reference material for display, comprising:
- determining the beginning position address of a source material image stored in an electronic database, said source material image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information;
  
  cutting said source material image into said discrete pieces;
  
  determining a starting point address and an ending point address of said discrete pieces of said image based upon said beginning position address of said source material image;
  
  recording said starting and said ending addresses in a look-up table;
  
  selecting a discrete portion of said source material image;
  
  determining the address of said selected discrete portion;
  
  converting said address of said selected discrete portion to an offset value from said beginning position address of said source material image;
  
  comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;
  
  selecting an external reference that corresponds to said look-up table start and end point addresses; and
  
  reproducing said external reference.

9. In a language learning method, a method for linking source material to reference material for display, comprising the steps of:
- reading a foreign language source material image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information with an electronic viewer;
  
  accessing reference materials on selected portions of said source material image;
  
  determining the beginning position address of said source material image;
  
  cutting said source material image into said discrete pieces;
  
  determining a start point address and an end point address of said discrete pieces of said image based upon said beginning position address of said source material image;
  
  recording said start and said end point addresses in a look-up table;
  
  selecting a discrete portion of said source material image;
  
  determining the address of said selected discrete portion;
  
  converting said address of said selected discrete portion to an offset value from said beginning position address of said source material image;
  
  comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;
  
  selecting an external reference that corresponds to said look-up table start and end point addresses; and
  
  reproducing said external reference.
- View Dependent Claims (10, 11, 12, 13, 14)
- - 10. The method of claim 9, further comprising the step of:
    - linking said source material to said reference information with a linking engine on any of a word-by-word and phrase-by-phrase basis.
  - 11. The method of claim 10, said linking step further comprising the steps of:
    - dividing said source material into discrete pieces;
      
      establishing at least one link between each of said discrete pieces and said reference information;
      
      assembling an integrated source image from said discrete pieces; and
      
      linking said assembled discrete pieces to said reference information.
  - 12. The method of claim 11, said linking step further comprising the step of:
    - building an index to link each of said source material pieces to said reference information.
  - 13. The method of claim 12, wherein said index links said source material pieces to said reference information based upon the offset between the starting position address for said source material pieces and the beginning position address of said integrated source image.
  - 14. The method of claim 13, wherein said offset locates said reference information to a corresponding source material piece based upon offset occurrence within a range defined by the value of the offsets of the starting and ending position addresses of said source material pieces from said beginning position address of said integrated source image.

15. In a language learning system, a system for linking source material to reference material for display, comprising:
- a text image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information;
  
  means for determining the beginning position address of said text image;
  
  means for cutting said text image into said discrete pieces;
  
  means for determining a starting point address and an ending point address of said discrete pieces of said image based upon said beginning position address of said source material image;
  
  means for recording said starting and said ending point addresses in a look-up table;
  
  means for selecting a discrete portion of said text image;
  
  means for determining the address of said selected discrete portion;
  
  means for converting said address of said selected discrete portion to an offset value from said beginning position address of said source material image;
  
  means for comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;
  
  means for selecting an external reference that corresponds to said look-up table start and end point addresses; and
  
  means for displaying said external reference.

16. In a language learning method, a method for linking source material to reference material for display, comprising the steps of:
- determining the beginning position address of a text image, said text image including a plurality of discrete pieces having links to external reference materials comprising any of textual, audio, video, and picture information;
  
  cutting said source material image into said discrete pieces;
  
  determining a starting point address and an ending point address of said discrete pieces of said image based upon said beginning position address of said text image;
  
  recording said starting and said ending point addresses in a look-up table;
  
  selecting a discrete portion of said text image;
  
  determining the address of said selected discrete portion;
  
  converting said address of said selected discrete portion to an offset value from said beginning position of said text image;
  
  comparing said offset value with said recorded start and end point addresses of said discrete pieces in said look-up table;
  
  selecting an external reference that corresponds to said look-up table start and end point address; and
  
  displaying said external reference.

17. A system for linking textual source material to external reference materials for display, the system comprising:
- means for determining a beginning position address of a textual source material stored in an electronic database;
  
  means for cutting the textual source material into a plurality of discrete pieces;
  
  means for determining starting point addresses and ending point addresses of the plurality of discrete pieces based upon the beginning position address;
  
  means for recording in a look-up table the starting and ending point addresses;
  
  means for linking the plurality of discrete pieces to external reference materials by recording in the look-up table, along with the starting and ending point addresses of the plurality of discrete pieces, links to the external reference materials, the external reference materials comprising any of textual, audio, video, and picture information;
  
  means for selecting a discrete portion of an image of the source material;
  
  means for determining a display address of the selected discrete portion;
  
  means for converting the display address of the selected discrete portion to an offset value from the beginning position address;
  
  means for comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces;
  
  means for selecting one of the external reference materials corresponding to the identified one of the plurality of discrete pieces; and
  
  means for displaying on a computer the selected one of the external reference materials.
- View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61)
- - 18. The system of claim 17, wherein the means for linking links the plurality of discrete pieces to external reference materials on a word-by-word or phrase-by-phrase basis.
  - 19. The system of claim 18, further comprising:
    - means for compiling the source material image from at least the plurality of discrete pieces; and
      
      means for indexing the plurality of discrete pieces and corresponding links to the external reference materials.
  - 20. The system of claim 19, further comprising:
    - means for building an index for each of the linked external reference materials.
  - 21. The system of claim 20, wherein the look-up table links the identified one of the plurality of discrete pieces to at least a corresponding one of the external reference materials based upon the offset value.
  - 22. The system of claim 21, wherein the identified one of the plurality of discrete pieces is identified based upon the offset value being within a range defined by the starting and ending point addresses of the identified one of the plurality of discrete pieces.
  - 23. The system of claim 17, further comprising:
    - means for manipulating the source material image and the external reference materials with at least two user keys.
  - 24. The system of claim 17, wherein cutting the textual source material into a plurality of discrete pieces is done manually.
  - 25. The system of claim 17, wherein cutting the textual source material into a plurality of discrete pieces is done automatically.
  - 26. The system of claim 25, wherein automatically cutting the textual source material into a plurality of discrete pieces is done using a grammar parser.
  - 27. The system of claim 25, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without using tags.
  - 28. The system of claim 25, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 29. The system of claim 17, wherein the link is a hyperlink.
  - 30. The system of claim 17, wherein the link is an address of the selected one of the external reference materials.
  - 31. The system of claim 17, wherein the link is reference information for retrieving the selected one of the external reference materials.
  - 32. The system of claim 17, wherein determining a display address of the selected discrete portion is done without using tags.
  - 33. The system of claim 17, wherein determining a display address of the selected discrete portion is done without reference to any tags which may be located in the textual source material.
  - 34. The system of claim 17, wherein determining a display address of the selected discrete portion is done without reference to any hierarchical information which may be located in the textual source material.
  - 35. The system of claim 17, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without using tags.
  - 36. The system of claim 17, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any tags which may be located in the textual source material.
  - 37. The system of claim 17, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any hierarchical information which may be located in the textual source material.
  - 38. The system of claim 17, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without using tags.
  - 39. The system of claim 17, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 40. The system of claim 17, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any hierarchical information which may be located in the textual source material.
  - 41. The system of claim 17, wherein the external reference materials comprise a plurality of text based external reference materials.
  - 42. The system of claim 17, wherein the external reference materials comprise a plurality of image based external reference materials.
  - 43. The system of claim 17, wherein the external reference materials comprise a plurality of graphic based external reference materials.
  - 44. The system of claim 17, wherein the external reference materials comprise a plurality of audio based external reference materials.
  - 45. The system of claim 17, wherein the external reference materials comprise a plurality of video based external reference materials.
  - 46. The system of claim 17, wherein at least one of the external reference materials is a combination of two or more of text based external reference material, image based external reference material, graphic based external reference material, audio based external reference material, and video based external reference material.
  - 47. The system of claim 17, wherein linking the plurality of discrete pieces is done manually.
  - 48. The system of claim 17, wherein linking the plurality of discrete pieces is done automatically.
  - 49. The system of claim 17, wherein the electronic database is an electronic relational database.
  - 50. The system of claim 17, wherein the electronic database is an electronic file.
  - 51. The system of claim 17, wherein the electronic database is electronic text.
  - 52. The system of claim 17, wherein the beginning position address is a beginning location of the textual source material in the electronic database.
  - 53. The system of claim 52, wherein each starting point address is a starting location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 54. The system of claim 52, wherein each ending point address is an ending location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 55. The system of claim 17, further comprising:
    - means for displaying the external reference materials corresponding to the identified one of the plurality of discrete pieces in a pop-up menu, prior to selecting one of the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 56. The system of claim 55, wherein the pop-up menu is displayed in the textual source material image next to the selected discrete portion.
  - 57. The system of claim 55, wherein the selected one of the external reference materials is selected using the pop-up menu.
  - 58. The system of claim 55, wherein the pop-up menu displays labels for the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 59. The system of claim 55, wherein the labels can each be selected in the pop-up menu to display the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 60. The system of claim 17, wherein the selected one of the external reference materials is a single word.
  - 61. The system of claim 17, wherein each of the external reference materials is a single word.

62. A computer-implemented method for linking textual source material to external reference materials for display, the method comprising the steps of:
- determining a beginning position address of textual source material stored in an electronic database;
  
  cutting the textual source material into a plurality of discrete pieces;
  
  determining starting point addresses and ending point addresses of the plurality of discrete pieces based upon the beginning position address;
  
  recording in a look up table the starting and ending point addresses;
  
  linking the plurality of discrete pieces to external reference materials by recording in the look-up table, along with the starting and ending point addresses of the plurality of discrete pieces, links to the external reference materials, the external reference materials comprising any of textual, audio, video, and picture information;
  
  selecting a discrete portion of an image of the textual source material;
  
  determining a display address of the selected discrete portion;
  
  converting the display address of the selected discrete portion to an offset value from the beginning position address;
  
  comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces;
  
  selecting one of the external reference materials corresponding to the identified one of the plurality of discrete pieces; and
  
  displaying on a computer the selected one of the external reference materials.
- View Dependent Claims (63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100)
- - 63. The method of claim 62, wherein cutting the textual source material into a plurality of discrete pieces is done manually.
  - 64. The method of claim 62, wherein cutting the textual source material into a plurality of discrete pieces is done automatically.
  - 65. The method of claim 64, wherein automatically cutting the textual source material into a plurality of discrete pieces is done using a grammar parser.
  - 66. The method of claim 64, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without using tags.
  - 67. The method of claim 64, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 68. The method of claim 62, wherein the link is a hyperlink.
  - 69. The method of claim 62, wherein the link is an address of the selected one of the external reference materials.
  - 70. The method of claim 62, wherein the link is reference information for retrieving the selected one of the external reference materials.
  - 71. The method of claim 62, wherein determining a display address of the selected discrete portion is done without using tags.
  - 72. The method of claim 62, wherein determining a display address of the selected discrete portion is done without reference to any tags which may be located in the textual source material.
  - 73. The method of claim 62, wherein determining a display address of the selected discrete portion is done without reference to any hierarchical information which may be located in the textual source material.
  - 74. The method of claim 62, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without using tags.
  - 75. The method of claim 62, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any tags which may be located in the textual source material.
  - 76. The method of claim 62, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any hierarchical information which may be located in the textual source material.
  - 77. The method of claim 62, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without using tags.
  - 78. The method of claim 62, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 79. The method of claim 62, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any hierarchical information which may be located in the textual source material.
  - 80. The method of claim 62, wherein the external reference materials comprise a plurality of text based external reference materials.
  - 81. The method of claim 62, wherein the external reference materials comprise a plurality of image based external reference materials.
  - 82. The method of claim 62, wherein the external reference materials comprise a plurality of graphic based external reference materials.
  - 83. The method of claim 62, wherein the external reference materials comprise a plurality of audio based external reference materials.
  - 84. The method of claim 62, wherein the external reference materials comprise a plurality of video based external reference materials.
  - 85. The method of claim 62, wherein at least one of the external reference materials is a combination of two or more of text based external reference material, image based external reference material, graphic based external reference material, audio based external reference material, and video based external reference material.
  - 86. The method of claim 62, wherein linking the plurality of discrete pieces is done manually.
  - 87. The method of claim 62, wherein linking the plurality of discrete pieces is done automatically.
  - 88. The method of claim 62, wherein the electronic database is an electronic relational database.
  - 89. The method of claim 62, wherein the electronic database is an electronic file.
  - 90. The method of claim 62, wherein the electronic database is electronic text.
  - 91. The method of claim 62, wherein the beginning position address is a beginning location of the textual source material in the electronic database.
  - 92. The method of claim 91, wherein each starting point address is a starting location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 93. The method of claim 91, wherein each ending point address is an ending location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 94. The method of claim 62, further comprising:
    - displaying the external reference materials corresponding to the identified one of the plurality of discrete pieces in a pop-up menu, prior to selecting one of the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 95. The method of claim 94, wherein the pop-up menu is displayed in the textual source material image next to the selected discrete portion.
  - 96. The method of claim 94, wherein the selected one of the external reference materials is selected using the pop-up menu.
  - 97. The method of claim 94, wherein the pop-up menu displays labels for the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 98. The method of claim 94, wherein the labels can each be selected in the pop-up menu to display the external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 99. The method of claim 62, wherein the selected one of the external reference materials is a single word.
  - 100. The method of claim 62, wherein each of the external reference materials is a single word.

101. A system for linking textual source material to external reference materials for display, the system comprising:
- means for determining a beginning position address of a textual source material stored in an electronic database;
  
  means for cutting the textual source material into a plurality of discrete pieces;
  
  means for determining a starting point address and an ending point address of at least one of the plurality of discrete pieces based upon the beginning position address;
  
  means for recording in a look-up table the starting and ending point addresses;
  
  means for linking at least one of the plurality of discrete pieces to at least one of a plurality of external reference materials by recording in the look-up table, along with the starting and ending point addresses of the at least one of the plurality of discrete pieces, a link to the at least one of the plurality of external reference materials, the plurality of external reference materials comprising any of textual, audio, video, and picture information;
  
  means for selecting a discrete portion of an image of the source material;
  
  means for determining a display address of the selected discrete portion;
  
  means for converting the display address of the selected discrete portion to an offset value from the beginning position address;
  
  means for comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces;
  
  means for selecting one of the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces; and
  
  means for displaying on a computer the selected one of the plurality of external reference materials.
- View Dependent Claims (102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145)
- - 102. The system of claim 101, wherein the means for linking links at least one of the plurality of discrete pieces to at least one of a plurality of external reference materials on a word-by-word or phrase-by-phrase basis.
  - 103. The system of claim 102, further comprising:
    - means for compiling the source material image from at least the plurality of discrete pieces; and
      
      means for indexing at least one of the plurality of discrete pieces and corresponding links to the plurality of external reference materials.
  - 104. The system of claim 103, further comprising:
    - means for building an index for each of the linked plurality of external reference materials.
  - 105. The system of claim 104, wherein the look-up table links the identified one of the plurality of discrete pieces to at least a corresponding one of a plurality of external reference materials based upon the offset value.
  - 106. The system of claim 105, wherein the identified one of the plurality of discrete pieces is identified based upon the offset value being within a range defined by the starting and ending point addresses of the identified one of the plurality of discrete pieces.
  - 107. The system of claim 101, further comprising:
    - means for manipulating the source material image and the plurality of external reference materials with at least two user keys.
  - 108. The system of claim 101, wherein cutting the textual source material into a plurality of discrete pieces is done manually.
  - 109. The system of claim 101, wherein cutting the textual source material into a plurality of discrete pieces is done automatically.
  - 110. The system of claim 109, wherein automatically cutting the textual source material into a plurality of discrete pieces is done using a grammar parser.
  - 111. The system of claim 109, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without using tags.
  - 112. The system of claim 109, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 113. The system of claim 101, wherein the link is a hyperlink.
  - 114. The system of claim 101, wherein the link is an address of the selected one of the plurality of external reference materials.
  - 115. The system of claim 101, wherein the link is reference information for retrieving the selected one of the plurality of external reference materials.
  - 116. The system of claim 101, wherein determining a display address of the selected discrete portion is done without using tags.
  - 117. The system of claim 101, wherein determining a display address of the selected discrete portion is done without reference to any tags which may be located in the textual source material.
  - 118. The system of claim 101, wherein determining a display address of the selected discrete portion is done without reference to any hierarchical information which may be located in the textual source material.
  - 119. The system of claim 101, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without using tags.
  - 120. The system of claim 101, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any tags which may be located in the textual source material.
  - 121. The system of claim 101, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any hierarchical information which may be located in the textual source material.
  - 122. The system of claim 101, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without using tags.
  - 123. The system of claim 101, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 124. The system of claim 101, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any hierarchical information which may be located in the textual source material.
  - 125. The system of claim 101, wherein the plurality of external reference materials comprises a plurality of text based external reference materials.
  - 126. The system of claim 101, wherein the plurality of external reference materials comprises a plurality of image based external reference materials.
  - 127. The system of claim 101, wherein the plurality of external reference materials comprises a plurality of graphic based external reference materials.
  - 128. The system of claim 101, wherein the plurality of external reference materials comprises a plurality of audio based external reference materials.
  - 129. The system of claim 101, wherein the plurality of external reference materials comprises a plurality of video based external reference materials.
  - 130. The system of claim 101, wherein at least one of the plurality of external reference materials is a combination of two or more of text based external reference material, image based external reference material, graphic based external reference material, audio based external reference material, and video based external reference material.
  - 131. The system of claim 101, wherein linking at least one of the plurality of discrete pieces is done manually.
  - 132. The system of claim 101, wherein linking at least one of the plurality of discrete pieces is done automatically.
  - 133. The system of claim 101, wherein the electronic database is an electronic relational database.
  - 134. The system of claim 101, wherein the electronic database is an electronic file.
  - 135. The system of claim 101, wherein the electronic database is electronic text.
  - 136. The system of claim 101, wherein the beginning position address is a beginning location of the textual source material in the electronic database.
  - 137. The system of claim 136, wherein each starting point address is a starting location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 138. The system of claim 136, wherein each ending point address is an ending location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 139. The system of claim 101, further comprising:
    - means for displaying the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces in a pop-up menu, prior to selecting one of the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 140. The system of claim 139, wherein the pop-up menu is displayed in the textual source material image next to the selected discrete portion.
  - 141. The system of claim 139, wherein the selected one of the plurality of external reference materials is selected using the pop-up menu.
  - 142. The system of claim 139, wherein the pop-up menu displays labels for the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 143. The system of claim 139, wherein the labels can each be selected in the pop-up menu to display the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 144. The system of claim 101, wherein the at least one of the plurality of external reference materials is a single word.
  - 145. The system of claim 101, wherein each of the plurality of external reference materials is a single word.

146. A computer-implemented method for linking textual source material to external reference materials for display, the method comprising the steps of:
- determining a beginning position address of textual source material stored in an electronic database;
  
  cutting the textual source material into a plurality of discrete pieces;
  
  determining a starting point address and an ending point address of at least one of the plurality of discrete pieces based upon the beginning position address;
  
  recording in a look up table the starting and ending point addresses;
  
  linking at least one of the plurality of discrete pieces to at least one of a plurality of external reference materials by recording in the look-up table, along with the starting and ending point addresses of the at least one of the plurality of discrete pieces, a link to the at least one of the plurality of external reference materials, the plurality of external reference materials comprising any of textual, audio, video, and picture information;
  
  selecting a discrete portion of an image of the textual source material;
  
  determining a display address of the selected discrete portion;
  
  converting the display address of the selected discrete portion to an offset value from the beginning position address;
  
  comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces;
  
  selecting one of the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces; and
  
  displaying on a computer the selected one of the plurality of external reference materials.
- View Dependent Claims (147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184)
- - 147. The method of claim 146, wherein cutting the textual source material into a plurality of discrete pieces is done manually.
  - 148. The method of claim 146, wherein cutting the textual source material into a plurality of discrete pieces is done automatically.
  - 149. The method of claim 148, wherein automatically cutting the textual source material into a plurality of discrete pieces is done using a grammar parser.
  - 150. The method of claim 148, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without using tags.
  - 151. The method of claim 148, wherein automatically cutting the textual source material into a plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 152. The method of claim 146, wherein the link is a hyperlink.
  - 153. The method of claim 146, wherein the link is an address of the selected one of the plurality of external reference materials.
  - 154. The method of claim 146, wherein the link is reference information for retrieving the selected one of the plurality of external reference materials.
  - 155. The method of claim 146, wherein determining a display address of the selected discrete portion is done without using tags.
  - 156. The method of claim 146, wherein determining a display address of the selected discrete portion is done without reference to any tags which may be located in the textual source material.
  - 157. The method of claim 146, wherein determining a display address of the selected discrete portion is done without reference to any hierarchical information which may be located in the textual source material.
  - 158. The method of claim 146, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without using tags.
  - 159. The method of claim 146, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any tags which may be located in the textual source material.
  - 160. The method of claim 146, wherein converting the display address of the selected discrete portion to an offset value from the beginning position address is done without reference to any hierarchical information which may be located in the textual source material.
  - 161. The method of claim 146, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without using tags.
  - 162. The method of claim 146, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any tags which may be located in the textual source material.
  - 163. The method of claim 146, wherein comparing the offset value with the starting and ending point addresses recorded in the look-up table to identify one of the plurality of discrete pieces is done without reference to any hierarchical information which may be located in the textual source material.
  - 164. The method of claim 146, wherein the plurality of external reference materials comprises a plurality of text based external reference materials.
  - 165. The method of claim 146, wherein the plurality of external reference materials comprises a plurality of image based external reference materials.
  - 166. The method of claim 146, wherein the plurality of external reference materials comprises a plurality of graphic based external reference materials.
  - 167. The method of claim 146, wherein the plurality of external reference materials comprises a plurality of audio based external reference materials.
  - 168. The method of claim 146, wherein the plurality of external reference materials comprises a plurality of video based external reference materials.
  - 169. The method of claim 146, wherein at least one of the plurality of external reference materials is a combination of two or more of text based external reference material, image based external reference material, graphic based external reference material, audio based external reference material, and video based external reference material.
  - 170. The method of claim 146, wherein linking at least one of the plurality of discrete pieces is done manually.
  - 171. The method of claim 146, wherein linking at least one of the plurality of discrete pieces is done automatically.
  - 172. The method of claim 146, wherein the electronic database is an electronic relational database.
  - 173. The method of claim 146, wherein the electronic database is an electronic file.
  - 174. The method of claim 146, wherein the electronic database is electronic text.
  - 175. The method of claim 146, wherein the beginning position address is a beginning location of the textual source material in the electronic database.
  - 176. The method of claim 175, wherein each starting point address is a starting location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 177. The method of claim 175, wherein each ending point address is an ending location of at least one of the plurality of discrete pieces based upon the beginning location of the textual source material.
  - 178. The method of claim 146, further comprising:
    - displaying the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces in a pop-up menu, prior to selecting one of the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 179. The method of claim 178, wherein the pop-up menu is displayed in the textual source material image next to the selected discrete portion.
  - 180. The method of claim 178, wherein the selected one of the plurality of external reference materials is selected using the pop-up menu.
  - 181. The method of claim 178, wherein the pop-up menu displays labels for the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 182. The method of claim 178, wherein the labels can each be selected in the pop-up menu to display the at least one of the plurality of external reference materials corresponding to the identified one of the plurality of discrete pieces.
  - 183. The method of claim 146, wherein the at least one of the plurality of external reference materials is a single word.
  - 184. The method of claim 146, wherein each of the plurality of external reference materials is a single word.

Specification

Resources

Litigation Campaign Assessment

Litigation Data

Current Assignee
Sentius International, LLC (Sentius Corporation)
Original Assignee
Sentius International, LLC (Sentius Corporation)
Inventors
Bookman, Marc, Yamanaka, Brian
Primary Examiner(s)
Hudspeth, David
Assistant Examiner(s)
SPOONER, LAMONT M

Application Number

US12/480,556
Time in Patent Office

1,184 Days
Field of Search

707706-708, 707/758, 707/999.003, 704/1, 704/9, 704/10, 715/255, 715/856, 345/157, 345/160
US Class Current

704/3
CPC Class Codes

G09B 19/06 Foreign languages with audi...

G09B 5/065 Combinations of audio and v...

System and method for linking streams of multimedia data to reference material for display

First Claim

5 Assignments

Litigations

0 Petitions

Accused Products

Abstract

252 Citations

184 Claims

Specification

Use Cases

Quick Links

Others

System and method for linking streams of multimedia data to reference material for display

First Claim

5 Assignments

Subscription Required

Subscription Required

Litigations

0 Petitions

Subscription Required

Accused Products

Subscription Required

Abstract

252 Citations

184 Claims

Specification

Subscription Required

Use Cases

Quick Links

Others