JP4339650B2 - Information processing method, program for causing computer to execute the method, and information processing system - Google Patents

Description

  The present invention relates to an information processing method, a program that causes a computer to execute the method, and an information processing system, and more particularly to an information processing system that records and reproduces audio data, image data, and the like. The present invention relates to an information processing method for improving information acquisition efficiency and simplifying information management, a program for causing a computer to execute the method, and an information processing system.

  In general, information required for work and life is often obtained from a paper medium or an electronic storage medium. The paper medium is, for example, a newspaper, a magazine, a book, a memo, a mail, and the like, and is used when exchanging information such as characters and images. On the other hand, the electronic storage medium stores radio waves transmitted from television stations, radio stations, communication satellites, etc., and image and audio data captured using a video camera as electronic files. Alternatively, it is a medium for storing Web contents such as images and sounds acquired via the Internet, contents distributed on a CD-ROM or DVD, and the like. The electronic storage medium is, for example, an HD, a CD-RW, a DVD, or the like, and is used when characters, sounds, and image information are exchanged.

  The paper medium has advantages such as good listability and easy handling, and has high write-once properties such as character information. Electronic storage media has a much larger storage capacity for information than paper media, so the electronic files stored in it have excellent output in terms of high information description capability and easy understanding. Has the advantage of being able to. A technique for associating a paper medium having such different properties and advantages with an electronic storage medium has been proposed.

  This technology associates paper medium information such as newspapers and books with Web contents stored in different media such as the Internet. For example, an index code for specifying individual posted contents is written in advance on the surface of a printed matter such as a newspaper or a book. This index code is input from the input device or reader of the terminal device, transmitted to the server via the network, and the electronic file transmitted from the server device corresponding to the index code is output from the display, speaker, printer, etc. In this way, a method for acquiring information for easily obtaining an electronic file related to contents published in a printed matter such as a newspaper or a book has been proposed (see Patent Document 1 below).

JP 08-272720 A

  However, even if the method of Patent Document 1 described above is a mechanism for associating the paper surface information by the paper medium with the electronic file information by the electronic storage medium, the present invention is prepared in advance by a newspaper company or a publisher. Electronic file information can be obtained only from index codes posted on paper information such as printed matter. For this reason, an individual or another company cannot freely generate an index code and use it in association with electronic file information.

  In addition, in the method of Patent Document 1, when it is desired to hold information necessary for each individual, electronic file information that can be acquired from an index code posted on paper information is determined in advance. It is necessary to select necessary information from the list. Furthermore, it is necessary to cut out index codes associated with the selected electronic file information from published newspapers or magazines or to transfer them to other paper media such as notebooks.

  In the method of Patent Document 1, for example, when the acquired electronic file information is moving image data, the moving image data is reproduced from the start position of the data. For this reason, when the information to be viewed is in the middle of the data, it is necessary to fast-forward to that position, and efficient reproduction cannot be performed.

  On the other hand, dynamic electronic file information that changes in time series, such as moving images and voices, is usually found while checking the contents, so you can find the location you want to store, so you can review or review them It is desirable to be able to indicate or check the position to be memorized during the process.

  The present invention adds search information for efficiently reproducing recorded audio data and image data in order to eliminate the above-described problems caused by the prior art, and sets the data position indicated by the search information and the paper medium. Information processing method capable of improving information acquisition efficiency and simplifying information management by associating and simply issuing a reproduction instruction from a paper medium, a program for causing a computer to execute the method, and an information processing system The purpose is to provide.

  In order to solve the above-described problems and achieve the object, an information processing method according to the first aspect of the present invention includes a photographing step of photographing a photographing target to obtain image data, and obtaining voice data by acquiring the sound of the photographing target. A recording step for recording at least one of the image data obtained by the sound acquisition step, the image data obtained by the photographing step, and the sound data obtained by the sound acquisition step as recording data; and the recording data by the recording step. When recording, an input signal receiving step of receiving an input signal including search information for searching the recorded data from the terminal, and the search in which the input is received by the input signal receiving step when receiving the input signal A conversion step of converting information into corresponding predetermined pattern information, and the pattern information converted by the conversion step is a paper medium Anda printing step of printing, by writing strokes for the scene input search information into printed paper medium, characterized in that associating the pattern information and the paper medium.

  According to a second aspect of the present invention, in the information processing method of the first aspect, the input signal receiving step inputs the search information and time information when the input of the search information is accepted. It is characterized by that.

  The information processing method according to a third aspect of the present invention is the information processing method according to the first or second aspect, wherein the printing step uses the conversion step to pattern search information received by the input signal reception step. When printing by converting to information, a part of the image data corresponding to the time indicated by the time information at which the input of the search information is accepted among the recorded data recorded by the recording process as a still image It is characterized by printing.

  The information processing method according to a fourth aspect of the present invention is the information processing method according to any one of the first to third aspects, wherein the printing step receives search information by the input signal reception step, Each time search information is converted into pattern information by the conversion step, the pattern information is printed.

  An information processing method according to a fifth aspect of the present invention is the information processing method according to any one of the first to third aspects, wherein the input signal receiving step stores the search information each time an input of the search information is received. A storage step, wherein the conversion step collectively converts the search information stored by the storage step into corresponding predetermined pattern information after the recording data is recorded by the recording step, In the printing step, the pattern information converted in a batch by the conversion step is printed.

  An information processing method according to a sixth aspect of the present invention is the information processing method according to any one of the first to fifth aspects, wherein after the recording data is recorded by the recording step, the paper medium is printed by the printing step. A reading step for reading the pattern information printed on the recording medium, and requesting acquisition of the recording data specified by the content of the pattern information read by the reading step from the recording data recorded by the recording step It includes an acquisition requesting step and an output step of outputting the recording data acquired in the acquisition requesting step using an image, text, sound, or the like.

  A program according to a seventh aspect of the invention can cause a computer to execute the method according to any one of the first to sixth aspects.

According to an eighth aspect of the present invention, there is provided an information processing system for photographing an object to be photographed to obtain image data, sound acquisition means for obtaining sound of the object to be photographed and obtaining sound data, and the photographing When recording the recording data by the recording means, the recording means for recording at least one of the image data obtained by the means and the audio data obtained by the sound acquisition means, and the recording means, Corresponding to the input signal receiving means for receiving an input signal including search information for searching the recorded data from the terminal, and the search information received by the input signal receiving means when the input signal is received indicia and converting means for converting into a predetermined pattern information, the pattern information converted by said converting means, for printing on a paper medium And means, and by writing the handwritten information for the scene input search information into printed paper medium, characterized in that associating the pattern information and the paper medium.

  An information processing system according to a ninth aspect of the present invention is the information processing system according to the eighth aspect, wherein the input signal receiving means inputs the search information and time information when the input of the search information is accepted. It is characterized by that.

  An information processing system according to a tenth aspect of the present invention is the information processing system according to the eighth or ninth aspect, wherein the printing unit uses the conversion unit to pattern the search information received by the input signal receiving unit. When printing by converting into information, a part of the image data corresponding to the time indicated by the time information at which the input of the search information is accepted among the recorded data recorded by the recording unit is set as a still image. It is characterized by printing.

  An information processing system according to an eleventh aspect of the present invention is the information processing system according to any one of the eighth to tenth aspects, wherein the printing means receives search information input by the input signal receiving means, Each time search information is converted into pattern information by the conversion means, the pattern information is printed.

An information processing system according to a twelfth aspect of the present invention is the information processing system according to any one of the eighth to tenth aspects, wherein the input signal receiving means stores the search information each time an input of the search information is received. Storage means that converts the search information stored by the storage means into corresponding predetermined pattern information after the recording data is recorded by the recording means, The printing unit prints the pattern information collectively converted by the conversion unit.

  An information processing system according to a thirteenth aspect of the present invention is the information processing system according to any one of the eighth to twelfth aspects, wherein the paper medium printed by the printing means is formed in a desired shape and size. It is characterized by being plain paper.

  An information processing system according to a fourteenth aspect of the present invention is the information processing system according to any one of the eighth to twelfth aspects, wherein the paper medium printed by the printing unit is formed in a desired shape and size. The paper base material is characterized in that a part of one surface of the paper base material is coated with an adhesive capable of repeated re-adhesion.

  An information processing system according to a fifteenth aspect of the present invention is the information processing system according to any one of the eighth to twelfth aspects, wherein the paper medium printed by the printing unit is formed in a desired shape and size. The label substrate is characterized in that an adhesive is applied to the entire area of one side of the label substrate.

  An information processing system according to a sixteenth aspect of the present invention is the information processing system according to any one of the eighth to fifteenth aspects, wherein the pattern information is a barcode.

  An information processing system according to a seventeenth aspect of the present invention is the information processing system according to the sixteenth aspect, characterized in that the barcode is a two-dimensional barcode.

  An information processing system according to an eighteenth aspect of the present invention is the information processing system according to any one of the eighth to seventeenth aspects, wherein the recording unit records the recording data so that the printing unit records the paper. An acquisition request for reading the pattern information printed on the medium, and the recording data specified by the content of the pattern information read by the reading means from the recording data recorded by the recording means And an output unit that outputs the recording data acquired by the acquisition request unit using images, characters, sounds, and the like.

  As described above, according to the present invention, search information for efficiently reproducing recorded audio data and image data is added, the data position indicated by the search information is associated with the paper medium, and the paper medium Thus, it is possible to improve the information acquisition efficiency and simplify the information management by simply giving a reproduction instruction.

  Exemplary embodiments of an information processing method, a program for causing a computer to execute the information processing method, and an information processing system according to the present invention will be explained below in detail with reference to the accompanying drawings.

(Embodiment 1)
First, the system configuration of the information processing system according to the embodiment of the present invention will be described. FIG. 1 is a configuration diagram showing a system configuration of an information processing system according to the first embodiment of the present invention. As shown in the figure, a mobile terminal 101, a printer 102, a moving image display terminal device 104, a video recording / distribution terminal device 107, and a print server 108 are connected via a LAN (Local Area Network) 100. It is connected. Further, the code scanner 103 is connected to the moving image display terminal device 104, and the camera 105 and the microphone 106 are connected to the video recording / distribution terminal device 107.

  In FIG. 1, a portable terminal 101 is a terminal device for performing an input operation of search information for reproducing recorded data recorded by a video recording / distribution terminal device 107 described later from a desired position. A function of inputting search information from a keyboard, a touch panel 205 (see FIG. 2), which will be described later, or a pressure-sensitive pen-input device is provided. Further, in order to acquire information such as a file name of recorded data from the video recording / distribution terminal device 107, an information communication function for transferring data via the LAN 100 or the Internet is provided. The portable terminal 101 is a PDA (Personal Digital Assistant (R)) having a communication function, but may be a desktop personal computer or a notebook personal computer.

  The printer 102 performs printing of materials, documents, image data, and the like, and is, for example, a laser printer or an ink jet printer. In the printer 102, a print command issued from each device is transmitted to the print server 108 and printed out by the print control of the print server 108.

  The moving image display terminal device 104 is configured by a general information processing device including a CPU, a RAM, a display, an HD (hard disk), and the like (not shown). The moving image display terminal device 104 retrieves at least one of audio data and image data recorded in the video recording / distribution terminal device 107, which will be described later, as recording data, and records data from the video recording / distribution terminal device 107. Play on the display by getting The moving image display terminal device 104 expands and executes a moving image display program for reproducing recorded data stored in a hard disk or the like on the RAM under the control of the CPU. The moving image display terminal device 104 is connected to a code scanner 103 for reading a barcode, and is used when searching for recorded data. As the moving image display terminal device 104, for example, various personal computers or workstations are used.

  The video recording / distribution terminal device 107 records data in a target scene such as a lecture hall or a conference room, and distributes the recorded data. The video recording / distribution terminal device 107 includes a CPU, a RAM, a display, a hard disk, etc. (not shown). The video recording / distribution terminal device 107 uses image data and audio data captured by the camera 105 and the microphone 106. Is input via a memory for the purpose of temporary buffering. At that time, audio data from the microphone 106 is taken in via the voice input interface, and image data from the camera 105 is taken in via the image interface. As the video recording / distribution terminal device 107, for example, various personal computers or workstations are used.

  The video recording / distribution terminal device 107 according to the present invention is configured by developing a recording program for recording recording data stored in a hard disk or the like in the RAM under the control of the CPU and executing it. Input recording data such as image data and audio data is output as a file to a storage device such as a hard disk or an MO under the control of a recording program.

  Note that the moving image display terminal device 104 may be placed in a place other than the target scene, such as an office room, as long as it is connected to the same LAN as the other devices. The video recording / distribution terminal device 107 is connected to a camera 105 that records video of the target scene and a microphone 106 that records audio.

  FIG. 2 is a block diagram showing a hardware configuration of the portable terminal according to the first embodiment of the present invention. As illustrated in FIG. 2, the mobile terminal 101 includes a CPU 201, a memory 202, a clock 203, a liquid crystal display 204, a touch panel 205, and a network interface 206. Each component is connected by a bus 200.

  Here, the CPU 201 controls the entire mobile terminal 101. The memory 202 is used as a work area for the CPU 201. The clock 203 is a system clock and is used as a clock that serves as a reference for all time information on the portable terminal 101. The liquid crystal display 204 is a display using a liquid crystal display.

  The touch panel 205 detects that the user has touched with the pen, and when the pen touches the panel, a pen down signal, when the pen moves while touching the panel, a pen move signal, and when the pen leaves the panel Outputs a pen-up signal and an XY coordinate value as its position signal. In addition, it is installed on the display surface of the liquid crystal display 204 so that the user can operate buttons and the like displayed on the display.

  The portable terminal 101 develops and executes an input program stored in a ROM or hard disk (not shown) on the RAM under the control of the CPU 201. The input program is a program for inputting search information for searching record data recorded by the video recording / distribution terminal device 107. The search information is input by acquiring a tap signal with the attached pen or finger on the touch panel 205 described above.

  FIG. 3 is a flowchart showing an example of processing of the recording program in the video recording / distribution terminal device according to the first embodiment of the present invention. FIG. 3 is a flowchart showing the operation of a recording program that operates on the video recording / distribution terminal device 107 and records recording data acquired by at least one of the camera 105 and the microphone 106.

  When the recording program is executed in the video recording / distribution terminal device 107, a recording program display screen (see FIG. 4) described later is displayed (step S301). Then, it is determined whether or not a Start button 402 (see FIG. 4) described later has been pressed (step S302). If it is determined that the Start button 402 has not been pressed (step S302: No), the determination is continued as it is (step S302).

  If it is determined that the Start button 402 has been pressed (step S302: Yes), the recording data based on at least one of the image data from the camera 105 and the audio data from the microphone 106 is recorded as a video recording / delivery terminal device. The data is recorded in a hard disk (not shown) or an external storage device 107 (step S303).

  Then, it is determined whether or not a stop button 403 (see FIG. 4) described later has been pressed (step S304). If it is determined that the Stop button 403 has not been pressed (step S304: No), the recording data is recorded as it is, and the determination is continued (step S304). If it is determined that the Stop button 403 has been pressed (step S304: Yes), the recording of the recording data is stopped, the recording data is saved, and the process is terminated.

  FIG. 4 is an explanatory diagram showing an example of a recording program display screen according to the first embodiment of the present invention. The display screen shown in FIG. 4 is executed by the video recording / distribution terminal device 107 and is displayed by the recording program shown in the flowchart of FIG.

  When the recording program is executed in the video recording / distribution terminal device 107, a window 400 shown in FIG. 4 is displayed on the display. An object 401 shown in the upper part of the screen displays an image captured and recorded by the camera 105. At the bottom of the screen, a Start button 402 and a Stop button 403 are displayed. When the Start button 402 is pressed, recording of the recording data using at least one of the image data from the camera 105 and the audio data from the microphone 106 is started on the video recording / distribution terminal device 107. Press to stop recording.

  The file format of data to be recorded is, for example, MPEG-4 (Moving Picture Experts Group Phase 4). Further, as an example of the file name when recording, when recording starts from 15:25:19 on September 13, 2002, “2002-09-13” with the year, month, day, hour, minute, and second as the file name By naming it as “15-25-19.mpg”, the file name can be uniquely determined as long as the recording data is not recorded at the same time.

  FIG. 5 is a flowchart showing an example of an input program process in the portable terminal 101 according to the first embodiment of the present invention. FIG. 5 is a flowchart showing the operation of an input program for inputting on the mobile terminal 101 search information for reproducing recorded data to be recorded in the video recording / distribution terminal device 107 from a desired position.

  When the input program is executed on the portable terminal 101, an input program display screen (see FIG. 6) described later is displayed on the liquid crystal display 204 (step S501). Next, it enters a standby state for an instruction input from the user using a pen for an Insert button 601 (see FIG. 6), which will be described later, displayed on the touch panel 205 on the liquid crystal display 204 (step S502). Then, it is determined whether or not an end button 602 (see FIG. 6), which will be described later, has been pressed (step S503). If it is determined that the End button 602 has been pressed (step S503: Yes), the processing ends.

  When it is determined that the End button 602 has not been pressed and the Insert button 601 has been pressed (step S503: No), the recorded data recorded on the video recording / distribution terminal device 107 is reproduced from a desired position later. The search information is input (step S504). Then, the search information input in step S504 is transmitted to the print server 108 via the network interface 206 together with the time information acquired in the clock 203 (step S505), and the process is terminated.

  FIG. 6 is an explanatory diagram showing an example of a display screen of the input program according to the first embodiment of the present invention. FIG. 6 shows a display screen displayed when the input program is executed on the mobile terminal 101. Using this display screen as an interface, search information for reproducing recorded data from the recording program shown in FIG. 3 from a desired position is input.

  When the input program is activated on the portable terminal 101, a window 600 appears on the liquid crystal display 204. The window 600 displays an explanation when inputting search information at the top, and an Insert button 601 and an End button 602 are displayed below it. The Insert button 601 is used to input search information while recording data is being recorded by the video recording / distribution terminal device 107.

  The search information may be input by pressing the Insert button 601 while looking directly at the shooting target. Further, the recorded data is displayed on the window 600 of the video recording / distribution terminal device 107, and when the scene to be reproduced later is displayed while being visually confirmed, the Insert button 601 is pressed. May be. The contents of the input search information will be described later with reference to FIG. An End button 602 is displayed at the bottom of the screen. When the End button 602 is pressed, the input program for inputting search information is terminated, and the window 600 in FIG. 6 is closed.

  FIG. 7 is an explanatory diagram showing an example of search information according to the first embodiment of the present invention. FIG. 7 shows search information that is input when an input program is executed on the mobile terminal 101 and the Insert button 601 is pressed.

  For example, it is assumed that the recording start time of recording data by the video recording / distribution terminal device 107 is September 13, 2002, 15:25:19. The time when the Insert button 601 is pressed is assumed to be 15:35:24 on September 13, 2002. In this case, the time when the Insert button 601 is pressed is 605 seconds after the start of recording, and the input program executed on the portable terminal 101 generates search information as shown in FIG. “Videoserver” shown in the search information example 701 in the figure indicates the host name of the video recording / distribution terminal device 107, and view. “cgi” indicates a file name of a moving image distribution program body to be described later.

  The file name of the recording data is acquired from the video recording / distribution terminal device 107 to the portable terminal 101 every time the Insert button 601 is pressed in the input program on the portable terminal 101. In this example, 2002-09-13-15-25-19. This shows data instructed to reproduce the recording data called mpg (src = in the figure) from 605 seconds (start = in the figure). Also, depending on how URL variables are given and rules in the video distribution program, not only the elapsed time from the start time, but also from the start time to the end time, a predetermined time from the specified time (for example, 3 minutes, etc.), etc. Can also be sent. The recorded data can be acquired from the video recording / delivery terminal device 107 by accessing the URL which is the search information shown in FIG.

  FIG. 8 is a flowchart showing an example of processing of the pattern information printing program in the print server 108 according to the first embodiment of the present invention. FIG. 8 is a flowchart showing an operation until the search information input by the portable terminal 101 is converted into pattern information and printing is performed by the printer 102.

  The pattern information printing program executed in the print server 108 receives search information transmitted from the input program executed in the portable terminal 101 (step S801). The received search information is converted into visible pattern information (step S802). For example, when the search information is expressed by single-byte alphanumeric characters, it can be converted into pattern information that is a two-dimensional barcode by using a PDF417 code (for example, as character information on a memo paper 901 in FIG. 9 described later). Pattern information displayed below the search information listed).

  Here, bar codes, particularly two-dimensional bar codes, are characterized in that the amount of data that can be encoded is larger than that of one-dimensional bar codes. This means that a one-dimensional bar code is used as an identification code, whereas a two-dimensional bar code can be used as a large-capacity data storage medium. In addition, an error recovery function using a special mathematical method is provided, so that accurate reading can be performed even if the printing accuracy is poor or a part of the code is dirty or damaged.

  In the present invention, the retrieval information is read by bar code input, so that it is possible to save the input time when acquiring the recording data and to acquire the data efficiently. Furthermore, by using a two-dimensional barcode instead of a one-dimensional barcode, a large amount of data can be held as search information, and the operability when reading can be improved. Become.

  Further, by using a commercially available software development kit such as BarStar Pro DTK (R) manufactured by AINIX, search information as character information can be converted into pattern information. Next, the pattern information converted in step S802 is printed by issuing a print instruction to the printer 102 (step S803). This operation can be easily realized by issuing a print command using the functions of various existing OSs (Operating System) and using control of a printer driver installed in the printer 102. The destination for printing out the pattern information is a paper medium from the viewpoint of excellent listability and additional writeability, but it can be used as needed if there is another available medium such as an OHP sheet.

  FIG. 9 is an explanatory diagram showing a printed paper medium example 1 according to the first embodiment of the present invention. FIG. 9 shows a specific example of a print result when the search information input by the portable terminal 101 is converted as pattern information by the print server 108 and printing is performed by the printer 102.

  The example shown in FIG. 9 is an explanatory diagram in which a memo paper 901 is used as a printing destination paper medium. At the top of the memo sheet 901, the input search information is written as character information, and below that, pattern information obtained by converting the search information is printed. Further, a ruled line is drawn below, and the user can use this memo paper 901 to write a memo for a scene where search information is input from the mobile terminal 101. Thereby, it becomes possible to easily associate a handwritten memo regarding an important scene of the recorded data with the recorded data itself.

  FIG. 10 is an explanatory diagram showing a printed paper medium example 2 according to the first embodiment of the present invention. FIG. 10 shows a specific example of the print result when the search information input by the portable terminal 101 is converted as pattern information by the print server 108 and printing is performed by the printer 102, as in FIG. is there.

  The example shown in FIG. 10 is an explanatory diagram in which the paper medium at the printing destination is a label 1002 with a sticker mount 1001. In the figure, only the pattern information obtained by converting the search information is printed on the label 1002. For example, when paper materials such as resumes are distributed during a meeting or lecture, or when writing in a memo pad prepared by the user, the label 1002 is used for such materials or memo pad paper. By pasting on the medium, the paper information and the recording data can be easily associated with each other.

  FIG. 11 is an explanatory diagram showing a printed paper medium example 3 according to the first embodiment of the present invention. In FIG. 11, as in FIGS. 9 and 10, specific examples of print results when the search information input by the mobile terminal 101 is converted as pattern information by the print server 108 and printing is performed by the printer 102. Is shown.

  The example shown in FIG. 11 is an explanatory diagram in which the paper medium of the print destination is a sticky note paper 1101. In the drawing, only pattern information obtained by converting search information is printed on a sticky note 1101. In addition, an adhesive that can be repeatedly peeled is applied to the back side of the hatched portion in the figure. Similar to the label 1002 shown in FIG. 10, the sticky note 1101 can be associated with the recording data by associating the paper information with the recording data by attaching it to an important part of the distributed document or memo. become able to.

  FIG. 12 is a flowchart showing an example of processing of the moving image display program in the moving image display terminal device 104 according to the first embodiment of the present invention. In FIG. 12, the pattern information printed by the printer 102 is read by the code scanner 103 connected to the moving image display terminal device 104, and the recording data indicated by the read pattern information is acquired by the video recording / distribution terminal device 107. The flowchart which requests and displays on the moving image display terminal device 104 is shown.

  First, when a moving image display program is started on the moving image display terminal device 104, the contents shown in a display screen (see FIG. 13) to be described later are displayed. Then, the pattern information shown in FIGS. 9 to 11 is read using the code scanner 103 (step S1201). On the screen, a display screen 1302 (see FIG. 13) described later and an end button 1303 (see FIG. 13) described later are displayed.

  The file name and time information of the record data, which is the search information read in step S1201, are read out, the record data corresponding to the time is requested to the video recording / distribution terminal device 107, and the received record data will be described later. It displays on the display screen 1302 of FIG. 13 (step S1202). Then, it is determined whether or not the end button 1303 has been pressed (step S1203).

  If the end button 1303 has not been pressed (step S1203: No), the display of the recording data displayed on the display screen 1302 is continued (step S1202). When the end button 1303 is pressed (step S1203: Yes), the display of the recorded data is ended and the process is ended.

  FIG. 13 is an explanatory diagram showing an example of a display screen of the moving image display program according to the first embodiment of the present invention. The display screen shown in FIG. 13 is displayed by a moving image display program executed on the moving image display terminal device 104.

  When the moving image display program is executed in the moving image display terminal device 104, a window 1301 shown in FIG. 13 is displayed on the display. The title is displayed in the upper bar of the window 1301, and the user can read the pattern information printed on the paper medium by the pattern information printing program of the print server 108 with the code scanner 103 at the upper part of the screen body below the window 1301. The instruction to instruct is displayed.

  On the display screen 1302 below, the video recording / distribution terminal device 107 is requested to acquire the recording data corresponding to the time from the file name and time information of the recording data that is the search information read by the code scanner 103. The acquired recording data is displayed on the display screen 1302. In FIG. 13, the video data to be displayed has not yet been specified, and the display screen 1302 for performing the display is blacked out. When the moving image display program is terminated, an end button 1303 is pressed.

  As described above, according to the first embodiment, at least one of the image data and the audio data input from the camera 105 and the microphone 106 is recorded, and the data is reproduced later. Search information indicating the playback position of the desired recorded data can be input from the touch panel 205 of the portable terminal 101. Accordingly, it is possible to easily input search information indicating a desired reproduction position from recorded data while visually confirming it, and it is possible to improve information acquisition efficiency.

  Also, the input search information can be printed on a paper medium from the printer 102 as pattern information such as a two-dimensional barcode. As a result, the search information indicating the desired reproduction position can be printed from the recorded data and output to the paper medium at the input position, so that the operator can easily read the information on the paper medium. You can create it. Furthermore, there is no need to transfer recorded data or the contents of the input search information or take notes, thereby simplifying information management.

  Further, the pattern information of the two-dimensional barcode printed by the printer 102 can be read, the recording data can be acquired from the read search information, and can be reproduced from a desired reproduction position. As a result, it becomes possible to associate the recording medium with a paper medium having a list property and a write-once property.

(Embodiment 2)
FIG. 14 is a flowchart showing an example of input program processing in the portable terminal 101 according to the second embodiment of the present invention. In FIG. 5, printing is performed every time search information is input from the mobile terminal 101. However, in FIG. 14, search information for reproducing recorded data recorded in the video recording / distribution terminal device 107 from a desired position. The operation of the input program for collectively inputting the above on the portable terminal 101 is shown in a flowchart.

  First, the display screen of the input program shown in FIG. 6 is displayed on the liquid crystal display 204 (step S1401). Next, the system enters a standby state for an instruction input in which the user presses the Insert button 601 shown in FIG. 6 displayed on the touch panel 205 using a pen or the like (step S1402). Then, it is determined whether or not the End button 602 shown in FIG. 6 has been pressed (step S1403). If it is determined that the End button 602 has been pressed (step S1403: Yes), the process ends.

  If it is determined that the End button 602 has not been pressed and the Insert button 601 has been pressed (step S1403: No), the recorded data recorded on the video recording / distribution terminal device 107 is reproduced from a desired position. The search information is stored in the memory 202 (step S1404), and the process returns to the standby state for the user instruction input shown in step S1402.

  FIG. 15 is a flowchart showing an example of processing of the pattern information printing program in the print server 108 according to the second embodiment of the present invention. In FIG. 15, the print server 108 receives a list of search information stored in the mobile terminal 101, converts each of the plurality of search information included in the list into pattern information, and collects each desired number by the printer 102. The flow of printing is shown in the flowchart. Here, the list refers to a file in which a plurality of search information is collected, and refers to a form when a plurality of search information is temporarily stored in the memory 202 of the portable terminal 101 and then transmitted to the print server 108.

  First, the pattern information printing program detects a signal indicating that the recording program has ended from the video recording / distribution terminal device 107 via the LAN 100 (step S1501). When the end of the recording program is detected in step S1501, a list of search information recorded in the memory 202 of the portable terminal 101 is received (step S1502). However, when a plurality of portable terminal devices equivalent to the portable terminal 101 are connected to the LAN 100, the user ID is received together with the list. The print server 108 determines from which mobile terminal device each list is received based on the user ID. Then, pattern information to be described later is also printed for each user ID.

  Each piece of search information included in the list received from the mobile terminal 101 is converted into visible pattern information (step S1503). The pattern information converted in step S1503 is printed by issuing a print instruction to the printer 102 (step S1504). This operation can be easily realized by issuing a print command using the functions of various existing OSs (Operating System) and using control of a printer driver installed in the printer 102.

  FIG. 16 is an explanatory diagram showing a paper medium example 1 that is a result of collectively printing search information according to the second embodiment of the present invention. FIG. 16 shows a specific example when the print server 108 receives a plurality of search information stored in the portable terminal 101 as a list, converts the search information into pattern information, and performs printing from the printer 102.

  An example in which search information input and stored in the portable terminal 101 is collectively printed on a paper medium 1601 is shown. The file name of the recorded data is printed at the top of the paper medium 1601, and character information indicating the ID of the user who recorded the search information is printed below the file name. Below that, the pattern information obtained by converting the search information and the time information of the recording data indicated by the pattern information are printed. The number of combinations of the pattern information printed in one page and the time information of the recording data is determined by the size of the pattern information itself and the print setting when transmitting to the print server 108. As described above, since the pattern information for reproducing the recording data and the search information are displayed in a list on the paper surface, the recording data can be efficiently reproduced from a desired position.

  FIG. 17 is an explanatory diagram showing a paper medium example 2 that is a result of collectively printing search information according to the second embodiment of the present invention. FIG. 17 shows a specific example when the print server 108 receives a plurality of search information stored in the portable terminal 101 as a list, converts it into pattern information, and prints from the printer 102.

  An example in which search information input and stored in the portable terminal 101 is collectively printed on a paper medium 1701 is shown. A file name of recorded data is printed at the top of the paper medium 1701, and character information indicating the ID of the user who recorded the search information is printed below the file name. Below that, an index image 1702 and pattern information obtained by converting search information are printed.

  Here, the index image 1702 is a still image at a corresponding time of the recording data, and is printed instead of the time information. As shown in the figure, if there is an index image 1702, visual changes such as the gesture of the explainer photographed in the still image, the movement of other participants, and the writing operation of the explainer are displayed in a list on the paper. Therefore, it is possible to efficiently reproduce the recorded data from a desired position.

  As described above, according to the second embodiment, when recording data is recorded on the video recording / distribution terminal device 107, search information for reproducing the recording data from a desired position is stored in the portable terminal. 101 is input from the touch panel 205, and a plurality of items are stored in the memory 202, and printing from the printer 102 can be performed at once. For this reason, it is possible to obtain a plurality of print results on a paper medium having a high listability. In addition, since the pattern information to be read by the code scanner 103 is displayed in a list in the print result, the pattern information can be read, that is, the recording data can be obtained efficiently.

  Further, since the pattern information is printed and the index image 1702 which is a still image of the recorded data is printed, it is easy to visually grasp what scene the recorded data is to be reproduced at a desired position. Furthermore, as shown in FIG. 17, a desired position of the recorded data can be searched from the gesture of the explainer photographed in the index image 1702, the movement of other participants, and the like, which is necessary efficiently. It is possible to acquire various information.

(Embodiment 3)
FIG. 18 is an explanatory diagram showing an apparatus example 1 according to the third embodiment of the present invention. In the first and second embodiments described above, the input program is executed on the mobile terminal 101. However, other programs such as a recording program, a pattern information printing program, a moving image display program, and a moving image distribution program are also available. It can be executed by the mobile terminal 101. For example, each function can be realized by mounting a recording medium 1801 storing these programs on the portable terminal 101 and appropriately executing the above-described programs from the recording medium 1801.

  FIG. 19 is an explanatory diagram showing Device Example 2 according to the third embodiment of the present invention. Each program such as the recording program, the input program, the pattern information printing program, the moving image display program, and the moving image distribution program described in the first and second embodiments can be executed by the personal computer 1902. Each function can be realized by mounting a recording medium 1901 (for example, a CD-ROM) storing these programs on the personal computer 1902 and appropriately executing the above-described programs from the recording medium 1901. it can.

  As described above, according to the third embodiment, the apparatus for executing the recording program, the input program, the pattern information printing program, the moving image display program, and the moving image distribution program described in the first and second embodiments is implemented. The present invention is not limited to the devices shown in the first and second embodiments.

  In the above embodiment, the video recording / distribution terminal device 107, the portable terminal 101, the printer 102, the print server 108, and the moving image display terminal device 104 are described as being connected in the same LAN 100. However, other connection forms may be used. For example, the moving image display terminal device 104 is connected to an external network, from which the LAN 100 to which the video recording / distribution terminal device 107 is connected can be accessed.

  In FIG. 1, the moving image display terminal device 104, the print server 108, and the video recording / distribution terminal device 107 have been described as separate machines, but other configurations may be used. For example, a device that records video and a device that distributes video may be separated. Further, one terminal device or portable terminal device may perform all of video recording, printer control, and video display / playback (in the case of one device, the distribution function is unnecessary). In this case, it is sufficient that one terminal device or portable terminal device has an interface for connecting the printer 102.

  In the above-described first to third embodiments, it has been described that a single printer 102 prints paper media of a plurality of users. However, each mobile terminal 101 may be connected to the printer 102. For example, there are mobile terminal devices with PocketPC OS (R) and mobile printers capable of infrared connection, such as MW-100 (R) manufactured by Brother Industries, Ltd. It is also possible to connect one mobile printer.

  In the first to third embodiments described above, it has been described that the moving image display program is started before reading the pattern information. For example, the moving image display program is started at the same time as the pattern information is read, and an acquisition request is made. The recorded data may be reproduced.

  In the first to third embodiments described above, the recording data file format is described as MPEG-4. However, other file formats may be used. For example, it may be a Windows Media (R) Video format of Microsoft Corporation or a Real Video (R) format of RealNetworks.

  In the first to third embodiments described above, the search information is described as the URL to the recording data and the relative time when the Insert button 601 is pressed (the start of the recording program is set to 0). The search information is only absolute time (based on the clock of the video recording / distribution terminal device 107), and when the absolute time is transmitted to the video distribution program, the video distribution program automatically selects the corresponding recording file, The recording data from the absolute time may be transmitted to the moving image display terminal device 104.

  Further, in the first to third embodiments described above, the description has been made on the assumption that the recording data at the time when the search information is input is displayed as a moving image. However, only image data, only audio data, and other data such as animations are displayed. May be played.

  In the first to third embodiments described above, the input search information is converted into pattern information and all of the search information is output to the print medium. However, the pattern information may be stored as image information. The pattern information of the image information is displayed on the display of the moving image display terminal device 104 and is read from the screen by the code scanner 103, whereby the recorded data can be reproduced from a desired reproduction position. By doing so, it is possible to prevent the printed paper medium from being lost, and by operating on the same display, it is possible to perform an efficient operation such as when it is necessary to view the same scene repeatedly. .

  Note that the information processing method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. Further, this program may be a transmission medium that can be distributed via a network such as the Internet.

  As described above, an information processing method according to the present invention, a program for causing a computer to execute the method, and an information processing system are useful for efficiently reproducing recorded audio data and image data. It is suitable for efficient information acquisition of recorded data such as lectures and meetings, and when managing information.

It is a block diagram which shows the system configuration | structure of the information processing system concerning this Embodiment 1 of this invention. It is a block diagram which shows the hardware constitutions of the portable terminal concerning this Embodiment 1 of this invention. It is a flowchart which shows an example of the process of the recording program in the video recording and delivery terminal device concerning this Embodiment 1 of this invention. It is explanatory drawing which shows an example of the display screen of the recording program concerning this Embodiment 1 of this invention. It is a flowchart which shows an example of the process of the input program in the portable terminal 101 concerning this Embodiment 1 of this invention. It is explanatory drawing which shows an example of the display screen of the input program concerning this Embodiment 1 of this invention. It is explanatory drawing which shows an example of the search information concerning this Embodiment 1 of this invention. It is a flowchart which shows an example of the process of the pattern information printing program in the print server 108 concerning this Embodiment 1 of this invention. It is explanatory drawing which shows the printed paper medium example 1 concerning this Embodiment 1 of this invention. It is explanatory drawing which shows the printed paper medium example 2 concerning this Embodiment 1 of this invention. It is explanatory drawing which shows the printed paper medium example 3 concerning this Embodiment 1 of this invention. It is a flowchart which shows an example of a process of the moving image display program in the moving image display terminal device 104 concerning this Embodiment 1 of this invention. It is explanatory drawing which shows an example of the display screen of the moving image display program concerning this Embodiment 1 of this invention. It is a flowchart which shows an example of the process of the input program in the portable terminal 101 concerning this Embodiment 2 of this invention. It is a flowchart which shows an example of the process of the pattern information printing program in the print server 108 concerning this Embodiment 2 of this invention. It is explanatory drawing which shows the paper medium example 1 resulting from having collectively printed the search information concerning this Embodiment 2 of this invention. It is explanatory drawing which shows the paper medium example 2 used as a result of having printed the search information concerning this Embodiment 2 of this invention collectively. It is explanatory drawing which shows the apparatus example 1 concerning this Embodiment 3 of this invention. It is explanatory drawing which shows the apparatus example 2 concerning this Embodiment 3 of this invention.

Explanation of symbols

100 LAN
DESCRIPTION OF SYMBOLS 101 Mobile terminal 102 Printer 103 Code scanner 104 Movie display terminal device 105 Camera 106 Microphone 107 Video recording / distribution terminal device 108 Print server 201 CPU
202 Memory 203 Clock 204 Liquid crystal display 205 Touch panel 206 Network interface 400,600 Window 401 Object 402 Start button 403 Stop button 601 Insert button 602 End button

Claims (18)

A shooting process of shooting a shooting target and obtaining image data;
An audio acquisition step of acquiring audio of the imaging target and obtaining audio data;
A recording step of recording at least one of the image data obtained by the photographing step and the audio data obtained by the audio acquisition step as recording data;
An input signal receiving step of receiving, from the terminal , an input signal including search information for searching for the record data when recording the record data by the recording step;
When the input signal is received, the conversion step of converting the search information received by the input signal receiving step into corresponding predetermined pattern information;
A printing step of printing the pattern information converted by the conversion step on a paper medium;
Including
An information processing method comprising associating pattern information with a paper medium by writing handwritten information for a scene in which search information is input on a printed paper medium .   The information processing method according to claim 1, wherein the input signal receiving step inputs the search information and time information when the input of the search information is accepted.   In the printing step, the search information received by the input signal receiving step is converted into pattern information by the conversion step and printed, and the search is recorded among the recorded data recorded by the recording step. 3. The information processing method according to claim 1, wherein a part of the image data corresponding to the time indicated by the time information when the input of information is received is printed as a still image.   The printing process prints the pattern information each time search information is received by the input signal receiving process and the search information is converted into pattern information by the conversion process. 4. The information processing method according to any one of 3. The input signal receiving step includes
A storage step of storing the search information each time an input of the search information is received,
In the conversion step, after the recording data is recorded by the recording step, the search information stored by the storage step is collectively converted into corresponding predetermined pattern information,
The information processing method according to any one of claims 1 to 3, wherein the printing step prints the pattern information collectively converted by the conversion step. A reading step of reading the pattern information printed on the paper medium by the printing step after the recording data is recorded by the recording step;
An acquisition request step for requesting acquisition of the recording data specified by the content of the pattern information read by the reading step from among the recording data recorded by the recording step;
An output step of outputting the recording data acquired by the acquisition request step using an image, a character, a voice, and the like;
The information processing method according to claim 1, further comprising:   A program for causing a computer to execute the method according to any one of claims 1 to 6. Photographing means for photographing a subject and obtaining image data;
Voice acquisition means for acquiring voice of the shooting target and obtaining voice data;
Recording means for recording at least one of the image data obtained by the photographing means and the sound data obtained by the sound obtaining means as record data;
An input signal receiving means for receiving, from the terminal , an input signal including search information for searching for the record data when recording the record data by the recording means;
When the input signal is received, conversion means for converting the search information whose input is received by the input signal receiving means into corresponding predetermined pattern information;
Printing means for printing the pattern information converted by the conversion means on a paper medium;
Including
An information processing system for associating pattern information with a paper medium by writing handwritten information on a scene in which search information is input to a printed paper medium .   The information processing system according to claim 8, wherein the input signal receiving unit inputs the search information and time information when the input of the search information is accepted.   The printing unit includes the search data among the recorded data recorded by the recording unit when the search information received by the input signal receiving unit is converted into pattern information by the conversion unit and printed. 10. The information processing system according to claim 8, wherein a part of the image data corresponding to the time indicated by the time information when the input of information is received is printed as a still image.   The printing means prints the pattern information each time search information is received by the input signal receiving means and the search information is converted into pattern information by the conversion means. The information processing system according to any one of 10. The input signal receiving means includes
A storage means for storing the search information each time an input of the search information is received;
The conversion means collectively converts the search information stored by the storage means into corresponding predetermined pattern information after the recording data is recorded by the recording means,
The information processing system according to any one of claims 8 to 10, wherein the printing unit prints the pattern information collectively converted by the converting unit.   The information processing system according to claim 8, wherein the paper medium printed by the printing unit is plain paper formed in a desired shape and size.   The paper medium printed by the printing means is the paper base material in which an adhesive capable of repeated re-adhesion is applied to a part of one side of the paper base material formed in a desired shape and size. The information processing system according to claim 8, wherein the information processing system is provided.   9. The paper substrate printed by the printing means is the label base material in which an adhesive is applied to the entire area of one side of the label base material formed in a desired shape and size. The information processing system as described in any one of -12.   The information processing system according to claim 8, wherein the pattern information is a barcode.   The information processing system according to claim 16, wherein the barcode is a two-dimensional barcode. Reading means for reading the pattern information printed on the paper medium by the printing means by recording the recording data by the recording means;
An acquisition requesting unit for requesting acquisition of the recording data specified by the content of the pattern information read by the reading unit from among the recording data recorded by the recording unit;
Output means for outputting the recording data acquired by the acquisition request means using an image, text, sound, etc .;
The information processing system according to claim 8, further comprising:

Images