JP3511278B2 - Video anchor setting device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [0001] BACKGROUND OF THE INVENTION 1. Field of the Invention
Related to the fixed device. The invention is particularly useful for
For setting anchors to targets etc. included in
About the installation. [0002] 2. Description of the Related Art Conventionally, a general hypermedia device is used.
Searching for information is mainly performed on text and still images.
Set a logical unit for the information link, and
Link the relevant information in advance and let the user
The form in which the related information is displayed when clicked
I was However, for example, for encoding and decoding moving images
In recent years, as represented by MPEG,
Various technologies to process not only images but also moving images are proposed
Have been. By handling moving images,
Media devices, CAI, various presentations,
Useful for creating content such as child catalogs. Video
Image editing is limited to a limited number of industrial fields such as broadcasting stations.
Although it has been used, personal computers will be
Is rapidly spreading as a personal system
it is considered as. [0003] Japanese Patent Application Laid-Open No. 4-163589 discloses a moving image.
A logical unit (called a node in the specification)
There is disclosed an image processing device that can be specified. This
In this device, the setting of the node in the still image is simply the display range.
For points that can be specified only by specifying
(1) Display range and (2) Time
In that you only need to specify the valid duration of the
Attention is paid to these specifications. Sand
Regarding (1), subjects appearing in a moving image
By pointing the surrounding area with a mouse or the like,
Is set for the node, while for (2),
Depending on the elapsed time from the start time of the moving image output,
Specify the valid duration of the code. So this node is
Uniquely defined by the two contents of the storage area and the elapsed time
In other words, related information can be linked to each node.
Wear. After the link, when actually playing the moving image, the user
Clicks an area on the screen with a mouse, etc.
Nodes are identified by location and time and relevant information is displayed
Is done. [0004] In the above apparatus, the logic
It was decided to set the unit area manually. Only
Naturally, moving images contain many files, unlike still images.
There are frames, and the position and shape of the subject change every moment.
For NTSC, 30 frames are required per second
Therefore, even if it is simply calculated, it processes a one-second moving image.
Requires 30 setting operations per logical unit
You. For example, when creating content for 5 minutes, one frame
Assuming that 5 logical units are set in the
45,000 times. [0005] The present invention has been made in view of this problem.
Its purpose is to define logical units (referred to herein as anchors).
A device that enables labor saving and simplification of setting work
More specifically, the anchor that had to be performed for each frame
Setting device that automatically calculates or automatically sets information
In the offer. [0006] SUMMARY OF THE INVENTION A moving image anchor of the present invention is provided.
Setting device, DynamicMultiple frames that make up the picturePrescribed for
At intervalsReference frameSelectionAndThoseEach of the reference frames
Anchor information setting method for setting anchor information for each
And a non-reference file based on the set anchor information.
Anchor information calculation means for calculating frame anchor information
And a moving image anchor setting device including
The anchor information set in the reference frame of
A predetermined error is determined based on the anchor information set in the sub-frame.
Judgment means for judging whether calculation is possible within the difference range
If it can be calculated,
Frame deletion means for changing a frame to a non-reference frame
And further includes [0007] BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, a moving image hyper-me
A preferred embodiment of the ear device will be described. This device
Is equipped with the video anchor setting device of the present invention.
You. According to this device, for example, a moving image of an aquarium tank
When you click on any fish swimming
Can display the name of the fish, supplementary explanations, etc.
Create interactive CAI software easily and efficiently
Can be. In the following embodiments, “user” is mainly
The creator of the content
Those who personally edit videotapes
It may be any. Embodiment 1 In this embodiment, the user specifies the start frame and end frame.
Frames, the first frame and the second
The two frames that are the frames of the first reference frame
Set the anchor as "Frame" is a table of images
It is a display unit and includes a picture referred to in MPEG. Book
Is the device an anchor set for the reference frame?
The anchor region in other frames
Automatically calculates anchor information such as area position, shape, and color
I do. “Anchor information” is, for example, the position of the anchor area.
When explicitly displaying the position, shape, or anchor area,
Refers to color. Note that even the first reference frame is a book.
The invention is established, but an example thereof will be described later. A moving image hypermedia device according to the present embodiment
The configuration of the entire system, including
Personal computer (hereinafter referred to as P
C) and a video playback device that provides a moving image to this PC.
You. The PC captures the image provided from the video playback device.
Built-in video capture board to capture and digitize
It is. Video playback device, normal playback start, stop, fast forward
Frame, time advance, etc.
It has functions such as playing back from the computer. Such video playback equipment
The device is widely used in broadcasting services, etc.
There is no need to be limited to this. Control of various functions of the video playback device
Is a user interface developed on a PC (hereinafter referred to as
UI), such as a "play button" displayed on the screen
Done through. In this case, the user clicks the button
If you check it, the action will go through the signal cable
It is transmitted from the PC to the video playback device. Video playback device
As such, it is not an essential component of a video hypermedia device
However, here, the system including this will be described. Figure
1 includes the moving image hypermedia device according to the present embodiment.
FIG. 1 is a configuration diagram of a system. [0010] This apparatus is roughly divided into anchor information and resource information.
Data operation unit 1, which operates data related to link information,
A data storage unit 2 for storing these data;
Display unit 3 that displays data in a meaningful form,
The user operation unit 4 that performs attachment and management and the video playback device 5
It comprises a moving image input section 6 for inputting the generated moving image. (1) Data operation unit 1 An instruction from the user to the data operation unit 1 is sent to a UI described later.
This is done. That is, the following internal configuration is software
It is an air module. [0012] The frame determination unit 10 determines a start frame and an end.
Determine the frame. In this embodiment, the user specifies
Frame is the start frame and end frame
It becomes. Examples of start and end frames are given above.
In the aquarium video, the top of the scene that depicts the aquarium and
This is the last frame. Suppose the scene is at the entrance of the aquarium
After moving to the video, it is necessary to set an anchor on the fish after that
Because there is no, specify the end frame before the scene transition
deep. The anchor setting unit 11 includes a start frame and an end frame.
The anchor is actually set between the acknowledgment frames. For example,
When you set an anchor for a fish,
Display a rectangle around the fish with the mouse.
This is registered as an anchor area. At this time, the video stops
In stop mode. Next, advance the video to the end frame.
Therefore, the anchor area is registered by surrounding the same fish again. start
The fish moves or changes direction between the frame and the end frame.
In general, both the position and the shape change.
Shape and position of the anchor area registered in the start frame
The shape and position of those registered in the
Generally not. The anchor setting unit 11 will be described later.
Information editing unit 11 used when the anchor is modified
0 and a text to set an anchor for text such as a character string.
A text anchor setting unit 111 is included. The anchor estimating unit 12 determines the start frame and the end
The first and second anchor information set in the
Interpolation calculation is performed based on an arbitrary frame (non-reference frame).
E) the position and size of the anchor in step (1) are estimated.
This processing will be described later in detail. [0015] Anchor search unit 15 outputs anchor information.
Anchor movement characteristics or anchor identification information
Search anchors based on. The identification information is
Find information to help identify the car from other anchors
For example, anchor name, anchor setting object, anchor
There is a car setting date and time. The hyperlink setting unit 13 sets the
Set the hyperlink to the anchor,
Create a data structure in the form of a table. Hyperlin
The search unit 14 searches for the set link information.
In the case of the above example, a fish anchor and a text
Text data etc. are linked by hyperlinks
You. (2) Data storage unit 2 The data storage unit 2 may be a database or various files.
File device or memory device. This part is mainly hard
Wear. The moving image data storage unit 20 has a key
Store captured and digitized video data
You. The anchor information storage unit 21 and the link information storage unit 22
Stores the set anchor information and link information respectively
I do. (3) Display unit 3 The display control unit 30 controls various images such as a UI and a moving image being edited.
A display system program that controls the display as a whole,
A display circuit such as a VGA controller and this drive
Including ba. The display control unit 30 includes a cursor change unit 300
have. The cursor changing unit 300 determines that the cursor is an anchor.
Change the display state of the cursor when entering the area. table
The output data of the display control unit 30 is a display device such as a PC monitor.
31 is displayed. (4) User operation unit 4 It allows the user to enter commands.
Hardware such as keyboard, mouse, and various pointing devices
And a command dispatcher. Koman
Examples of anchors include setting anchors, modifying anchor areas, and
And link search. (5) Moving picture input unit 6 A hardware equivalent to a video capture board.
It has a D converter and a frame memory (not shown).
Digitize the input moving image. After this, the data
This is provided to the moving image data storage unit 20. Based on the above configuration, first, anchor and phosphorus
The procedure for setting the network is explained, and later the UI for anchor setting
Explain the child. [1] Setting of anchor FIG. 2 shows an anchor setting and correction procedure according to this embodiment.
FIG. 3 is a flowchart showing the order, and FIG.
It is a figure showing a table of information. First, as shown in FIG.
Various initialization processing is performed on the software and the like (S21),
Reading of moving image data stored in the moving image data storage unit 20
The embedding (S22) is performed. Beyond loaded video data
The head frame is first displayed as a still image on the display device 31.
Is done. Next, the video data already set
Read anchor information from the anchor information storage unit 21.
(S23). If anchor information exists,
Display the anchor area on the screen (hereinafter, anchor
Set the mode in which the area is displayed on the screen to "Anchor display mode".
Mode), the mode that is not displayed is "anchor non-display mode"
). Subsequently, a new anchor is set this time.
Video data up to the start frame of the current period (S2
4) When the desired frame appears, select “Start Frame” on the screen.
Button to register the start frame. This state
Waiting state for setting the anchor area in this frame
State, and the user moves the mouse around, for example, another fish.
A rectangular area is provided by clicking the button. The rectangular area is determined
Then, the upper left point (x1, y1) and the lower right point (x2, y
The coordinates of 2) are obtained, and this is the frame of the start frame.
Along with the number (serial number from the first frame of the video)
Is recorded as the anchor information of the fish (S25). Thereafter, the moving image data is advanced again, and
Stop when the end frame appears (S26), and the same fish
Is provided with a rectangular area. End frame here
Is completed (S27). Of FIG.
“Anchor1” is an anchor ID indicating this fish.
You. Here, the frame numbers of the start frame and end frame
Number (frames 1 and 100 respectively) and the anchor area
Coordinate information is stored in a table. In this manner, the anchor in the both-end reference frame
-If the information is confirmed, the third frame (non-standard
Frame) is obtained by interpolation calculation.
(S28). FIG. 4 shows an interpolation calculation method of anchor information.
FIG. here, The anchor information at the start frame (time t0) is A
(T0) The anchor information at the end frame (time t1) is A
(T1) The anchor information at time t is A (t) T1−t0 = Δt If so,   A (t) = {A (t1) −A (t0)} t / Δt + {A (t0) t1−A (t1) t0} / Δt (Equation 1) And multiply. As A, the x1, y1, x2,
If y2 is substituted, outside the anchor area at an arbitrary time
The shape turns out. Substituting the barycentric coordinates of the anchor area
The rough movement of the anchor area is found. Color number for A
By substituting, the color change of the anchor area can be tracked. This
In addition to this, information that can be expressed numerically also uses Equation 1.
Interpolation can be performed by the internal division calculation. By interpolation
The anchor information of the non-reference frame obtained by
You can add it to "anchor1" on the table
In other words, the table shown in FIG.
Is calculated for each frame.
It may be performed sequentially. In the present embodiment,
Is assumed. When S28 is completed, the anchor information is actually
Is displayed to confirm the contents (S29). At this time, start
The video data is played back to the frame,
The anchor area is displayed as a rectangle. This rectangular area is calculated
It moves continuously according to the result. In the case of "anchor1", the fish is a straight line
Exercise gives very good results, but if you swim halfway
If the direction is changed, the fish
-The area shifts. Therefore, the anchor information is corrected (S3
0). First, the user first downloads the video up to the frame
Data and stop the image here. Then, the screen display
Click the end of the anchor area that is
To change the shape or position of the area. Anchor estimator
12 sets the frame thus corrected as a reference frame.
Upgraded (hereinafter, those that have been promoted to the reference frame)
This anchor information is also called “intermediate reference frame”).
Add to the table in FIG. FIG. 5 shows the intermediate reference frame in FIG.
Shows the table obtained by adding the anchor information of the
ing. On the other hand, FIG.
Shows how to perform interpolation calculation based on three frames
FIG. The non-reference frame to be estimated is the first
Between the start frame, which is a frame, and the intermediate reference frame
If it exists, interpolation calculation is performed between those frames,
A subframe exists between the intermediate reference frame and the end frame.
If there is, interpolation calculation is performed between those frames (S2
8). Thereafter, the display in S29 and the re-correction in S30
After that, when good anchor information is obtained (S31
Y) Save this (S32) and end the anchor setting process
You. If the anchor of another frame is modified in S30,
Of course, this frame is also an intermediate reference frame. Note that S
In 25, set two or more anchors in the same frame
If you do, the anchor ID is automatically set inside the device in the setting order.
To the anchor area.
What is necessary is just to take measures such as performing rectangular display of the area in different colors. According to the above procedure, the following effects can be obtained.
You. 1. Set the anchor in both reference frames
Settings for a large number of frames in between.
Work becomes unnecessary. 2. If the position of the anchor is shifted in the interpolation calculation,
Can be confirmed. Therefore, the
Frames are easy to recognize, and once a frame is modified,
Automatically promoted to an intermediate reference frame,
You need to pay attention to whether it should be a reference frame
Absent. 3. For example, a fish with an anchor swims in an arc
In such cases, in addition to the reference frames at both ends,
If you make corrections in the frame, you will get enough good anchor information
Can be The above is a description of the moving image hyperme
Of the media devices, in particular, an overview of the video anchor setting device
is there. [2] Link setting Next, change the link settings for the set anchor.
Do. FIG. 7 shows link setting and detection according to this embodiment.
A flowchart showing a search procedure, and FIG. 8 shows a set link.
It is a figure showing a table of information. FIG. 7 shows the setting of an anchor and the setting of a link.
FIG. 2 shows a processing procedure in the case of performing completely independently, and FIG.
First, various initialization processing (S40), reading of moving image data
(S41). Next, set in [1]
Read anchor information from anchor information storage unit 21
Link information that has already been set with (S42)
From the link information storage unit 22. Next, the both-end reference frame and the intermediate reference
Anchor of another frame based on the anchor information of the frame
-Reproduction of moving image while obtaining information by interpolation calculation (S44)
Is displayed continuously in accordance with (S4)
5). In this state, the user operation unit 4
An input wait state is set (S46). [0033] Here, the user can display the moving image or the moving image.
After stopping once, click on a certain anchor area,
If you press the "Create / Change Link" button, the anchor
Then, link information is created (S47). example
For example, if a fish in the aquarium is clicked, phosphorus is added to that fish.
Text, images, etc. that should be
The text selected by the user is the anchor of the fish.
(More precisely, an object called fish contained in the anchor
Project). If there are no suggestions, the user
It is also possible to enter a character string by itself and link this
is there. FIG. 8 shows the information in text format in “anchor1”.
The report “anchor1.txt”, as well as “anchor1.txt”
2 ”bitmap image“ anchor ”
2. "bmp" is shown in a linked state. like this
Once the link information is confirmed, the content of the link is
The information is stored in the information storage unit 22, and the user waits for an input again. On the other hand, in S46, the user
If you press the “Search” button and specify an anchor, the anchor
Is retrieved and displayed (S4).
9). In the case of FIG. 8, for example, for the fish of anchor1
And the name, length, and characteristics of the fish are displayed as character strings.
For nchor2 fish, the fish actually inhabit
A photo of the sea where you are located is displayed. This display shows
The user can confirm content operation at this point.
Tool creation can be completed. Content is, for example,
By storing on a recording medium such as a CD-ROM,
It can also be commercialized. When shipping as goods,
Generally, an anchor hiding mode that does not display the anchor area
Change to mode. Here, the setting of the anchor and the link is
Although described as an independent process, for example, an image during link setting
If you provide a button on the surface that says "Return to anchor settings"
Both are free to go and edit more easily. [3] UI for anchor setting FIG. 9 is a diagram showing an example of a UI screen for setting an anchor.
You. In the figure, an image display area 50 includes a processing target.
The movie is displayed. The buttons 52 in black in the upper column are
Use the object buttons to directly instruct playback, stop, etc.
is there. Next to it, the frame displayed in the image display area
Rectangular button 5 for setting anchor area for
4. Similarly, change the displayed frame to the start frame.
Or start frame finger to designate as end frame
Button 56 and an end frame designation button 58 are provided.
ing. In the figure, the anchor area 60 for one fish is shown.
Is set. At the center right of the screen, set or modify
Name, ID, start frame number, end of anchor
There is an anchor-related box group 62 indicating the frame number.
You. Below the image display area 50, the currently displayed frame
And the scene number of that frame
The scene-related box group 64 indicating the serial number in
You. Below that, a small amount of video for editing
There is a box 66 to go forward or back. This right end
Press the button to advance the video, and press the left edge to return. Current
The position of the displayed frame in the scene
In the box 66, it is indicated by a vertical line 70. This button
Below the box are the start and end frames for the scene.
There is a box 68 indicating the position of the frame. Start frame
And the end frame positions are indicated by double vertical lines 72 and 74, respectively.
And the position of the intermediate reference frame
This is indicated by the shape symbol 76. In the figure, first, the user inputs a scene number.
As a clue, to the beginning of the scene where you want to set the anchor
Advance videotape. In this case, for example, multiple scenes
Aquarium with scene number "5"
The video is going on. Here, the user
Press the rightmost button to advance the video one frame at a time.
Good. The first frame that tries to set the anchor appears
Then, the user presses the start frame designation button 56, and
Register it. At this time, the corresponding part of the box 66
A double vertical line 72 appears indicating the position of the start frame.
At this point, the user presses the rectangular button 54 to set the image in the image display area 50.
Click the upper left and lower right points of the anchor area to be set with the mouse.
Click. This completes the anchor setting of the start frame.
You. Next, advance the video, register the end frame in the same way
Perform anchor setting. The setting in the both-end reference frame is completed.
Is detected, the anchor estimating unit 12 of the present apparatus
The calculation is started by substituting the anchor information into the equation (1). This
Here, the user returns to the start frame and
As the frame advances, the anchor estimating unit 12
Find the time corresponding to the currently displayed frame, and
An anchor area is displayed based on the corresponding estimation result. table
If the indicated anchor area is misaligned, the user must
By pressing the shape button 54, the area is corrected. After modification,
A triangular symbol 76 appears at the location corresponding to the frame.
According to this UI, the anchor information is actually displayed on the moving image data.
Display the editing result in real time.
And it can be easily modified. The above is the outline of the present embodiment. In addition,
Regarding the present embodiment, the following improvements, modifications, etc. are considered.
It is. (1) Setting of text anchor This is performed by the text anchor setting unit 111 in FIG. Ma
Edit the text data on the screen and put it on the video
Overlap and set the anchor. Difference from normal anchor setting
Or, do not specify a partial area of the reproduced image.
Put the created text on the image once, and then
At the point where the anchor area is set to surround the text
You. Conventionally, for example, annotations were directly added to video images.
Was a common practice, but in that case it was later annotated.
This is inconvenient when re-editing, such as deleting an option. Real truth
The embodiment eliminates this. When a text anchor is set,
Anchor information is also stored in the anchor information table. Was
However, in the table shown in FIG.
The place is "text" and the text name is entered in that field. As for the text anchor, the related information
Link is possible. For example, for the aquarium scene in FIG.
Paste the text "South Sea Fishes"
"The southern sea is full of brightly colored fish
You can link text like
Wear. (2) Changing the display state of the cursor This is performed by the cursor changing unit 300 of FIG. This feature
In particular, the anchor non-display mode, for example, when the content is
Useful when used in Because of this feature, the car
The sol change unit 300 is configured to always acquire the cursor position.
Location acquisition program and the acquired location is
Judgment program to judge whether it is included in the car area
When the cursor enters the anchor area, the cursor
How to change the display state of the
Change program that actually changes the cursor shape etc. according to
With ram. The cursor can be changed for each anchor.
There is a case where the change is not changed and a case where it is changed. Former
For example, change the cursor, which is usually a + sign, to ◎
Or increasing the brightness of the cursor. In this aspect
According to the report, especially, the target moves and changes
There is a benefit when the change of the anchor area is drastic. On the other hand, in the latter case, the change program
From the anchor ID of the anchor area where the cursor is
Search, and replace it with the cursor
It may be displayed at the position. For example, if the cursor is
When you enter the anchor area of a fish,
The target content of the anchor, such as "Shark"
Can be shown. According to this aspect, the user has to bother with the fish.
You don't need to click to know the name of the fish
it can. (3) Explicit designation of intermediate reference frame In this embodiment, first, only the both-end reference frames are determined.
However, when the movement of the target is irregular,
In some cases, the need for correction can be anticipated. In that case,
Frames other than the start frame and end frame from the beginning
Also accepts designation of an anchor area. For example
In the UI shown in FIG.
In addition to the end frame designation button 58, the intermediate frame designation button
To respond by providing a tongue. This frame has been
Because the frame is used as a frame, the interpolation
It can be thought that it is started from. (4) Anchor area other than rectangle The anchor area need not be limited to a rectangle. For example a circle or
In the case of an ellipse, the coordinates are based on the coordinates of the major axis, minor axis, and center.
You can specify the area by using For polygons, use the coordinates of each vertex
No. When the outer periphery of the target itself is the anchor area
Is the coordinates of a point on the outer circumference and the chain expressed from that point.
The region can be specified by the code. (5) Use of nonlinear interpolation In the present embodiment, linear interpolation is used most simply.
This may of course be a non-linear interpolation. The equation used for interpolation is
Determined by experiment etc. according to the characteristics of the moving image to be processed
be able to. (6) Determination of start and end frames In the present embodiment, these frames are explicitly specified by the user.
Although specified, there are also the following methods. 1. The user does not need to be aware of the start and end frames,
Simply specify the frame and set the anchor. Specified
The reference frame becomes the reference frame. Frame determination unit 10
Is the frame of the frame where the user has set the anchor.
Start the frame with the lowest program number and end the frame with the highest
Decide with a frame. In this case, specify the start frame in FIG.
The button 56 and the end frame designation button 58 become unnecessary.
You. 2. The user specifies one frame and
And set the anchor,
Specify the target that became. This frame is the reference frame.
It becomes a frame. The frame determining unit 10 determines the reference frame.
By examining the frames before and after the
Frames that appear and disappear, and
Let these be the start frame and end frame, respectively. The presence or absence of the target is determined by matching the image.
Judge by taking. In other words, the
Using the target as a model,
Performs a switching process. Search pairs as long as matching is achieved
Spread the elephant frame back and forth. Eventually the matching
If it cannot be obtained, the start and end frames are determined. This one
According to the law, only one reference frame should be provided initially.
No. (7) Three-dimensional display of anchor area Display the set anchor area on the anchor setting unit 11
In the x, y and time t directions
Provide a function for three-dimensional display. This is editing the anchor
4 may be displayed on the screen as it is. This
Display gives the user a visual overview of the anchor
Can be done As an application of this technology, three-dimensional display
You can edit the anchor information directly.
No. For example, the anchor area in the intermediate reference frame of FIG.
If you move the area to the left on the screen, the display shown in Fig. 6 will not be displayed.
It is. Users can understand the effects of editing in real time
Can be. (8) Cross-section display of moving image In the anchor setting unit 11, the start frame to the end frame
FIG. 10 is a cross-sectional view in the lateral direction of the locus of the anchor area up to FIG.
(A)) and vertical sectional view (Fig. 10 (b))
And added a function to display this along with the path of the anchor
I do. First, the anchor area is determined from the anchor information of the reference frame.
The x and y coordinates of the center of gravity G of the area are obtained. FIG. 10 (a)
In this case, a straight line parallel to the x-axis is drawn on the frame from the center of gravity. next to
A plane containing these straight lines between the touching reference frames (Fig.
(Middle shaded area). Next, cut the video on this plane
You. Project the obtained cross-sectional view on the xt plane (dotted area in the figure)
I do. In the case of FIG. 10B, the same processing is performed by exchanging x and y.
Make sense. If the anchor trajectory is calculated correctly
I.e., the estimation of anchor information in non-reference frames.
When the precision is sufficiently high, the two projections
A travel route should appear. For example, a red ball
If the target is to set an
A motion path appears. If you break the pencil vertically, the core will appear in a straight line
Is the same as If this route is cut off or thick
If so, correct the anchor position at that point.
Just do it. (9) Grouping of anchors The anchors set separately in the anchor information editing unit 110
ー Group information into a virtual anchor
Add functions to handle. For example, the person A is in the frame N1
N2 and frames N3 to N4 exist in the screen,
Frames N1 to N3 do not exist in frames N2 to N3.
2 and person A in frames N3 to N4.
Treat the anchor as one. As a result, the anchor
The task of setting and correcting information is reduced. In addition,
Grouping person A and person B appearing in the same frame
You can also. (10) List display of anchor information The anchor information editing unit 110
A function to display a list of anchor information set in advance is provided. An example
For example, along with the video title "AQUARIUM"
Anchor names such as "FISH1", "FISH2" ...
Display a list on the screen. Enter the anchor name you want to check
When selected by the user, the anchor's start frame
, And the moving image may be reproduced. (11) Search for anchor A search UI for anchor information is provided. Anchor to search
Input text information such as information name as a keyword
From the anchor information storage unit 21
Search for and display those with that keyword. That
Alternatively, the movement of the anchor area may be used as a search key. example
If you want to find an object that moves to the right,
For example, a button “→” is pressed in the search UI. Anchor
-The search unit 15 calculates the locus of each anchor area, and moves to the right.
Find and display anchors containing moving objects
You. (12) List display of anchor information display images In the anchor information editing unit 110, the start frame and the end frame
Frames (reference frames, non-reference frames)
Frame), and the anchor setting unit 11
Anchor information set in advance, or anchor estimation unit 12
The anchor information estimated by
-A function to create information display images and display them in a chronological list
Provide. For example, as shown in FIG.
81 and end frame 82 at both ends
Select a frame with Δt. Next, each of these frames
Information display image with anchor information 80 superimposed on the
And display them side by side with the earlier display time
I do. With this configuration, it is possible to see at a glance whether the anchor setting is appropriate.
You can pass. For this reason, according to box 66 in FIG.
Positioning work can be omitted, making it easy to modify anchors.
You. It is not necessary to select frames at regular intervals.
For example, only the reference frame may be selected. Also display
In the anchor information display image
You can also edit directly by dragging with the mouse
No. (13) Correction of anchor information during reproduction of moving image As shown in FIG. 12, the moving image is
A moving image reproducing unit 118 for reproducing on the screen and a frame being displayed
Information display section that displays anchor information about the system
120 and one or more times during video playback
When the anchor information correction operation is performed by
The frame that was playing at the time when the
If they are non-reference frames
Promoted to frames and
Anchor information based on each anchor information correction operation
An anchor information correction unit 119 for correction is provided. This configuration
First, the image display area of FIG.
A moving image is displayed in the area 50. At the same time, the anchor information
The information display unit 120 displays an
The car information is displayed as the anchor area 60. A user
Is a frame in which the anchor area 60 is displaced from the target.
When you find a program, mouse over the center of the target in the video
Click with. This action causes the anchor information
The correction unit 119 was displayed at the time when the click was performed.
Identify the frame and click on the center of the clicked point.
Correcting anchor information by generating car information
You. The size of the newly set anchor area is, for example,
It may be the same as the original anchor area. Hereafter, this frame
The system is treated as a reference frame. With this configuration,
You can specify the target position sequentially while the video is playing
This saves the trouble of checking and correcting later. Embodiment 2 In the first embodiment, the anchor information is mainly obtained by interpolation.
Dynamic calculations were performed and corrections were made manually. In this embodiment
Is a certain number of frames based on the video analysis
The anchor is automatically set as a reference frame and these
The interpolation method of the first embodiment is used between the reference frames. This
Corresponds to the intermediate reference frame of the first embodiment.
Since there is a frame to be installed from the beginning,
Positive effort is reduced. FIG. 13 shows a moving image hyper according to this embodiment.
FIG. 3 is a configuration diagram of an anchor setting unit 11 of the media device. A
Configurations other than the anchor setting unit 11 are the same as those in FIG. In FIG. 13, the automatic anchor setting unit 11
2 has an adjacent frame extraction unit 117. Proximity frame extraction
The output unit 117 has a fixed interval between adjacent reference frames.
To extract non-reference frames and raise them to reference frames.
Classify. The automatic anchor setting unit 112 also sets the motion vector.
Toll use setting unit 113, contour information use setting unit 114,
And a pattern matching use setting unit 116. this
These three setting units should implement one of them originally
However, in this embodiment, everything is implemented, and depending on the situation,
Select one of them. The reference frame deletion unit 115 is used as described later.
The criteria set by the automatic anchor setting unit 112
Redundant frames are returned to non-reference frames. Less than
The operation of this configuration will be described below. [1] Anchor by using motion vector
Automatic setting of The feature of this processing is that once from the start frame to the end frame
The motion vector of the block until
Judgment of the degree of coincidence between the virtual movement path of the unit and the motion vector
Tracking accuracy of target position estimation
In a two-stage configuration. 1. Get motion vector The time of the start frame and the time of the end frame are t0 and t, respectively.
Let it be 1. In addition to these, the proximity frame extraction unit 117
First, some of the non-reference frames are used as reference frames.
change. Here we simply change every 5 frames
For simplicity, the elapsed time between reference frames is set to 1
Is normalized. Period from start frame to end frame
To find the motion vector of a specific anchor between
In the image area near the center of gravity of the anchor as a block,
Perform block matching. At any time t
The frame to be written is referred to as a frame (t). FIG. 14 shows a motion vector according to the present embodiment.
9 is a flowchart showing a procedure for acquiring a file. Per figure
First, the time counter t is set to t0 (S10).
0). Next, the block set at the start frame is
Of the blocks from which the motion vector is to be obtained.
You. The motion vector usage setting unit 113 specifies the specified anchor.
Area including the center of gravity of the
Block (hereinafter referred to as “anchor block”)
It is stored (S101). Next, the picture of frame (t)
The image data I (t) and I (t +
1) is acquired (S102). I (t) is included in the frame.
This is a set of pixel values p of each pixel. Thereafter, the block is placed in the frame (t + 1).
Search for the best matching while moving with (S10)
3). Each pixel value of the block itself is found from I (t).
Therefore, the block is arranged at an arbitrary position in the frame (t + 1).
And calculate the squared error of the pixel value between overlapping pixels
This is integrated over the entire block. A little block
This integration is performed while moving
The position is determined to be the destination of the block. If the destination is determined, the frame (t)
From block to block in frame (t + 1)
Since the amount and direction of movement to
It is acquired as tor V (t) (S104). Where t
+1 has reached the end frame time t1.
(S105), and if not reached, increment t.
(S106) to repeatedly acquire a motion vector.
You. If t + 1 is equal to t1, the V obtained so far
After saving (t) (S107), the process ends. FIG. 15 shows a case where t0 = 0 and t1 = 3.
The figure which shows the example of the obtained motion vector V (0) -V (2).
It is. As shown in the figure, V (t) is
With x and y defined and t defined in the time direction,
It can be represented by three components of (x, y, t). 2. Judgment of coincidence A block of the same size as the block set for the motion vector
Locks divide each frame so that the target
Find all possible routes. FIG.
FIG. 3 shows one of the roads. In the figure, the frame is
The path in the start frame is divided into 16 blocks
14 and the end point of the path in the end frame are shown in FIG.
Match the block. Under these conditions, all routes are 1
There are 6 × 16 patterns. Next, this route (hereinafter referred to as “virtual
Each section of the route is referred to as a vector (hereinafter, referred to as a route) shown in FIG.
V (t) is defined below. Route
Vector is a virtual path from one frame to the next
When you follow, it is determined by that direction. v (t) is also (x, y,
It is described by three components of t). Here, V (t) and v
The angle formed by (t) is defined as θt, and the following equation using the inner product
Therefore, f (t) = cos θt is calculated. [0073]   f (t) = (V (t), v (t)) / | V (t) | · | v (t) | (Equation 2) FIG. 17 shows V (t) of FIG.
In the additionally displayed diagram, the meaning of θt is shown. Equation 2
Is larger, the virtual route in that section is
Although the degree of coincidence of motion vectors is high, the degree of coincidence is
Even if it becomes large, if the degree of coincidence of other sections is very low,
It is necessary to consider that the degree of agreement as a body is low. So, each
Evaluate the overall degree of matching while taking into account the degree of matching between sections
In order to do so, the following evaluation formula is introduced. [0074]   g (t) = max {f (t-1) + g (t-1)} (Equation 3) By calculating Equation 3 recursively, the time
The virtual route with the highest degree of coincidence is found. This meter
If the calculation is performed up to the end frame,
Because the virtual route with the highest
It is regarded as the route of the get. After that, this route and each
At the intersection of the quasi-frames,
The automatic setting of the anchor is performed assuming that the anchor exists.
The set anchor information is the anchor information text shown in FIG.
Just add it to the table. Note that other than the reference frame
For the frame of No. 1, the same method as in the first embodiment is used.
If the anchor information is sequentially calculated from the interpolation calculation,
Good. [2] Self-control of anchor by using contour information
Dynamic setting As another method of automatic anchor setting, the target contour
There is a method to estimate the position of the target based on the movement of
You. The contour information use setting unit 114 performs the same processing as in FIG.
Contour image is generated for each frame by the return process.
You. The outline image is binarized so that 1 on the outline and 0 on the other.
Image, and the image contains a compass gradient (Compas
s-gradient) type filter
is there. Once the contour image has been obtained, the anchor
Setting of anchor information as moving exactly the same as
Should be performed. [3] Identification of anchor using matching
Dynamic setting As yet another method of automatic anchor setting, FIG.
Estimation of target position by pattern matching
is there. In the case of this method as well, first, the adjacent frame extracting unit 11
7, a certain number of reference frames are provided in advance. Next
The anchor area set in the start frame 130
Create a model 134 for pattern matching from the area 132
And the highest matching level among the adjacent reference frames 136.
A high region 138 is determined. Pattern matching method and
To overlay the image data of the model
The plate matching method and the feature points extracted from the image
Structural matching method that performs superposition based on positional relationship
There is. Pattern matching is centered around the model
Do. Thus, the area 13 in the second reference frame
8 is found, this area 138 is used as a new model.
And repeat the process to track the target
Good. Note that if the movement or deformation of the target is
Good match when frames are set too wide
There is a case that cannot be taken. In such a case, the proximity frame
The system extraction unit 117 narrows the interval between the reference frames to increase
After setting up a number of reference frames,
It shall be corrected. [4] Deletion of Unnecessary Reference Frame In the above example, a reference frame is provided every 5 frames.
Was. However, for example, the target makes a linear motion
In such cases, the reference frame is the start frame and end frame
Is just enough. Target ends from start frame
In the case where not all are performing uniform linear motion up to the frame
Even so, for the duration of such exercise,
Only the reference frames at both ends of the period need be provided. Standard
Each time the frame is reduced, the computational load is reduced. [1]
This is particularly effective because the number of virtual routes is drastically reduced. From this viewpoint, the reference frame deleting unit 115
Deletes unnecessary reference frames. Figures 19 to 21
It is a figure showing signs that a quasi-frame is deleted. these
In the figure, the horizontal axis is time, and the vertical axis is x- provided on the frame.
The distance from the origin of the y coordinate is shown. Also, in each figure
○ schematically shows an anchor area. Delete
The following procedure is used. [FIG. 19] Initially, there are six reference frames, including both-end reference frames.
Have been killed. Here, start frame anchor and end frame
Connect the frame anchors with a straight line, and
Calculate the distance of Anchor whose distance has become less than the specified value
If there is, the reference frame at that time is deleted. In the figure
Has no anchor to be deleted. Next,
The anchor farthest from the straight line (hereinafter referred to as the farthest anchor)
Find). Here, the anchor at t = 3 is the farthest anchor.
It is a car. [FIG. 20] Delete the straight line and set the start frame anchor and farthest
And the anchor of the end frame with a polygonal line in this order.
Then, the distance between the polygonal line and each anchor is calculated again. distance
Is smaller than the predetermined value, the t = 4 anchor is deleted.
You. The farthest anchor is changed to t = 2 anchor. [FIG. 21] Modify the line to pass through the new furthest anchor. This
Here, the distance to the new polygonal line has become less than the predetermined value.
The reference frame at t = 1 is deleted. This ends the process
I do. In this example, two reference frames are deleted.
It will be. If there are many initial reference frames,
1. 1. Deletion of reference frames below a predetermined value; Furthest anchor
2. Search for The correction of the broken line may be repeated. The above is the outline of the present embodiment. In addition,
The following improvements or modifications can be made to this embodiment.
Conceivable. (1) Modification of equation 2 In equation (2), f (t) = cos θt is adopted.
May be another function. The function of increasing and decreasing θt is f
(T) can be a candidate. (2) How to take a block In FIG. 15, the block is set to include the vicinity of the center of gravity of the anchor area.
Decided, but this could be a different decision. For example,
Anchor area may be used as anchor block
No. Similarly, in FIG. 16 as well, regardless of the size of the block,
You may decide to lock. (3) Another method of the above [3] (No. 1) Another mode of automatic anchor setting by matching described above
I'm sorry. Match one after another using the area of a certain frame as a model
Errors, build up errors and gradually target
May be removed from the For this reason, the proximity frame
Not only matching from the
The judgment is made in consideration of the matching result from the frame. As shown in FIG. 22, here, the time distance
Start frame and end frame as separate reference frames
Is adopted. Now, a new anchor position should be specified.
It is assumed that the reference frame 404 is at time t + Δt. one
The model A400 of the anchor area of the start frame and the end
Model B401 of the anchor area of the
The model C403 of the anchor area of the reference frame 402 is
All are known. So, these three reference frames
And the reference frame 404 at time t + Δt, respectively.
Take matching. At this time, all matching results
If the matches, the tracking result for that area is reliable. one
If the matching result does not match, for example,
Determine the anchor position by the method. 1.3 Reference frame at time t + Δt as a result of matching three times
The three regions obtained on the program 404 are overlapped,
An axis of the same size as the original area, centered on the center of the minute
Create a car area. 2. One model, model C403
Find multiple matching results for
Model A400, model A400
The area obtained from the matching result of B401 is included
It is determined whether or not. Places that are included in a certain percentage or more
Area, the overlapping part between the regions obtained from the matching result
Anchor of the same size as the original area, centered on the center of
Create an area. Note that here, the reference frame
The start and end frames in addition to the
However, there is a degree of freedom in the combination. For example, close criteria
Frame and any number of bases separated by a fixed time distance
A quasi-frame may be employed. (4) Another method of the above [3] (No. 2) As shown in FIG. 23, automatic setting is performed in the automatic anchor setting unit 112.
A reliability judgment unit 130 and an automatic setting reliability display unit 131 are provided.
I can. The automatic setting reliability judgment unit 130
Area obtained by performing matching in the forward direction with
Overlaps with the anchor area specified in the end frame.
The reliability of the tracking is determined based on the degree. For example, heavy
If the area of multiple parts is 70% or more, the tracking result is reliable.
If it is 0% or less, it is determined that it is not reliable. Automatic setting reliability
The display unit 131 displays the reliability of tracking (whether or not
Or its%). For example, as shown in FIG.
Tracking result 1 by matching against original trajectory 140
When 41 is warped, tracking is reliable due to low degree of overlap
It is determined that it cannot be done. So, this time,
Reverse image matching using anchor area as model
And re-track the estimated position of the target.
At this time, in each reference frame, match in the forward direction first
Area and the current match in the reverse direction
Compare the anchor areas obtained by
If they overlap by more than the ratio, the tracking ends. At this time
Alternatively, stop tracking at specified frame
You may. The frame to end tracking is the start frame
And the distance ratio from the end frame.
No. How to determine duplication and what frame to end tracking
The specified method may be used together. As described above, according to this method, an error occurs during tracking.
Avoids subsequent deterioration of tracking results even if
And the final correction work is reduced. Also,
If you want to finish matching in the reverse direction by looking at the degree of overlap
In this case, only the necessary parts are modified, reducing processing time
Leads to. Note that even if the reliability is low,
Instead of automatically starting
You may just display the reliability. In that case, the user
The matching in the reverse direction may be executed,
Positive may be applied. In any case, automatic setting reliability display
The unit 131 allows the user to know whether the tracking is good or not.
And appropriate measures can be taken. (5) Another method of the above [3] (No. 3) 12, that is, the moving image reproducing unit 118 and the anchor
The information display unit 120 and the anchor information correction unit 119
-Provided in the automatic setting unit 112. Here, video playback
The unit 118 chronologically arranges each frame constituting the moving image,
Display at appropriate time intervals. Anchor information correction unit 119
Indicates that the anchor information correction operation can be performed at any time during video playback.
When performed, the frame of the frame displayed at that time
Correct the anchor information. At the same time,
Of the frame displayed during the immediately preceding specified number of images or the specified period
Invalidate the result of automatic anchor setting. The operation in this configuration will be described. here
Is the forward direction from the start frame according to the video playback
It is assumed that the display is performed while matching is performed. This dynamic
In the case of the work, as described above, once the matching is good
If it disappears, the anchor information will gradually come off
There is. The user can select the video and anchor information to be played.
When the anchor area has deviated from the target while watching
Click the screen. At this point, playback stops. here
For example, if the user clicks on the center of the
If the anchor position is modified so that the point is the center,
You. Subsequent matching is based on the modified anchor information.
, So it is good. According to this method, during reproduction of a moving image, the user
It is necessary to consider the delay of the action because the screen is clicked.
It is necessary. That is, the anchor region is outside the target
When you click when you recognize that
That such a phenomenon was gradually progressing over the frame
Conceivable. Therefore, the anchor information correction unit 119
Predetermined duplication that exists before the frame whose car information has been modified
Invalidate automatically set anchor information for several frames
Become FIG. 25 shows the original trajectory of the target and the map.
Relationship between tracking results obtained by
FIG. 14 is a diagram illustrating the operation of the information correction unit 119. Solid line in the figure
150 indicates that the trajectory of the target matches the tracking result
While the broken line 151 indicates that the tracking result is off the track.
Is shown. As shown in the figure, the tracking results at times t0 to t1
Is reliable, but starts to fall off at time t1. The user
And clicks the screen at time t2. This result
As a result, correct tracking is performed again between time t2 and t3.
At time t1 to t2, an incorrect tracking result remains.
Is invalidated. For the invalidated part,
Thus, the anchor information at times t1 and t2 is linearly complemented.
Can compensate for missing tracking results
You. The number of frames for which the anchor information is invalidated is set in advance.
It may be specified, or may be specified at the time of correction. Embodiment 3 Application of the moving image hypermedia device of the first and second embodiments
And the following devices or systems can be built.
You. 1. Interactive video teaching material production equipment The moving image hypermedia device according to the present invention is a CAI container.
It is also ideal for producing music. That is, the video
Set anchors on teaching materials and link necessary additional information
You. Figure 26 shows the video teaching materials produced by this device.
FIG. Explanation for anchor A as shown in FIG.
A and anchor B are linked to explanation B etc.
You. Students want more explanation while playing the video
Click the new object on the screen. Clicked
If the object is associated with anchor A, explain
A is displayed on the screen. 2. Interactive video server system A moving image hypermedia device according to the present invention is a video server.
Ideal for systems. FIG. 27 shows this video server system.
It is a block diagram of a stem. As shown in the figure, this system
Is a server 200 that shares the configuration of FIG.
It consists of a client 250. The server 200 stores the moving image and its anchor information.
Information and related data linked to the anchor
Data storage unit 204, anchor estimation unit 206, arbitrary
Hyper search for related data linked to anchor
A link search unit 208 is provided. The anchor estimation unit 206
Estimate anchor information in a non-reference frame. On the other hand, the client 250
When you click the target in the picture, any anchor area
Anchor determination unit 252 that determines whether is clicked
Prepare. In this configuration, the client 250
When the user clicks on an object on the screen,
Anchor determination unit 252 specifies the clicked anchor
I do. This information is sent to server 200. Server 20
0 hyperlink search unit 208 is the data storage unit 204
From the relevant data linked to that anchor,
This is sent to the client 250. As described above, according to this system, moving image data
And anchor information collectively on the server 200 side.
Video from many users and linked to it
You can see the information. [0101] According to the moving picture anchor setting apparatus of the present invention,
For example, set anchor information only for the reference frame
This means that non-reference frames, that is,
Since the anchor information of the frame can be estimated,
There is no need to set anchor information for the reference frame.
You. As a result, labor for setting an anchor can be saved.
Wear. [0102]Also,Including reference frame deletion meansBecause,
The number of reference frames to hold the anchor information has been reduced.
Reduce storage requirementsYou.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a configuration diagram of a system including a moving image hypermedia device according to Embodiment 1. FIG. 2 is a flowchart showing a procedure for setting and correcting an anchor according to the first embodiment. FIG. 3 is a diagram showing a table of anchor information set in the first embodiment. FIG. 4 is a diagram showing an interpolation calculation method of anchor information according to the first embodiment. FIG. 5 is a diagram showing a table obtained by adding anchor information of an intermediate reference frame to FIG. 3; FIG. 6 is a diagram illustrating a method of performing an interpolation calculation based on three frames of an intermediate reference frame and both-end reference frames in the first embodiment. FIG. 7 is a flowchart showing a link setting and search procedure according to the first embodiment; FIG. 8 is a diagram showing a table of link information set in the first embodiment. FIG. 9 is a diagram illustrating an example of a UI screen for anchor setting. FIG. 10A is a lateral cross-sectional view of the trajectory of the anchor area from the start frame to the end frame, and FIG.
0 (b) is a vertical sectional view similarly. FIG. 11 is a diagram showing an anchor information display image displayed in chronological order by the anchor information editing unit in the first embodiment. FIG. 12 is a diagram showing an example of an internal configuration of an anchor information editing unit of the moving image hypermedia device according to the first embodiment. FIG. 13 is a configuration diagram of an anchor setting unit of the moving image hypermedia device according to the second embodiment. FIG. 14 is a flowchart showing a procedure for acquiring a motion vector according to the second embodiment. FIG. 15 is a diagram illustrating an example of motion vectors V (0) to V (2) obtained when t0 = 0 and t1 = 3 in FIG. 14; FIG. 16 is a diagram illustrating one of the paths that may be followed by the anchor. FIG. 17 shows V (t) of FIG. 16 and V (t) of FIG.
It is the figure which added and displayed (t). FIG. 18 is a diagram showing a method for automatically setting an anchor based on pattern matching in the second embodiment. FIG. 19 is a diagram illustrating a state where reference frames are deleted in the second embodiment. FIG. 20 is a diagram showing a state where reference frames are deleted in the second embodiment. FIG. 21 is a diagram illustrating a state where reference frames are deleted in the second embodiment. FIG. 22 is a diagram illustrating a method of performing matching using a reference frame that is separated by a certain time distance in addition to an adjacent reference frame in the second embodiment. FIG. 23 is a diagram illustrating a configuration example of an automatic anchor setting unit of the moving image hypermedia device according to the second embodiment. FIG. 24 is a diagram illustrating an erroneous tracking result that may occur without the configuration in order to explain the effect of the configuration of FIG. 23; FIG. 25 is a diagram showing a relationship between an original trajectory of a target and a tracking result obtained by matching, and an operation of an anchor information correction unit. FIG. 26 is a diagram illustrating a configuration of an interactive video teaching material production device according to a third embodiment; FIG. 27 is a diagram illustrating a configuration of an interactive video server system according to a third embodiment. [Description of Signs] 1 Data operation unit, 2 Data storage unit, 3 Display unit, 4
User operation unit, 6 moving image input unit, 10 frame determination unit, 11 anchor setting unit, 12 anchor estimation unit, 1
3 hyperlink setting section, 14 hyperlink search section, 15 anchor search section, 20 video data storage section,
21 anchor information storage unit, 22 link information storage unit,
Reference Signs List 30 display control unit, 31 display device, 50 image display area, 52 button group, 54 rectangular button, 56 start frame designation button, 58 end frame designation button, 60
Anchor area, 62 Anchor related box group, 64
Scene-related boxes, 66, 68 boxes, 80
Anchor information, 81 start frame, 82 end frame, 110 anchor information editing unit, 111 text anchor setting unit, 112 automatic anchor setting unit, 113
Motion vector use setting unit, 114 contour information use setting unit, 115 reference frame deletion unit, 116 pattern matching use setting unit, 117 adjacent frame extraction unit, 11
8 moving image display section, 119 anchor information correction section, 120
Anchor information display unit, 130 automatic setting reliability determination unit,
131 Automatic setting reliability display section, 140 Original trajectory of target, 141 Tracking result by matching, 20
0 server, 204 data storage unit, 206 anchor estimation unit, 208 hyperlink search unit, 250 client, 252 anchor determination unit, 300 cursor change unit, 400 model A, 401 model B, 402 reference frame at time t, 403 model C , 404 Reference frame at time t + Δt.

Continuation of the front page (51) Int.Cl. ⁷ Identification symbol FI G06T 13/00 G06T 13/00 B (72) Inventor Koji Wakimoto 2-3-2 Marunouchi, Chiyoda-ku, Tokyo Mitsubishi Electric Corporation (72) Inventor Satoshi Tanaka 2-3-2 Marunouchi, Chiyoda-ku, Tokyo Inside Mitsubishi Electric Corporation (56) References JP-A-3-52070 (JP, A) JP-A-3-292571 (JP, A) Takano, Hajime, “Consideration of Video Data Model for Hypermedia,” Proc. Of the 46th Annual Meeting of the Information Processing Society of Japan (early 1993) (4) p. 221-222 (Heisei 5-3-23) Takano, Matoba, Hara "Hypermedia Construction Method with Nodes Appearing in Video Data as Nodes," Proceedings of the 7th Human Interface Symposium, p. 301 −306, 1991 (Heisei 3-10−23) Takano, Matoba, Hara “Navigation Method for Video Hypermedia”, 8th Human Interface Symposium, p. 607-612, 1992 (Hira 4-10-21) Hirata, Kawasaki, Takano, Hara "Moving Video Hypermedia Implementation Method in Network Environment" Proceedings of IPSJ Symposium, Vol. 94, no. 13, p. 165-173, 1994 (Heisei 6-12-7) Kazuo Tanaka, Joe Tanaka "HyperMovie Architecture and Its Applications" Information Processing Society of Japan Vol. 96, No. 119 (96-IM-28), p. 73-77 (Heisei 8-11-29) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06F 17/30 G06T 13/00

Claims (1)

(57) [Claims 1] for a plurality of frames constituting the moving picture
Select a reference frame at predetermined intervals, and the anchor information setting means for setting the anchor information for each of their reference frames, anchor information calculating means for calculating the anchor information of the non-reference frame based on the anchor information set In the moving image anchor setting device, it is determined whether or not the anchor information set in one or a plurality of reference frames can be calculated within a predetermined error range based on the anchor information set in another reference frame. Determining means for determining; and reference frame deleting means for changing the reference frames to non-reference frames when it is determined that calculation is possible;
A moving image anchor setting device.