JP4484255B2 - Information processing apparatus having touch panel and information processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information processing apparatus such as a computer or a word processor. In particular, the present invention relates to an information processing apparatus and an operation method thereof for performing an input operation efficiently while reducing the size and weight.
[0002]
[Prior art]
Conventionally, in order to input a character string or the like to a computer or the like, it is common to use a built-in mechanical keyboard.
[0003]
However, recently, there is a tendency for devices to be reduced in size and weight for portable convenience or to reduce occupied space. For this reason, information processing apparatuses having no mechanical keyboard have been developed. In such an apparatus, for example, a method of inputting a character string or the like by touching a screen provided with means for sensing that the upper and lower surfaces of the screen are in contact with a pen or the like is employed. That is, a character string can be input by touching and selecting a predetermined character in the character group displayed on the screen with a pen, or the device can recognize the character by handwriting the character on the screen with a pen. Inputs a character string.
[0004]
Japanese Laid-Open Patent Publication No. 6-083512 discloses that characters and the like are input by capturing the movement of hands and fingers on a desk or the like with a camera and digitizing the captured signals.
[0005]
[Problems to be solved by the invention]
However, the input efficiency using the pen or the like is significantly lower than the input using the keyboard. This is because the character to be input must be visually searched from the character group displayed on the screen for each character, and the pen tip must be moved to touch the screen. In addition, when a character is handwritten with a pen on the screen to cause the device to recognize the character, a long time is required for the handwriting operation and the character recognition by the device.
[0006]
In addition, the method of digitizing information captured as an image as disclosed in the above Japanese Patent Laid-Open No. 6-083512 is considered difficult to obtain high accuracy. It is difficult. Note that Japanese Patent Application Laid-Open No. 6-083512 does not disclose inputting characters or the like by touching a keyboard displayed on the screen.
[0007]
An object of the present invention is to provide an information processing apparatus that is small and thin and has high input efficiency, and Information processing It is to provide a method.
[0008]
[Means for Solving the Problems]
In order to achieve the above object, in the information processing apparatus and information processing method provided with the touch panel according to the present invention, a touch panel for detecting the touch position of the instruction unit is provided on the display screen of the display panel, and is displayed on the display screen. In an information processing apparatus and an information processing method provided with a touch panel that can be operated by touching a keyboard, detection means for detecting a pressing force P by an instruction means when touching the keyboard, preset pressures P1, P2 (where 0 <P1 <P2) is provided, and when the detected pressure by the detecting means is P1 ≦ P ≦ P2, the first process is performed, and the pressing force P is changed from P1 ≦ P ≦ P2 to P2 < A control unit that performs a second process when changing to P, and the first process is a process of displaying a keyboard at a position corresponding to a touch position on the display screen. In the second process, as a character input and displayed at a predetermined position on the display screen, a character assigned to a key corresponding to a position where a pressing force of P2 <P is detected in the keyboard is designated. The display of the keyboard as the process and the first process is displayed at a position where the keyboard can be operated as it is at the touch position where the pressure P1 ≦ P ≦ P2 is detected.
[0009]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment for transmitting an e-mail according to the present invention will be described in detail with reference to FIGS.
[0010]
In the drawings, the same reference numeral represents the same object.
[0011]
FIG. 1 is a perspective view of an information processing apparatus according to the present embodiment, FIG. 2 is a block diagram illustrating a configuration of the information processing apparatus of the present embodiment, and FIGS. 3 to 10 are diagrams for explaining pressure distribution detection according to the present embodiment. FIGS. 11 to 16 are diagrams showing the operation flow of the present embodiment, and FIGS. 17 to 32 are diagrams showing examples of display screens at each stage of the operation of the present embodiment.
[0012]
In FIG. 1, the apparatus 200 has a structure in which the inside is partially or entirely covered by a main body apparatus case 201. The size of the device is about B5 to A4, and can be easily carried. The display device 202 is fitted into the main body device case 201. A transparent tablet device 240 is placed on the display device 202. Since the tablet device 240 is transparent, the user can view the display content of the display device 202 from the outside of the device 200. Reference numeral 24 </ b> C denotes a tablet device cutting unit which is provided for explaining that the tablet device 240 is placed on the display device 202, and is not actually cut.
[0013]
A keyboard (hereinafter referred to as “virtual keyboard”) 430 displayed on the display screen is for inserting a character string at the position of a cursor 415 displayed on the display device 202 in the example of FIG.
[0014]
220 is a mouse device, and 228 is a pen. 421 is the user's left hand, and 422 is the right hand.
[0015]
FIG. 2 is a block diagram illustrating the configuration of the information processing apparatus with a tablet to which the virtual keyboard according to the present embodiment is applied.
[0016]
The configuration of this apparatus will be described with reference to FIG.
[0017]
In FIG. 2, a power source 209 is for supplying power to each part of the electronic component of the apparatus, and a power button 210 is for controlling the power source 209. The clock 211 is an oscillating device for operating each part of the apparatus in synchronization. The control device 224 has a function of performing necessary processing on an input signal to the mouse device 220 and transmitting the signal to the central processing device 231. The operator can input data by pressing the input surface of the tablet device 240 with a finger or a pen. The tablet device pressure distribution processing module 241 functions to process an input signal to the tablet device 240 and send the processed signal to the central processing device 231 and receive information such as a display state of a virtual keyboard on the display device 202 from the central processing device 231. It has. The secondary storage device 234 has a function of supplying necessary data to the central processing unit 231 from the outside. The display device 202 is for displaying the data written in the display memory in the central processing unit 231 outside the device.
[0018]
Next, detection of key data in this apparatus will be described in detail with reference to FIGS.
[0019]
FIG. 3 is a block diagram for explaining the tablet device pressure distribution processing module 241 of FIG. 2 in detail. Reference numeral 242 denotes a pressed key detection unit, 243 denotes a post-processing module, and 244 denotes a control device. Reference numeral 240 denotes a tablet device.
[0020]
The tablet device 240 of this device is a transparent plate-like input device, on which a grid-like grid is arranged. It is possible to simultaneously detect the pressure applied to all lattice points. A lattice point for detecting this pressure is called a pressure-sensitive point.
[0021]
From the tablet device 240, pressure data of all pressure sensitive points is input to the pressed key detection unit 242 at regular time intervals.
[0022]
The pressed key detection unit 242 passes to the post-processing module 243 information regarding whether or not each key including the modifier key and the function key can be pressed at regular time intervals. At the same time, the pressed key detection unit 242 determines whether or not to update the position or type of the display keyboard or the like, and if so, information on which type of keyboard is displayed at which position of the display device. To tell. Examples of the keyboard include a QWERTY keyboard and a numeric keypad.
[0023]
The post-processing module 243 looks at the rise and fall of each key data received from the pressed key detection unit 242. Thereby, for each key including the modifier key, it is detected whether the key is newly pressed or continuously pressed, and the result is transmitted to the central processing unit 231. A modifier key is a control key, a shift key, or the like.
[0024]
When eight fingers excluding both thumbs are placed on the tablet device 240 as shown in FIG. 4, the pressure is actually measured at each point where there is a pressure-sensitive point on the tablet device 240. If the number of pressure sensitive points per unit area of the device 240 is sufficiently large, there is no practical problem even if the pressure between the pressure sensitive points is approximated by interpolation. Thus, an isobaric line of pressure for pressing the tablet device 240 can be considered.
[0025]
When isobars with the same finger are combined into one set, this set can be regarded as a mountain in the topographic map when the pressure value is replaced with the height in the topographic map. Hereinafter, a set of isobaric lines with the same finger may be referred to as a “mountain”. In the case of FIG. 5, there are 8 peaks. In addition, the center of the region where the pressure is the highest as a result of pressure interpolation is referred to as “vertex”. The density of pressure sensitive points of the tablet device shall be sufficiently large.
[0026]
In FIG. 5, reference numeral 551 denotes an isobar of pressure distribution generated by the user's right index finger. In the description here, the right direction toward the tablet device 240 is the + x direction, and the upward direction is the + y direction. The xy coordinate axes 550 are for this explanation and are not present in the actual device.
[0027]
FIG. 6 is an explanatory diagram of isobaric lines of pressure with which the finger presses the tablet device 240, 552 is an enlarged view of the isobaric line 551 in FIG. 5, and 553 is a vertex.
[0028]
FIG. 7 is a diagram illustrating a state in which the tablet device 240 is “strongly pressed” and a “weakly pressed” state by each finger. 554 is an enlarged view of the isobaric line 551 in FIG. 5, and 555 is a vertex.
[0029]
The pressures P1 and P2 that press the tablet device 240 are constants, and 0 <P1 <P2. When the pressure at the vertex is p, if P1 ≦ p ≦ P2, the key to which the vertex belongs is defined as “weakly pressed”, and if P2 <p, the key to which the vertex belongs is “strongly pressed”. Defined.
[0030]
P1 and P2 can be set individually according to the value of the x coordinate of the peak of the mountain when a template such as the virtual keyboard 430 is not displayed. Thereby, the criterion of “strongly pressing” can be set individually for the middle finger of the right hand and the little finger of the right hand, for example.
[0031]
When these templates are displayed, they can be set separately depending on the key area. Here, the “key area” represents an area delimited by the display of each key top of a template such as a QWERTY type virtual keyboard 430 or a numeric keypad.
[0032]
Hereinafter, the operation of the pressed key detection unit 242 will be described with reference to FIGS. 8 to 10 which are state transition diagrams.
[0033]
A screen 2001 represents a screen state in which the virtual keyboard 430 is not displayed.
[0034]
The screen 2002 has the same screen state as the screen 2001, but is different from the screen 2001 in that the state of the screen 2001 is a state in which it is measured whether the number of specific mountains continues for a certain period of time. It is expressed as a node different from the node.
[0035]
A screen 2003 represents a screen state in which a QWERTY type virtual keyboard 430 is displayed and a key code can be input.
[0036]
The pressed key detection unit 242 operates in synchronization with the tablet device 240. That is, it is assumed that there is an input from the tablet device 240 to the pressed key detection unit 242 at regular time intervals, and the state transition of FIGS.
[0037]
The user can display at least two types of templates on the apparatus. One is a QWERTY type virtual keyboard 430, and the other is a virtual numeric keypad.
[0038]
When one of the following two types of calling operations is input on the screen 2001, a QWERTY type virtual keyboard 430 or a virtual numeric keypad is displayed.
[0039]
The calling operation for displaying the QWERTY type virtual keyboard 430 satisfies all the following conditions (1) to (4).
[0040]
(1) The apparatus is in a state where neither the QWERTY type virtual keyboard 430 nor the virtual numeric keypad is displayed.
[0041]
(2) The state where the finger is weakly pressed with eight fingers continues for a certain time or more. Here, the state of being weakly pressed by eight fingers means that the number of peaks is 8, and the apex pressure p of all the eight peaks satisfies P1 ≦ p ≦ P2.
[0042]
(3) The four points from the smallest x coordinate of the peak of the mountain are “almost on a straight line and about the interval between fingers”. Here, “substantially on a straight line” means, for example, that the distance from the straight line of the four points by the least square method is within 8 mm for all the four points. Further, the “interval between finger intervals” means that the interval between the vertices of adjacent mountains is 19 mm to 22 mm, for example.
[0043]
(4) The four points from the largest x coordinate of the peak of the mountain shall be “almost on a straight line and at intervals of the finger interval”.
[0044]
Hereinafter, this is called a QWERTY type virtual keyboard calling operation.
[0045]
The calling operation for displaying the virtual numeric keypad satisfies all the following conditions (1) to (3).
[0046]
(1) The apparatus is in a state where neither the QWERTY type virtual keyboard 430 nor the virtual numeric keypad is displayed.
[0047]
(2) The state of being pressed weakly with three fingers continues for a certain period of time. The state of being weakly pressed by three fingers here means that the number of peaks is 3, and the apex pressure p satisfies P1 ≦ p ≦ P2 for all three peaks.
[0048]
(3) The apexes of the three peaks are “almost on a straight line and about the interval between fingers”. Here, “substantially on a straight line” means, for example, that the distance from the straight line from the three points by the least square method is within 8 mm for all the three points. Further, the “interval between finger intervals” means that the interval between the vertices of adjacent mountains is 19 mm to 22 mm, for example.
[0049]
Hereinafter, this is called a numeric keypad call operation.
[0050]
By preparing templates other than the QWERTY type virtual keyboard 430 and the virtual numeric keypad in advance in association with the call operation for displaying them, the user can also use these templates.
[0051]
The calling operation in that case may be any appropriate one, and does not necessarily follow the above example.
[0052]
For example, if five fingers are touching the tablet device 240 for a certain period of time, a template with a 50-sound order arrangement may be displayed.
[0053]
When a QWERTY type virtual keyboard calling operation is input on the screen 2001, the screen transitions to the screen 2003 to display the QWERTY type virtual keyboard 430.
[0054]
Further, when a virtual numeric keypad call operation is input on the screen 2001, the screen transitions to a screen 2003 to display the numeric keypad.
[0055]
Hereinafter, the operation of the pressed key detection unit 242 will be described step by step in accordance with the state transition.
[0056]
First, the variable N used in the following description will be described.
[0057]
Let N be the number of vertices satisfying P2 <p, where p is the number of strongly pressed fingers, that is, apex pressure.
[0058]
When a template such as a QWERTY type virtual keyboard 430 is displayed on the display device, if the number of fingers pressing the tablet device with a pressure equal to or higher than P1 is set to 0, the template display is erased.
[0059]
This state is a start state, and the screen 2001 in FIG. 8 corresponds to this state.
[0060]
An input 1601A is an input in which the tablet device is weakly pressed with three or eight fingers and satisfies (3) and (4) of the software keyboard calling operation.
[0061]
When the input 1601A is input in the state of the screen 2001, the apparatus starts measurement for checking whether the number of peaks in the input 1601A continues for a predetermined time, and transitions to the state of the screen 2002. The fixed time is, for example, 200 milliseconds.
[0062]
In the state of the screen 2001, when an input other than the input 1601A is input, the pressed key detection unit 242 informs the post-processing module 243 that there is no key that is strongly pressed with a finger, and also notifies the central processing unit 231. Tells the template to disappear and not change. Then, the state remains the screen 2001.
[0063]
Here, “convenient” means that there may be a key area that is actually pressed strongly.
[0064]
For example, when the operation of “four fingers touching the tablet device for a certain period of time” is not defined as an operation for calling some template, the device is pressed with pressure of P1 or more with four fingers, and Assume that at least one of the four is pressed with a pressure of P2 or more.
[0065]
In this case, for the sake of convenience, the post-processing module 243 is informed that there is no such key even though there is a key being pressed with a pressure equal to or higher than P2.
[0066]
In the state of the screen 2002, the number of peaks in the input 1601A remains unchanged, and all fingers continue to be pressed for a certain time with the tablet device pressed weakly. If the number of peaks is 3, the numeric keypad is used, and if it is 8, the QWERTY The type virtual keyboard 430 is displayed, and the state transitions to the state of the screen display 2003. At the same time, the post-processing module 243 is informed that there is no key area including a vertex that satisfies P2 <p.
[0067]
In the state of the screen 2002, if all the vertices are weakly pressed with the number of peaks in the input 1601A and a certain time has not passed, it is determined whether or not the number of peaks in the input 1601A continues for a certain time. The measurement for checking is continued and the state of the screen 2002 remains.
[0068]
In the state of the screen 2002, if the number of peaks pressing the tablet device weakly before a certain time elapses differs from the number of peaks in the input 1601A, it is used to check whether the number of peaks in the input 1601A continues for a certain time The measurement is discarded and the screen 2001 is entered.
[0069]
In the screen 2003, there are the following three types.
[0070]
(1) When the number of peaks is 1 or more and N = 0 is input, the pressed key detection unit 242 notifies the post-processing module 243 that there is no key that is strongly pressed with a finger, The processing device 231 is instructed not to change the template display. Then, the state remains the screen 2003.
[0071]
(2) When the number of peaks is 1 or more and N> 0 is input, the pressed key detection unit 242 notifies the post-processing module 243 of all key areas strongly pressed by a finger and performs central processing. The apparatus 231 is instructed not to change the display of the template. Then, the state remains the screen 2003.
[0072]
(3) When the number of peaks is 0, that is, in the case of an input in which no finger presses the tablet device 240 with a pressure equal to or higher than P1, the pressed key detection unit 242 has no key that is strongly pressed with the finger. This is notified to the post-processing module 243, and the central processing unit 231 is instructed not to display the template. Then, the state transitions to the screen 2001.
[0073]
Next, operation examples of the information processing apparatus based on the present invention will be described in detail with reference to FIGS.
[0074]
11 to 16 are diagrams illustrating an operation flow of the information processing apparatus according to the present embodiment.
[0075]
11 to 16, the part following “A:” represents the intention of the user and the input by the user to the apparatus, and the part following “B:” represents the reaction of the apparatus to the user's input and the like. And
[0076]
Steps 1000 to 1010 will be described.
[0077]
The user presses the power button 210 shown in FIG. 2 so that the power of the power source 209 can be supplied to each part of the electronic component of the apparatus and activates the apparatus. Then, the present apparatus displays an initial screen 400 as shown in FIG. 17 on the display device.
[0078]
An example of reading an e-mail will be described. The user operates the mouse pointer 225 or an equivalent operation using the mouse device 220 or a similar pointing device (hereinafter referred to as the mouse device 220 or the like), and selects and executes the e-mail activation icon 401.
[0079]
Step 1011 will be described. This apparatus starts e-mail software, displays a user name / password input window 410 as shown in FIG. 18 on the display device, and inputs the user name and the like at the position of the cursor 415 to the user. Prompt.
[0080]
Step 1020 will be described. The user wants to input a character string representing the user name. As shown in FIG. 19, the user can use 10 fingers of the user's left hand 421 and the user's right hand 422, as in the case where the left and right hands are placed on a normal keyboard that is generally used at present. Place the 8 fingers excluding the thumb with the left and right index fingers sufficiently separated from each other. Here, “separate enough” means that when the QWERTY type virtual keyboard is displayed later, the left hand part and the right hand part of the QWERTY type virtual keyboard are separated so as not to overlap, It means that. The QWERTY type virtual keyboard will be described later.
[0081]
Step 1021 will be described. This device determines that eight fingers are placed on the tablet device 240, and as shown in FIG. 20, the user positions the right hand 421 and left hand 422 on the tablet device at the home position. A QWERTY type virtual keyboard 430 with a key pitch that matches the finger of the user is displayed.
[0082]
In the case of a QWERTY type keyboard, the home position is a way of placing a finger in which the index finger of the left hand is the position of the F key and the index finger of the right hand is the position of the J key.
[0083]
According to the present embodiment, the user can directly set the position where the hand is placed on the display device as the home position. For this reason, in order to adjust the position of the finger to the position of the home position, it is not necessary to move the line of sight to the display portion of the QWERTY type virtual keyboard 430 and move the finger. That is, the user can use the QWERTY type virtual keyboard 430 without taking his / her line of sight from the insertion point of the character string. Therefore, the visual fatigue of the user can be reduced, and further, the operation time for adjusting the position of the finger or moving the viewpoint can be shortened.
[0084]
The key pitch is the distance between the centers of any two keys arranged side by side in the horizontal direction.
[0085]
Since the shape of the finger including the thickness varies depending on the individual, it is desirable that the key pitch of the keyboard is variable.
[0086]
In the case of a conventional virtual keyboard, (1) an appropriate key pitch is registered in advance for each user, or (2) the user explicitly performs an operation using a control panel or the like for adjustment. Operation was necessary.
[0087]
However, since this apparatus determines the key pitch suitable for the user based on the distance between the fingers contacting the tablet device 240, the key pitch can be designated directly and automatically.
[0088]
Furthermore, since the thickness of the finger varies from finger to finger, the distance between adjacent fingers in a state where the finger is naturally opened is considered to vary from finger to finger. The apparatus can also provide a virtual keyboard 430 that automatically adjusts the key pitch to the interval between adjacent fingers. Thereby, the excessive movement of fingers can be reduced and the physical burden can be reduced.
[0089]
The QWERTY type virtual keyboard 430 in the state of FIG. 20 may be displayed in a semi-transparent state or in an opaque state so that the portion that was originally displayed is hidden as much as possible by the display of the QWERTY type virtual keyboard 430. May be. When displayed in a semi-transparent state, there is an advantage that the user can recognize the originally displayed portion and use the information.
[0090]
The translucent state in the display of the QWERTY type virtual keyboard 430 is to prevent the part that was originally displayed from being hidden as much as possible by the display of the QWERTY type virtual keyboard 430 and is originally displayed on the display device. The display of the QWERTY type virtual keyboard 430 can be seen through from the top of the part that has been overlapped. Of the display dots of the display device, only the dot values sufficient for the user to determine the key are changed so that the hidden portions of the originally displayed portions are reduced. By doing so, the user can recognize the part that was originally displayed to some extent and use the information.
[0091]
Steps 1022 to 1056 will be described. The user inputs the correct user name and the correct password by typing with a finger using the QWERTY type virtual keyboard 430 displayed on the display device.
[0092]
Then, the system displays a mail title list screen 400E as shown in FIG. 452 represents an e-mail whose title is “Welcome to a hot spring trip”. Reference numeral 453 denotes a rectangular area representing an e-mail whose title is “Thank you for the other day”. Reference numeral 454 denotes a rectangular area representing an electronic mail whose title is “impressions that have seen xxx”. Reference numeral 455 denotes a rectangular area representing an e-mail whose title is “Feast”. Reference numeral 456 denotes a rectangular area representing an e-mail whose title is “Recent”. 452, 453, 454, 455, 456
The sender and title of the e-mail currently delivered to the user are displayed.
[0093]
Step 1060 will be described. The user operates the mouse cursor 225 or the like as necessary using the mouse device 220 or the like, and selects and executes the rectangular area 452.
[0094]
Step 1061 will be described. This device displays the contents of “Invitation for hot spring trip” on the display device. In this example, the apparatus displays a text on the upper part of the display device and a pamphlet on the lower part.
[0095]
FIG. 22 explains the state of display of a pamphlet as an accompanying document for “invitation of hot spring trip”. Reference numeral 610 denotes a window that displays the text of an e-mail message “invitation for hot spring trip” received by the user. Reference numeral 620 denotes a window for the contents of a brochure attached to the received mail. In this example, it is a hot spring pamphlet. Reference numeral 601 denotes a menu bar, and reference numeral 602 denotes a menu item for displaying a submenu related to “message”.
[0096]
Steps 1070 to 1071 will be described. The user reads the contents of the window 610 on the screen and the contents of the received mail attached pamphlet contents 620 and writes a reply.
[0097]
FIG. 23 explains the state of the screen when the user selects and executes the menu item for starting reply creation. Reference numeral 603 denotes a submenu related to “message”. Reference numeral 603A denotes one of the submenus, which is a menu item for selecting and executing a reply creation command. Reference numeral 603B denotes one of the submenus, which is a menu item for selecting and executing a transfer command. Reference numeral 603C denotes one of the submenus, which is a menu item for selecting and executing a transmission command.
[0098]
FIG. 24 explains the state of the screen when the user displays a window for writing a reply. The user selects the menu item 603A for creating a reply using the mouse device 220 or the like on the screen of FIG. Then, the present apparatus displays a window 640 for the user to write a reply on the display device. Others are the same as the description of FIG.
[0099]
Steps 1100 to 1103 will be described. In FIG. 25, 431 is a return key area, and 432 is a space key area. First, the user touches the tablet device 240 with eight fingers excluding the thumbs of the right hand 421 and the left hand 422. Then, the present apparatus displays the QWERTY type virtual keyboard 430 on the display device so as to match the home position of each finger of the user.
[0100]
If necessary, the user switches to the Japanese input mode using a key in the QWERTY type virtual keyboard 430. Here, it is assumed that the commonly known Romaji-kana conversion and Kana-Kanji conversion are used. Then, by typing “hiyouhadanokurakakarisoudesuka?”, A conversion character type “how much does it look like hiyo?” Is input. Then, the user performs conversion by typing the space key area 432, which is a key area for conversion, with a finger in the same manner as a normal kana-kanji conversion operation, and confirms. Then, the device inserts a character string “How much does it cost?” At the position of the cursor 415 and displays it on the display device. In the kana-kanji conversion system of the present embodiment, the space key is also used as the conversion key.
[0101]
FIG. 26 illustrates the state of the screen when the user inputs the line feed code and the character string “Brochure” following the input of the character string “How much does it cost?”. A line feed code can be input by pressing the return key area 431. Reference numeral 651 denotes a character string inserted by input, and the others are the same as in the description of FIG.
[0102]
Steps 1104 to 1105 will be described. When the user separates the right hand 421 and the left hand 422 from the tablet device 240, the QWERTY type virtual keyboard 430 is not displayed on the display device as shown in FIG.
[0103]
Generally, it is sufficient that the virtual keyboard is displayed only when inputting. In the case of this apparatus, it is sufficient that the display is performed only when the user touches the tablet device 240 with a finger. When displayed at other times, the display area of the display device is substantially reduced by the amount that the virtual keyboard is displayed.
[0104]
Upon completion of input, the present apparatus can automatically turn off the display of the QWERTY type virtual keyboard 430 by releasing all fingers of both hands from the tablet device 240. Therefore, a substantial reduction in display area due to the display of the QWERTY type virtual keyboard 430 can be prevented with a few operation procedures.
[0105]
Steps 1110 to 1111 will be described. When the user returns his / her hand to the tablet device 240 again, the state shown in FIG. 26, that is, the QWERTY type virtual keyboard 430 is displayed, and the state returns to a state where characters can be input. After completing the reply by continuing the text input operation, the user selects and executes the menu item 603C representing the transmission shown in FIG. 23 using the mouse device 220 or the like, and transmits the mail.
[0106]
A description of the subsequent operations is omitted.
[0107]
Hereinafter, a description will be given of the behavior of the present apparatus when a window in which a user is about to input characters is displayed at a position where it is difficult to see by overlapping the user's finger placed on the display screen.
[0108]
For example, the state of the screen in step 1071 is not the case shown in FIG. 24 but the case where the reply creation window 640 is displayed at the lower part of the screen which is likely to overlap with the user's finger as shown in FIG. It is desirable to input a character string or the like while looking at the input progress. In such a case, it is difficult to input while looking at the input progress unless any special measures are taken.
[0109]
Steps 1312 to 1313 shown in FIG. 15 will be described. The user touches the tablet device 240 with eight fingers to input a sentence. The apparatus then displays the QWERTY type virtual keyboard 430 so that the position of the user's finger is at the home position while scrolling the display on the display device upward.
[0110]
29 and 30 are diagrams for explaining the state of the scroll. FIG. 29 shows a state where both hands 441 and 442 of the user have not yet touched the tablet device 240. FIG. 30 shows a state in which the screen of the display device is automatically scrolled upward immediately before the QWERTY type virtual keyboard 430 is displayed so that the window 640 is not hidden by fingers with both hands 441 and 442 touching the tablet device 240. It is.
[0111]
The user can set whether or not to perform the automatic scroll function.
[0112]
Steps 1320 to 1333 will be described. It is assumed that the user wants to see the window 620 of the contents of the brochure attached to the received mail when the user inputs “How much does it cost? (Line feed character) brochure” as shown in FIG. However, in this state, the window 620 for the contents of the received mail attached brochure is out of the visible portion by scrolling the display device upward in step 1321. Here, as shown in FIG. 32, when all the fingers are temporarily released from the tablet device 240, the upward scrolling is released, and the received mail attached pamphlet content window 620 is displayed on the display device.
[0113]
The user refers to the window 620 of the contents of the brochure attached to the received mail, and then places the eight fingers on the tablet device 240 again to continue the input. When the sentence is completed, a menu item representing transmission is selected, executed, and transmitted.
[0114]
Hereinafter, the description of the operation until the power button 210 is turned off is omitted.
[0115]
As described in detail above, the information processing apparatus according to the present embodiment does not need to be provided with a mechanical keyboard, so that the entire apparatus can be reduced in weight and thickness.
[0116]
In addition, since a template such as a keyboard is displayed on a display device and a character string or the like can be input by bringing a finger or the like into contact with the tablet device, an operation can be performed as if a mechanical keyboard exists, and a mechanical keyboard is provided. It is possible to prevent a decrease in input efficiency in a device that does not.
[0117]
Moreover, since it is a virtual keyboard system, various templates can be provided to the user. The various templates here include, for example, a variety of display positions, key pitches, key area shapes, and the like, as well as a variety of key labels and arrangements including multilingual correspondence and functions. Specifically, in the case of a keyboard for character input, in addition to the commonly known QWERTY type arrangement, the DVORAK arrangement, or the Japanese alphabetical arrangement or the like is displayed for the user. Can be provided. It is possible to provide the user with input by displaying a numeric keypad arrangement for numerical input and an arrangement of a piano keyboard for music. In addition, for each application software, the function key labeling can be changed and displayed.
[0118]
【The invention's effect】
As described above, according to the present invention, the display screen of the information processing apparatus The touch operation by pressing can be performed efficiently. As a result, the device is thin and light and efficient. operation· Can be entered.
[Brief description of the drawings]
FIG. 1 is a perspective view of an information processing apparatus according to an embodiment of the present invention.
FIG. 2 is a block diagram showing a configuration of an information processing apparatus according to an embodiment of the present invention.
FIG. 3 is a block diagram showing the configuration of an information processing apparatus according to an embodiment of the present invention in more detail.
FIG. 4 is a diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 5 is a diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 6 is a diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 7 is a diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 8 is a state transition diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 9 is a state transition diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 10 is a state transition diagram for explaining pressure distribution detection according to an embodiment of the present invention.
FIG. 11 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 12 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 13 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 14 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 15 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 16 is a diagram showing an operation flow of one embodiment of the present invention.
FIG. 17 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 18 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 19 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 20 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 21 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 22 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 23 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 24 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 25 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 26 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 27 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 28 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 29 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 30 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 31 is a diagram showing an example of a display screen in one embodiment of the present invention.
FIG. 32 is a diagram showing an example of a display screen in one embodiment of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 200 ... This apparatus, 201 ... Main body apparatus case, 202 ... Display apparatus, 209 ... Power supply, 210 ... Power button, 211 ... Clock, 220 ... Mouse apparatus, 224 ... Control apparatus of mouse apparatus, 225 ... Mouse pointer, 228 ... Pen 231 ... Central processing unit, 234 ... Secondary storage device, 240 ... Tablet device, 24C ... Tablet device cut unit, 241 ... Tablet device pressure distribution processing module, 242 ... Pressed key detection unit, 243 ... Post processing module, 244 ... Control device, 400 ... Initial screen, 400E ... Received mail subject list screen, 401 ... Email activation icon, 410 ... User name / password input window, 415 ... Cursor, 421 ... User's left hand, 422 ... User's left hand Right hand, 430 ... QWERTY type virtual keyboard, 431 ... Return key area 432 ... Space key area, 452 ... Rectangle area representing e-mail whose title is "Welcome to hot spring trip", 453 ... Rectangular area representing e-mail whose title is "Thank you the other day", 454 ... The title is "I see xxx" Rectangular area representing an e-mail of “Takanou”, 455... Rectangular area representing an e-mail whose title is “Feast”, 456. ,...,... Enlarged view (1), 553... Vertex (1), 554... Enlarged view (2), 555... Vertex (2), 556. ,...,... P 2, 601... Menu bar, 602. 610 ... received mail body text window, 620 ... received mail attached brochure content window, 225 ... mouse pointer, 603 ... submenu related to "message", 603A ... menu item representing reply creation, 603B ... forwarded Menu item, 603C ... Menu item representing transmission, 640 ... Window for user to write reply, 651 ... Inserted character string, 1000 ... Operation step, 1001 ... Operation step, 1010 ... Operation step, 1011 ... Operation step DESCRIPTION OF SYMBOLS 1020 ... Operation step, 1021 ... Operation step, 1022 ... Operation step, 1051 ... Operation step, 1056 ... Operation step, 1060 ... Operation step, 1061 ... Operation step, 1070 ... Operation step, 1071 ... Operation step, 1 DESCRIPTION OF SYMBOLS 100 ... Operation step, 1101 ... Operation step, 1102 ... Operation step, 1103 ... Operation step, 1104 ... Operation step, 1105 ... Operation step, 1110 ... Operation step, 1111 ... Operation step, 1312 ... Operation step, 1313 ... Operation step, 1320 ... Operation step, 1321 ... Operation step, 1322 ... Operation step, 1323 ... Operation step, 1330 ... Operation step, 1331 ... Operation step, 1332 ... Operation step, 1333 ... Operation step, 1601A ... Input, 2001 ... Screen, 2002 ... Screen, 2003 ... screen.

Claims (6)

In an information processing apparatus provided with a touch panel that detects a touch position of an instruction unit on a display screen of a display panel and that can be operated by touching a keyboard displayed on the display screen.
Detecting means for detecting the pressing force P by the instruction means when touching the keyboard;
Preset pressures P1, P2 (where 0 <P1 <P2) are provided, and when the detected pressure by the detecting means is P1 ≦ P ≦ P2, the first process is performed, and the pressing force P is P1 ≦ P A control unit that performs a second process when P2 is changed from P2 to P2 <P;
The first process is a process of displaying a keyboard at a position corresponding to a touch position on the display screen;
In the second process, a character assigned to a key corresponding to a position where a pressing force of P2 <P is detected is designated as a character to be input and displayed at a predetermined position on the display screen. The display of the keyboard as the first process is displayed at a position where the keyboard can be operated as it is at the touch position where the pressure of P1 ≦ P ≦ P2 is detected. An information processing device equipped with a touch panel. 2. The information processing apparatus with a touch panel according to claim 1, wherein the first process is performed when a state in which the detection pressure by the detection unit is P1 ≦ P ≦ P2 continues for a predetermined time or longer. The second process is performed when the pressing force P at a position corresponding to the keyboard satisfies P2 <P in a state where the first process is performed. An information processing apparatus comprising the touch panel according to 2. The first process is a process of displaying the keyboard on the display screen at a position where the touch position where the pressure of P1 ≦ P ≦ P2 is detected becomes the home position as it is. An information processing apparatus comprising the touch panel according to any one of 3. An information processing method using a touch panel that detects a touch position of an instruction unit by a touch panel provided on a display screen of a display panel and allows operation by touching a keyboard displayed on the display screen,
The pressure P by the instruction means when touching the keyboard is detected, and preset pressures P1 and P2 (where 0 <P1 <P2) are provided, and the detected pressure by the instruction means is P1 ≦ P ≦ When P2, the first process is performed. When the pressing force P is changed from P1 ≦ P ≦ P2 to P2 <P, the second process is performed.
The first process is a process of displaying a keyboard at a position corresponding to a touch position on the display screen;
In the second process, a character assigned to a key corresponding to a position where a pressing force of P2 <P is detected is designated as a character to be input and displayed at a predetermined position on the display screen. The display of the keyboard as the first process is displayed at a position where the keyboard can be operated as it is at the touch position where the pressure of P1 ≦ P ≦ P2 is detected. Processing method provided with a touch panel. When the pressing force P of the position corresponding to the keyboard in a state in which the first processing has been performed becomes P2 <P, according to claim 5, wherein the second process is performed information processing method using the touch panel.

Images