Adding Mouse and Touch Controls to Canvas

Because the canvas element works both on the desktop and in iOS, it can be interacted with by either mouse or touch. This section shows you how to create canvas webpages that respond equally well to both mouse and touch input.

Because the canvas element responds to JavaScript, you can include controls for the canvas anywhere on the page. This chapter covers four input variants.

Using Standard Inputs with Canvas

There are a few things to bear in mind when using standard HTML inputs with canvas.

Text input fields bring up the soft keyboard on iOS-based devices, covering the lower half of the screen. Make sure the relevant parts of the canvas aren’t obscured by the keyboard, or choose a different kind of input.

Selection input fields with alternates bring up the rotary picker on iPhone and iPod touch, again covering the lower half of the screen. Make sure the relevant parts of the canvas aren’t obscured by the picker, or choose a different kind of input.

Button inputs with default settings tend to be quite small on iPhone and iPod touch. To make buttons easier to find with a finger, try setting a smaller viewport or a larger initial scale using the tag, or making the button font larger using the CSS font style.

The example in Listing 13-1 sets the viewport width to 300, the initial scale to 2, and the input font to larger and bold, resulting in large, easy-to-push buttons on iPhone and iPod touch. The desktop version is illustrated in Figure 13-1.

Figure 13-1  Big buttons

Listing 13-1  Make big buttons

    Big Buttons
    
    
    
    
    
    
    
    
    
    
    
        
        
        
    

Using Standard Inputs on Canvas

You can superimpose standard HTML inputs—or custom inputs—on the canvas simply by declaring the inputs after the tag and using CSS to position the inputs on top of the canvas.

The inputs cover any graphics or animation drawn on the canvas.

The example in Listing 13-2 positions a pair of buttons and a selector on top of the canvas, as illustrated in Figure 13-2.

Figure 13-2  Controls on canvas

Listing 13-2  Putting controls on canvas

    Controls on Canvas
    
    
    
        
    
    
    
    
    
    
        
        
        
            
            
            
        
    

Responding to Mouse and Touch Events on Canvas

For some applications, you don’t need a specific input object—just a way to respond to mouse and touch events on the canvas as a whole.

Install event listeners on the canvas element for mousedown or click events, and install event listeners on the body element for mouseup events, in case a mouse event begins on the canvas and ends off the canvas. Similarly, listen for touchstart and touchend events on the canvas, but listen for touchcancel events on the HTML body.

To obtain the mouse or touch coordinates in terms of the canvas, get the pageX and pageY properties, then subtract the canvas’s offsetLeft and offsetTop properties.

By default, dragging a finger in iOS pans the browser window. To allow touch to flow smoothly over the canvas on iOS, prevent the default panning behavior by adding preventDefault() to your touchstart event handler.

Tracking a Single Touch

The example in Listing 13-3 tracks mouse and touch movements that originate on the canvas, displaying the canvas coordinates and whether the mouse button or finger is down. The results are displayed on the canvas, as shown in Figure 13-3.

Figure 13-3  Tracking events on canvas

The example listens for mousemove or touchmove events on the canvas to track the mouse or finger position on the canvas. The example also listens for mousedown and mouseup, or touchstart and touchend, to determine if the mouse button or finger is down. Note that the mouse is still tracked when the mouse button is released, but when the finger is lifted off the screen, there is no touch to track. The example then shows the current x,y position and state (up or down) of the mouse or touch, and draws a white cursor at that position on the canvas.

Only a single touch event is tracked; additional simultaneous touches are ignored. To obtain all the touch events that begin on the canvas, iterate through the event’s targetTouches array. See Tracking Multiple Touches and Testing for Hits for details.

Listing 13-3  Track mouse and touch events

    
    
    Tracking Mouse and Touch Events on Canvas
    
 
    
    

Tracking Multiple Touches and Testing for Hits

The example in Listing 13-4 draws an endless series of descending red bubbles on the canvas, as illustrated in Figure 13-4. Clicking the mouse on a bubble, or touching a bubble with a finger on iOS, pops the bubble.

This example tracks up to four simultaneous touch events, allowing the user to pop up to four bubbles at a time on iOS-based devices.

The example uses isPointInPath() to test each bubble against each touch. The length of the touches array is stored in a global variable, and the variable is updated whenever a touch starts, ends, or is canceled.

Figure 13-4  Bubbles

Listing 13-4  Track multiple touches

    
    
    Pop the Bubbles
    
    
    

Creating Custom Canvas Controls

You can draw any kind of control you like on the canvas, and use the techniques described in Responding to Mouse and Touch Events on Canvas to determine if the input is on your custom control, but there is a faster and better way to implement most custom controls.

If your custom control is part of the canvas itself, the control is just a graphic, not a targetable element. Consequently, you need to track all touches on the canvas, and compare the coordinates of each touch to each control you draw. It can get complicated.

A better approach is to build the control using HTML and CSS, then position the control on top of the canvas using CSS. Your control can still be a graphic image—or multiple images—alpha channels in images are automatically composited onto the underlying canvas.

By creating the control as an element in HTML, you can make the control a target for mouse and touch events. That way, Safari sorts the touches for you, and you can respond to touches on the control itself. There’s no need to compare multiple touches with multiple controls, or to track the mouse or finger coordinates at all.

Adding a Custom Button

To add a custom button to the canvas, create an HTML div or img element and use CSS to style the element and position it on top of the canvas.

Add a listener function for touchstart and mousedown events to detect a custom button being pressed, and add a listener function for touchend and mouseup events to detect the button being released. You might want to take an action when the button is pressed or when it is released, or both.

Add a state variable to track whether the button is pressed or released.

Add a listener function for mouseup events to the page as a whole, in case the user clicks your button, then moves the mouse pointer off your button before releasing the mouse button.

Similarly, add a listener function for touchcancel events to the page as a whole, in case the touch is canceled for some reason (such as an incoming phone call, for example).

The example in Listing 13-5 creates a div element, styles it as a button, and positions it on the canvas. When the button is clicked or touched, the button state changes and a different style is applied to the button. The canvas also changes, in this case to blue. When the touch ends or the mouse button is released, the button style reverts to the unpressed state and the canvas changes to black. The results are illustrated in Figure 13-5.

Figure 13-5  Clicking a custom button

The listener functions are added to the button and the HTML body using HTML attributes, such as onmousedown and ontouchstart.

Listing 13-5  Creating a custom button on canvas

    Custom Button
    
    
    
    
    
    
    
         onmousedown="press1()" onmouseup="release1()"
         ontouchstart="press1()" ontouchend="release1()">
        Click Me
    

Adding a Slider

A slider is a useful control for user input having a fixed range. A slider consists of a knob and a bar for the knob to slide on. The range of the slider can be anything, but the number of dragable steps is constrained by the length of the bar. To create a slider with a range of n1 to n2 in 100 steps, for example, you need to create a bar at least 100 pixels long—a single pixel is the minimum finger-controllable movement of the knob.

A slider can be a graphic image, but you can also use CSS to style a set of nested div elements to act as a slider, using only text.

On iOS-based devices, the minimum comfortable size for the knob on a slider is 44 x 44 pixels. A circle of radius 25 meets these criteria and makes a comfortable target for a finger.

To build a slider, listen for mousedown, mousemove, touchbegin, and touchmove events on the slider element. Listen for mouseup events on the body element and track the mouse button state.

Begin your touch event handlers with preventDefault() to allow the finger to drag the slider instead of scrolling the page.

Position the knob relative to the bar using CSS. The slider has a dragable range from 0 to the width of the bar, minus the width of the knob. For example, for a circular knob of radius 25, the minimum bar width is 150 pixels to allow 100 dragable steps while keeping the knob on the bar.

The knob value is the mouse or touch event’s pageX property, minus the slider’s offsetLeft property. The knob should be positioned half its width to the left of the knob value, so the mouse or finger drags the center of the knob. The knob value should be clamped at 0 and the bar width minus the knob width.

The example in Listing 13-6 creates a slider using three nested div elements. The outermost div element is the slider and is positioned absolutely. The two inner div elements are the bar and the knob, and are positioned relatively within the slider. The bar div is styled into a horizontal line and the knob div is styled into a circle using CSS.

The knob is 52 pixels wide, including the border, and the bar is 152 pixels wide, giving the slider a positional range of 0-100. The slider is used to scale a graphic from a size of 0.25 to 0.75 in 100 steps, to demonstrate that the value range driven by the slider is not constrained by the positional range. The result is illustrated in Figure 13-6.

Figure 13-6  Slider controlling image size

The knob value is displayed and the image is redrawn in an independent animation loop, so as not to overload the event handlers and make them unresponsive. The knob is repositioned using CSS, by setting the offsetLeft property. Safari redraws the knob automatically.

Listing 13-6  Adding a slider using CSS

    Custom Slider
    
    
    
    
    
    
    
         onmousedown="mouseDown()" onmousemove="mouseXY()"
         ontouchstart="touchXY()" ontouchmove="touchXY()">