How to Select Complex Areas: Sky, Objects, Hair and Soft Edges

By Photoyam team Updated October 21, 2026 9 min read

Almost every serious edit starts with a selection: brighten only the sky, recolor one object, cut a product out of its background. A jagged tree line, soft clouds or a head of hair are hard, and no single tool gets them right alone. This guide explains which tool to reach for, how to combine them, and how to turn a rough selection into a clean, editable mask.

What a selection really is

The marching ants are only an outline. Underneath, a selection is a grayscale map the size of the image: each pixel is fully selected, not selected, or partly selected. Partly selected pixels make soft edges possible, so an edit fades out along the edge instead of leaving a seam.

That is why complex selections are hard: a box needs a crisp outline, while a cloud or hair needs a gradual one. Good selection work means getting a rough shape quickly, then spending your effort on the edge.

Pick the right tool

Pressing a toolbar slot’s letter picks its first tool; pressing it again moves to the next tool in that slot.

Defaults: the Magic Wand starts at Tolerance 32 with Contiguous and Sample All Layers on; Quick Selection uses Size 30 px and Tolerance 24. Leave the Marquee and Lasso Feather field at 0 and soften later. With the Magnetic Lasso, click once and move the pointer along the edge; it snaps to strong edges. Close a polygonal or magnetic outline by clicking the first point or pressing Enter.

Add, subtract and intersect

Real selections are built in passes. Each selection tool’s options bar has New, Add, Subtract and Intersect buttons, but modifier keys override them as you drag or click: Shift adds, Alt (Option on a Mac) subtracts, and Shift+Alt keeps only the overlap.

Quick Selection has only New, Add and Subtract, and switches itself to Add after your first stroke. Hold Alt to paint away anything it grabbed by mistake.

Keyboard basics: Ctrl+A selects all, Ctrl+D deselects and Ctrl+Shift+D reselects (Cmd on a Mac). To invert, use Select › Inverse: its Ctrl+Shift+I shortcut opens the developer tools in most browsers before Photoyam sees it. Inverting is often the quickest route: if the background is simpler than the subject, select the background and invert.

Color Range: select by color

Select › Color Range… works across the whole image, not outward from a click. With the dialog open, click the image to sample a color (each click averages a 5×5 pixel area, so noise does not throw it off). Switch the Eyedropper to Add to Sample to collect several colors or Subtract to remove some. Fuzziness (0–128, default 40) sets how different a pixel may be and still be partly selected. The Select menu also has presets such as Blues, Highlights and Shadows that need no sampling.

Set Selection Preview to Grayscale to see the mask itself (white selected, black not, gray partial), or Black Matte, White Matte or Quick Mask to judge soft edges against a backdrop.

That is Color Range’s weakness: it has no idea where the sky ends, and lowering Fuzziness only trades spill for speckled holes. For one connected region, an edge-aware tool is faster. You can also combine them: after Color Range, drag a Rectangular Marquee with Shift+Alt held to keep only the part inside the rectangle.

Select Subject: the automatic start

Select › Subject (also a Select Subject button on the Quick Selection and Magic Wand options bar) runs an AI matting model that finds the main foreground subject. The first run downloads the model once, with a progress dialog; after that it is cached. Processing happens on your device and the photo is never uploaded.

It is built for people, pets and products against a reasonably clear background. It will not select a sky or one tree among many; if it finds nothing, it says “No subject found”. It also works on a copy no larger than 1,024 pixels on the long side, so edges on a large photo come out soft.

Worked example: select and recolor a sky

The goal: change the sky’s color without touching the mountains, trees or lake. The screenshots use Photoyam’s own sample image, but the steps work the same on a photo.

1. Open the photo. In the editor, use File › Open… (Ctrl+O) or the sample image button on the start screen.
2. Paint the sky with Quick Selection. Press W twice to get Quick Selection. Keep Size around 30 px and Tolerance at 24, and drag long horizontal strokes across the sky, finishing a little above the horizon. The selection stops at the dark ridge line by itself.
3. Remove what leaked in. The pale peak on the right is almost the sky’s color, so the strokes swallowed it, and Alt-painting it away took sky with it. Switch to the Magic Wand (W), set Tolerance to about 16 with Contiguous on, and Alt-click the peak.
4. Refine the edge. Choose Select › Refine Edge…, set View to On Black, tick Smart Radius with a Radius of about 6 px, then set Smooth to 3, Feather to 1 px and Shift Edge to +1 px. Keep Output To on Selection and click OK.
5. Add the adjustment and mask it. Choose Layer › New Adjustment Layer › Hue/Saturation. Unlike Photoshop, the new layer does not pick up the selection automatically, so with the selection still active choose Layer › Layer Mask › Reveal Selection.
6. Recolor and check. In the Properties panel, set Hue to about +40 and Saturation to +20, then press Ctrl+D to deselect. Zoom to 100% (Ctrl+Alt+0) and follow the horizon. Any spot the mask missed can be painted on the mask with a soft brush.

Nothing here is final: change the Hue later, lower the layer’s Opacity, or paint the mask. To get the selection back, Ctrl+click the mask thumbnail (Cmd+click on a Mac) or use Load as selection in the Properties panel.

Refine Edge, and how to approach hair

Refine Edge needs an existing selection. Its controls are applied in a fixed order: Shift Edge, Smart Radius, Smooth, then Feather.

• View: Marching Ants, Overlay, On Black, On White, or On Layers (the active layer previewed as if masked). Check dark subjects on white, light ones on black.
• Smart Radius + Radius (0–50 px): within a band of that width around the edge, the selection is reshaped to follow edges in the image instead of being softened evenly. Radius works only while Smart Radius is ticked.
• Smooth (0–20) rounds off jagged outlines and fills tiny holes.
• Feather (0–50 px) blurs the whole edge evenly.
• Shift Edge (−20 to +20 px) moves the edge in or out. A negative value is the classic fix for a light fringe around a cut-out.
• Output To: Selection, Layer Mask, New Layer, New Layer with Layer Mask, New Document, or New Document with Layer Mask. New Layer with Layer Mask is the safe choice for cut-outs because the original stays untouched.

For hair or fur on your own photo: get the body of the subject with Select Subject or Quick Selection, open Refine Edge, tick Smart Radius and raise Radius until the band covers the loose strands (start near 10 px and increase while watching On White). Keep Feather at 0 or 1 px, since feathering blurs the strands Smart Radius just found. Check On White and On Black, output to New Layer with Layer Mask, and finish the mask with a soft, low-opacity brush.

Clean-up and keeping selections

• Select › Modify: Border, Smooth, Expand, Contract and Feather. Contracting by 1–2 px before masking a cut-out removes a background-colored outline.
• Grow adds similar neighboring pixels; Similar adds matching pixels anywhere. Both use the Magic Wand’s Tolerance.
• Select › Transform Selection scales, rotates or moves the outline itself, not the pixels. Confirm with Enter, cancel with Esc.
• Quick Mask (Q, or Select › Edit in Quick Mask Mode) shows the unselected area as a red overlay you can paint. The Brush adds to the selection and the Eraser removes from it, whatever color is set. Press Q again to return.
• Select › Save Selection… stores the selection as an alpha channel (Alpha 1, Alpha 2…) in the Channels panel; Load Selection… brings it back and can invert it or combine it with the current selection.

Troubleshooting and common mistakes

Quick Selection keeps jumping into the background

The edge between the two areas is weak. Lower Tolerance, use a smaller Size near the edge, and Alt-drag through the part that leaked. For a flat-colored leak, Alt-click it with the Magic Wand.

There is a light or dark halo after masking

The selection sits slightly outside the subject. Run Refine Edge with Shift Edge at −1 to −3 px, or use Select › Modify › Contract… by 1–2 px before adding the mask.

Refine Edge or Save Selection is greyed out

Both need an active selection. Ctrl+Shift+D restores the last one.

FAQ