Put a rack in the middle of the oven and preheat to 350°F (175°C). Line two light-colored baking sheets with parchment. Whisk the flour, baking powder, baking soda, cinnamon, nutmeg, cloves, and salt in a bowl. In a larger bowl, beat the softened butter and granulated sugar with an electric hand mixer on medium speed for 2 to 3 minutes, until the mixture looks pale and fluffy.
Beat the egg and vanilla into the butter mixture, then beat in the pumpkin. If the mixture looks a little grainy, keep going. Mix in the dry ingredients on low and finish with a spatula, stopping as soon as the last streaks of flour disappear. The dough should be sticky enough to cling to the scoop and thick enough to hold a mound.
Scoop 24 rounded mounds, about 48 g each. A large cookie scoop works well here, or use two spoons. Leave about 2 inches (5 cm) between the mounds, with up to 12 on each half-sheet. If the dough slumps as you scoop, chill it for 20 minutes before portioning the rest.
Bake one tray at a time for 14 to 17 minutes. Start checking at 14 minutes. The edges should be set and the tops should lose their wet shine. Let the cookies sit on the sheet for 5 minutes, then move them to a rack to cool completely. Keep the second tray away from the hot oven while it waits.
Whisk the powdered sugar, melted butter, vanilla, and 2 tablespoons (30 mL) of milk in a small bowl. Add the rest of the milk a teaspoon (5 mL) at a time, until the glaze falls in a thin ribbon that leaves a line in the bowl for a second or two. If the glaze is runny, add powdered sugar a tablespoon at a time.
Set the rack over parchment to catch the drips. Spoon the glaze over the fully cooled cookies and let it set for about 20 minutes. Before packing, touch a strip of parchment to one stripe. If any glaze comes away on the paper, give the cookies more time or pack them in a single layer.