These easy Unicorn Cupcakes are a great way to treat ... then taste before adding more.) Step 4: Spoon the cake batter into the muffin cups until each is about 2/3 full. Bake for 18-20 minutes ...