You can drag a colour from a panel to an object or another panel. Using this method avoids having to select the object first.
You can drag colours from the fill or stroke boxes in the Swatches or Colours panels.
Drop the colour on to the fill or stroke of an object.
You can also drag a swatch from the Swatches panel into another InDesign document window, to add the swatch to that document.