The only such problem I know of happens if you have color samplers active and the info palette visible. Otherwise Photoshop's CPU usage goes down to about 1% in the background.
While you are actively using Photoshop, the CPU usage will be higher, of course.