Yes. Many GPUs perform a brief fan self-test at startup before switching to idle mode.