Yes, the tray or system bar application can be configured to not start automatically.

Disable automatic start of the tray application on Microsoft Windows, see here.

Disable automatic start of the system bar application on Mac OS X, see here.