The best way to tell what's going on is to open one of the e-mail messages and view the full message headers. It will show the full mail flow and all server handoffs along the way, with timestamps so that you may be able to tell where its being delayed.