Maybe return calls via cellphone away from the Job during lunch and breaks? If they want to see you right away "I'm (in client meetings, working on a large rush project) most of today - let me check my schedule. (My last meeting today is not far from you/I should be finished the project late afternoon) would 6p.m. suit you?"

Depending on your/their location this might work for you.

Lynne