What should my Quality of Service settings be ?

Your site router (or layer 3 switch) should be set to have the DSCP or ToS setup with:

SIP TOS/DiffServ Value: 0x68
RTP TOS/DiffServ Value: 0xb8

SIP is for call signaling and RTP is for the media paths on the live call.