I realise that this is a very old post. But there haven't been any responses on this and since I visited Antigua last week; I thought to update.
Yes it is safe. Just follow common sense precautions i.e. dont wear flashy jewellery, don't roam around unknown neighbourhoods late at night etc. We had a great time there and we are from Pakistan originally.
