I entered the UK on a fiance visa, but would to get married in Italy (France, Australia, etc). Is it ok?

Yes. But to come back in to the UK, you would need to get a spousal visa first.