Mr. Brownlow accompanied Olive to visit ...place of his wealth.

Mr. Brownlow accompanied Olive to visit Fagin in the prison, and Fagin told Oliver the secret hiding place of his wealth.