There are many different ways to enjoy Victoria Harbour but if you just want a cheap option take one of the Ferries from Central to Kowloon. It's cheap and you get a great view over both sides of the harbour. The ferry boats are cute and old school enough to make you love them. You could also do more touristy options like a Junket but that will cost more.
