You may like walking to Kirribilli Point and more great harbour views.
Each are some distance from the CBD and public transport will be required. I can not reconcile it with my memories of accelerating up. If you're staying for than 3 months consider residing at share lodging.