Very much, 422 Collins Street is very busy during business hours as it is a very business hub. Once you hit the weekends you will find it extremely quiet. There could be more security in the lift etc but you will find with the amount of occupants in the building you will be right.
I guess the only consideration would be the night club (silk roads) across the street but it is an upmarket club not one of those hard tech druggy ones but with more mature crowds and after work get togethers. Anyway nothing beats walking down to Kenny's for a Vietnamese Pork Roll or Bacon and Egg Roll anyway!