The thing people are forgetting is that pet attack speed comes (way) after being able to play the class right, and at a maximum level.
Only then, when you get with the top players, it gets from being not so important to really important, because that's when the last percentages of optimization are important. So before you are a top quality player yourself, it's not noticeably better, or just a little.