They say three is a collection. Building on that, we think 5, 7, 9, and so on are also good for displays. But we've always shied away from arranging even-numbered groupings...
Whether flowers in a vase or frames on a wall, odd numbers seem preferable to even. We think it's something about creating a happy randomness. Your eyes automatically want to split in half most even-numbered arrangements. But given 5 or 7 of something provides an integrated mix that isn't easily split. Is this just our own tendencies or do you share this opinion?
Things Fall Apart: Living Alone in a Space After a Breakup
Juan's Garage Turned Modern Guest House
Good Food to Share 
The Big Book of Small, Cool Spaces 
Apartment Therapy Presents 
The Eight-Step Home Cure 
Commercial Flour Sa...
10 Picnic-Ready Salads to Eat Outside
Recipe: Thai Ginger Chicken Stir-Fry
I have unconsciously done this in every house I've lived in, I think it shows off the collection in a neat and organized way.
The finest collections invariably involve a total number of objects equaling a prime number. Surely this is why there are 53 state in the Union.
It completely depends on the objects. A symmetrical arrangement of twos can be lovely for example. Or a dozen roses. Small clusters can look a bit better in odd numbers (in the picture above 2 and 4 would be a little harder to pull off), but the larger the group the less likely you are to subconciously count things (6 or 8 could look fine). In many ways the variety of shapes and heights in a collection is more important than the number of objects in it.
Are we running out of topics to talk about?
You HAVE to do odd numbers or the planet will fall off of its axis. That's why I do it, anyway.
I get a little bit OCD about symmetry sometimes. The odd numbers look beautiful and maybe it would help me stop obsessing about equal things on both sides!
Unless you do two sets of odd numbers on each side. ;)
Four.
I've been having a lot of fun with items in groupings of four. I think they work exactly because odd numbers of items are so expected and comfortable. It takes half a minute and a brain to pull it off, but it can create a more jarring and attention-grabbing effect.
If that 53 state comment was a joke, HILARIOUS.
if not...aaaaahhm. yeah.
This is a commonly used trick in the art world. Artists will usually create some sort of "pyramid" with three main focuses in an artwork, because it creates a sense of balance that is much more interesting than two or even one major focal point. So it makes sense!
By the way, I count four items in Exhibit A. :)