Bulldog clips. This isn't a solution for beloved original art or family heirlooms, but it's an easy trick for prints and photos, which can be switched in and out quickly to transform the feel of a room with minimal effort. The simple metal clips have a minimalist, timeless feel, and they look especially good in rooms with a casual, vintage-y, or industrial edge.
You can find bulldog clips at almost any store that sells office supplies, and at Amazon where you can score three dozen for under ten bucks.
For more ideas on easy (and noncommittal) ways to hang your art, check out this past post on Rotating Artwork Displays, 5 Ways.
Images: 1: Skona Hem via Poppytalk, 2: Monique for Apartment Therapy: San Francisco, 3: Elle Decor via Design Crisis, 4: The Creative Mama
Weekend DIYs: 10 Wood Molding Projects for the Home
Monica & Austin's Charming Bungalow
Good Food to Share 
The Big Book of Small, Cool Spaces 
Apartment Therapy Presents 
The Eight-Step Home Cure 
Ercol Bar Stool
True Greek Recipe: Paximadi Bread Salad with Tomatoes, Feta and Capers
Likewise, if that look is just too deconstructed for you organized and polished types, try pushpins.
Brilliant! I love how easily they can be swamped for new art/pics, and still look great. I have been dragging my feet on setting up a collage in my living room and this is the perfect solution.
I did this in my son's playroom to display his artwork. A bit of advice from someone who's done this: Use those plastic screw anchors for your wall. Also, screwing the clips into the wall requires that you find screws small enough to fit through the hole in the clip but with a large enough head to hold the clip. But the REALLY big secret is finding an itty bitty screwdriver that fits through the hole in the bulldog clip. You can't get a regular screwdriver between the front and back of the clip, and most screwdriver drill bit thingies are just a smidge too big to fit through the hole in the clip, so you stick a little tiny screwdriver through the hole and secure it to the wall that way.
Also, maybe it's just my wall, but I've found that if I push very hard on the bulldog clip to change out the artwork, my wall crumbles a bit. Just FYI.
lols @ "screwdriver drill bit thingies"
I've done this for clients many times but you don't need anchors or heavy screws if you're just hanging papers with a bulldog clip. Paper is light and so are the clips. Just use push pins. They really work and won't damage the walls like anchors sometimes do.
I do this too.
Also been weighing the idea of a LONG, SHALLOW SHELF that could hold multiple framed pictures (& other bits)... Advantage being that it will give me the option of easily changing in & out many different items. I love variety & am not good at limiting my viewing options.
However, having one straight line of pictures, is limiting in a way too... sort of shortchanges the exciting potential of an entire space that a wall can provide.
Although they're no problem with drywall, pushpins + plaster = um, no. That may be the crumbly problem Daffodil is having. I've been hanging lots of little stuff with sticky poster putty, and that would work great for this, too. Just put a ball on the back and presto. You could rearrange easily, too.
As a bit of a retired artist, I'd like to share this article with you (http://www.pressdisplay.com/pressdisplay/showlink.aspx?bookmarkid=5ZNOPXBQRF66&preview=article&linkid=4e9ffa03-a6f7-432e-a7c6-285a3dceed03&pdaffid=ZVFwBG5jk4Kvl9OaBJc5%2bg%3d%3d). It's a rarity that really speaks true to the modern artistic community.
So if you have a bit of time, this one's not a bad read.
I love the pretty green wall display! My favorite all time wall display was in Domino magazine, great stripes in charcoal and white with a wonderful wall display on top! I miss Domino magazine! http://bit.ly/dyZEEO
The Designer Insider