The cheapest — and sometimes free — options include repurposing ordinary household and natural items. I'm talking cardboard egg crates, ice cube trays, muffin tins, spools, branches, and driftwood. My frugal mom uses the former, and I've always liked how neatly they stack on her dresser. If you can't abide by cardboard, ceramic egg crates are affordable, too (under $15 at the sites linked).
You can also turn good-looking knobs into wall hooks or make old picture frames into a backdrop for your jewelry. My dad made the earring display in Image 7 by stapling a fine metal mesh to the back of a free frame, screwing in two picture hangers, and threading them with clear fishing line. (I made the necklace display below it with scrap wood and paper.) There's always pegboard (Image 9), and a slightly more ambitious DIYer could follow directions from Design*Sponge to recreate the bust in the first image.
Images: 1. Kate Pruitt for Design*Sponge 2. Sarah Rainwater for Apartment Therapy 3. Young House Love 4. Apartment Therapy 5. Christiana Coop via Decor8 6. Heather Ulrich via Apartment Therapy 7. Leah Moss for Apartment Therapy 8. Bethany Nauert for Apartment Therapy 9. Apartment Therapy 10. Haylie Waring for Design*Sponge