We've all experienced it before and we all hate it. You call someone and leave a voice message or send them an e-mail - when will you hear back? You text a friend asking if they want to grab lunch - well it's been an hour and you're hungry and haven't heard back...
You set up an Evite for a birthday party weeks in advance and need to figure out how much food and drink to buy - it's three days before the party and 1/5th of the people have responded yes or no. You can even see when they looked at the evite, they just aren't bothering to respond! So why don't people respond to our inquiries, no matter the method? Do you share in our frustration with lack of communication in a supposedly hyper-connected world.
Before modern communication, if someone came calling, you took the time to receive them properly. But if you weren't home, tough luck to the visitor.
Letters and correspondence were sent but took time and who knew if the person received it or would even write back.
Telegraphs were expensive and resulted in a shorthand that humorously enough has come back with modern character limits on text messages and tweets. As with modern technology, who knew if the recipient got it and when they were going to reply.
Telephones allowed instant connection from distances, but the person had to be there on the other end until the invention of answering machines, to which return calls were always a curiosity of when.
Then the internet and e-mail came along which allowed us to not only easily and quickly send along messages but include and ask for a wealth of information previously difficult to communicate back and forth.
Along with Outlook meeting invitations and Google Calendar, Evite and Facebook events made it easier than ever to plan group outings. But the "not yet replied" column always stayed full as people just didn't seem to bother to reply.
Cell phones and text messaging suddenly created an instant line of communication with anyone anywhere, as they carried their communication devices with them everywhere they went!
Suddenly we were bombarded with a huge influx of communication requests. A hyper-connected always on society that could communicate easily with anyone anywhere. But along with this connectivity the desire to respond in a timely fashion (or even at all) seems to have fallen by the wayside. For messages we were hesitant for whatever reason to respond to in the first place we suddenly were loathe to have access to 24x7, and a huge pushback started to occur.
Think about the way we use text messaging in our daily lives. It's like a condensed version of voicemail/telephone conversations great for when short and simple messaging is required, and a hyper version of e-mail at worst. When you send out text messages, do you always get a response back? Even if you explicitly asked a question of the recipient? Even if you're lucky enough to get a response, was it immediate? Maybe it was hours or even days later. It seems as if the common reaction to text messaging corresponds with its rapid communicating capabilities - the easier it is to communicate, the lesser importance we place on the necessity to respond or act on it.
What's your own policy on returning messages? Do you generally respond immediately? Hours or days later? When you're good and ready? Do your own expectations for others to respond sync up to your own responses to others?

White Enamel Flatwa...
If I am interested, I respond immediately.
If I am in class, I wait until I am finished.
If you do not receive a message, take that as a no.
I agree, it is very annoying when you text someone and they do not reply. I reply very quickly to text messages. However, if someone leaves me a voicemail, I'm pretty slow to respond. :-)
If I don't get an answer I generally assume they just didn't get it, or missed it. Reaaally easy for this to happen with texts, emails, or IMs. Especially IMs as all sorts of things can shut down your computer before you see there's a new message.
In fact, I'm more annoyed by people who expect their digital communications should be treated like some sort of word of god that must be answered, and answered NOW.
The only time it's worth getting upset if if you *already* planned to meet during a certain time, and then the person is incommunicado. Then it's rude, sure.
But if you're just randomly texting up someone to see if they want lunch? Give 'em 15 minutes and then assume they're busy and take yourself to lunch. No big deal.
Personally, I tend to respond immediately if I can, because otherwise I'll forget to do so later. But I think it's silly to demand prompt answers unless it's like, your SO. And even then, phone batteries wear down, unexpected stuff happens, etc. Better to be relaxed about it.