After posting about using old-style typewriters as a toy, I've asked my dad to look for the one I used to play with as a child. While he's looking, I came across another great idea.
Introduce your young child to the rotary dial phone. See if they even recognize it as a phone. We've definitely seen these for sale or even for free at yard sales.