Voice Agent Doorman

This idea came from my building in New York City.

There is a doorman, and when someone is trying to come in, they cannot get upstairs until the doorman calls me. There were plenty of times when I was not on my phone and people were left waiting outside for a few minutes. I got tired of having to pick up every time for the same basic interaction.

So I cloned my voice using ElevenLabs, got a Twilio phone number, and connected the cloned voice agent to that number.

Now when someone calls, they can have a short conversation with "me." I also fine-tuned it for this very specific use case, so if someone is trying to enter the building, it can simply say, "You can let them in."

Stack

• Node.js
• ElevenLabs
• Twilio voice webhooks
• Vercel deployment