A unicorn that acts like a bluetooth speaker that attempts to move the mouth in sync with the audio, built using an ESP32

———————————
Links:
———————————

Project Code: https://github.com/witnessmenow/Talking-Unicorn-Bluetooth-Speaker

Atomic 14 YT channel: @atomic14

The Electronic Engineer YT Channel: @The Electronic Engineer

Blog post for Bluetooth Graphic Equalizer display:
https://blog.squix.org/2020/12/esp32-adding-a-spectrum-analyzer-to-bluetooth-audio.html

———————————
Music Used:
———————————

———————————
My Discord:
———————————

Come hang out and talk about this video or any project you are working on!

https://discord.gg/nnezpvq

———————————
Github Sponsorship:
———————————

I have set up a Github Sponsorship page, it’s similar style thing to patreon. Github sponsorships help support videos like these plus the open source projects I create.

https://github.com/sponsors/witnessmenow/

Some people have said they would prefer a once off way of supporting the channel, here is a Paypal link if you would prefer that!

https://www.paypal.me/bloughyt

———————————
Other Platforms:
———————————

Twitter: @witnessmenow – https://twitter.com/witnessmenow

———————————
My Tools & Kit*:
———————————

Ender 3 Pro 3d Printer – I got one of these recently and I love it!
– UK : https://amzn.to/31bebXT
– US : https://amzn.to/2IlSLid

Ts-100 Soldering Iron – I have this a couple of years and I love it, I thinking about getting a second!
– UK : http://amzn.to/2nlOF23
– US : http://amzn.to/2jDcyxl

Logitech C920 HD 1080p Pro webcam – I use one of these for my videos
– UK: http://amzn.to/2pnxk9Z
– US: http://amzn.to/2BsLMiF

*= Affiliate Links

, https://i.ytimg.com/vi/QKQ9-rlDxfs/hqdefault.jpg

source

34 Comments

  1. Nicely done! Interesting/nice that you could mod things without actually doing anything with the motor itself mechanically. Nice Audio firmware – will have to keep that in mind! -J

  2. Love the story at the end! Is it a spring loaded solenoid on the mouth rather than a motor, that might be simpler but might not have to torque? Also if you can get the max volume of a track (or ambient max at the time) and set the threshold to say 80% of this value to move the mouth, it should help. You could also do a pitch shifter on it which shouldnt be too hard. On a use case note, we had a DIY Christmas hat competition in the family one year (the year after the raspberry pi 1 was released as I used that in it) and I made it react to music with LEDs and a 3" LCD display for eyes based on a gif image, power consumption terrible and required a battery pack with 4 18650s in it so it weighed a tonne. You could wear it as a hat that plays music or tells terrible Christmas jokes at random and wear it in the office at Christmas (maybe 2023 when we might get back to the office), or (my kids would love this part) turn it into Ponyhead from "Star Vs the forces of evil". In fact now that idea has popped into my head, where did you buy the unicorn (it's probably not on sale anymore being long past Christmas)?

  3. Cute and fun project. Going to show this to my daughters tomorrow, they'll love it πŸ™‚

  4. Spring-loaded mechanism returns the position back to start as soon as you disconnect power to the motor…

  5. Very nice project. You may be able to improve the mouth movement if you check the spectrum for vowel sounds. If you search for "identify vowels from spectrum" you can find some examples. This requires checking a larger part of the spectrum, but may still be possible. In order to avoid the volume problem you could try to scale it to the maximum peak. It may also be fun to change the pitch of the voice by shifting the spectrum and doing a reverse FFT, but I don`t know if the ESP32 is fast enough for that.

  6. This is great Brian. I've been wanting to so something like this with a furby for ages so this gives me some ideas. Also – loved the kiddy babbling at the end! Takes me right back.

  7. It's a scary day when you wake up with a unicorn's head on the pillow next to you. lol

  8. ….. Well done Mate, the threshold value would have to adjust to the input level ?

  9. Hide it at the foot of the bed. When uncovered it starts making an offer you cannot refuse!

    Separating voice from music is a very difficult subject. You'll need to do more DSP processing on more than just one frequency band.

  10. a crap type of vocal removal subtracts the right channel from the left, then anything in the "center" is quiet. could you use the difference in spectral content to act on what's the center (the vocals)?

  11. This is awesome. I have been swearing at myself on and off trying to get a puppet mouth syncing to live audio. I was trying jawduino but it is designed for a servo. I wanted to get less noise and went to a stepper but everything I tried only ever half worked. This should give me a good starting point. Thank you!

    Does anyone know the name / model of the Devboard / EPS32 shield being used?

  12. That's fantastic, I love it… well the voice coming from a disembodied head did creep me out a little. Thanks Brian, Happy New Year.

  13. Now that is proper hacking, like it. Does the Unicorn replace you appearaning "on screen" completely in a future video?

  14. Awesome fun project. Certainly made me think… "Now for something completely different to start the new year." πŸ˜‰ It's always interesting how having kids around provides the motivation to work on this kind of fun stuff. I'm sure this will provide some lasting entertainment, and no doubt a basis for some fun related projects. Happy New Year, and all the best for 2022.

  15. I like the fact you document those whose inspired you various solutions. Good for finding new inspirations for your viewers! Thanks!

    By the way, wouldn't it be funny to have a video of the singing unicorn singing THE unicorn song by the IRISH rovers! πŸ˜‰ I'll leave it to you.

  16. I dissected a Billy Bass enroute to getting one to talk with the Donald Bell script and as someone else noted it has a spring on the motor.

  17. Thanks for the compliment on my analyzer. Great work is based on good examples and I do remember using your video’s in the past to learn new stuff.

  18. Usually these toys have a spring to return the mechanism to its "closed" state. It's crude but effective, and you should definitely not power the motor too long

  19. A talking unicorn, eh? Definitely an object that you can sell to Brexiters – although perhaps make it a bit more sparkly. And you can sell anything to Brexiters anyway.

Leave a Reply

Your email address will not be published. Required fields are marked *