cocos2d for iPhone

A fast, easy to use, free, and community supported 2D game engine

1. 

   cjl
   Member

   Well, I wanted to learn a little about sound on the iPhone, so I whipped up a little project today. It uses AVAudioPlayer, and moves the pipe and mouth based on the peak levels of the sample being played.

   Now that I've put it together, I'm thinking of submitting it as a free app, something like "iFreud: Pocket Psychiatrist". I could include 20 standard psychiatry cliche sayings. Maybe even let the user record some more?

   Anyway, let me know what you think about my experiment:

   Get the Video Player

   Posted 11 months ago #
2. 

   Codemattic
   Moderator

   pretty cool effect - the mouth and the pipe move/sync well to the spoken dialog.

   Posted 11 months ago #
3. 

   PhilM
   Member

   hehe, nice! I've been working on some manual lip sync for something, and was planning to add a feature later using a similar technique to allow user controlled lip sync.

   Did you get this running with CocosDenshion's CDSoundEngine at all, or is it only using AVAudioPlayer? I need to try n mix the two, had a go before with some tips from Steve, but had some issues at the time, so decided to put it on hold.

   Posted 11 months ago #
4. 

   cjl
   Member

   Thanks for the feedback.

   PhilM, I am using AVAudioPlayer right now, but I plan on trying to move it to CDSoundEngine. I asked in an earlier thread, and Steve said that access to the underlying player is pretty straightforward, so it looks like it might be possible.

   Basically, I schedule a function that calls:

   [player updateMeters];
   float soundLevel = [player averagePowerForChannel:0];

   soundLevel now represents the dB of the playing sound. I'm using a mono WAV right now, so channel 0 is the one it plays on. I then take soundLevel, and base the movement of the mouth sprite and pipe sprite on a normalized value.

   It's actually really simple, and I think it has a Monty Python feel to it. I thought about trying to make different shaped mouths for different sounds, but that is beyond me at this point.

   The cool thing is it will work for any speech sample I throw at it, if there is enough variability in dB.

   Posted 11 months ago #
5. 

   Steve Oldmeadow
   Administrator

   Very cool. As I said before it would be easy to use CDAudioManager's backgroundMusic AVAudioPlayer for this as it is exposed as a property. I also can't see any reason that managing your own AVAudioPlayer wouldn't work with CocosDenshion - except on the simulator where there is a bug that stops all OpenAL sound when an AVAudioPlayer stops.

   Posted 11 months ago #
6. 

   cjl
   Member

   Steve, thanks again for the information. I plan on giving CocosDenshion a try over the next few days. This project was more of a proof-of-concept. I'm sure I'll have more questions as I work through it.

   I must say, after having dipped my toe in the iPhone sound programming waters today for the first time, I find most of the Apple sample project source code nearly incomprehensible.

   Posted 11 months ago #
7. 

   PhilM
   Member

   Thanks for the extra info. Yea, I found it difficult to take in all the intricacies of audio on the iphone. I plan to have another go in the next few weeks. Thanks to Steve, at least regular playback is simple these days : )

   Look forward to seeing your progress!

   Posted 11 months ago #
8. 

   jotajota
   Member

   Hey, any luck porting your idea to CocosDenshion?
   Cheers!

   Posted 6 months ago #

RSS feed for this topic

Reply

You must log in to post.