Hey, any luck porting your idea to CocosDenshion?
Cheers!

Thanks for the extra info. Yea, I found it difficult to take in all the intricacies of audio on the iphone. I plan to have another go in the next few weeks. Thanks to Steve, at least regular playback is simple these days : )

Look forward to seeing your progress!

Steve, thanks again for the information. I plan on giving CocosDenshion a try over the next few days. This project was more of a proof-of-concept. I'm sure I'll have more questions as I work through it.

I must say, after having dipped my toe in the iPhone sound programming waters today for the first time, I find most of the Apple sample project source code nearly incomprehensible.

Very cool. As I said before it would be easy to use CDAudioManager's backgroundMusic AVAudioPlayer for this as it is exposed as a property. I also can't see any reason that managing your own AVAudioPlayer wouldn't work with CocosDenshion - except on the simulator where there is a bug that stops all OpenAL sound when an AVAudioPlayer stops.

Thanks for the feedback.

PhilM, I am using AVAudioPlayer right now, but I plan on trying to move it to CDSoundEngine. I asked in an earlier thread, and Steve said that access to the underlying player is pretty straightforward, so it looks like it might be possible.

Basically, I schedule a function that calls:

[player updateMeters];
float soundLevel = [player averagePowerForChannel:0];

soundLevel now represents the dB of the playing sound. I'm using a mono WAV right now, so channel 0 is the one it plays on. I then take soundLevel, and base the movement of the mouth sprite and pipe sprite on a normalized value.

It's actually really simple, and I think it has a Monty Python feel to it. I thought about trying to make different shaped mouths for different sounds, but that is beyond me at this point.

The cool thing is it will work for any speech sample I throw at it, if there is enough variability in dB.

hehe, nice! I've been working on some manual lip sync for something, and was planning to add a feature later using a similar technique to allow user controlled lip sync.

Did you get this running with CocosDenshion's CDSoundEngine at all, or is it only using AVAudioPlayer? I need to try n mix the two, had a go before with some tips from Steve, but had some issues at the time, so decided to put it on hold.

pretty cool effect - the mouth and the pipe move/sync well to the spoken dialog.

Well, I wanted to learn a little about sound on the iPhone, so I whipped up a little project today. It uses AVAudioPlayer, and moves the pipe and mouth based on the peak levels of the sample being played.

Now that I've put it together, I'm thinking of submitting it as a free app, something like "iFreud: Pocket Psychiatrist". I could include 20 standard psychiatry cliche sayings. Maybe even let the user record some more?

Anyway, let me know what you think about my experiment:

http://www.vimeo.com/6070730