A fast, easy to use, free, and community supported 2D game engine
Hello,
I'm trying to record audio while playing sounds. According to this thread ( http://www.cocos2d-iphone.org/forum/topic/740 ) CDSoundEngine (OpenAL) is compatible with AVAudioRecorder.
But acccording to my tests, it fails.
The line in CDSoundEngine that makes the AVAudioRecorder is
alcMakeContextCurrent(context);
I've found out this because if I exit the CDSoundEngine init jsut before this line, the AVAudioRecorder woks.
I really dont know what happens in this method.
Steve Oldmeadow
Administrator
You can use AVAudioRecorder with CocosDenshion but I've never tried playing sounds and recording at the same time. It sounds like you are running into some limitation of AVAudioRecorder. The line you have indicated basically activates OpenAL and without it you wouldn't be able to play any sounds.
@Wayne, that means your sounds were playing while you were recording ? That's exactly what I want to do. I don't remember which version of ocosdenshion I'm using, I will update to the latest and test again. Which method do you use to stop and resume effects ?
According to this article ( http://www.gentswithbeards.com/2009/06/avaudiorecorder-record-returns-no.html ) it's possible to play and record at the same time. I tried what is said before recording :
UInt32 sessionCategory=kAudioSessionCategory_PlayAndRecord;
AudioSessionSetProperty(kAudioSessionProperty_AudioCategory, sizeof(sessionCategory), &sessionCategory)Now the recording works but the sounds doesn't play anymore. Weird.
Steve Oldmeadow
Administrator
Thx, so before starting the record, I used :
[audioManager setMode: kAMM_PlayAndRecord];
After this line, no more sounds can be played, but the record works.
When the record is over, I used this line to restore the sounds :
[audioManager setMode:kAMM_FxPlusMusicIfNoOtherAudio];
The ability to play and record at the same time is not absolutely necessary for what I'm trying to do, so this is an acceptable behaviour for me.
[edit] Ah, another thing, when there is a background music playing from the iPod application, and when the record starts, the music is stopped but it's not restored after. Is there a way to restore the music?
[edit2] When playing my own background music, it's automatically routed to the ear speakers when the record starts, and back to the main speaker when the record stops.
@Steve, do you understand why setting the mode of the audio manager to kAMM_PlayAndRecord makes the sounds not playing anymore ? In "PlayAndRecord" there is "Play" too, so that's why I'm confused.
Steve Oldmeadow
Administrator
@jptsetung - I don't understand why you are seeing that behaviour. You do not have to change the mode from PlayAndRecord to play sounds, I have done that myself and can confirm you can play sounds in PlayAndRecord mode. The only thing I haven't tried is simultaneously playing sounds and recording but Wayne was able to do that.
What device and OS combinations are you testing on? I haven't tested any of this on 4.3 so maybe it is an issue with that.
I'm testing on iOS4.1 iPhone 4 .
I've updated to CocosDenshion of the 1.0.0beta.
If I initialize the CDAudioManager to PlayAndRecord, sounds are not playing. So I guess I'm doing something wrong to play or initialize the sounds.
I'll try to test with the example provided with CocosDenshion and let you know.
Steve Oldmeadow
Administrator
Ah ah, yes you're right the sounds are playing in the ear speaker. The music was too loud and was masking the sounds when I tested this the first time. Thx!
The code to restore the built-in speaker is the following :
UInt32 audioRouteOverride = kAudioSessionOverrideAudioRoute_Speaker;
AudioSessionSetProperty (kAudioSessionProperty_OverrideAudioRoute, sizeof (audioRouteOverride),&audioRouteOverride);So to conclude, the sounds AND the background music is playing while I record. That's perfect. Thx Steve and Wayne.
[edit] the only little problem remaining is the case where the user is listening to an iPod music. The music is stopped when starting to record (I guess by the system) and it is not restored when we stop recording. But I guess we can't do anything about this.
Steve Oldmeadow
Administrator
the only little problem remaining is the case where the user is listening to an iPod music. The music is stopped when starting to record (I guess by the system) and it is not restored when we stop recording. But I guess we can't do anything about this.
The PlayAndRecord category takes over the audio, there is no category that allows recording plus other audio to play.
You can't restart terminated audio because all you can find out is that other audio was playing, you don't know what application was playing the audio. It could be the iPod app but it could a 3rd party app like Pandora or Last.fm.
Yes that's what I thought.
Another little problem with the playAndRecord mode, when you switch on/off the hardware mute button, the isDeviceMuted method always return false. It seems the playAndRecord mode force the AudioRoute to a certain value. I'm investigating.
Steve Oldmeadow
Administrator
PlayAndRecord doesn't obey the mute switch so maybe that is the problem.
Yes that's the problem.
My workaroudn is to check if the switch is muted before changeing the audio mode. If it's muted, I change it to Record instead of PlayAndRecord. It works (record with sounds mute).
But if the user toggle the mute switch during the record session, the mode is not updated.
There is a similar thread but with no clear answer http://www.cocos2d-iphone.org/forum/topic/14178
In the comments of the isDeviceMuted method you've added :
//NB: originally I tried using a route change listener and intended to store the current route,
//however, on a 3gs running 3.1.2 no route change is generated when the user switches the
//ringer mute switch to off (i.e. enables sound) therefore polling is the only reliable way to
//determine ringer switch stateWoudl it be a way to detect the mute button change while being in record mode ? I don't think so because the audio route will not change.
I can't believe don't provide a simple way to know if the mute button is on or off...
Steve Oldmeadow
Administrator
The route change listener may work in 4.x. I guess it depends on what OS versions you want to support, it definitely didn't work on 3.1.2.
Also, beware there is a memory leak on 4.2 (at least) when you call isDeviceMuted. There is a thread about it. There is no resolution at the moment to that. At the moment I'm favouring having a leak over having a potential crash.
satish
Member
Hello Steve,
This link helps me to build taking app for iphone and ipad,My application is working fine with ipad, But I have one issue with iphone,i am able to record sound with AVAudioRecorder, but when i play it on iphone using CDSoundEngine the audio is not loud as
compair to other application audio.
I use following to make iphone speaker on,
UInt32 audioRouteOverride = kAudioSessionOverrideAudioRoute_Speaker;
AudioSessionSetProperty (kAudioSessionProperty_OverrideAudioRoute, sizeof (audioRouteOverride),&audioRouteOverride);And Following line to play recoded audio
int soundSlot = 0;
NSArray *defs = [NSArray arrayWithObjects: [NSNumber numberWithInt:1],nil];
[sounEngine defineSourceGroups:defs];
[sounEngine loadBuffer:soundSlot filePath:path];//path is the location of //audio file to be play of type .caf
soundId=[sounEngine playSound:soundSlot sourceGroupId:0 pitch:1.4f pan:0.6f gain:1.0f loop:NO];This code perfectly work on ipad but not on iphone 4 iso 4.1
Thanks
Satish
Steve Oldmeadow
Administrator
satish
Member
Hello steve,
I have try this seting for pan,but it is still vahe same problem. Is there any problem with my recording setings. my recordre setings is
NSDictionary *settings = [NSDictionary dictionaryWithObjectsAndKeys:
[NSNumber numberWithInt:AVAudioQualityMin], AVEncoderAudioQualityKey,
[NSNumber numberWithInt:16], AVEncoderBitRateKey,
[NSNumber numberWithInt: 2],
AVNumberOfChannelsKey,
[NSNumber numberWithFloat:44100.0],
AVSampleRateKey,
nil];And I vahe used this seting as
AVAudioRecorder *recordAudio = [[AVAudioRecorder alloc] initWithURL:url settings:settings error:&err];
Thanks In advance
satish
Steve Oldmeadow
Administrator
Try a mono recording instead of stereo i.e. AVNumberOfChannelsKey should be 1.
You must log in to post.