Hmm. Vorbis encoded audio in an Ogg container should still work. Are the files offered under the right MIME type? I’ve seen Firefox struggle with guessing the right MIME on media files.
Otherwise you might want to try WebM instead of Ogg. This is actually encouraged by Mozilla since “ it provides a better compression to quality ratio”. It will depend on what browsers you want to support (and how far back).