In audio part we use features like log mel spectrogram, mfcc etc. from the raw audio samples and we build a model to get feature vector out of it .
As the name suggests, it has two parts. First one is the audio part and second one is the visual part.