My research has opened my eyes to many important points to making this project a success. The most important point is that I need to use an underlying multimedia framework. This framework is responsible for encoding / decoding video & audio, importing & export various formats of media files, and generally doing all the hard work. I am not ambitious enough to write my own media framework, so that has lead me to find the following possible frameworks:
- MLT - is an open source multimedia framework, designed and developed for television broadcasting. It provides a toolkit for broadcasters, video editors, media players, transcoders, web streamers and many more types of applications. The functionality of the system is provided via an assortment of ready to use tools, xml authoring components, and an extendible plug-in based API.
- GStreamer - is a library that allows the construction of graphs of media-handling components, ranging from simple Ogg/Vorbis playback to complex audio (mixing) and video (non-linear editing) processing.
Also, these 2 frameworks each support various languages, and they might not provide equal support to all the languages I am considering using. So this could also impact which language I decide to choose.