Product Overview
The CAIMAN-ASR solution is used via a websocket interface. Clients send audio data in chunks to the server, which returns transcriptions.
Components of the solution
-
CAIMAN-ASR bitstream: this is the bitstream that is flashed onto the FPGA. This bitstream supports all of the ML model architectures (for more details on the architectures, see the Models section). This only needs to be reprogrammed when a new update is released.
-
CAIMAN-ASR program: This contains the instructions for a particular model architecture (base, large or extra-large). The server has one built-in program per architecture and loads the right one at runtime. The model weights come from the
hardware-checkpointproduced during training, which the server loads directly. Pre-trained weights are provided for the base, large and extra-large architectures. -
CAIMAN-ASR server: This provides a websocket interface for using the solution. It handles loading the program and communicating to and from the card. One server controls one card; if you have multiple cards, you can run multiple servers and use load-balancing.
-
ML training repository: This allows the user to train their own models, validate on their own data, and export model weights for the server.
An example configuration of CAIMAN-ASR is as follows:
