# Speech recognition

Moonshine Web is a simple application built with React and Vite, running on Moonshine Base, a powerful speech recognition model optimized for fast and accurate automatic speech recognition (ASR), particularly suited for resource-constrained devices. The application runs locally in the browser, utilizing Transformers.js and WebGPU for acceleration (with WASM as an alternative). Its significance lies in providing users with a serverless solution for local speech recognition, which is especially crucial for scenarios requiring swift processing of voice data.

Aixploria is a website focused on artificial intelligence, offering an online directory of AI tools that helps users find and select the best AI solutions to meet their needs. With a simplified design and intuitive search engine, users can easily search for various AI applications using keywords. Aixploria not only provides a list of tools but also publishes articles explaining how each AI works, helping users understand the latest trends and popular applications. Additionally, Aixploria features a 'Top 10 AI' section that is updated in real-time, allowing users to quickly learn about the top AI tools in each category. Aixploria is suitable for anyone interested in AI, whether beginners or experts, and valuable information can be found here.

SenseVoiceSmall is a speech foundation model that supports multiple speech understanding capabilities, including automatic speech recognition (ASR), spoken language recognition (LID), speech emotion recognition (SER), and audio event detection (AED). After training for more than 400,000 hours on data, the model supports more than 50 languages and has a recognition performance that surpasses the Whisper model. The SenseVoiceSmall model, which is a small model, uses a non-autoregressive end-to-end framework with extremely low inference latency and handles a 10-second audio in only 70 milliseconds, which is 15 times faster than Whisper-Large. In addition, SenseVoice also provides convenient fine-tuning scripts and strategies, supports multi-concurrency request service deployment pipelines, and the client languages include Python, C++, HTML, Java, and C#.

StreamSpeech is a real-time speech-to-speech translation model based on multi-task learning. By learning translation and synchronization strategies in a unified framework, it effectively identifies the translation timing within streaming voice input, achieving a high-quality real-time communication experience. The model has demonstrated leading performance on the CVSS benchmark and can provide low-latency intermediate results, such as ASR or translation.

AnyGPT is a unified large-scale language model that employs discrete representations for the uniform processing of various modalities, including voice, text, images, and music. AnyGPT can be trained stably without modifying the architecture or training paradigm of existing large-scale language models. It relies entirely on data-level preprocessing, which facilitates the seamless integration of new modalities into the language model, akin to the addition of a new language. We have constructed a text-centric multi-modal dataset for multi-modal alignment pre-training. Utilizing generative models, we have created the first large-scale multi-modal instruction dataset from any modality to any modality. It consists of 108,000 multi-turn dialogue examples with different modalities intertwined, enabling the model to handle combinations of any modal input and output. Experimental results indicate that AnyGPT can facilitate multi-modal dialogues from any modality to any modality and achieve performance comparable to dedicated models across all modalities, demonstrating that discrete representations can be effectively and conveniently used for unifying multiple modalities in language models.

Speechnotes is a reliable and secure web-based speech-to-text tool that can quickly and accurately transcribe audio and video recordings, as well as allow for dictation notes instead of typing, saving you time and effort. Speechnotes features voice commands for punctuation and formatting, automatic capitalization, and easy import and export options, providing you with an efficient and user-friendly dictation and transcription experience. Speechnotes has been serving millions of users since 2015.

Transcribe ~ Speech to Text is an iOS speech-to-text application. It leverages OpenAI's Whisper technology and Apple's Neural Engine to achieve high-precision speech recognition, directly transcribing audio and video files into readable text. It supports both offline and cloud-based recognition modes. Applicable to various speech-to-text needs, it is simple and easy to use.

Hanami Live Translator is a real-time translation tool that captures any audio from WINDOWS speakers and microphones. It utilizes lightweight multi-process and chunk processing of audio, with each chunk taking approximately 3-5 seconds to process. The application creates a hardware loopback via low-level access, allowing it to listen to content even when the speakers are muted. It uses the soundcard library to capture audio signals, the SpeechRecognition library to convert binary audio to text, and the selenium library to simulate network calls to deepl servers for free translation. The application requires an internet connection to operate and logs all actions through the Traces.log file.

The voice evaluation API is based on independently developed education AI voice models, integrating core technologies such as voice evaluation and speech recognition. It provides high-quality, multi-dimensional Chinese and English pronunciation evaluation APIs to help customers create intelligent learning products and realize human-machine interaction. Product features include core patented technology, stable and reliable AI models, and rich evaluation dimensions, including completeness, accuracy, and fluency. Pricing strategies include free trials, professional versions, and enterprise versions. Supports various evaluation scenarios, such as homework and exams. Supports HTTP and WebSocket protocols.

Translate.video is an AI-powered video translation tool that can help users automatically translate the audio and subtitles of videos into multiple languages. Utilizing advanced speech recognition and machine translation technologies, the tool ensures efficient and accurate video content translation. Users simply need to upload a video or input a video link, select the target language, and they can quickly obtain the translated video. Translate.video also supports automatic subtitle generation and editing, making it convenient for users to make fine adjustments and proofread the subtitles. The tool offers flexible pricing plans, including various packages and payment options, to cater to diverse user needs.

TTSLabs is an online voice synthesis and speech recognition service, offering high-quality, natural and fluent voice synthesis and accurate and reliable speech recognition. Through simple API calls, users can convert text to real speech and convert speech to text. TTSLabs supports multiple voice styles and multiple languages, featuring fast response and high efficiency. Pricing is flexible and transparent, suitable for both individual developers and enterprise users.