mrfakename (mrfakename)

Posts 6

Post

1041

Excited to launch two new SOTA text-to-speech models on the TTS Arena:

- OpenVoice V2
- Play.HT 2.0

𝗔𝗯𝗼𝘂𝘁 𝘁𝗵𝗲 𝗧𝗧𝗦 𝗔𝗿𝗲𝗻𝗮

The TTS Arena is an open sourced Arena where you can enter a prompt, have two models generate speech, and vote on which one is superior.

We compile the results from the votes into a automatically updated leaderboard to allow developers to select the best model.

We've already included models such as ElevenLabs, XTTS, StyleTTS 2, and MetaVoice. The more votes we collect, the sooner we'll be able to show these new models on the leaderboard and compare them!

𝗢𝗽𝗲𝗻𝗩𝗼𝗶𝗰𝗲 𝗩𝟮

OpenVoice V2 is an open-sourced speech synthesis model created by MyShell AI that supports instant zero-shot voice cloning. It's the next generation of OpenVoice, and is fully open-sourced under the MIT license.
https://github.com/myshell-ai/OpenVoice

𝗣𝗹𝗮𝘆.𝗛𝗧 𝟮.𝟬

Play․HT 2.0 is a high-quality proprietary text-to-speech engine. Accessible through their API, this model supports zero-shot voice cloning.

𝗖𝗼𝗺𝗽𝗮𝗿𝗲 𝘁𝗵𝗲 𝗺𝗼𝗱𝗲𝗹𝘀 𝗼𝗻 𝘁𝗵𝗲 𝗧𝗧𝗦 𝗔𝗿𝗲𝗻𝗮:

TTS-AGI/TTS-Arena

Post

3913

Mistral AI recently released a new Mixtral model. It's another Mixture of Experts model with 8 experts, each with 22B parameters. It requires over 200GB of VRAM to run in float16, and over 70GB of VRAM to run in int4. However, individuals have been successful at finetuning it on Apple Silicon laptops using the MLX framework. It features a 64K context window, twice that of their previous models (32K).

The model was released over torrent, a method Mistral has recently often used for their releases. While the license has not been confirmed yet, a moderator on their Discord server yesterday suggested it was Apache 2.0 licensed.

Sources:
• https://twitter.com/_philschmid/status/1778051363554934874
• https://twitter.com/reach_vb/status/1777946948617605384

View all posts