feat(TaskProcessing): add AudioToTextSubtitles TaskType#61127
Conversation
a6604f7 to
86c9847
Compare
86c9847 to
df27584
Compare
|
We could use the |
The one potential use case I could see with the record button would be for recording and transcribing a podcast at the same time, although I think recording locally before uploading and transcribing would still be preferred for some people anyway. Let's switch to the In that case, would we still be able to validate eligible files by MIME type (either in the file action or in the Assistant modal)? If so, how? |
The assistant modal would not be able to do that, as it doesn't know anything about what the provider wants except what the task type tells it. The file action might be able to do so. But we should definitely check in the provider implementation and raise a user facing error if the mime type is not supported. |
Different providers might support different audio/video types too, so yeah, it's probably best to push the validation responsibility to the providers anyway. |
Signed-off-by: Edward Ly <contact@edward.ly>
df27584 to
3692d1a
Compare
Summary
Adds a
core:audio2text:subtitlestask type which outputs a subtitles file for speech-to-text tasks instead of plain text transcripts (as is the case forcore:audio2text).TODO
EShapeType::Audiocovers video files in addition to audio files. If not, maybe we should have a separate input shape that does cover both?Checklist
3. to review, feature component)stable32)AI (if applicable)