@@ -9,8 +9,6 @@ Speech-to-Text in golang. This is an early development version.
99
1010## Running
1111
12- (Note: Docker images are not created yet - this is some forward planning!)
13-
1412You can either run the whisper service as a CLI command or in a docker container.
1513There are docker images for arm64 and amd64 (Intel). The arm64 image is built for
1614Jetson GPU support specifically, but it will also run on Raspberry Pi's.
@@ -27,11 +25,11 @@ The following command will run the server on port 8080 for an NVIDIA GPU:
2725docker run \
2826 --name whisper-server --rm \
2927 --runtime nvidia --gpus all \ # When using a NVIDIA GPU
30- -v whisper:/models -p 8080:8080 -e WHISPER_DATA=/models \
31- ghcr.io/mutablelogic/go-whisper
28+ -v whisper:/data -p 8080:80 \
29+ ghcr.io/mutablelogic/go-whisper:latest
3230```
3331
34- If you include a ` -debug ` flag at the end, you'll get more verbose output. The API is then
32+ The API is then
3533available at ` http://localhost:8080/v1 ` and it generally conforms to the
3634[ OpenAI API] ( https://platform.openai.com/docs/api-reference/audio ) spec.
3735
@@ -71,19 +69,19 @@ There's more information on the API [here](doc/API.md).
7169
7270## Building
7371
74- If you are building a docker image, you just need Docker installed:
72+ If you are building a docker image, you just need make and docker installed:
7573
7674* ` DOCKER_REGISTRY=docker.io/user make docker ` - builds a docker container with the
7775 server binary, tagged to a specific registry
7876
79- If you want to build the server yourself for your specific combination of hardware,
80- you can use the ` Makefile ` in the root directory and have the following dependencies
77+ If you want to build the server yourself for your specific combination of hardware (for example ,
78+ on MacOS), you can use the ` Makefile ` in the root directory and have the following dependencies
8179met:
8280
8381* Go 1.22
8482* C++ compiler
8583* FFmpeg 6.1 libraries (see [ here] ( doc/build.md ) for more information)
86- * For CUDA, you'll need the CUDA toolkit including the ` nvcc ` compiler
84+ * For CUDA, you'll need the CUDA toolkit installed including the ` nvcc ` compiler
8785
8886The following ` Makefile ` targets can be used:
8987
0 commit comments