一、背景与环境信息
官方部署文档：
- https://github.com/coze-dev
- https://github.com/coze-dev/coze-loop
服务器信息：
| 主机名 |
IP |
操作系统 |
规格 |
GPU情况 |
备注 |
| ksp-registry |
172.20.0.22 |
Ubuntu 20.04.3 LTS |
12c20g+300G |
NVIDIA A40*1 |
|
此文档使用docker-compose的方式来部署coze-loop。
二、部署与配置
下载源码
1
2
| root@ksp-registry:/opt/code_repos# git clone https://github.com/coze-dev/coze-loop.git
root@ksp-registry:/opt/code_repos# cd coze-loop/
|
配置模型
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
| #备份文件 release/deployment/docker-compose/conf/model_config.yaml
root@ksp-registry:/opt/code_repos# cd release/deployment/docker-compose/conf/
root@ksp-registry:/opt/code_repos/release/deployment/docker-compose/conf# cp ./model_config.yaml ./model_config.yaml.bak
#删除model_config.yaml中默认的使用的doubao相关配置，转而使用ollama模型的配置文件内容
root@ksp-registry:/opt/code_repos/release/deployment/docker-compose/conf# cat model_config_example/ollama.yaml >> ./model_config.yaml
#编辑model_config.yaml
root@ksp-registry:/opt/code_repos/release/deployment/docker-compose/conf# vi ./model_config.yaml
models:
- id: 1
name: "qwen2.5:32b"
desc: ""
ability:
max_context_tokens: 65536
max_input_tokens: 65536
max_output_tokens: 8192
function_call: true
json_mode: false
multi_modal: false
ability_multi_modal:
image: false
ability_image:
url_enabled: true
binary_enabled: true
max_image_size: 20
max_image_count: 20
frame: "eino"
protocol: "ollama"
protocol_config:
base_url: "http://172.20.0.22:11434"
api_key: ""
model: "qwen2.5:32b"
protocol_config_ollama:
format: ""
keep_alive_ms: 600000
scenario_configs:
...
|
1
2
3
4
5
6
7
8
9
10
11
12
| #编辑.env或docker-compose.yaml
root@ksp-registry:/opt/code_repos/release/deployment/docker-compose/conf# cd ../
#编辑.env，因为此服务器上的8888、8889端口已经被coze-studio占用了，所以COZE_LOOP_APP_OPENAPI_PORT改为8890
root@ksp-registry:/opt/code_repos/coze-loop/release/deployment/docker-compose# vi .env
# app
COZE_LOOP_APP_IMAGE_REGISTRY=docker.io
COZE_LOOP_APP_IMAGE_REPOSITORY=cozedev
COZE_LOOP_APP_IMAGE_NAME=coze-loop
COZE_LOOP_APP_IMAGE_TAG=1.0.0
COZE_LOOP_APP_OPENAPI_PORT=8889 #从8888改为8890
COZE_LOOP_APP_DEBUG_PORT=40000
...
|
启动服务
1
2
3
4
| # 启动服务，默认为开发模式
# 在 coze-loop/目录下执行
root@ksp-registry:/opt/code_repos/coze-loop# make compose-up
#其他操作服务的命令，请查看当前目录下的Makefile文件，比如停止服务：make compose-down
|
访问coze-loop的web界面
http://172.20.0.22:8082/
image-20250822123812886