Hey! I'm your first Markdown document in StackEdit[^stackedit]. Don't delete me, I'm very helpful! I can be recovered anyway in the Utils tab of the Settings dialog.
目前来说，APP端搜索的Dataflow大致情况如下：
jiaxinc jcao-ai
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2024-12-30 01:16:39.111 | INFO | mem_pool | GPU Memory Usage on rank 0: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=38979.96MB (58.43%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:16:40.850 | INFO | mem_pool | GPU Memory Usage on rank 1: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=38799.47MB (58.16%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:16:45.394 | INFO | openai_api_server | Avg prompt throughput: 20.03 tokens/s, Avg completion throughput: 0.47 tokens/s | |
| 2024-12-30 01:17:05,302 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:05.310 | INFO | req_logger | [0,0] Params: | |
| {"id": "cmpl-uXx5nXzTpgxgXQGaQvJuVo", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\n\n<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n \nYou only output JSON. You can write NSFW / adult content if requested. Let’s role play. You are the social media account: Hitomi. Hitomi is a relaxed girl and a reliable friend w |
jcao-ai
/ gist:246ddb7bf7403e50b65f120c014c919f
Created
May 4, 2024 13:32
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2024-05-04 13:25:09,987 - INFO: 45.56.78.139:0 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK | |
| 2024-05-04 13:25:10,027 - INFO: 45.79.47.102:0 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK | |
| 2024-05-04 13:25:11,236 - INFO: 3.22.41.165:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-05-04 13:25:12.896 | ERROR | ft_worker | Sample length 53356 is larger than 32000. Skip this task | |
| 2024-05-04 13:25:12.990 | ERROR | ft_worker | Traceback (most recent call last): | |
| File "/usr/local/lib/python3.10/dist-packages/l3m-0.0.1-py3.10-linux-x86_64.egg/l3m/serve/ft_worker.py", line 275, in generate_gate | |
| async for result in proxy.result(): | |
| File "/usr/local/lib/python3.10/dist-packages/l3m-0.0.1-py3.10-linux-x86_64.egg/l3m/serve/batcher/task_proxy.py", line 574, in result | |
| new_gen = fc_handler.parse(ret.get('text', ''), next_field) | |
| AttributeError: 'BadParamsError' object has no attribute 'get' |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 途虎APP搜索问题整理 | |
| =================== | |
| Hey! I'm your first Markdown document in **StackEdit**[^stackedit]. Don't delete me, I'm very helpful! I can be recovered anyway in the **Utils** tab of the <i class="icon-cog"></i> **Settings** dialog. | |
| ---------- | |
| 前言 | |
| ------------- | |
| 目前来说，APP端搜索的Dataflow大致情况如下： |