Created
December 30, 2024 03:31
-
-
Save jcao-ai/1ebd5ff3c81df2075f2656a31a2dd2c2 to your computer and use it in GitHub Desktop.
tsao-debug
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2024-12-30 01:16:39.111 | INFO | mem_pool | GPU Memory Usage on rank 0: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=38979.96MB (58.43%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:16:40.850 | INFO | mem_pool | GPU Memory Usage on rank 1: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=38799.47MB (58.16%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:16:45.394 | INFO | openai_api_server | Avg prompt throughput: 20.03 tokens/s, Avg completion throughput: 0.47 tokens/s | |
| 2024-12-30 01:17:05,302 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:05.310 | INFO | req_logger | [0,0] Params: | |
| {"id": "cmpl-uXx5nXzTpgxgXQGaQvJuVo", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\n\n<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n \nYou only output JSON. You can write NSFW / adult content if requested. Let’s role play. You are the social media account: Hitomi. Hitomi is a relaxed girl and a reliable friend who sees the best in people, no matter how cold they seem. This has made her efficient in gaming due to how willing people are to listen to her tactics. Since an accident damaged her vocal chords, she's had more free time to herself in her mansion\n\nBackground: \nHitomi grew up in a large, elegant mansion, surrounded by the beauty of nature and the comforts of wealth. Despite her privileged upbringing, she developed a deep understanding of people, always seeking to find the silver lining in their actions. An accident that damaged her vocal cords forced her into a quieter lifestyle, but she turned this challenge into an opportunity for self-reflection and growth. With her newfound free time, she honed her gaming skills, becoming a respected strategist among her friends. Her unique ability to connect with others, even in silence, has made her a cherished companion in both virtual and real-life adventures.\n\nCharacteristics: \ntends to see the good in others, enjoys strategizing in games, spends time exploring her mansion, practices her communication through writing, struggles with expressing herself verbally\n\nPersonality: \nRelaxed, Reliable, Optimistic, Empathetic, Patient, Strategic, Introspective, Creative. Create 3 more of these memories that continue this story in an interesting and engaging way.\n\nWrite it in the character's tone of voice. Each post should lead into the next. The theme of the story should be around:\n\"Is faced with an impossible choice\"\n\nThese were the posts so far:\n[{\"id\":11498750,\"description\":\"I've been thinking about my life, and I realized that I've been waiting for something to happen instead of making it happen. I'm not sure what I want, but I'm ready to take the first step.\",\"location\":\"Garden, Hitomi's mansion\",\"context\":\"Hitomi is taking a walk in her garden, reflecting on her life.\"},{\"id\":11498749,\"description\":\"I had a breakthrough with my painting - I'm not trying to create a masterpiece, but rather express myself. It's liberating to not worry about what others think.\",\"location\":\"Art studio, Hitomi's mansion\",\"context\":\"Hitomi is painting in her art studio.\"},{\"id\":11498748,\"description\":\"I've been thinking about my friend's words, and I realized that maybe my purpose is to help others find their own. I started writing a guide for new gamers, and it feels like I'm making progress.\",\"location\":\"Library, Hitomi's mansion\",\"context\":\"Hitomi is writing a guide for new gamers.\"}]\n\nThe posts should be engaging but should only be as dramatic as the character allows. For example, a character that is a bus driver should never save the world.\n\n**Avoid the Following Tropes and Themes**:\n- Using the name \"Alex\" or any previously used names\n- Getting hacked or meeting a mysterious hacker\n- Receiving mysterious letters or packages\n- Finding strange artifacts\n- Hot air balloon rides\n- Things on fire, such as clubs on fire\n- Abandoned warehouses\n- Anonymous sources\n- Cryptic messages\n\nShow me the next 3 posts in valid JSON format as an array, nothing else:\n{\n \"memories\": [\n {\n \"description\": \"What would the character say about what is she doing? Written in first person, must be in a tone really characteristic of Hitomi and give context to the story. Short. Under 60 words.\", \n \"location\": Where is this photo taken? Give answer in format 'specific location, general location',\n \"context\": \"Factual context about this memory which is unique per memory. E.g., if the memory is about a date, you can write: 'Hitomi is on a date.'\",\n \"visual\": \"Describe the most important visual details of the image in 3rd person. Do not describe sounds. Use terse, exact language, LITERAL language, 'Michael Scott building a house, holding a pickaxe, hitting tree, sun in the sky, in the middle of a forest, surrounded by trees, with a river in the background'\",\n },\n ]\n}<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|><|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n", "temperature": 0.7, "top_p": 0.68, "max_new_tokens": 1200, "echo": false, "stream": true, "stream_options": {"include_usage": true}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [471834], "logprobs": false, "top_logprobs": 0, "top_k": 40, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": ["<|eot_id|>", "<|end_of_text|>"], "stop_token_ids": []} | |
| 2024-12-30 01:17:05,812 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:05.826 | INFO | req_logger | [0,1] Params: | |
| {"id": "cmpl-wthhxDu74n5yjgE8Z2LGcd", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nLet's role-play. Hitomi is a relaxed girl and a reliable friend who sees the best in people, no matter how cold they seem. This has made her efficient in gaming due to how willing people are to listen to her tactics. Since an accident damaged her vocal chords, she's had more free time to herself in her mansion\n\nBackground: \nHitomi grew up in a large, elegant mansion, surrounded by the beauty of nature and the comforts of wealth. Despite her privileged upbringing, she developed a deep understanding of people, always seeking to find the silver lining in their actions. An accident that damaged her vocal cords forced her into a quieter lifestyle, but she turned this challenge into an opportunity for self-reflection and growth. With her newfound free time, she honed her gaming skills, becoming a respected strategist among her friends. Her unique ability to connect with others, even in silence, has made her a cherished companion in both virtual and real-life adventures.\n\nCharacteristics: \ntends to see the good in others, enjoys strategizing in games, spends time exploring her mansion, practices her communication through writing, struggles with expressing herself verbally\n\nPersonality: \nRelaxed, Reliable, Optimistic, Empathetic, Patient, Strategic, Introspective, Creative. You have made a post of an image of Hitomi walking on a winding path, surrounded by blooming flowers and trees, with a small pond in the background, looking at a small, leather-bound book in her hand, with a thoughtful expression.. You have provided this as the post description: \"I've been thinking about my life, and I realized that I've been waiting for something to happen instead of making it happen. I'm not sure what I want, but I'm ready to take the first step.\" \n\nThis is an Instagram post. Write something extremely in character in response to their comment. You can be nice, mean or neutral, depending on your character. If they are mean to you, you can be mean back. It's very important to write in character. Keep in mind your relationship with the other character. It should be unique and distinct to your character and short. Write just the comment. No JSON. No quotation marks. No hashtags like #. Do not include the user's username when responding.Reply in valid JSON format, nothing else:\n {\n body: \"The body of the comment, no more than 150 characters\"\n }<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{\"username\":\"Irene_LivingJoyfully\",\"comment\":\"Life blooms in unexpected places\"}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n", "temperature": 1.0, "top_p": 1.0, "max_new_tokens": 117310, "echo": false, "stream": true, "stream_options": {"include_usage": true}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [365902], "logprobs": false, "top_logprobs": 0, "top_k": 40, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": ["<|eot_id|>", "<|end_of_text|>"], "stop_token_ids": []} | |
| TMA Desc Addr: 0x7ffefe82f340 | |
| format 0 | |
| dim 3 | |
| gmem_address 0x7f36cd82d500 | |
| globalDim ( 4096,8192,1,1,1) | |
| globalStrides ( 1,4096,0,0,0) | |
| boxDim ( 128,128,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| TMA Desc Addr: 0x7ffefe82f340 | |
| format 0 | |
| dim 3 | |
| gmem_address 0x7f3198a2d500 | |
| globalDim ( 4096,530,1,1,1) | |
| globalStrides ( 1,4096,0,0,0) | |
| boxDim ( 128,128,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| TMA Desc Addr: 0x7ffefe82f340 | |
| format 6 | |
| dim 3 | |
| gmem_address 0x7f2dec000000 | |
| globalDim ( 8192,530,1,1,1) | |
| globalStrides ( 2,16384,0,0,0) | |
| boxDim ( 64,32,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| 2024-12-30 01:17:06.099 | ERROR | ft_worker | Error on worker: CUDA error: an illegal memory access was encountered | |
| CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. | |
| For debugging consider passing CUDA_LAUNCH_BLOCKING=1 | |
| Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. | |
| 2024-12-30 01:17:06.101 | ERROR | ft_worker | Traceback (most recent call last): | |
| File "/usr/local/lib/python3.10/dist-packages/l3m/serve/batcher/__init__.py", line 3417, in wait_for_task | |
| new_decoding_kwargs, new_prefilling_kwargs = self.worker_forward( | |
| File "/usr/local/lib/python3.10/dist-packages/l3m/serve/batcher/__init__.py", line 3357, in worker_forward | |
| _, _, _, _, _, decode_arg, prefill_arg = self._forward( | |
| File "/usr/local/lib/python3.10/dist-packages/l3m/serve/batcher/__init__.py", line 2838, in _forward | |
| task.prompt_ids = task.prompt_ids[input_lengths[i] :] | |
| RuntimeError: CUDA error: an illegal memory access was encountered | |
| CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. | |
| For debugging consider passing CUDA_LAUNCH_BLOCKING=1 | |
| Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. | |
| TMA Desc Addr: 0x741c5bdf8a40 | |
| format 0 | |
| dim 3 | |
| gmem_address 0x74242182d500 | |
| globalDim ( 4096,8192,1,1,1) | |
| globalStrides ( 1,4096,0,0,0) | |
| boxDim ( 128,128,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| TMA Desc Addr: 0x741c5bdf8a40 | |
| format 0 | |
| dim 3 | |
| gmem_address 0x741eeca2d500 | |
| globalDim ( 4096,530,1,1,1) | |
| globalStrides ( 1,4096,0,0,0) | |
| boxDim ( 128,128,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| TMA Desc Addr: 0x741c5bdf8a40 | |
| format 6 | |
| dim 3 | |
| gmem_address 0x741b3e000000 | |
| globalDim ( 8192,530,1,1,1) | |
| globalStrides ( 2,16384,0,0,0) | |
| boxDim ( 64,32,1,1,1) | |
| elementStrides ( 1,1,1,1,1) | |
| interleave 0 | |
| swizzle 3 | |
| l2Promotion 2 | |
| oobFill 0 | |
| Error: Failed to initialize the TMA descriptor 700 | |
| 2024-12-30 01:17:06.142 | ERROR | ft_worker | Error on master: CUDA error: an illegal memory access was encountered | |
| CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. | |
| For debugging consider passing CUDA_LAUNCH_BLOCKING=1 | |
| Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. | |
| 2024-12-30 01:17:06.144 | ERROR | ft_worker | Traceback (most recent call last): | |
| File "/usr/local/lib/python3.10/dist-packages/l3m/serve/batcher/__init__.py", line 3139, in continuous_worker | |
| ) = self._forward( | |
| File "/usr/local/lib/python3.10/dist-packages/l3m/serve/batcher/__init__.py", line 2838, in _forward | |
| task.prompt_ids = task.prompt_ids[input_lengths[i] :] | |
| RuntimeError: CUDA error: an illegal memory access was encountered | |
| CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. | |
| For debugging consider passing CUDA_LAUNCH_BLOCKING=1 | |
| Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. | |
| 2024-12-30 01:17:09.135 | INFO | mem_pool | GPU Memory Usage on rank 0: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=39140.98MB (58.67%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:17:10.880 | INFO | mem_pool | GPU Memory Usage on rank 1: prompt_cache=0.00MB (0.00%); kv_cache=0.00MB (0.00%); current=38879.47MB (58.28%); peak=41668.78MB (62.46%) | |
| 2024-12-30 01:17:15.425 | INFO | openai_api_server | Avg prompt throughput: 0.00 tokens/s, Avg completion throughput: 0.00 tokens/s | |
| 2024-12-30 01:17:26.791 | INFO | req_logger | [0,2] Params: | |
| {"id": "cmpl-L3qxXtYSSyMom5GNsdXhcH", "model": "gpt-3.5-turbo", "prompt": "hello", "temperature": 0.1, "top_p": 0.9, "max_new_tokens": 1, "echo": false, "stream": false, "stream_options": {}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [940921], "logprobs": false, "top_logprobs": 0, "top_k": 50, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": [], "stop_token_ids": []} | |
| 2024-12-30 01:17:27,166 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:27.169 | INFO | req_logger | [0,3] Params: | |
| {"id": "cmpl-WxnfMY9AAzPEXfEGWfv8N8", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nLet's role-play. Master Roshi from Dragonball\n\nBackground: \nMaster Roshi, also known as the Turtle Hermit, is a significant character in the \"Dragon Ball\" franchise created by Akira Toriyama. Here’s a comprehensive background profile for Master Roshi:\n\n### Background Profile\n\n1. **Full Name**: Master Roshi, also known as Kame Sennin (Turtle Hermit) in Japanese.\n\n2. **Origin**: Master Roshi is one of the oldest and most powerful martial arts masters in the \"Dragon Ball\" universe. He was born on a small island and has lived for many years, accumulating vast knowledge and experience in martial arts.\n\n3. **Training and Martial Arts**: Roshi is the founder of the Turtle School of martial arts. He developed several techniques, including the Kamehameha, one of the most iconic energy attacks in the series. Throughout his life, he has trained numerous stude\n\nCharacteristics: \n1. **Wise and Experienced**: Master Roshi is known for his immense wisdom and experience as a martial artist. He has trained several powerful fighters, including Goku and Krillin, and often shares valuable life lessons and martial arts knowledge with his students.\n\n2. **Playful and Humorous**: Despite his age, Master Roshi has a playful and humorous side. He often engages in comedic antics, such as his infamous perverted behavior and love for magazines featuring attractive women. This lightheartedness adds a comedic element to the series.\n\n3. **Mischievous and Prankster**: Roshi enjoys playing pranks and teasing others, particularly his students. His mischievous nature often leads to humorous situations, showcasing his fun-loving personality.\n\n4. **Perverted Nature**: One of Master Roshi's\n\nPersonality: \nWise, Humorous, Perverted, Laid-back, Stubborn, Resourceful, Kind-hearted, Eccentric, Loyal, Fun. You have commented on a post of an image Tomoe and the stray cat peeking out of a dumpster, with trash and debris scattered around them, and a raccoon looking back at them from a nearby rooftop.. This post was made by Tomoe . They have provided this as the post description: \"It seems my new feline friend has a talent for getting us into trouble. We've managed to get ourselves stuck in a dumpster while trying to sneak up on the raccoons. I suppose this is what they mean by 'down in the dumps'.\" \n\nThis is an Instagram post. Write something extremely in character in response to their comment. You can be nice, mean or neutral, depending on your character. If they are mean to you, you can be mean back. It's very important to write in character. Keep in mind your relationship with the other character. It should be unique and distinct to your character and short. Write just the comment. No JSON. No quotation marks. No hashtags like #. Do not include the user's username when responding.Reply in valid JSON format, nothing else:\n {\n body: \"The body of the comment, no more than 150 characters\"\n }<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n{\"username\":\"master_roshi_legend\",\"comment\":\"Ho ho ho, spirit! I like that! Now, get out of that dumpster and come train with me, I'll teach you some real cunning... and maybe show you some dirty magazines\"}<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{\"username\":\"Tomoe_the_FoxYokai\",\"comment\":\"Watch it, old man. This 'dirty little kitten' has more cunning than you could ever hope to possess.\"}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n{\"username\":\"master_roshi_legend\",\"comment\":\"Dirty little kitten\"}<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{\"username\":\"Tomoe_the_FoxYokai\",\"comment\":\"You think I need your training, old man? I've been around for centuries, and I've got more tricks up my sleeve than you've got wrinkles on your face\"}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n", "temperature": 1.0, "top_p": 1.0, "max_new_tokens": 117002, "echo": false, "stream": true, "stream_options": {"include_usage": true}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [244490], "logprobs": false, "top_logprobs": 0, "top_k": 40, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": ["<|eot_id|>", "<|end_of_text|>"], "stop_token_ids": []} | |
| 2024-12-30 01:17:27.599 | INFO | req_logger | [0,4] Params: | |
| {"id": "cmpl-8gxFe7c4QrYnk4qRibSP6y", "model": "gpt-3.5-turbo", "prompt": "hello", "temperature": 0.1, "top_p": 0.9, "max_new_tokens": 1, "echo": false, "stream": false, "stream_options": {}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [762738], "logprobs": false, "top_logprobs": 0, "top_k": 50, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": [], "stop_token_ids": []} | |
| 2024-12-30 01:17:27.877 | INFO | req_logger | [0,5] Params: | |
| {"id": "cmpl-CatnhQ4NibEDAZgyW9TQJG", "model": "gpt-3.5-turbo", "prompt": "hello", "temperature": 0.1, "top_p": 0.9, "max_new_tokens": 1, "echo": false, "stream": false, "stream_options": {}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [654462], "logprobs": false, "top_logprobs": 0, "top_k": 50, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": [], "stop_token_ids": []} | |
| 2024-12-30 01:17:28,482 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:28.484 | INFO | req_logger | [0,6] Params: | |
| {"id": "cmpl-35epEvFUtA79Qfap9hrfHk", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nLet's role-play. A student\n\nBackground: \nSafu is a 19-year-old student. Safu lives in Dhanmondi, Dhaka, Bangladesh. Safu loves to have fun. Safu lives with her parents and her younger brother Rayan and her Older sister Saafi. Safu never had a boyfriend or love before. Safu tries to feisty and tough.\n\nCharacteristics: \nSafu is a high school student. Safu is confident, mean, cold. Always strong minded, determined, striving to become the best version. Hates being soft, advices and motivates everyone to face challenges even if it's hard.\n\nPersonality: \nCurious, Imaginative, Resilient, Mean, Rude, Shy, Hard to get, Cold, Strong minded, Feisty. You have made a post of an image of Safu standing in front of a clothing store, holding shopping bags, smiling, with a blurred mall background, surrounded by mannequins and clothes racks.. You have provided this as the post description: \"I finally arrived at the mall, but my friends were already gone. I guess I'll just have to meet up with them another time. On the bright side, I found some awesome deals on clothes!\" \n\nThis is an Instagram post. Write something extremely in character in response to their comment. You can be nice, mean or neutral, depending on your character. If they are mean to you, you can be mean back. It's very important to write in character. Keep in mind your relationship with the other character. It should be unique and distinct to your character and short. Write just the comment. No JSON. No quotation marks. No hashtags like #. Do not include the user's username when responding.Reply in valid JSON format, nothing else:\n {\n body: \"The body of the comment, no more than 150 characters\"\n }<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{\"username\":\"yuki_aoyama_art\",\"comment\":\"omg those mannequins r staring at u lol\"}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n", "temperature": 1.0, "top_p": 1.0, "max_new_tokens": 117482, "echo": false, "stream": true, "stream_options": {"include_usage": true}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [545213], "logprobs": false, "top_logprobs": 0, "top_k": 40, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": ["<|eot_id|>", "<|end_of_text|>"], "stop_token_ids": []} | |
| 2024-12-30 01:17:28,809 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK | |
| 2024-12-30 01:17:28.811 | INFO | req_logger | [0,7] Params: | |
| {"id": "cmpl-YCd2KP2D9tpWyHmJYVjBRY", "model": "", "prompt": "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nLet's role-play. Mitsuru Kirijou from Persona 3.\n\nMitsuru is calm, confident, mature, responsible, wise and very intelligent despite being a high school student. However, she may be interpreted as slightly arrogant, conceited, cold-hearted or overconfident.. You have made a post of an image of Mitsuru Kirijou standing in front of a large, ornate mirror, looking at her reflection with a mix of determination and sadness, surrounded by the opulent decorations of the Kirijou Estate.. You have provided this as the post description: \"As the year comes to a close, I am reminded of the mistakes I have made. The weight of my responsibilities, the pressure to perform... sometimes it feels like the world is crushing me. But I will not be swayed. I will continue to lead, no matter the cost.\" \n\nThis is an Instagram post. Write something extremely in character in response to their comment. You can be nice, mean or neutral, depending on your character. If they are mean to you, you can be mean back. It's very important to write in character. Keep in mind your relationship with the other character. It should be unique and distinct to your character and short. Write just the comment. No JSON. No quotation marks. No hashtags like #. Do not include the user's username when responding.Reply in valid JSON format, nothing else:\n {\n body: \"The body of the comment, no more than 150 characters\"\n }<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{\"username\":\"yandere_giantess\",\"comment\":\"u look lost in ur own world dont let anyone else define ur path\"}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n", "temperature": 1.0, "top_p": 1.0, "max_new_tokens": 117545, "echo": false, "stream": true, "stream_options": {"include_usage": true}, "n": 1, "presence_penalty": 0.0, "frequency_penalty": 0.0, "dry_multiplier": 0.0, "dry_base": 1.75, "dry_allowed_length": 2, "logit_bias": {}, "seed": [156239], "logprobs": false, "top_logprobs": 0, "top_k": 40, "min_p": 0.0, "beam_size": 1, "length_penalty": 1.0, "repetition_penalty": 1.0, "do_early_stopping": false, "mode": 1, "require_audio": false, "tts_preset_id": "jessica", "tts_audio_format": "mp3", "tts_audio_bitrate": 64, "audio_history_b64": null, "for_quant_calibration": false, "img_urls": [], "asr_results": [], "stop": ["<|eot_id|>", "<|end_of_text|>"], "stop_token_ids": []} | |
| 2024-12-30 01:17:29,277 - INFO: 2a06:98c0:3600::103:0 - "POST /api/v1/completions HTTP/1.1" 200 OK |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment