Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image generation : rpc error: code = Unavailable desc = error reading from server: EOF #3888

Open
TiDjY35 opened this issue Oct 20, 2024 · 0 comments
Labels
bug Something isn't working unconfirmed

Comments

@TiDjY35
Copy link

TiDjY35 commented Oct 20, 2024

LocalAI version:
localai-aio-cpu:latest

Environment, CPU architecture, OS, and Version:
Docker : Cpu used

Describe the bug

This error when generation image

{"error":{"code":500,"message":"rpc error: code = Unavailable desc = error reading from server: EOF","type":""}}

To Reproduce

Quick start LocalAI and run

curl http://localhost:8080/v1/images/generations -H "Content-Type: application/json" -d '{
"prompt": "floating hair, portrait, ((loli)), ((one girl)), cute face, hidden hands, asymmetrical bangs, beautiful detailed eyes, eye shadow, hair ornament, ribbons, bowties, buttons, pleated skirt, (((masterpiece))), ((best quality)), colorful|((part of the head)), ((((mutated hands and fingers)))), deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, Octane renderer, lowres, bad anatomy, bad hands, text",
"size": "256x256"
}'

Expected behavior

Logs

Additional context
no problem with generation text

curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "llama-3.2-1b-instruct-q4_k_m.gguf",
"messages": [{"role": "user", "content": "Say this is a test!"}],
"temperature": 0.7
}'

{"created":1729445382,"object":"chat.completion","id":"e660dac5-0e66-4c58-8060-e85b1a5bf30f","model":"llama-3.2-1b-instruct-q4_k_m.gguf","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"\n\nIt's just a text!"}}],"usage":{"prompt_tokens":17,"completion_tokens":8,"total_tokens":25}}

My CPU FLAGS

fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm cpuid_fault pti ssbd ibrs ibpb stibp tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid xsaveopt arat vnmi umip md_clear arch_capabilities

Thank you for our help

@TiDjY35 TiDjY35 added bug Something isn't working unconfirmed labels Oct 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working unconfirmed
Projects
None yet
Development

No branches or pull requests

1 participant