fix: auto-adjust n_ubatch when n_batch > 512 for embedding#2333

lxcxjxhx wants to merge 2 commits into

abetlen:mainabetlen/llama-cpp-python:mainfrom

lxcxjxhx:fix-embed-n-batch-1762lxcxjxhx/llama-cpp-python:fix-embed-n-batch-1762Copy head branch name to clipboard