GitHub - modelsphere/mock-llmd · GitHub

Repository navigation

mock-llmd

Public

About

No description, website, or topics provided.

Apache-2.0 license

Code of conduct

Security policy

Custom properties

0 stars

0 watching

Report repository

Name		Name	Last commit message	Last commit date
.github/workflows		.github/workflows
helm		helm
.gitignore		.gitignore
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
go.mod		go.mod
go.sum		go.sum
main.go		main.go
main_test.go		main_test.go

Repository files navigation

lightweight mock llm server

Streaming/Non-Streaming
/v1/chat/completions, /v1/completions, /v1/messages
configurable TTFT/per chunk latency via request header or request body
serverd mode name mocking

About

No description, website, or topics provided.

Apache-2.0 license

Code of conduct

Security policy

Custom properties

0 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages