Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: engine and cortex cpp log do not write to file in correct order #1850

Open
2 of 7 tasks
nguyenhoangthuan99 opened this issue Jan 13, 2025 · 0 comments
Open
2 of 7 tasks
Assignees
Labels
type: bug Something isn't working

Comments

@nguyenhoangthuan99
Copy link
Contributor

Cortex version

v1.0.8

Describe the issue and expected behaviour

Problem
log for llamacpp engine and cortex.cpp doesn't write to file in right order:

  • cortex cpp log at 02:11:22
  • llama-cpp engine load model and write log at 02:11:09

but the log for llama-cpp engine is written after cortex cpp

Steps to Reproduce

  1. start server
  2. cortex run any model
  3. check the log file

Screenshots / Logs

Image

What is your OS?

  • Windows
  • Mac Silicon
  • Mac Intel
  • Linux / Ubuntu

What engine are you running?

  • cortex.llamacpp (default)
  • cortex.tensorrt-llm (Nvidia GPUs)
  • cortex.onnx (NPUs, DirectML)

Hardware Specs eg OS version, GPU

No response

@nguyenhoangthuan99 nguyenhoangthuan99 added the type: bug Something isn't working label Jan 13, 2025
@nguyenhoangthuan99 nguyenhoangthuan99 self-assigned this Jan 13, 2025
@nguyenhoangthuan99 nguyenhoangthuan99 moved this to Investigating in Menlo Jan 13, 2025
@nguyenhoangthuan99 nguyenhoangthuan99 moved this from Investigating to Eng Review in Menlo Jan 13, 2025
@nguyenhoangthuan99 nguyenhoangthuan99 moved this from Eng Review to In Progress in Menlo Jan 13, 2025
@vansangpfiev vansangpfiev changed the title bug: [engine and cortex cpp log doesn't write to file in correct order] bug: engine and cortex cpp log do not write to file in correct order Jan 15, 2025
@vansangpfiev vansangpfiev mentioned this issue Jan 15, 2025
3 tasks
@vansangpfiev vansangpfiev moved this from In Progress to QA in Menlo Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
Status: QA
Development

No branches or pull requests

2 participants