Skip to content

[BUG] How should the consumed tokens be counted when the inference is interrupted halfway or canceled #105

@JonSmall

Description

@JonSmall

📋 CheckList

  • I have searched existing issues to avoid duplicates
  • I am using a recently maintained version of Coze Loop
  • I have provided all required information
  • I understand this is a bug report and not a feature request
  • I have submitted this report in English (otherwise it will not be processed)

🐛 Bug Description

How should the consumed tokens be counted when the inference is interrupted halfway or canceled
The current statistics are based on the last output of usage_age. If the inference fails halfway, how can it be completed.

🔄 Steps to Reproduce

Do it by yourself !

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions