Is it also missing the "bos" in the chunked prefill figure, at the "second prefill split" part?
Kyle H
kylehh
·
AI & ML interests
None yet
Recent Activity
commentedon an article 6 months ago
Continuous batching from first principlesOrganizations
