Running Qwen3.8-Flash-Next NVFP4 at 184 tok/s on a single RTX 6000 Pro

3 comments

• saejox 21 minutes ago
  it is very hard to run 150k token context with these kind of setups. even if you do, all of us are used to running multiple agents at once.

  i hope ram prices will come down a little.
• IronWolve 9 hours ago
  Been running versions of this on my pc, if you have 64 gigs ram, you can run it on a 12+ gig cards easily.
• lowbloodsugar 11 hours ago
  Been running Qwen3.8-Flash-Next NVFP4 for weeks now. What's new about this?
  [-]
  • catchnear4321 11 hours ago
    hn title is completely different from the article title, which takes clicking the hn title to discover.

    > Our first model-kernel combos