Hey everyone,
I recently acquired a single NVIDIA DGX Spark and have been experimenting with running qwen 3.8 flash next on it. After some optimization, I'm getting around 52-70 tokens/sec while still having roughly 30 GB of RAM available during inference.
I'm now looking for a good agent harness or framework to leverage the model for serious research, rather than just conventional chatting or coding.
I've currently been experimenting with a combination of Hermes Agent, DeepSeek harness, omp/pi and Goose, but I'm curious about what others are using:
Long-running, autonomous research workflows
Tool calling and MCP integrations
Context and persistent memory management
Multi-step reasoning and task execution
Web research and technical analysis
Are there any other harnesses or frameworks you've had particularly good experiences with when running local models?
I'd appreciate recommendations based on actual hands-on experience rather than just feature comparisons