That's an impressive jump in performance by providing the agent with access to relevant literature.

Is there a breakdown of which wins came from hyperparameter values (where BO would likely match this) vs. wins from techniques the agent wouldn’t have tried without the paper?

yes - the blog post has a figure showing all the improvements and how big they were.

also, some times the baseline agent tries the same idea but doesn't get as big a boost as the baseline + Paper Lantern agent. We studied it and found the reason was that the baseline tries changes in isolation whereas the research-backed ideas understand the interactions between parameters and suggests multiple changes at the same time - which the baseline agent never discovers.

This is pretty cool. How do you compare to GSD and superpowers?

Trying this out on a valve engineering PDF extraction task — the repo claims 72% improvement on PDF extraction specifically, which is why I'm biting. Installed the MCP and the results were actually contextualized against what I'd already tried in the repo, which surprised me. Handing it to Claude Code now. Quick question: does it pull implementation details from the paper itself, or just the technique? Will report back.

Thanks for trying it out :)

Yes, we contextualize the search for technques to your work and then pull everything out : the idea itself, supporting results and all implementation details - so your coding agent has a trivial time implementing it

You mention the index covers "applied CS" — where does it draw the line? If I'm implementing a time series forecasting model, does it cover the stats/econometrics literature too, or only CS-venue papers? A lot of the best techniques for engineering problems live in adjacent fields. Same question for computational biology, NLP-for-legal, etc.

for now, we are covering all of Computer Science - most techniques that are code-able likely show up there - but yes, if it is impactful we are open to expanding to other nearby domains too :)

Yes - would be interested in other domains. I'm particularly interested in computational biology. Let me know when that becomes available.

you should checkout paperlantern.ai , our main website - it already has biomedcine search over 45M+ papers :)

if you want MCP access to it, we can definitely do it - let us know

it's been a while since I've updated it, but here ya go: http://www.parimashah.com/

Created this website from scratch. It's a website which act as my portfolio as a Software Engineer. :) Would appreciate feedback/thoughts!