Superhuman/X ArchiveView on X
C5R CORP

@c5rcorp

In 12 weeks, we built a research facility that is run entirely by AI.

AI designs, executes, and observes experiments end-to-end across biology, chemistry, and materials science.

We’re introducing SciUniverse: a benchmark that measures AI’s ability to do real-world scientific research.
114147826324
C5R CORP

@c5rcorp

We made an ontology of actions, an inventory management system, and an experiment scheduler across machines & people. We’ve integrated 40+ scientific instruments – by reverse engineering drivers and using custom hardware adapters.

This is a physical harness for research.
208111
C5R CORP

@c5rcorp

Once given a goal, models can explore inventory and read specs to design experiments as code. The code is converted into equipment control and instructions to people.

Models can then analyze measurements, replan and make a choice about what to try next – just like a person.
10551
C5R CORP

@c5rcorp

But can they do science in the real world?

To answer this we made SciUniverse [Level 1], a scientific benchmark that spans the research process including protocol debugging and bring-up, instrument operation, data analysis, and longer horizon tasks.
10502
C5R CORP

@c5rcorp

We learned models have theoretical scientific knowledge, but miss critical details in physical laboratory work.

They pipette frozen samples, contaminate DNA, fail to account for evaporating solvents, and vortex open containers.
Image from the post
30591
C5R CORP

@c5rcorp

Models doing Software and Mathematics have had the benefit of instant verification loops. Science is an intrinsically physical endeavor.

AI is going to radically change how we do science. We're building facilities where models can execute the entire research process and learn directly from reality.
11471
End of thread