News Menu

LabDish Blog

Members of the Sheltzer Lab
Members of the Sheltzer Lab. Left to right: Jason Sheltzer, Nicole Sayles, Chris Giuliano, Ann Lin

What a real-life science test looks like

By revealing evidence that contradicts the rationale for a new cancer drug, a pair of student scientists learns firsthand that when you do science, you must ultimately treat everything as a hypothesis.

At first, Ann Lin and Chris Giuliano thought, 鈥渨e must have done something wrong.鈥 The two Stony Brook undergrads are cancer researchers in the lab of CSHL Fellow Jason Sheltzer, and when their results just didn鈥檛 add up with what many established scientists had already found, it was reasonable, as a starting point, to doubt themselves.

The source of their confusion was a gene called MELK. Many experiments by other scientists had turned up evidence that breast cancer cells need MELK to survive and multiply鈥攕o much evidence that a drug believed to target MELK is now being used to treat cancer patients in clinical trials. Lin and Giuliano used a new, highly accurate genome editing tool called CRISPR to get rid of MELK in breast cancer cells鈥攖o test if the cells really did depend on it to survive. If the dependency was real, the cancer cells would die.

The way you do science is you pick your favorite hypothesis and then you struggle as hard as you can to disprove it鈥

Instead, they found that the breast cancer cells got along just fine without MELK. Just as surprising, the drug still worked to limit growth of the MELK-less cells.

Lin and Giuliano did the experiment again, tested their method in other cells, and still came up with the same results, which is . By revealing that the drug must target a protein besides MELK, the pair of student scientists learned firsthand that when you do science, you must ultimately treat everything as a hypothesis.

鈥淚 was always told that the way you do science is you pick your favorite hypothesis and then you struggle as hard as you can to disprove it,鈥 says Sheltzer, their mentor. 鈥淚f at the end of the day you fail to disprove your hypothesis, then you have to accept it because you did everything you could against it.鈥

MyLITV reports on how high school students learned the importance of 鈥渃hallenging authority鈥 at CSHL

CRISPR only recently became 鈥渙ne of those things that scientists could do鈥 to try to disprove their hypotheses. For the most part, it wasn鈥檛 available when the previous scientists were forming those initial conclusions about MELK. Before CRISPR came along in 2013, the best tool available for blocking the activity of genes was a technology called RNA interference, or RNAi. Whereas CRISPR allows scientists to totally 鈥渟ilence鈥 a gene, RNAi only allows them to lower its volume.

The new findings demonstrate how CRISPR can help validate new drugs before they get to the clinic, and why new technologies like it are vital to the self-correcting nature of science. It鈥檚 an interesting moment to be helping to teach young scientists that, as Sheltzer puts it, 鈥減eople should trust the scientific method, the process which we use to get to answers, rather than the answers at any given point.鈥 Last year, in a of over 1,500 researchers, 90 percent agreed that science is going through a 鈥渞eproducibility crisis.鈥 Scientists are having trouble getting the same results as their peers when they do the same experiment.

Reproducibility is important to scientific integrity. Yet, as Sheltzer points out, 鈥渋f another experiment is flawed in some way, then just repeating it exactly as another group did doesn鈥檛 get us any closer to the truth.鈥 With CRISPR, Sheltzer鈥檚 team was able to block MELK more precisely than was possible with the RNAi technology used in the previous research.

Sheltzer and his team weren鈥檛 exactly looking to reproduce an existing experiment, but they were eager to see what this new technology could tell them. They were looking for 鈥渃ancer cell addictions鈥濃攇enes that cancer cells absolutely depend upon to survive and grow鈥攁nd started with the ones scientists had identified previously. 鈥淧eople have done large-scale screens like the ones that we were intending to do based on RNAi, so we wanted to see how it would work with CRISPR,鈥 Giuliano says.

When they started out, no one in Sheltzer鈥檚 lab thought that their test was about MELK. They actually included MELK as a point of comparison, Sheltzer says, because, 鈥渨e thought, 鈥榯his is an example of a well-studied gene,鈥 and when we mutate it with CRISPR, the cancer cells are going to die.鈥 In real-world science, unlike in a college class, the most important tests are the ones you couldn鈥檛 have prepared for.

Stay informed

Sign up for our newsletter to get the latest discoveries, upcoming events, videos, podcasts, and a news roundup delivered straight to your inbox every month.

  Newsletter Signup