New Algorithm Uses Online Learning for Massive Cell Data Sets

The method enables researchers to analyze millions of cells with the amount of memory found on a standard computer.

9:47 AM

Author | Kelly Malcom

Purple Colored Data With Laptop
Michigan Medicine

The fact that the human body is made up of cells is a basic, well-understood concept. Yet amazingly, scientists are still trying to determine the various types of cells that make up our organs and contribute to our health.

A relatively recent technique called single-cell sequencing is enabling researchers to recognize and categorize cell types by characteristics such as which genes they express. But this type of research generates enormous amounts of data, with datasets of hundreds of thousands to millions of cells.

A new algorithm developed by Joshua Welch, Ph.D., of the Department of Computational Medicine and Bioinformatics, Ph.D. candidate Chao Gao and their team uses online learning, greatly speeding up this process and providing a way for researchers world-wide to analyze large data sets using the amount of memory found on a standard laptop computer. The findings are described in the journal Nature Biotechnology.

MORE FROM THE LAB: Subscribe to our weekly newsletter

 "Our technique allows anyone with a computer to perform analyses at the scale of an entire organism," says Welch. "That's really what the field is moving towards."

The team demonstrated their proof of principle using data sets from the National Institute of Health's Brain Initiative, a project aimed at understanding the human brain by mapping every cell, with investigative teams throughout the country, including Welch's lab.

Typically, explains Welch, for projects like this one, each single-cell data set that is submitted must be re-analyzed with the previous data sets in the order they arrive. Their new approach allows new datasets to the be added to existing ones, without reprocessing the older datasets. It also enables researchers to break up datasets into so-called mini-batches to reduce the amount of memory needed to process them.

"This is crucial for the sets increasingly generated with millions of cells," Welch says. "This year, there have been five to six papers with two million cells or more and the amount of memory you need just to store the raw data is significantly more than anyone has on their computer."

Welch likens the online technique to the continuous data processing done by social media platforms like Facebook and Twitter, which must process continuously-generated data from users and serve up relevant posts to people's feeds. "Here, instead of people writing tweets, we have labs around the world performing experiments and releasing their data."

Like Podcasts? Add the Michigan Medicine News Break on iTunes, Google Podcast or anywhere you listen to podcasts.

The finding has the potential to greatly improve efficiency for other ambitious projects like the Human Body Map and Human Cell Atlas. Says Welch, "Understanding the normal compliment of cells in the body is the first step towards understanding how they go wrong in disease."

Paper cited: "Iterative single-cell multi-omic integration using online learning," Nature Biotechnology. DOI: 10.1038/s41587-021-00867-x


More Articles About: Lab Report All Research Topics Health Care Delivery, Policy and Economics Hospitals & Centers Emerging Technologies Future Think
Health Lab word mark overlaying blue cells
Health Lab

Explore a variety of healthcare news & stories by visiting the Health Lab home page for more articles.

Media Contact Public Relations

Department of Communication at Michigan Medicine

[email protected]

734-764-2220

Stay Informed

Want top health & research news weekly? Sign up for Health Lab’s newsletters today!

Subscribe
Featured News & Stories doctor holding tablet hospital room with stethoscope
Health Lab
Popular sepsis prediction tool less accurate than claimed
The algorithm is currently implemented at hundreds of U.S. hospitals.
Older couple holding hands
Health Lab
In sickness and in health, older couples mostly make Medicare moves together
A new study suggests the need for more efforts to help both members of a couple weigh and choose their Medicare options together, because most changes of plan occur with both members of the couple changing from the same option to the same option.
Photo of two silhouettes in a hallway
Health Lab
Most new doctors face some form of sexual harassment, even after #MeToo
Sexual harassment of all kinds is a common experience among first-year medical residents, also known as interns, especially those in surgical specialties, but it may be declining.
Speculum illustration including a gloved hand holding a swab in front of microscopic cells
Health Lab
U.S. could cut cervical cancer cases, deaths by up to 20% if more patients followed up after screening, study suggests
Many women don’t get cervical cancer screening such as Pap tests, or don’t go for follow up diagnostic tests; a new study shows what could happen if all of them did.
gun with lock on it with key there gun is in black and background yellow and lock is white
Health Lab
Michigan’s new firearm injury prevention laws: What everyone should know
Michigan has a set of new laws related to firearms, all designed to reduce the risk of injury and death across the state.
Spilled pills next to a stethoscope and pile of cash
Health Lab
Drug pricing program improved prostate cancer treatment adherence
Socially vulnerable patients were more likely to stick with oral medications when treated at a hospital participating in 340B program, suggesting these hospitals may have more resources to help patients.