To Keep Track of Salmon Migrations in Real Time, First Nations Turn to AI

by Spoorthy Raman

Sockeye salmon (Oncorhynchus nerka) © Dr. Jonathan Moore.

Partnering with First Nations, a new interdisciplinary study proposes harnessing artificial intelligence and computer-based detection to count and produce real-time data about salmon numbers.
Monitoring their population when they return to the rivers and creeks is crucial to keep tabs on the health of the population and sustainably manage the stock, but the current manual process is laborious, time-consuming and often error-prone.
Fisheries experts say the use of real-time population data can help them make timely informed decisions about salmon management, prevent overfishing of stocks, and give a chance for the dwindling salmon to bounce back to healthy levels.
First Nations say the automated monitoring tool also helps them assert their land rights and steward fisheries resources in their territories.

Between spring and fall each year in coastal British Columbia, when salmon migrate upstream, the region’s First Nations manually count the number of fish passing through to get a sense of how healthy the population is. But it’s work that takes place in remote and hard-to-access streams of the province, making it laborious, time-consuming, and often error-prone.

So for a recent study, marine scientists, computer scientists and conservation practitioners partnered with Indigenous-led fisheries organizations to build and deploy an automated system to monitor and count salmon.

This first-of-its-kind tool harnesses the power of artificial intelligence to “learn” how to differentiate objects using computer vision algorithms. It can recognize and count 12 species of fish found in the Pacific Northwest, including the five species of wild Pacific salmon, by merely scanning video clips. The study was published in the journal Frontiers in Marine Science.

“This is the first time that anyone has automated counting of salmon from a video,” said Will Atlas, a salmon watershed scientist at the Oregon-based Wild Salmon Center. “We’ve come sort of the closest to having a tool that’s ready to be rolled out into actual management applications.”

Still from the video system showing the computer system identifying and counting salmon species passing through the box (weir openings) during training and learning. Video courtesy of the Gitanyow Fishery Authority.

In coastal British Columbia, Pacific salmon holds a unique place as a culturally revered fish for Indigenous peoples, and is a prized delicacy for seafood aficionados. The many coastal First Nations had sustainably managed salmon numbers for thousands of years, until logging and overfishing destroyed the delicate balance in the last century. As a result, the number of salmon returning to the many creeks and rivers where they spawn has fluctuated dramatically, casting doubts about their future.

“A central part of managing and conserving salmon is monitoring the number of adult salmon that return to the river to spawn,” Atlas told Mongabay.

Doing so manually, however, just isn’t feasible. “It’s challenging work because we’re at the whim of Mother Nature and the environment,” said fisheries biologist Mark Cleveland from the Indigenous-led Gitanyow Fisheries Authority in Kitwanga, British Columbia.

To train their AI-based tool, researchers used more than half a million video clips recorded by the Gitanyow Fisheries Authority and the Skeena Fisheries Commission. In recent years, these two Indigenous-led fisheries management organizations have begun using high-definition underwater cameras to monitor salmon migration in the Kitwanga and Bear rivers. But they still depend on humans to review the video and count the salmon.

In its initial stages of development, the AI-based tool needed humans to “teach” it to identify salmon — a task field technicians helped with by annotating salmon in the video clips. Over time, the tool learned to recognize the fish so well that it got it right seven times out of 10. Its accuracy surpassed 90% for sockeye (Oncorhynchus nerka) and coho salmon (Oncorhynchus kisutch), two of the important species in the North Pacific.

However, its accuracy was low in identifying pink (Oncorhynchus gorbuscha) and chinook salmon (Oncorhynchus tshawytscha) because the individuals of these species differ in their looks. During the spawning season, the male pink salmon develops a large hump and hooked jaw, and the chinook salmon change colors.

Salmon school — Every two years, adult pink salmon (Oncorhynchus gorbuscha) swim upstream from the oceans to the gravel beds of the many rivers and creeks where they lay eggs and die. After a few months, the eggs hatch and the young salmon, called smolts, make their way back to the open ocean. Image by Erector/Wikimedia Commons.

The researchers say they hope that training the algorithm with more data sets, collected from different rivers with more salmon species, can improve its accuracy.

While Indigenous traditional knowledge was not used in developing the AI tool itself, it formed the basis for building Indigenous weirs — fence-like structures built across rivers with a small passage for the fish to pass through — where the cameras were placed. Without the weirs, counting multiple fish captured in a video frame would have been far more challenging. Traditional knowledge also played a role in determining the monitoring season for different salmon, like correcting partners to monitor returning sockeye as early as April, and placing cameras in streams where elders knew salmon migrated.

“It’s a really good proof-of-concept feasibility study,” said AI scientist Justin Kay, co-founder of Ai.Fish, who was not involved in the study. “What they have done well is bringing together all of the stakeholders in developing and deploying [this] technology. I think it’s really impressive.”

Real-time data for better decisions

The newly developed tool automates the existing salmon count carried out manually by First Nations, which can be a bottleneck for making management decisions regarding salmon, such as when to close commercial fisheries or limit the catch in rivers where salmon numbers are low.

Without automation, it takes months to manually review the videos and compile the counts, and by the time the numbers arrive, they’re too outdated to have much practical use.

“At the moment, we get the results postseason — after we recover the hard drive from the site,” said Janvier Doire, fisheries biologist at the Skeena Fisheries Commission.

“Depending on how many data files and different projects are going on, sometimes it could be weeks or months before we have the information we need to make those important decisions,” said Cleveland from the Gitanyow Fisheries Authority.

Indigenous weirs fence-like structures built across rivers with a small passage for the fish to pass through — where monitoring cameras are placed. Image by Dr. Jonathan Moore.

Both said they hope AI can hasten the process and provide real-time data needed to make decisions on the fly. “Once we can get the number of fish that are coming back to rivers quicker using AI, on a day-to-day basis, First Nations that are harvesting salmon will be able to manage their harvest accordingly,” Doire said.

Computer scientist Robert Moorhead from Mississippi State University, who was not involved in the study, deployed a similar AI-based system to monitor snapper and mackerel in the southeastern United States. “This type of technology is going to be very useful for real-time fish monitoring,” he said. “I think they’re doing something very useful and in the right direction.”

Can AI strengthen Indigenous stewardship?

The Heiltsuk Nation, on the central coast of BC, about 500 kilometers (310 miles) northwest of Vancouver, is larger than the state of Connecticut. Only a handful of staff monitor the number of returning adults and out-migrating juvenile salmon each year in the streams and rivers of the nation’s vast territory.

“Monitoring is important because the salmon are such a huge part of the ecosystem and our own lives — not only for food sustenance but culturally,” said William Housty from the Heiltsuk Integrated Resource Management Department, the nation’s stewardship arm. It’s a way the “salmon people,” as he calls his community, to pay homage to salmon.

To ease this laborious task, the Heiltsuk Nation partnered with Atlas’s team to run a pilot of the AI-based monitoring tool in their weir across the Koeye River. The pilot focused primarily on monitoring sockeye salmon in Heiltsuk territory — a species about which the nation had no information and struggled to make management decisions. After the staff learned how to use the AI-based tool, their productivity transformed: Instead of spending all their time between April and October watching the salmon go by, they could focus 60% of their time on other priority projects.

“It was amazing to be able to sit here in our office and watch the live views of the salmon swimming through the weir and getting notifications on your phone that nine fish just passed through,” Housty said. “It’s unreal to think that that’s actually happening.”

For the Heiltsuk, integrating groundbreaking technology such as AI with their Indigenous knowledge of when and where salmon migrate in the territory is a way to strengthen stewardship over their territories. “It really is an extension of exerting our title and rights over management of salmon populations in our territory,” Housty said. “It’s never before we have seen data produced like this that’s so accurate and so quick and in a form that’s usable for making decisions on the spot.”

Impressed by its performance, the nation plans to use the system in the future too.

Atlas said the AI-based tool could play a vital role in managing salmon populations under a recently signed historic agreement, where coastal First Nations like Heiltsuk work closely with Fisheries and Oceans Canada (DFO), the federal agency responsible for fisheries management, to jointly manage fishery resources in coastal British Columbia. “This information that we’re generating can be foundational to managing salmon under those co-governance agreements,” he said.

By 2025, the researchers plan to roll out the tool with 10 partnered First Nations for monitoring salmon in real time throughout the season. They also plan to build a web application where anyone can upload video clips to automatically count fish numbers.

Atlas said this collective effort of developing a real-time monitoring system is a way to ensure the salmon populations remain healthy and can be fished for centuries to come. “This isn’t just about developing a scientific tool, but it’s about putting food on people’s plates.”

The article is reposted from Mongabay, please follow the link here to see the original post.

Photo Banner Credit: A sockeye salmon swims in the Kwakusdis River © Olivia Leigh Nowak / Salmon Nation

[xyz-ihs snippet=”Prepared-by-PK”]

Related Topics:AI fisheries News salmon Salmon Monitoring stories from the sea sustainable technology

Up Next

SEVENSEAS Media’s Beach Cleanup with ISB Students Makes a Splash in November 2023

Don't Miss

SAWFISH NEWS: SeaWorld Orlando Celebrates the Birth of Endangered Sawfish Pups

Aquacultures & Fisheries

Mussels: The Sustainable Seafood Superstar Making Waves in Aquaculture

The humble mussel, often overlooked in the seafood aisle, is quietly revolutionizing the aquaculture industry. Not only are mussels delicious and nutritious, but they are emerging as champions of sustainable seafood, offering a glimmer of hope for a healthier planet. Recent data paints a compelling picture of their positive impact, and forward-thinking companies are leading the charge in responsible mussel farming.

Mussels are filter feeders, meaning they naturally clean the water around them. This remarkable ability contributes to improved water quality and a healthier marine environment. Unlike other aquaculture forms, mussel farming requires no added feed, as they derive their nutrients from the surrounding water column. This eliminates the environmental concerns associated with feed production and potential pollution.

Furthermore, mussel farms create habitat for other marine species, acting as artificial reefs that enhance biodiversity. They provide shelter and breeding grounds, contributing to a thriving ecosystem. Studies have shown that mussel farms can increase the abundance and diversity of marine life in their vicinity.

But the sustainability story doesn’t end there. Mussel farming has a remarkably low carbon footprint compared to other protein sources. Their efficient growth and minimal input requirements make them a climate-friendly choice. As consumers become increasingly aware of the environmental impact of their food choices, mussels are gaining popularity as a sustainable and delicious alternative.

The global mussel market is experiencing significant growth, driven by increasing consumer demand for sustainable seafood. This surge in interest has spurred innovation in mussel farming techniques, with a focus on minimizing environmental impact and maximizing efficiency. Researchers are exploring new methods for culturing mussels, including integrated multi-trophic aquaculture, where mussels are grown alongside other species, creating a balanced and sustainable ecosystem.

However, not all mussel farming practices are created equal. It’s crucial to support producers who prioritize environmental responsibility and social accountability. Third-party certifications, like Friend of the Sea, play a vital role in ensuring that mussels are farmed sustainably.

Spotlight on Amegrove: A Leader in Sustainable Mussel Farming

One company leading the way in responsible mussel aquaculture is Amegrove. They have achieved Friend of the Sea certification, a testament to their unwavering commitment to sustainable practices.

Amegrove’s mussels have earned this prestigious certification due to several key factors:

They maintain strict water quality parameters.
Their farming methods minimize impact on seabed and surrounding habitats.
They use responsibly sourced mussel seed.
They uphold fair labor practices and contribute to the local economy.

These practices align perfectly with Friend of the Sea’s requirements for sustainable aquaculture, which include evaluating impacts on water quality, habitat preservation, responsible feed sourcing, and social responsibility.

“We are thrilled to award Friend of the Sea certification to Amegrove,” said Paolo Bray, Director of Friend of the Sea. “Their dedication to sustainable aquaculture is truly commendable. They serve as an excellent example for the industry, showcasing how high-quality seafood can be produced while respecting the environment and local communities.”

Esteban Fernandez Casal, presidente at Amegrove, added:
“This certification is a testament to our team’s hard work and dedication to sustainable practices. We believe that responsible aquaculture is essential for our oceans’ health and the seafood industry’s future. We are proud to partner with Friend of the Sea in promoting environmentally and socially responsible seafood choices.”

By choosing Friend of the Sea certified mussels from companies like Amegrove, consumers can support responsible aquaculture practices and contribute to a healthier planet. Mussels offer a delicious and sustainable seafood option, proving that we can enjoy the ocean’s bounty while protecting its delicate ecosystems.

Author Credit: Originally published by Friend of the Sea – www.friendofthesea.org

About Friend of the Sea

www.friendofthesea.org

Friend of the Sea is a project of the World Sustainability Organization (WSO), offering international certification for sustainable seafood and aquaculture. Products certified meet strict environmental and social responsibility criteria, verified through independent audits.

Over 1,000 companies across 70+ countries are certified by Friend of the Sea. The program also covers services such as sustainable restaurants, seaweed, UV creams, whale watching operators, ornamental fish, and more. Friend of the Sea actively runs conservation campaigns to protect endangered species and habitats.

About Amegrove

Amegrove is a company dedicated to producing high-quality mussels through sustainable aquaculture practices. It is committed to minimizing environmental impact and contributing to the local community.

For more information, visit their official website: Amegrove

Aquacultures & Fisheries

Breathe. Wheel. Flukes Up. Dive. Swim On, Whales!

April 24th was Massachusetts Right Whale Day. A vertical puff of water vapor split the air on that bright, calm day in Cape Cod Bay off Provincetown’s Wood End Lighthouse. The V-shaped blow is not visible because the whale is positioned broadside to us. Most baleen whales have narrower spouts. With no dorsal fin and a brief glimpse of broad flukes—the whale’s tail—confirms the presence of a right whale, approximately 50 feet long.

Right whale spout seen from afar with Wood End Lighthouse in the background on a clear blue day.

A right whale releases a vertical spout off Provincetown’s Wood End Lighthouse on Massachusetts Right Whale Day.

Right whales are so rare that whale-watching vessels must stay at least 500 yards, or 1,500 feet, away so as not to disturb them. Right whales are like icebergs in freshwater, with most of their bodies hidden underwater. We watched the magnificent mammals from a distance.

Two right whales worked the shore along Herring Cove. Herring gulls showed no interest in the whales as they followed the fishing boat, heading for the harbor with the morning’s catch. Right whales eat zooplankton, straining small animals that drift in the water column with six-foot-long cartilage plates hanging down from the roof of the whale’s mouth. Hairs on baleen form a fine mesh that traps zooplankton inside, where the whale’s tongue, the size of a BMW Smart car, swipes and swallows.

A pair of right whales swim in synchronization, turning and rolling onto their right side to elevate the left side of their flukes above the water. A third whale follows closely behind the twisting whales.

Today, the whales are likely eating shoals of Calanus copepods that are corralled between them and the steeply rising shore. We saw between 12 and 17 right whales from Race Point, with its lighthouse, to Long Point, which has a lighthouse at the tip of the sandy finger at the end of the raised arm known as Cape Cod.

Further offshore from Herring Cove, a slim, long whale with a sharply curved dorsal fin blows, wheels, and dives. With many decades of experience, the whale-watch boat captain maneuvers closer and stops the engine as a second sei whale surfaces. Reaching as much as 60 feet, sei whales are the third largest whale in the world, preceded by blue and fin whales. Sei is Norwegian for pollack fish, as they were often seen together.

Sei whale dorsal fin just above surface in calm blue waters off the Cape.

A sei whale arches before diving — its slim frame and distinct dorsal fin barely breaking the surface.

The two dark, bluish-gray whales settle beneath the water beside the boat, the white of their undersides visible as they roll onto their sides. The roqual grooves along their pleated chin and cheeks distend. Still in the water, these whales let the plankton float into their mouths, or so we think, as we cannot see any plankton in the dark waters. They rose to breathe after a few minutes, which seemed to our astonishment like an eternity.

The first humpback whales of the season are found north of Race Point. Low in the water, they appear to be lounging about, perhaps taking it easy after a morning of feeding on sand lance. Last week, I found the pencil-thin fish on the Herring Cove beach, likely dropped by a gull.

A humpback whale partially surfaced, showing blowholes and dorsal fins in blue open ocean.

A humpback whale lies below the surface with its blowholes and dorsal fin above the water.

A humpback whale lies below the surface with its blowholes and dorsal fin above the water. To the right, a second whale stirs the water that laps over its back.

The boat floats by the two humpback whales. Looking through the water, we see the whale’s 15-foot-long white flipper. The scientific name for humpback whales is Megaptera novaeangliae, meaning large-winged New Englander.

We are startled to see a second flipper looming white beneath the whale. A third whale is stealthily poised directly below the whale on the surface. When we saw two whales on the surface, there were really four humpbacks, surfacing two by two.

Later, all four whales were on the surface nearly at once. One rolled on its side to reach an enormous flipper to the sky. The narrator assured us that the whale was not waving. Whales slap the water to communicate with more distant whales, but there were no slapping sounds today.

The whales slowly drifted beneath our vessel, revealing their entire outlines from above. Here, the tail fluke can be seen while the head and flippers are on the other side of the boat. The whales moved beneath us, from left to right and then from right to left, four times!

Finally, a humpback whale lifted its tail before diving. The black and white pattern on the underside was recognized as belonging to the female humpback named Habanero for the appearance of a chili pepper mark. Habanero is well known to the Dolphin Fleet of whale watch vessels. Habanero was observed with a calf in September 2012. A second humpback was identified as Candlestick. The other two humpbacks never showed their tails.

Tail fluke of a humpback whale above the water, with Cape Cod shoreline and water tower in background.

The black-and-white tail fluke of Habanero, a known female humpback, rises above the bay before she dives deep once more.

Returning to the harbor, the right whales continued to forage along the shoreline. These whales are called urban whales because they come near our urban shores more often than others. Right whales do not migrate, except for females that give birth off Savannah and Jacksonville. The newborns have little blubber and require warm water. However, these clear waters offer little food. Therefore, right whales travel to Cape Cod Bay for the abundant shoals of zooplankton. They may stay for six weeks before spreading out across the North Atlantic.

Lobstermen do not trap during April and May along Massachusetts’ sandy shores and boat traffic consists of smaller vessels alert to right whales. The greatest threat to right whale survival is the diminishing availability of food. Our pollutants have caused phytoplankton productivity to drop by 60% since 2000. Copepods now have less fat content, requiring whales to consume more to obtain the same nutritional value.

What we are doing to the land is harmful. We have crossed a tipping point by removing vegetation and soil, which hard surfaces and urbanization have replaced. There are cascading negative consequences. Boston’s annual rainfall is a steady 46.4 inches a year, yet, destructive stormwater and combined sewer overflows are rising because we have removed the vegetation and the soil carbon sponge.

Water that once soaked into the ground now washes across heat islands. It warms up and transports heat to the ocean. The year 2023 was not an exceptionally hot summer for Boston but it was the wettest summer since 1955. This resulted in a record warming of the Gulf of Maine surface waters nearest to Boston. While 2021 was Boston’s hottest summer, the surface ocean water did not experience significant warming.

Nutrients spilled into the sea fuel harmful algal blooms and ocean dead zones. The ten-fold increase in the use of the herbicide Roundup since 1996, when Monsanto developed crops resistant to glyphosate, is likely more than coincidental to the loss of phytoplankton.

The solution to the threat to the ocean ecosystems on which whales depend lies on land. Land should be granted the right to retain the rainwater that falls upon it. Developers should not be permitted to profit from their constructions while leaving the municipality responsible for managing increased stormwater, likely leaving people in the flood zone standing in CSO sewage.

The dry land heats up worsening climate change when developers starve the land of water. Property owners must instead slow water down, return it to the ground where plants may draw to photosynthesize during the dry season, where groundwater may recharge rivers, and with water in the ground to prevent forest fires. Let’s improve the whale’s marine ecosystem with no more pollution, stormwater damage, and ocean heating from the land.

Returning past Race Point, a right whale raised its head high out of the water. Gray baleen plates hung beneath a white, encrusted black upper lip. In doing so, I don’t know what advantage was gained by the whale. I took it as a smile, as my smile was no less broad.

Nearly fifty years ago, on April 15, 1976, I was on the first Dolphin Fleet whale watch. We saw right whales and a humpback whale that the boat captain’s son would later name Salt when he became the boat captain. Since then, Salt has birthed 12 calves and is the grandmother of seven more humpback whales. There were then estimated to be 350 right whales. Today’s estimate is 372 whales, not including the ten calves born last winter.

I was on the first commercial whale watch because two summers earlier, I was alone on the deck of a 27-foot sailboat, south of Seguin Light off the coast of Maine. A right whale surfaced next to the boat. I babbled, having never imagined that something alive could be the size of a sandbar. The whale left only a circular slick spot on the water for the rest of the crew to see.

We are fortunate to be in the company of whales, which grace our sandy shores for about six weeks in spring. The loss of vegetation and soil on our properties and in neighborhoods is harming the marine ecosystem on which right whales depend to break their winter fast. To ensure future generations can share the ocean with a burgeoning right whale population, we must increase the carbon sponge on our land and stop stormwater runoff.

Breathe. Wheel. Flukes up. Dive. Swim on, whales!

Dr. Rob Moir is a nationally recognized and award-winning environmentalist. He is the president and executive director of the Ocean River Institute, a nonprofit based in Cambridge, MA, that provides expertise, services, resources, and information not readily available on a localized level to support the efforts of environmental organizations. Please visit www.oceanriver.org for more information.

More from Dr. Rob Moir

Aquacultures & Fisheries

Entries of URI’s ‘Ocean View’ Youth Art Competition to be Displayed at Pawtucket Gallery

This article is written by Neil Nachbar.

Submissions will be on display at the Art League RI gallery from April 5-27; winning entries will be showcased at URI’s Graduate School of Oceanography thereafter

The winning entry in the grades 9 to 12 division in 2023 was “Ocean Sur Mon Coeur” by Chelsea Andrea De La Rosa of Providence.

KINGSTON, R.I. – About 300 Rhode Island students in grades kindergarten through 12th grade entered the third biennial “Ocean View” student art competition, organized by the University of Rhode Island’s Graduate School of Oceanography (GSO).

All submissions will be displayed at the Art League RI gallery in Pawtucket, 80 Fountain Street, Suite 107A, from April 5-27. Three winners from each of the four age divisions will be announced at a ceremony at the gallery on Thursday, April 17 at 3 p.m.

Students were required to submit a statement of no more than 100 words on the theme, “What does ‘The Ocean State’ mean to you?’” Their two-dimensional artwork was limited to 24 inches by 36 inches. Suggested art mediums included illustration, painting, mixed media and collage, and photography.

The judges were three professional artists: Janine Wong, Laurie Kaplowitz, and Ruth Clegg, who is also the president of the board of directors of Art League RI.

“Sea Monster at Sea,” by Bentley Riley of Providence, was awarded first place in the grades 6 to 8 division in 2023

“Jayvion’s Ocean Design,” by Jayvion Desjardin of Pawtucket, won first place in the kindergarten to second grade division in 2023. (URI Photos)

Lucienne D’Nitto of Wakefield captured first in the grades 3 to 5 division in 2023 for his “Below the Water’s Surface” entry.

Wong takes a multidisciplinary approach when creating abstract prints, weaving together elements of art, craft, design, and architecture. Kaplowitz uses the human figure to explore nature and existence. Her art has been exhibited in galleries in Boston, Los Angeles, New York, Dallas, Miami, and San Francisco. Clegg’s art, which includes photography, video, printmaking, painting, and collage, has been displayed at the Providence Art Club, Bristol Museum of Art, Mystic Museum of Art, the Rhode Island School of Design Museum, Care New England, and the Smithsonian Graphic Art Collection.

“Art League RI is pleased to host the ‘Ocean View’ art competition with the URI Graduate School of Oceanography,” said Clegg. “We’re happy to encourage children to recognize the value of the ocean through the process of creating these works of art.”

After April 27, the 12 award-winning pieces of art will be showcased at GSO’s Ocean Science & Exploration Center. The winners will be invited to GSO for a reception on a date to be determined, where they will be presented their awards. The art will be displayed for at least a year, where they may be viewed by the public, students, staff, and faculty.