Journal article
Advanced image recognition: a fully automated, high-accuracy photo-identification matching system for humpback whales
Mammalian Biology, Vol.102, pp.915-929
06/2022
Metrics
83 Record Views
UN Sustainable Development Goals (SDGs)
This output has contributed to the advancement of the following goals:
Source: InCites
Abstract
We describe the development and application of a new convolutional neural network-based photo-identification algorithm for individual humpback whales (Megaptera novaeangliae). The method uses a Densely Connected Convolutional Network (DenseNet) to extract special keypoints of an image of the ventral surface of the fluke and then a separate DenseNet trained to look for features within these keypoints. The extracted features are then compared against those of the reference set of previously known humpback whales for similarity. This offers the potential to successfully automate recognition of individuals in large photographic datasets such as in ocean basin-wide marine mammal studies. The algorithm requires minimal image pre-processing and is capable of accurate, rapid matching of fair to high-quality humpback fluke photographs. In real world testing compared to manual image matching, the algorithm reduces image management time by at least 98% and reduces error rates of missing potential matches from approximately 6–9% to 1–3%. The success of this new system permits automated comparisons to be made for the first time across photo-identification datasets with tens to hundreds of thousands of individually identified encounters, with profound implications for long-term and large population studies of the species.
Details
- Title
- Advanced image recognition: a fully automated, high-accuracy photo-identification matching system for humpback whales
- Creators
- Ted Cheeseman - HappywhaleKen Southerland - HappywhaleJinmo ParkMarilia Olio - HappywhaleKiirsten Flynn - Cascadia Research CollectiveJohn Calambokidis - Cascadia Research CollectiveLindsey Jones - College of the AtlanticClaire Garrigue - University of New CaledoniaAstrid Frisch Jordán - Ecología y Conservación de BallenasAddison Howard - GoogleWalter Reade - GoogleJanet Neilson - Glacier Bay National Park and PreserveChristine Gabriele - Glacier Bay National Park and PreservePhil Clapham
- Publication Details
- Mammalian Biology, Vol.102, pp.915-929
- Publisher
- Springer
- Grant note
- Funding for this research was provided by a grant from Cheesemans’ Ecology Safaris, San Jose, California (www.cheesemans.com).
- Identifiers
- 991012988295402368
- Copyright
- © Deutsche Gesellschaft für Säugetierkunde 2021
- Academic Unit
- Faculty of Science and Engineering; Marine Ecology Research Centre; Science
- Language
- English
- Resource Type
- Journal article