CAMARINE: A FISH SPECIES RECOGNITION SYSTEM THROUGH YOU ONLY LOOK ONCE
Prince Jewel C Federe | Andrew Emil M Pagador | Avegail O Ruiz
Discipline: Engineering
Abstract:
Data collection for marine sciences has always been arduous, mainly because of cost. The higher the
cost is, the slower the growth of knowledge. To ease that cost, Camarine was built. An application for fish species
recognition, Camarine used the algorithm You Only Look Once (YOLO) to seep through convolutional layers to
detect and identify fish species. Twelve species of fish were categorized according to likeness and lack thereof.
Over 4800 images were augmented to sport better results for the trained model. For testing, around 600 images
were collected in various locations, including experiments done in a controlled environment. Results in detection
showed an average of 88.63%, while the results in identification showed an average of 88.10%. For fishes of
different appearances but the same species, the recorded accuracy was 92.66%. And for fishes of similar
appearance but different species, the recorded accuracy was 86.60%. And finally, for general identification,
90.83% was the recorded accuracy. This all cumulates to the said 88.10% identification accuracy. Indeed, YOLO
works well with identification, but this remains untested against turbid underwater images.
References:
- Alsmadi, M. K., & Almarashdeh, I. (2020). A survey on fish classification techniques. Journal of King Saud University - Computer and Information Sciences, 34(5), 1625 1638. https://doi.org/10.1016/j.jksuci.2020.07.005
- Ancuti, C., Ancuti, C. O., Haber, T., & Bekaert, P. (2012). Enhancing underwater images and videos by fusion. In 2012 IEEE conference on computer vision and pattern recognition (pp. 81-88). IEEE.
- Boca Chica Baits. (2019). Caudal fin throttle fin - An article on the different types of caudal fins and how fish use them. Retrieved 5 June 2021, from https://bocachicabaits.com/blogs/news/caudal-fin-throttle-fin
- Bochkovskiy, A., Wang, C. Y., & Liao, H. Y. M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934.
- Bouchard, L. (2020). What is the YOLO algorithm? Introduction to You Only Look Once, Real-time object detection. What is Artificial Intelligence. https://medium.com/whatis-artificial-intelligence/what-is-the-yolo-algorithm-introduction-to-you-only-lookonce-real-time-object-detection-f26aa81475f2.
- Brownlee, J. (2020). How to calculate precision, recall, and F-measure for imbalanced classification. Machine Learning Mastery. Retrieved January 18, 2022, from https://machinelearningmastery.com/precision-recall-and-f-measure-forimbalanced-classification/
- Capuli, E., & Luna, S. (2009). Aspidontus taeniatus summary page. Retrieved 11 May 2021, from https://www.fishbase.se/summary/Aspidontus-taeniatus.html
- Chandra, B. (2021). A beginners guide to Computer Vision (Part 4)- Pyramid. Medium. Retrieved November 15, 2021, from https://medium.com/analytics-vidhya/a beginners-guide-to-computer-vision-part-4-pyramid-3640edeffb00
- Chen, J. W., Lin, W. J., Cheng, H. J., Hung, C. L., Lin, C. Y., & Chen, S. P. (2021). A smartphone-based application for scale pest detection using multiple-object detection methods. Electronics, 10(4), 372. https://doi.org/10.3390/electronics10040372
- Cui, S., Zhou, Y., Wang, Y., & Zhai, L. (2020). Fish detection using deep learning. Applied Computational Intelligence and Soft Computing, 2020, 1–13. https://doi.org/10.1155/2020/3738108
- dos Santos, A. A., & Gonçalves, W. N. (2019). Improving Pantanal fish species recognition through taxonomic ranks in convolutional neural networks. Ecological Informatics, 53, 100977. https://doi.org/10.1016/j.ecoinf.2019.100977
- Fu, H., Song, G., & Wang, Y. (2021). Improved YOLOv4 marine target detection combined with CBAM. Symmetry, 13(4), 623. MDPI AG. Retrieved from http://dx.doi.org/10.3390/sym13040623
- Gad, A. (2020, October). Evaluating object detection models using Mean Average Precision (mAP). PaperspaceBlog. https://blog.paperspace.com/mean-average precision/. Garcia, P. (2021). What are caudal fins? Retrieved 5 June 2021, from https://www.allthingsnature.org/what-are-caudal-fins.htm
- Garrison, T. S. (2015). Chapter 2 History. In Oceanography: An invitation to marine science (9th ed.). Essay, Cengage Learning.
- Gholamy, A., Kreinovich, V., & Kosheleva, O. (2018). Why 70/30 or 80/20 relation between training and testing sets: A pedagogical explanation. International Journal of Intelligent Technologies & Applied Statistics, 11(2).
- Google Developers. Classification: Precision and Recall | Machine Learning Crash Course. (n.d.). Google Developers. Retrieved January 18, 2022, from https://developers.google.com/machine-learning/crashcourse/classification/precision-and-recall
- Jalal, A., Salman, A., Mian, A., Shortis, M., & Shafait, F. (2020). Fish detection and species classification in underwater environments using deep learning with temporal information. Ecological Informatics, 57, 101088. https://doi.org/10.1016/j.ecoinf.2020.101088
- Jiang, Z., Zhao, L., Li, S., & Jia, Y. (2020). Real-time object detection method based on improved YOLOv4-tiny. arXiv preprint arXiv:2011.04244.
- Kalhagen, E. S. & Olsen, Ø. L. (2020). Hierarchical fish species detection in real-time video using YOLO (Master's thesis). University of Agder, Grimstad.
- Kang & Atul, (2019, August 19). Gaussian Pyramid. TheAILearner. Retrieved November 15, 2021, from https://theailearner.com/tag/gaussian-pyramid/
- Kennedy, J. (2019). What are the basics of fish anatomy? Retrieved 5 June 2021, from https://www.thoughtco.com/fish-anatomy-2291578
- Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020). Deep learning for generic object detection: A survey. International Journal of Computer Vision, 128, 261-318. https://doi.org/10.1007/s11263-019-01247-4
- Mahmood, Z., Muhammad, N., Bibi, N., Malik, Y. M., & Ahmed, N. (2018). Human visual enhancement using multi scale retinex. Informatics in Medicine Unlocked, 13, 9–20. https://doi.org/10.1016/j.imu.2018.09.001
- Mohamed, H. E. D., Fadl, A., Anas, O., Wageeh, Y., ElMasry, N., Nabil, A., & Atia, A. (2020). MSR-YOLO: Method to enhance fish detection and tracking in fish farms Procedia Computer Science, 170, Retrieved from https://doi.org/10.1016/j.procs.2020.03.123539–546.
- New Jersey Sea Grant Consortium [NJSGC]. (2010). Fish morphology. Retrieved 11 May 2021, from http://njseagrant.org/wp-content/uploads/2014/03/fish_morphology.pdf
- On The Water [OTW]. (2020, December). Identifying bluefin vs yellowfin tuna. https://www.onthewater.com/identifying-bluefin-vs-yellowfin-tuna
- Oosting, T., Star, B., Barrett, J. H., Wellenreuther, M., Ritchie, P. A., & Rawlence, N. J. (2019). Unlocking the potential of ancient fish DNA in the genomic era. Evolutionary Applications, 12(8), 1513–1522. https://doi.org/10.1111/eva.12811
- Petro, A. B., Sbert, C., & Morel, J. M. (2014). Multiscale retinex. Image Processing On Line, 4, 71–88. https://doi.org/10.5201/ipol.2014.107
- Priyankan, K., & Fernando, T. G. I. (2021). Mobile application to identify fish species using YOLO and convolutional neural networks. Lecture Notes in Networks and Systems, 303–317. https://doi.org/10.1007/978-981-33-4355-9_24
- Rathi, D., Jain, S., & Indu, S. (2017). Underwater fish species classification using convolutional neural network and deep learning. In 2017 Ninth International Conference on Advances in Pattern Recognition (ICAPR), 1-6. IEEE
- Raza, K., & Hong, S. (2020). Fast and accurate fish detection design with improved YOLO-v3 model and transfer learning. International Journal of Advanced Computer Science and Applications, 11(2). https://doi.org/10.14569/ijacsa.2020.0110202
- Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You Only Look Once: Unified, real-time object detection. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 779-788). https://doi.org/10.1109/cvpr.2016.91
- Sharpe, S. (2020). The seven types of fish mouths and how they are used. Retrieved 11 May 2021, from https://www.thesprucepets.com/fish-mouth-types-1381813#id-
- Sigwart, J. D., Blasiak, R., Jaspars, M., Jouffray, J. B., & Tasdemir, D. (2021). Unlocking the potential of marine biodiscovery. Natural Product Reports.
- Snyderman, M. (2003, May 6). Form and function: Sea creature shapes examined. DiveTraining. https://blog.roboflow.com/train-yolov4-tiny-on-custom-data-lightingfast-detection/
- Solawetz, J. (2021, March 8). Train YOLOv4-tiny on custom data - lightning fast object detection. Roboflow Blog. https://dtmag.com/thelibrary/form-function-sea-creatureshapes-examined/
- Stanford University. (2002). The Laplacian Pyramid. Stanford Exploration Project. Retrieved November 15, 2021, from http://sepwww.stanford.edu/data/media/public/sep/morgan/texturematch/paper_html/node3.html
- Torres, S.K., & Santos, B.S. (2019). Species identification among morphologically-similar Caranx species. Turkish Journal of Fisheries and Aquatic Sciences, 20(2), 159-169.
- Villon, S., Mouillot, D., Chaumont, M., Darling, E. S., Subsol, G., Claverie, T., & Villéger, S. (2018). A deep learning method for accurate and fast identification of coral reef fish underwater images. Ecological Informatics, 48, 238–244. https://doi.org/10.1016/j.ecoinf.2018.09.007
- Wood, T. (2020, August 7). F-score. DeepAI. Retrieved January 18, 2022, from https://deepai.org/machine-learning-glossary-and-terms/f-score
- Wu, L., Ma, J., Zhao, Y., & Liu, H. (2021). Apple detection in complex scene using the improved YOLOv4 model. Agronomy, 11(3), 476. MDPI AG. Retrieved from http://dx.doi.org/10.3390/agronomy11030476
- Zhou, C., Yang, X., Zhang, B., Lin, K., Xu, D., Guo, Q., & Sun, C. (2017). An adaptive image enhancement method for a recirculating aquaculture system. Scientific Reports, 7(1). https://doi.org/10.1038/s41598-017-06538-9
ISSN 2546-0749 (Online)
ISSN 1908-9058 (Print)