akridge/yolo11m-sea-urchin-detector

Yolo11m Sea Urchin Detector

Model Details / Overview

This model was trained to detect sea urchins using the YOLO11 architecture. Trained on open datasets to identify and locate urchins in various underwater conditions.

• Model Architecture: YOLO11m
• Task: Object Detection (Urchin Detection)
• Footage Type: Underwater Footage
• Classes: 1 (urchin)

Evaluation of YOLOv11n & YOLOv11m Performance

• link to nano sized model: https://huggingface.co/akridge/yolo11n-sea-urchin-detector

Model Weights

The model's weights can be found here | Also available in various formats:

• PyTorch (best.pt): Standard format for PyTorch-based applications.
• Latest PyTorch Checkpoint (last.pt): The latest checkpoint from training.
• ONNX (best.onnx): ForONNX runtime.
• TorchScript (best.torchscript)
• NCNN: Efficient for mobile platforms and embedded systems.

Benchmarks

index	Format	Status	Size (MB)	metrics/mAP50-95(B)	Inference time (ms/im)	FPS
0	PyTorch	✅	38.7	0.5694	23.69	42.21
1	TorchScript	✅	77.1	0.5619	21.34	46.86
2	ONNX	❎	76.7	NaN	NaN	NaN
3	OpenVINO	❌	0.0	NaN	NaN	NaN
4	TensorRT	✅	86.4	0.5619	20.72	48.27
5	CoreML	❌	0.0	NaN	NaN	NaN
6	TensorFlow SavedModel	✅	193.1	0.5619	40.84	24.48
7	TensorFlow GraphDef	✅	76.8	0.5619	38.65	25.88
11	PaddlePaddle	✅	153.4	0.5619	30.63	32.65
12	MNN	✅	76.6	0.5615	1133.73	0.88
13	NCNN	✅	76.6	0.5619	1068.97	0.94
14	IMX	❌	0.0	NaN	NaN	NaN
15	RKNN	❌	0.0	NaN	NaN	NaN

Intended Use

• Real-time detections on underwater footage
• Post-processed video/imagery for detecting sea urchins in underwater environments

Factors

Model Performance

• Multi-source Dataset: Trained on datasets that include urchin images from various angles.
• Model Architecture (YOLO11m): Lightweight and optimized for real-time urchin detection in underwater footage.
• Training Data: The dataset is split into 70% training, 20% validation, and 10% test data.
• Training Parameters: Configured with 50 epochs, a 0.001 learning rate, and 640x640 image size for convergence.

Datasets

The training data was collected, parsed and organized from open sources:

1. Orange-OpenSource Marine-Detect
2. Roboflow - Sakana Urchins CJLib

• Roboflow Details:
  • Workspace: sakana
  • Project: urchins-cjlib
  • Version: 1
  • License: CC BY 4.0
  • URL: https://universe.roboflow.com/sakana/urchins-cjlib/dataset/1

Dataset Composition:

• Training Images: 1169
• Validation Images: 334
• Test Images: 168
• Train/Val/Test Split Ratio: 7:2:1

Metrics

Below are the key metrics from the model evaluation on the validation set:

Training Validation Results

Training and Validation Losses

Confusion Matrix

Precision-Recall Curve

F1 Score Curve

Training Configuration

• Model Weights File: yolo11m_urchin_trained.pt
• Number of Epochs: 100
• Learning Rate: 0.001
• Batch Size: 32
• Image Size: 640x640

Deployment

How to Use the Model

To use the trained model, follow these steps:

1. Load the Model:

   from ultralytics import YOLO
   
   # Load the model
   model = YOLO("yolo11m_urchin_trained.pt")
   

Limitations

The model was trained on a mix of open source images. It may not generalize well to other environments or non-marine scenarios. Additionally, environmental variations, occlusions, or poor lighting may affect performance.

Additional Notes:

Dataset Sources:

• Two datasets were combined to improve model robustness, allowing the model to adapt to varying lighting and water conditions. Ethical Considerations:
• The detection results should be validated before using them for critical applications. The model’s performance in new environments might vary, and it may have biases if certain types of sea urchins were underrepresented in the training datasets.

Disclaimer

This repository is a scientific product and is not official communication of the National Oceanic and Atmospheric Administration, or the United States Department of Commerce. All NOAA project content is provided on an ‘as is’ basis and the user assumes responsibility for its use. Any claims against the Department of Commerce or Department of Commerce bureaus stemming from the use of this project will be governed by all applicable Federal law. Any reference to specific commercial products, processes, or services by service mark, trademark, manufacturer, or otherwise, does not constitute or imply their endorsement, recommendation or favoring by the Department of Commerce. The Department of Commerce seal and logo, or the seal and logo of a DOC bureau, shall not be used in any manner to imply endorsement of any commercial product or activity by DOC or the United States Government.