1. |
- Alqaysi, Hiba, et al.
(författare)
-
A temporal boosted yolo-based model for birds detection around wind farms
- 2021
-
Ingår i: Journal of Imaging. - : MDPI AG. - 2313-433X. ; 7:11
-
Tidskriftsartikel (refereegranskat)abstract
- Object detection for sky surveillance is a challenging problem due to having small objects in a large volume and a constantly changing background which requires high resolution frames. For example, detecting flying birds in wind farms to prevent their collision with the wind turbines. This paper proposes a YOLOv4-based ensemble model for bird detection in grayscale videos captured around wind turbines in wind farms. In order to tackle this problem, we introduce two datasets—(1) Klim and (2) Skagen—collected at two locations in Denmark. We use Klim training set to train three increasingly capable YOLOv4 based models. Model 1 uses YOLOv4 trained on the Klim dataset, Model 2 introduces tiling to improve small bird detection, and the last model uses tiling and temporal stacking and achieves the best mAP values on both Klim and Skagen datasets. We used this model to set up an ensemble detector, which further improves mAP values on both datasets. The three models achieve testing mAP values of 82%, 88%, and 90% on the Klim dataset. mAP values for Model 1 and Model 3 on the Skagen dataset are 60% and 92%. Improving object detection accuracy could mitigate birds’ mortality rate by choosing the locations for such establishment and the turbines location. It can also be used to improve the collision avoidance systems used in wind energy facilities.
|
|
2. |
- Alqaysi, Hiba
(författare)
-
Cost Optimization of Volumetric Surveillance for Sky Monitoring : Towards Flying Object Detection and Positioning
- 2022
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Unlike surface surveillance, volumetric monitoring deals with three-dimensional target space and moving objects within it. In sky monitoring, objects fly within outdoor and often remote volumes, such as wind farms and airport runways. Therefore, multiple cameras should be implemented to monitor these volumes and analyze flying activities.Due to that, challenges in designing and deploying volumetric surveillance systems for these applications arise. These include configuring the multi-camera node placement, coverage, cost, and the system's ability to detect and position flying objects.The research in this dissertation focuses on three aspects to optimize volumetric surveillance systems in sky monitoring applications. First, the node placement and coverage should be considered in accordance with the monitoring constraints. Also, the node architecture should be configured to minimize the design cost and maximize the coverage. Last, the system should detect small flying objects with good accuracy.Placing the multi-camera nodes in a hexagonal pattern while allowing overlap between adjacent nodes optimizes the placement. The inclusion of monitoring constraints like monitoring altitude and detection pixel resolution influences the node design. Furthermore, presented results show that modeling the multi-camera nodes as a cylinder rather than a hemisphere minimizes the cost of each node. The design exploration in this thesis provides a method to minimize the node cost based on defined design constraints. It also maximizes the coverage in terms of the number of square meters per dollar. Surveillance systems for sky monitoring should be able to detect and position flying objects. Therefore, two new annotated datasets were introduced that can be used for developing in-flight birds detection methods. The datasets were collected by Mid Sweden University at two locations in Denmark. A YOLOv4-based model for birds detection in 4k grayscale videos captured in wind farms is developed. The model overcomes the problem of detecting small objects in dynamic background, and it improves detection accuracy through tiling and temporal information incorporation, compared to the standard YOLOv4 and background subtraction.
|
|
3. |
- Alqaysi, Hiba, et al.
(författare)
-
Cost Optimized Design of Multi-Camera Domefor Volumetric Surveillance
- 2021
-
Ingår i: IEEE Sensors Journal. - 1530-437X .- 1558-1748. ; 21:3, s. 3730-3737
-
Tidskriftsartikel (refereegranskat)abstract
- A multi-camera dome consists of number ofcameras arranged in layers to monitor a hemisphere aroundits center. In volumetric surveillance,a 3D space is required tobemonitoredwhich can be achievedby implementing numberof multi-camera domes. A monitoring height is consideredas a constraint to ensure full coverage of the space belowit. Accordingly, the multi-camera dome can be redesignedinto a cylinder such that each of its multiple layers hasdifferent coverage radius. Minimum monitoring constraintsshould be met at all layers. This work is presenting a costoptimized design for the multi-camera dome that maximizesits coverage. The cost per node and number of squaremetersper dollar of multiple configurations are calculated using asearch space of cameras and considering a set of monitoring and coverage constraints. The proposed design is costoptimized per node and provides more coverage as compared to the hemispherical multi-camera dome.
|
|
4. |
- Alqaysi, Hiba, et al.
(författare)
-
Design Exploration of Multi-Camera Dome
- 2019
-
Ingår i: ICDSC 2019 Proceedings of the 13th International Conference on Distributed Smart Cameras. - New York, NY : ACM Digital Library. - 9781450371896
-
Konferensbidrag (refereegranskat)abstract
- Visual monitoring systems employ distributed smart cameras toeffectively cover a given area satisfying specific objectives. Thechoice of camera sensors and lenses and their deployment affectsdesign cost, accuracy of the monitoring system and the ability toposition objects within the monitored area. Design cost can bereduced by investigating deployment topology such as groupingcameras together to form a dome at a node and optimize it formonitoring constraints. The constraints may include coverage area,number of cameras that can be integrated in a node and pixelresolution at a given distance. This paper presents a method foroptimizing the design cost of multi-camera dome by analyzing tradeoffsbetween monitoring constraints. The proposed method can beused to reduce monitoring cost while fulfilling design objectives.Results show how to increase coverage area for a given cost byrelaxing requirements on design constraints. Multi-camera domescan be used in sky monitoring applications such as monitoring windparks and remote air-traffic control of airports where all-round fieldof view about a point is required to monitor.
|
|
5. |
- Alqaysi, Hiba, et al.
(författare)
-
Evaluating Coverage Effectiveness of Multi-Camera Domes Placement for Volumetric Surveillance
- 2017
-
Ingår i: ICDSC 2017 Proceedings of the 11th International Conference on Distributed Smart Cameras. - New York, NY, USA : Association for Computing Machinery (ACM). - 9781450354875 ; , s. 49-54
-
Konferensbidrag (refereegranskat)abstract
- Multi-camera dome is composed of a number of cameras arranged to monitor a half sphere of the sky. Designing a network of multi-camera domes can be used to monitor flying activities in open large area, such as birds' activities in wind parks. In this paper, we present a method for evaluating the coverage effectiveness of the multi-camera domes placement in such areas. We used GPS trajectories of free flying birds over an area of 9 km2 to analyze coverage effectiveness of randomly placed domes. The analysis is based on three criteria namely, detection, positioning and the maximum resolution captured. The developed method can be used to evaluate results of designing and optimizing dome placement algorithms for volumetric monitoring systems in order to achieve maximum coverage.
|
|
6. |
- Alqaysi, Hiba, et al.
(författare)
-
Full Coverage Optimization for Multi Camera Dome Placement in Volumetric Monitoring
- 2018
-
Ingår i: ACM International Conference Proceeding Series. - New York, NY, USA : ACM Digital Library. - 9781450365116
-
Konferensbidrag (refereegranskat)abstract
- Volumetric monitoring can be challenging due to having a 3D target space and moving objects within it. Multi camera dome is proposed to provide a hemispherical coverage of the 3D space around it. This paper introduces a method that optimizes multi camera placement for full coverage in volumetric monitoring system. Camera dome placement is modeled in a volume by adapting the hexagonal packing of circles to provide full coverage at a given height, and 100% detection of flying objects within it. The coverage effectiveness of different placement configurations was assessed using an evaluation environment. The proposed placement is applicable in designing and deploying surveillance systems for remote outdoor areas, such as sky monitoring in wind farms and airport runways in order to record and analyze flying activities.
|
|
7. |
- Fedorov, Igor, et al.
(författare)
-
A two-layer 3D reconstruction method and calibration for multi-camera-based volumetric positioning and characterization
- 2021
-
Ingår i: IEEE Transactions on Instrumentation and Measurement. - 0018-9456 .- 1557-9662. ; 70
-
Tidskriftsartikel (refereegranskat)abstract
- A three-dimensional (3D) reconstruction method and multi-camera calibration using multiple artificial reference markers have been used for precise volumetric surveillance of fast-flying objects. The method uses a two-layer 3D reconstruction that integrates two multi-camera stereo-nodes. The fields of view of stereo nodes are directed at an acute angles to each other to provide greater coverage with the given constraints and to determine the flight characteristics of objects in 3D. The object’s flight reconstruction includes a “rough” estimation of its positions relative to selected artificial reference points in both stereo nodes separately and subsequent “refinement” of calculated positions. In this paper, we describe the proposed method and calibration technique, using a multi-camera system to measure object characteristics in 3D. The proposed method applies to volumetric surveillance in situations where it is necessary to count, track, and analyze the activities of flying objects, especially birds, using high spatial resolution.
|
|
8. |
- Fedorov, Igor, et al.
(författare)
-
Placement Strategy of Multi-Camera Volumetric Surveillance System for Activities Monitoring
- 2017
-
Ingår i: ICDSC 2017 Proceedings of the 11th International Conference on Distributed Smart Cameras. - New York, NY, USA : Association for Computing Machinery (ACM). - 9781450354875 ; , s. 113-118
-
Konferensbidrag (refereegranskat)abstract
- The design of multi-camera surveillance system comes with many advantages, for example it facilitates as understanding how flying objects act in a given volume. One possible application is for the observation interaction of birds and calculate their trajectories around wind turbines to create promising systems for preventing bird collisions with turbine blades. However, there are also challenges, such as finding the optimal node placement and camera calibration. To address these challenges we investigated a trade-off between calibration accuracy and node requirements, including resolution, modulation transfer function, field of view and angle baseline. We developed a strategy for camera placement to achieve improved coverage for golden eagle monitoring and tracking. This strategy based on the modified resolution criterion taking into account the contrast function of the camera and the estimation of the base angle between the cameras.
|
|
9. |
- Fedorov, Igor, 1980-, et al.
(författare)
-
Towards calibration of outdoor multi-camera visual monitoring system
- 2018
-
Ingår i: ACM International Conference Proceeding Series. - New York, NY, US : ACM Digital Library. - 9781450365116
-
Konferensbidrag (refereegranskat)abstract
- This paper proposes a method for calibrating of multi-camera systems where no natural reference points exist in the surrounding environment. Monitoring the air space at wind farms is our test case. The goal is to monitor the trajectories of flying birds to prevent them from colliding with rotor blades. Our camera calibration method is based on the observation of a portable artificial reference marker made out of a pulsed light source and a navigation satellite sensor module. The reference marker can determine and communicate its position in the world coordinate system at centimeter precision using navigartion sensors. Our results showed that simultaneous detection of the same marker in several cameras having overlapping field of views allowed us to determine the markers position in 3D world coordinate space with an accuracy of 3-4 cm. These experiments were made in the volume around a wind turbine at distances from cameras to marker within a range of 70 to 90 m.
|
|