Literature DB >> 35498235

iFO (infrared Fish Observation) - An open source low-cost infrared underwater video system.

Andreas Hermann1, Jérôme Chladek1, Daniel Stepputtis1.   

Abstract

Underwater video surveillance is an important data source in marine science, e.g. for behaviour studies. Scientists commonly use water resistant ruggedized monitoring equipment, which is cost-intensive and usually limited to visible light. This has two disadvantages: the observation is limited to space and time where visible light is available or, under artificial illumination, behaviour of marine life is potentially biased. Infrared (IR) video surveillance have been used before to overcome these. It records videos at visible light and under IR-illumination. With today's efficiency of IR-LED and video technology even low-cost systems reach visibility ranges suited for many application scenarios. We describe a low-cost open-source based hardware/software system (iFO). It consists of a single-board computer controlling the camera and lamps (with high power IR-LEDs), printed circuit boards (PCB), the underwater housings and 3D-printable models to mount PCBs in the housings and the housings to standard GoPro mounts. The Linux based software includes webserver, remote control, motion detection, scheduler, video transfer, storage at external hard disk and more. A ready-to-use SD-card image is included. We use rugged underwater housings with 100 m (optional 400 m) depth ratings. Finally, we describe a typical application observing the behaviour of cod in fish pots.
© 2020 The Authors.

Entities:  

Keywords:  Animal behaviour; Fish; Infrared camera; Marine life; Observation; Open source; Underwater video

Year:  2020        PMID: 35498235      PMCID: PMC9041171          DOI: 10.1016/j.ohx.2020.e00149

Source DB:  PubMed          Journal:  HardwareX        ISSN: 2468-0672


Specifications table

Biological Sciences (Marine and Fishery research) Educational Tools and Open Source Alternatives to Existing Infrastructure Underwater imaging tools Field measurements and sensors Electrical engineering and computer science

Hardware in context

We present “infrared Fish Observation” (iFO), an open-source low-cost underwater infrared (IR) video observation system using high power LEDs and low-cost CMOS camera modules. The use of IR-video surveillance at night is very common for onshore applications and therefore hardware became very efficient at low-cost. On the other hand, in marine science, the use of visible light in dark environments is mostly inappropriate to avoid bias of fish behavior. Acoustic cameras have been used for this purpose [7], but those are complex and expensive systems with low resolution compared to optical cameras. Like human eyes, many marine species, such as fish, cannot see IR-light. One major obstacle is the relative high attenuation of IR-light under water compared to visible light [2], [3], [4]. That limits this method to short-range observations. Nevertheless, IR-video surveillance have been used for underwater observations in dark environments earlier, e.g. [1], [5], [6], [8], [9]. These studies do not give detailed description of the IR systems and therefore are not reusable. Additionally, since the time of their development, technology has made great improvements. With today’s effectivity of LED technology, even low-cost CMOS cameras can cover ranges of observation >2 m, suited for many application scenarios. Furthermore, single board computers like Raspberry Pi or BeagleBone are inexpensive and can be operated with freely available open source operating systems (Linux based). They are used in many different application areas and a wide range of open-source software tools are free available. This makes them ideal for quickly realizable developments of highly adaptable cost-effective systems.

Hardware description

As there were no affordable underwater IR systems available, we developed the open-source system iFO (infrared Fish Observation). iFO uses a consumer single-board computer (Raspberry Pi) and standard industry parts. The Raspberry Pi single-board computers have been applied for marine supervision and fish observation earlier, e.g. [20], [21], [22]. In our application one system consists of one camera and two lights, whereby components cost around 530€ including 100 m depth rated housings. With the reuse of existing open-source software and hardware, that were adapted to our scientific needs, we achieved a sustainable ocean monitoring system at low-cost. The system offers a webserver, a comfortable scheduler, a motion detection unit and can store internally more than one week continuous video data. We present iFO in a typical application where we observe the behaviour of cod (Gadus morhua, L. 1758) at the entrance of different fish pots with the aim to improve the catch effectivity. It delivers 24/7 underwater video footage in a range up to 2 m at infrared illumination and much greater distances at daylight. Additionally, we use a LTE router (FritzBox 6890) with a 2 GB swappable hard disk to be used with up to four camera systems. This allows video data storage for several weeks and provides full access via VPN and LTE to the whole system in the field. It gives remotely live videos, access to the cameras’ webserver for adjustment and setup, for instant download of data and to the cameras’ operating system for maintenance.

Spectral sensitivity of the camera

The CMOS camera has an OV5647 [13] sensor chip, which has no IR filter. We use lenses that do not have IR filter either. As typical for colour camera sensors, the photoactive area is evenly distributed in red, green and blue filtered pixels. Its relative spectral quantum efficiency is shown in Fig. 1. Quantum efficiency (QE) is measured over a range of different wavelengths to characterize a device's efficiency at each photon energy level. It shows the fraction of emitted electrons e from a given number of photons illuminating the sensor. That means, e.g. a number of 100 photons of 555 nm wavelength generates 90 electrons (yellow line) on a green filtered pixel and a number of 100 photons of 850 nm wavelength generates 35 electrons (blue line) on the same pixel.
Fig. 1

Spectral quantum efficiency of the CMOS camera [14]. The sensitivity at the medium wavelength of the IR lamp (850 nm) is marked with a blue line and the sensitivity at the wavelength with the highest sensitivity of human eyes (555 nm) is marked with a yellow line. (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.)

Spectral quantum efficiency of the CMOS camera [14]. The sensitivity at the medium wavelength of the IR lamp (850 nm) is marked with a blue line and the sensitivity at the wavelength with the highest sensitivity of human eyes (555 nm) is marked with a yellow line. (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.) Each colour (blue, green and red) represents a third of the full active sensor area. Therefore, the total quantum efficiency of the active area for a monochromatic light at a certain wavelength can be calculated from the sum of the electrons on each coloured pixel type, e.g. for 555 nm it is the sum of 15e at blue, 90e at green and 8e at red pixel equals to 15e + 90e + 8e = 113e. It can be seen that the quantum efficiency for infrared light at 850 nm (@850 nm: 35e + 35e + 35e = 105e) is very similar to those in the visible range (@555 nm: 15e + 90e + 8e = 113e). Consequently, the camera can be used for visible light and IR-light. The datasheet also specifies a photometric sensitivity of and a dark current value of 16 mV/s [13] (see Table 1).
Table 1

components of iFO IR underwater observation system.

PartComponentTypeSourcechapter
IR-server cameraEnclosureMechanical (from supplier)external supplier3.1, 3.3.1
Single board computerPrinted circuit boardexternal supplier3.3.2
IR camera boardPrinted circuit boardexternal supplier3.3.3
Real time clockPrinted circuit boardexternal supplier3.3.4
PCB IR-serverV11Printed circuit boardSourcefile (Eagle)3.3.5
Mount for PCBMechanical (3D printable)Sourcefile (STL)3.3.6
Mount for GoProMechanical (3D printable)Sourcefile (STL)3.2
IR-lampEnclosureMechanical (from supplier)external supplier3.1, 3.4.1
PCB IR-LampV31Printed circuit boardSourcefile (Eagle)3.4.2
PCB IR-LampV32Printed circuit boardSourcefile (Eagle)3.4.2
Aluminium heat drainMechanicalSourcefile (STL)3.4.3
Mount for GoProMechanical (3D printable)Sourcefile (STL)3.2
components of iFO IR underwater observation system.

Spectrum and intensity of the IR lamps

Each infrared lamp uses six Osram SFH4715AS IR-LED’s [15] with a beam angle of 90°. The beam angles can be adapted by optical lenses mounted on the PCB (Table 11: no. 15, 15a). The total electrical power is . The centroid wavelength is 850 nm with a radiant power per LED, resulting in 9.180 W per lamp. Fig. 2 shows the relative spectral intensity.
Table 11

Bill of material for the two PCBs of IR-Lamp (4 pieces each).

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
18Capacitor SMD-32162,2uF/100 Vde.rs-online.com136–4335AVX SMD MLCC X7R 12061C225KAT2A2.40
24Recom LED-Treiber IC, 31 W, PCB 6-Pinde.rs-online.com668–9870Recom RCD-24–1.044.48
38OpAmp OP295GSZ SOIC8de.rs-online.com523–0284AnalogDevicesOP295GSZ33.28
48Diode 1 N4148de.rs-online.com739–0290Schaltdiode 1N4148TA, 100 V 400 mA DO-35 2-Pin0.88
58Resistor SMD-1206 220kOhm 5% 0.5 Wde.rs-online.com807–1173TE-Connectivity CRGH1206J220K0.24
64Resistor SMD-1206 100Ohm 5% 0.5 Wde.rs-online.com 807–1104TE-Connectivity CRGH1206J100R0.12
74Resistor SMD-1206 15kOhm 5% 0.5 Wde.rs-online.com 807–1132TE-Connectivity CRGH1206J15K0.12
84Resistor SMD-1206 560kOhm 5% 0.5 Wde.rs-online.com 807–1255TE-Connectivity CRGH1206J560K0.12
920/36Pin socket1 × 2 2.54 mmde.rs-online.com549–0026E-TEC 36-pin-socketBL1-036-G-700–011.87
108/20Pin socket1 × 2 2.54 mm longde.rs-online.com217–609HARWIN 20-pin-socket D01B99520-420.83
1128/36Pin header1 × 4 2.54 mmde.rs-online.com360–6342Molex C-Grid III 20pin90210–07801.55
124Trimmpoti 3296Y 10kOhm 10% 1/2Wde.rs-online.com522–0079Bourns 25 Gang THT 3296Y-1-103LF9.24
1324Osram Oslon Black LED ± 45° SFH4715Sde.rs-online.com 758–7646OSRAM SFH4715S, 3 Pin76.08
144Phototransistor VTT9812FHwww.digikey.de VTT9812FH-NDExcelitas Technologies4.08
15*24OSRAM lens 10 mm med. spot frosted, 30°www.lumitronix.com 60,387Carclo SKU 60,38726.88
15a*24OSRAM lens 10 mm plain tight, 20°www.lumitronix.com 60,386Carclo SKU 60,38626.88
1648/500Slotted screwM3 × 8 mmonline-schrauben.deDIN84-4.8-M3X8Steel galvanizedDIN84-M3x80.96
1716/100Spacer round, Ø 6 × 3 mm, 3.2 mm drillde.rs-online.com 102–6110Richco469.09.031.91
186/100Potting compound 100 gde.rs-online.com199–1418RS PRO Epoxid 2 × 50 g0.54
194/12PCB IRlamp_V31www.aisler.netPCB for playground 12 pcs19.40
204/12PCB IRlamp_V32www.aisler.netPCB for playground 12 pcs25.88
211Aluminium rod diameter 65, 63.5 or 60 mm, length 70 mm
Total250.86
Total for 1 piece62.71

Optional: depending on the application, different type of LED lenses can be used.

Fig. 2

Relative spectral intensity of the LED lamp.

Relative spectral intensity of the LED lamp.

Hardware components

Enclosure

The housings for the IR-server camera and the IR-lamp are taken from the Blue Robotics Inc. 3″-series. Technical details and 3D-drawings can be downloaded at [16]. We use the acrylic tube version that is depth rated to 100 m, an aluminium version rated to 400 m is also available. The end caps have through-holes for cable feed-through penetrators, whereas different types of penetrators are available [17]. The cable feed-through is sealed with marine epoxy to build a safe custom made cable confection. A detailed tutorial is given at [18].

GoPro mount for IR-lamp and IR-server

The GoPro mount (see Fig. 3 fits to the outer surface of the acrylic tube. It is tightened by a M5 × 35 mm screw (hexagon socket ISO10642) with M5 hexagon nut. We have used ABS material for 3D-printing to improve stability of the GoPro-mount under water and cold conditions. The use of standard PLA was insufficient because it became brittle in saltwater after a few weeks.
Fig. 3

3D-printable mounting device for IR-lamp and IR-camera for GoPro mounts.

3D-printable mounting device for IR-lamp and IR-camera for GoPro mounts.

Server/Camera

In the server/camera enclosure, four printed cicuit boards (PCB) are connected to each other and tied on a 3D printable mount. Raspberry Pi single-board computer [12] PCB with Real time clock PCB with the camera module PCB ‘IR-server’ with voltage regulator and two output drivers.

Enclosure Server/Camera

For the server/camera a 298 mm acrylic tube described in chapter 3.1 is sectioned in two halfes to get enclosures for two server/cameras. For a set of two cameras the following parts (see Table 2), are needed:
Table 2

Bill of material for a set of two IR-server/camera housings.

ItemNo.DescriptionManufacturer CodePrice/€
11Cast Acrylic Tube – 11.75″, 298 mm (3″)WTE3-P-TUBE-12-R1-RP46.00
24O-Ring Flange (3“)WTE3-M-FLANGE-SEAL-R2-RP96.00
32Aluminium End Cap (3″)WTE3-M-END-CAP-R1-RP20.00
42Clear Acrylic End Cap (3″)WTE3-P-END-CAP-R1-RP20.00
52Enclosure Vent and PlugVENT-ASM-R1-RP16.00
64M10 Cable Penetrator for 8 mm CablePENETRATOR-M-BOLT-8MM-10-25-R2-RP20.00
Total218.00
Total for one piece109.00
Bill of material for a set of two IR-server/camera housings. Table 3 shows a distributor list for the enclosure. For sealing the cable penetrator we use potting compound (Table 8, Item15). The 100 g package can be used for about 35 cable penetrators, when all are sealed with one compound mix (within ½ an hour).
Table 3

Distributor list for IR-server camera housings.

1:www.bluerobotics.com2:www.nido.ai3:www.igp.de
Table 8

Bill of material for PCB ‘IR-server’

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
12Resistor SMD-1206220kOhm 5% 0.5 Wde.rs-online.com807–1173TE-Connectivity CRGH1206J220K0.058
22Resisitor SMD-1206220 Ohm 5% 0,5Wde.rs-online.com807–1176TE-Connectivity CRGH1206J220R0.056
32Transistor NDS355AN SOT23de.rs-online.com739–0167FairchildNDS355AN0.54
41DC/DC Converter Traco TSR2-2450 SIP3de.rs-online.com166–6063TracopowerTSR2-245010.14
54/90Pin socket 2 × 6 2.54 mmde.rs-online.com230–4922Stelvio Kontek 90x2-pin613,090,271,1230.23
64/36Pin socket 1 × 4 2.54 mmde.rs-online.com549–0026E-TEC 36-pin-socketBL1-036-G-700–010.37
72/36Pin socket 1 × 2 2.54 mmde.rs-online.com549–0026E-TEC 36-pin-socketBL1-036-G-700–010.19
84/20Pin header 1 × 4 2.54 mmde.rs-online.com360–6342Molex C-Grid III 20pin90210–07800.40
92/20Pin header 1 x2 2.54 mmde.rs-online.com360–6364Molex C-Grid III 20pin90°90121–07800.18
104/100Slotted screwM2 × 12 mmde.rs-online.com560–710RSPRO, steel galvanizedDIN84-M2x120.21
114/250Hexagon nutM2 × 4 mmde.rs-online.com560–271RSPRO, steel galvanized0.09
124/100Spacer round, Ø 6 × 3 mm, 3.2 mm drillde.rs-online.com102–6110Richco469.09.030.48
134/500Tapping screw2.2 × 6 mmonline-schrauben.deDIN7971-C-2,2X6,5Steel galvanizedDIN7971-C-2,2X6,50.24
144/500Slotted screwM3 × 8 mmonline-schrauben.deDIN84-4.8-M3X8Steel galvanizedDIN84-M3x80.08
153/100Potting compound 100 gde.rs-online199–1418RS PRO Epoxid 2x50g0.27
161/12PCB IRserver_V11www.aisler.netPCB for playground 12pcs1.21
Total for one piece14.74
Distributor list for IR-server camera housings.

Raspberry Pi single-board computer

The Raspberry Pi single-board computer has a CSI interface for the camera board and a 40 pin-GPIO interface used here for the PCB RTC and the PCB ‘IR-server’ with power converter and two output drivers (see Fig. 4).
Fig. 4

RaspberryPi interfaces in use: CSI-camera connector and GPIO connector with attached pins.

RaspberryPi interfaces in use: CSI-camera connector and GPIO connector with attached pins. The assembly of the PCB ‘IR-server’ is documented in chapter 3.3.7. The Raspberry Pi with additional PCBs and the camera PCB is fixed to a 3D-printable mount that fits into the underwater housing. The mechanical details of this mount are specified in chapter 3.3.6. The bill of material is shown in Table 4.
Table 4

Bill of material for the Raspberry Pi.

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
12Raspberry Pi 3 Model B+de.rs-online.com137–3331Raspberry Pi 3 Model B+58.94
22Micro SD Karte, MicroSDXC 64 GB,Class 10, UHS-I U3de.rs-online.com174–4627Kingston SDCR/64 GB45.98
Total104.92
Total for one piece52.46
Bill of material for the Raspberry Pi.

PCB IR-camera

The camera PCB uses the 5MP OV5647 CMOS sensor IC, which has no IR-filter. It is supplied with CSI interface and cable. The M12 S-mounted lenses are without IR-filter, either, different angles of sight are available.The bill of material is shown in Table 5.
Table 5

Bill of material for IR camera PCBs.

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
12RPi IR camera (F) (75° lens)www.exp-tech.deEXP-R63-017Waveshare SKU: 10299 Part:: Rpi Camera (F) UPC: 70064694991577.20
1a2RPi IR camera (H) (fisheye lens)www.exp-tech.deEXP-R63-019Waveshare SKU: 10703 Part:: Rpi Camera (H) UPC: 799632838333119.56
Total for one piece (75° lens)38.60
Bill of material for IR camera PCBs.

PCB Real time clock

Various RTC modules are available for the Raspberry Pi. The most appropriate one is from SERTRONICS as it only uses five pins of the GPIO header at a low price. The bill of material is shown in Table 6.
Table 6

Bill of material for the real time clock.

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
12Real Time Clock for Raspberry Piwww.reichelt.deRPI RTC CLOCKSERTRONICS RPI-RTC5.50
Total for one piece2.75
Bill of material for the real time clock.

PCB ‘IR-server’

The PCB ‘IR-server’ is mounted via the 2 by 6-pin-socket JP1 to the GPIO pin-header of the Raspberry Pi Table 7. On the topside of the PCB, there are two pin-headers JP2 and JP4. The 4-pin I/O header JP2 is connected to the 24VDC input power and the two output drivers (O13 out and O21 out) that allow a remote control of two independent groups of lamps. In our standard applications we control the lamps by light sensors. For remote controlled lamps some modifications are necessary, which are described in chapter 3.4.5. For the standard setup, the 2-pin header JP4 delivers the 5VDC@2A power for the Raspberry Pi. It is connected via a 2-wire line with pin-sockets to the power pins of the Raspberry Pi. Fig. 5 shows the schematic and the top and bottom view of the PCB ‘IR server’. Table 7 the jumper connections and Table 8 the bill of material.
Table 7

PCB ‘IR server’ jumper connections.

JP1
Pinto RPI PinfunctionPinto RPI Pinfunction
140GPIO21, Lamp2833GPIO13, Lamp1
239GND9…1032…31n.c.
3…638…35n.c.1130GND
734GND1229n.c.
Fig. 5

PCB ‘IR server’: left: Schematic view; right: PCB top and bottom view.

PCB ‘IR server’: left: Schematic view; right: PCB top and bottom view. PCB ‘IR server’ jumper connections. Bill of material for PCB ‘IR-server’

PCB mount (3D-printable)

Fig. 6 shows the 3D-printable mount that holds the Raspberry Pi with its additional PCB boards in the acrylic tube and the CMOS camera at the centre in front of the acrylic window. It is attached to the flange with four screws.
Fig. 6

Drawings of the 3D-printable mount inside the IR-server enclosure; left: PCB mount, right: schematic view of Raspberry Pi, mounted on the PCB mount inside the enclosure.

Drawings of the 3D-printable mount inside the IR-server enclosure; left: PCB mount, right: schematic view of Raspberry Pi, mounted on the PCB mount inside the enclosure.

Assembly

For the assembly of the server/camera, the PCB of the RTC and the ‘IR-server’ are mounted to the GPIO header of the Raspberry Pi. The PCB ‘IR-server’ is connected to the Raspberry Pi GPIO-pins #29 to #40. The PCB of the RTC to the odd pin row from #1 to #9. The power supply for the Raspberry Pi is connected by a two wire cable with pin sockets between JP4 at PCB ‘IR-server’ and Raspberry Pi GPIO-pins #2 (+5V) and #6 (GND). All connections are marked in red in Fig. 7.
Fig. 7

PCB ‘IR-server’ and PCB RTC connected to the Raspberry Pi’s GPIO-header.

PCB ‘IR-server’ and PCB RTC connected to the Raspberry Pi’s GPIO-header. We use Raspberry Pi 3 Model B + but we also tested older versions (Pi 3 Model B and Pi 2 Model B). The camera module is without infrared filter. Different types of optics are available e.g. 160° or 75° degrees angle of view. The operating system with all necessary modules, setups and software components is written to the SD memory card. It is recommended to use 64 GB (or greater) SDXC memory card, to have enough space to locally store videos. The Raspberry Pi with the attached PCBs and the camera module are mounted to the 3D-printed mount that fits to the flange (Fig. 8).
Fig. 8

Attaching the camera and the Raspberry Pi PCBs to the 3D-printed PCB mount.

Attaching the camera and the Raspberry Pi PCBs to the 3D-printed PCB mount. The camera is mounted to the front gap with four flat head tapping screws 2.2 mm × 6 mm with the cable connector to the bottom. The Raspberry Pi is attached with four M2 × 12 mm screws (each a 3 mm spacers between the PCB and the mount) and hexagon nuts to the four slot holes on the mount. A CSI-cable connects the camera to the Raspberry Pi computer. It is inserted with the blue mark to the front at the cameras PCB and with the blue mark to the back of the Raspberry Pi (Fig. 9).
Fig. 9

Attachment of the IR-server/camera to the flange.

Attachment of the IR-server/camera to the flange. The PCB mount is fixed with four M3 × 8 mm screws to the M3 threads of the front flange. The external power has to be connected to the connector J2 at the PCB ‘IR-server’. Finally, the electronics will be mounted inside the acrylic tube (enclosure) with the electrical connections tailored at the backside plate (Table 9). The underwater sealing procedure of the through-hole connectors is described at [18]. The underwater cable types and cable configuration depends on the requirements of the application. As power and ethernet cable for the server/camera, we use underwater ethernet cable like [19]. After sealing, the power and data lines are assembled according to Table 9. A simple connection of the Ethernet port of the Rasperry Pi can be made by cutting a standard patch cable, dismantle the sheath and solder the four data lines (Tx+,TX-,Rx + and Rx-) to the corresponding wires of the underwater cable. The power is tranferred according to 10/100BASE-TX with PoE pinout. The four wires are soldered to a two pin socket (2x 24VDC; 2x GND) (see Fig. 10).
Table 9

Server/camera: PoE-cable configuration; the input voltage range for 24VDC is 12-36VDC.

Pin/wireFunctioncolourPin/wirefunctionColour
1TX+orange/white524VDCbblue/white
2TX-orange6RX-Green
3RX+green/white7GNDabrown/white
424VDCablue8GNDbBrown
Fig. 10

Cable assembly for IR server/camera.

Server/camera: PoE-cable configuration; the input voltage range for 24VDC is 12-36VDC. Cable assembly for IR server/camera. On the surface side, we use 9-pin WEIPU SP21 connectors to connect the underwater ethernet cable from the server/camera to the top side power and ethernet device. For easy installation we designed a 3D-printable mounting device that fits to all GoPro compatible mounts. A more detailed description with the mechanical drawings is given in chapter 3.2, Fig. 11 shows an assembled server/camera.
Fig. 11

Assembled server/camera, attached to a frame using standard GoPro-clamps.

Assembled server/camera, attached to a frame using standard GoPro-clamps. In summary the major assembly steps are: Solder all parts to the PCBs. Assemble the PCBs ‘IR-server’ and RTC to the RapsberyPi GPIO jumper. Connect PCB ‘IR-server’ J4 power out to RaspberryPi GPIO jumper pins #2 (+5V) and #6 (GND) by a 2-wire line. Insert the SD-card with the iso-image in the SD-card holder of the Raspberry PI. Assemble the camera to the PCB mount. Assemble the Raspberry Pi PCB to the PCB mount. Connect the camera and the Raspberry Pi with a CSI-cable. Assemble the PCB mount to the front flange of the enclosure. Tailor the electrical connection at the backside plate to your needs and connect power in to J2 (pin #3 and #4) at the PCB ‘IR-server’ and the four ethernet wires to the RJ45 connector of the Raspberry Pi.

IR lamp

Enclosure lamp

The housing for the IR lamp is the same as for the server/camera except, that the original tube is sectioned in four quarters of 74 mm length each. For a set of four lamps you need parts according to Table 10.
Table 10

Bill of material for the underwater housing (4 pieces).

ItemNo.DescriptionManufacturer CodePrice/€
11Cast Acrylic Tube – 11.75″, 298 mm (3″)WTE3-P-TUBE-12-R1-RP46.00
28O-Ring Flange (3“WTE3-M-FLANGE-SEAL-R2-RP192.00
34Aluminium End Cap (3″ Series)WTE3-M-END-CAP-R1-RP40.00
44Clear Acrylic End Cap (3″ Series)WTE3-P-END-CAP-R1-RP40.00
54Enclosure Vent and PlugVENT-ASM-R1-RP32.00
64M10 Cable Penetrator for 8 mm CablePENETRATOR-M-BOLT-8MM-10-25-R2-RP20.00
Total370.00
Total for one lamp92.50
Bill of material for the underwater housing (4 pieces). A distributor list can be found in Table 3. For sealing the cable penetrator we use potting compound (Table 8, Item15). The 100 g package can be used for appr. 35 cable penetrators, when all are sealed with one compound mix (within ½ an hour).

PCB IR lamp

Two PCBs are required for each IR lamp: ‘IR-lampV31′ with six LEDs and ‘IR-lampV32′ for the LED driver. The schematics and PCBs are shown in Fig. 12 and Fig. 13.
Fig. 12

PCB IR-lampV31: Top: Circuit diagram; Mid: PCB layout in top and bottom view; Bottom assembled PCB with optional lens assembly (left), long pin-socket at bottom side (right).

Fig. 13

PCB ‘IR-lampV32′: Top: Circuit diagram; Mid: top and bottom view; Bottom: assembled PCB top and bottom view.

PCB IR-lampV31: Top: Circuit diagram; Mid: PCB layout in top and bottom view; Bottom assembled PCB with optional lens assembly (left), long pin-socket at bottom side (right). PCB ‘IR-lampV32′: Top: Circuit diagram; Mid: top and bottom view; Bottom: assembled PCB top and bottom view. The bill of material is given in Table 11 for four IR lamps. The six LEDs at each PCB ‘IR-lampV31′ are reflow soldered, while all other parts (including the SMD parts) can be also soldered manually. Both PCBs have four through holes to mount the PCBs to the M3-threads in the aluminium cooling mount. The PCB ‘IR-lampV32′ has 4 additional holes to mount it to the M3 threads in the flange of the underwater enclosure. When sufficient ambient light is available, e.g. during the day in shallow water, the IR illumination is not required. Therefore, there are two control options for the lamp: Control by a light sensor Control by the IR server/camera control signal Bill of material for the two PCBs of IR-Lamp (4 pieces each). Optional: depending on the application, different type of LED lenses can be used. In our standard applications, we control the lamps by ambient light sensors (phototransistor VTT9812FH, Table 11, item 14). For a control by a light sensor, the phototransistors pins are soldered to a 3-pin socket with the anode at pin #1 and the cathode at pin #3, pin #2 is not connected. This 3-pin socket is connected to J2 at the PCB ‘IR lampV32′ (Fig. 13, bottom left). The setup for the control by the camera/server is described in chapter 3.4.5. The bill of material for the IR-lamps is given in Table 11.

Aluminium cooling mount

The two PCBs ‘IR-lampV31′ and ‘IR-lampV32′ are finally mounted to the aluminium cylinder that drains the heat from the LEDs to the aluminium flange and further to the surrounding water. The aluminium mount should have a diameter of 63.5 mm to fit best into the flange. We turned a 65 mm aluminium rod down to 63.5 mm and sawed 16 mm thick pieces from it, alternatively aluminium rods with diameters down to 60 mm can be used. The drilling were done by handcraft. There are four through holes with M3 threads to mount the PCB boards on the two sides of the cooling mount (Fig. 14).
Fig. 14

Drawing of the aluminium cooling mount for the two PCBs ‘IR-lampV31’ and ‘IR-lampV32’.

Drawing of the aluminium cooling mount for the two PCBs ‘IR-lampV31’ and ‘IR-lampV32’. Fig. 15 shows the assembly of the PCB boards with the cooling aluminium mount from the top left to the bottom right. First, the PCB ‘IR-lampV32′ is mounted to the aluminium mount with four M3 × 8 mm screws and 3 mm spacers. Then the long 2-pole-pin socket of the PCB ‘IR-lampV31′ connected to the standard 2-pole pin header at the mounted PCB ‘IR-lampV32′ which is inside the 8 mm hole at the center of the aluminium mount. It is important to observe the correct polarity: LED + at ‘IR-lampV32′ has to be connected to LED + at ‘IR-lampV31′. The PCB ‘IR-lampV31′ is fixed directly to the aluminium mount using four M3 × 8 mm screws. To improve heat flow, thermal conductance paste between the bottom side of the PCB and the aluminium mount can be used. Finally, the block with the PCB boards and the aluminium mount is inserted into the flange and fixed with four M3 × 8 mm screws. Thermal conductance paste between the lateral area of the aluminium and the flange would increase heat flow even further.
Fig. 15

Assembly of the aluminium mount and the PCBs to the flange of the enclosure.

Assembly of the aluminium mount and the PCBs to the flange of the enclosure. The backside plate of the enclosure with its the electrical connections can be tailored to specific needs. The underwater sealing procedure of the through-hole connectors is described at [18]. Underwater cable types and cable configuration depend on the requirements of the application. In our application, we use 3-wire water resistant DIN VDE 0276 NYY-J 3x1,5mm2 cable and 3-pin WEIPU SP21 connectors to connect the lamps to the top side surface unit. After sealing, the power and data lines are assembled according to Table 12. The two power wires are soldered to a 2-pin socket, which is connected to J1 of the PCB ‘IR-lampV32′ with respect to the correct polarity. There are two options to control the lamps: by an ambient light sensor (standard) and remotely from the server/camera (optional) (see Fig. 16).
Table 12

IR-lamp: cable configuration (*for server/camera controlled lamp, see chapter 3.4.5).

Pin/wireFunctioncolourconnect to
1+24VDCbrownIR-lampV32, J1, pin 1
2Controlyellow/greenIR-lampV32, J2, pin 2*
3GNDblueIR-lampV32, J1, pin 2
Fig. 16

Cable assembly for IR lamp (left: ambient light control, right: Server/camera control).

IR-lamp: cable configuration (*for server/camera controlled lamp, see chapter 3.4.5). Cable assembly for IR lamp (left: ambient light control, right: Server/camera control). For easy installation we designed a 3D-printable mount for the IR lamp that fits to GoPro compatible clamps. A more detailed description with the mechanical drawings is given in chapter 3.2. Fig. 17 shows an assembled IR-lamp mounted to a frame.
Fig. 17

Assembled IR lamp with 3D-printed mount attached to a frame using standard GoPro-clamps.

Assembled IR lamp with 3D-printed mount attached to a frame using standard GoPro-clamps. Major assembly steps are: Soldering all parts to the PCBs ‘IR-lampV31′ and ‘IR-lampV32′. Glueing optical lenses to the PCB ‘IR-lampV31′ (optional). Assembling the PCB ‘IR-lampV32′ to the aluminium mount with spacers. Assembling the PCB ‘IR-lampV31′ to the aluminium mount with respect to the polarity of LED+ and LED- connectors, heat conducting paste can be used. Assembling the mount with its devices to the front flange of the enclosure. Tailor the the electrical connection at the backside plate to your needs and connect the power to J1 at the PCBs ‘IR-lampV32’.

PCB IR lamp under server/camera control

In our standard applications we control the lamps by ambient light sensors. For a remote control by server/cameras the cable setup is different and another cable type is needed. It either has two more wires for the lamp control, e.g. a underwater data cable with shielded 5 × twisted pairs (Table 13, Item 1) or one twisted pair with a greater cross-sectional area for power supply (Table 13, Item 2). It this case, the power supply is connected via the thicker twisted pair and the remaining twisted pair can be used for the two control lines.
Table 13

Cable types for server/camera remote operation of the lamps.

ItemNo.DescriptionDistributor / CodeManufacturer / CodePrice/€
1100 mHelukabel 21037 Datenkabel LiYCY 5 × 2 × 0.25 mm2 Grauwww.conrad.de1931447 – 62AVX SMD MLCC X7R 12061C225KAT2A144.04
21 mSubConn PUR Cable P3TSP22#/1TSP18#www.bornhoeft.deP3TSP22#/1TSP18#SubConn PUR Cable P3TSP22#/1TSP18#
Cable types for server/camera remote operation of the lamps. For the remote control setup, the four twisted pairs for Ethernet are connected as described in Table 9. The two wires of the remaining twisted cable pair are connected to the lamp control outputs at J2 on PCB ‘IRserverV11′. Each of these wires can control a group up to six lamps. Therefore, the power-in-wires and the lamp control output wires are soldered to a 4-pin socket ordered as shown for JP2 in Table 7. This 4 pin-socket is connected to J2 on PCB ‘IRServerV11′ in the correct orientation. And, as in the standard setup, the 2-pin header JP4 is connected via a 2-wire line with pin-sockets to the power pins of the Raspberry Pi (GPIO jumper pins #2 (+5V) and #6 (GND)). Fig. 18 shows a wiring diagram.
Fig. 18

Wiring diagram for the remote lamp control in a surface unit.

Wiring diagram for the remote lamp control in a surface unit. In the surface unit, the control wires from the IR server/camera cable are connected to the control wire of cable to the lamps they should control. Two groups of lamps (‘Lamp control 1′ or ‘Lamp control 2) can be controlled by one server/camera. They are controlled by the GPIO Pins GPIO13 and GPIO21. It can be done by simple bash scripts, which can be accessed in the webservers scheduler or other LinuxOS scheduler (e.g. crontab). For the remote control setup also the IR lamp wiring is modified. At first, the ambient light sensor is removed. The control signal wire (Table 12) from the underwater cable is soldered to a 3-pin socket at pin #2, while pin #1 and pin #3 are not connected. This 3-pin socket is connected to J2 at the PCB ‘IR- lampV32′ (Fig. 16, right). As in standard configuration, the two power wires are soldered to a 2-pin socket, which is connected to J1 (see Fig. 17, Fig. 18).

Software

The server/camera uses a Linux Debian OS without graphical XServer. The open source software RPi-Cam-Control [10], [11], provide a webserver which gives access to settings for camera and motion detection, as well as to basic system settings, like restart, power down or user defined functions (Fig. 19). Additionally, a live video stream and a comfortable scheduler are available, that can also start user defined scripts. A full documentation can be found at [12]. All software is packed as .iso image.
Fig. 19

Screenshot of RPi-Cam-Control-Webfrontend on a mobile device.

Screenshot of RPi-Cam-Control-Webfrontend on a mobile device.

Setup the SD card image and access the server

The software for the server/camera is pre installed on the image file, that can be written to the SD-card using command “dd” under a LinuxOS or using the software Rufus () under WinOS. This SD-card has to be inserted into the Raspberry Pi before powering the server/camera. Two network connections are predefined, which can be modified after the first connection: Ethernet connection: Static IP Adress: 192.168.178.6 Gateway 192.168.178.1 Wifi Connection: SSID: NKServer, Password: 3790 0606 0721 2004 9114 with DHCP enabled The predefined connections were configured with the network command line interface “nmcli”. Both make it easy to install the cameras immediately on any FritzBox either directly wired or via Wifi, when the Wifi connection of the router is setup as predefined in the server/camera above. For a login the following credentials are valid: Hostname: IRServer3 User: pi Password: irserver Static IP: 192.168.178.6 The server/camera is remote accessible via three protocols at its IP address: via HTTP through the webserver interface, via SSH connection to the Linux OS or via SCP for file or video transfer from the camera to the remote system.

Use case with remote access via surface unit

In our specific use case, we wanted to improve fish pots for cod (Gadus morhua, L. 1758), especially the design of the pot entrance. Therefore, we needed a video surveillance system to observe cod behaviour in relation to different entrance designs – during day and night for several months. The requirements were: observation at day and night minimum observation range: 2 m video data storage for several months fast swappable data disk motion detection remotely accessible webserver with live stream In this use case the fish traps are located in shallow water (below 10 m depth) but we use the system also for applications in deeper waters (see specifications). A combination of two iFO systems is installed in the field (each with one camera and two IR-lamps). Both connected to an LTE router (FritzBox6890) with a swappable network attached storage (NAS) hard disk (Fig. 20).
Fig. 20

System overview of the remotely accessible system in the field.

System overview of the remotely accessible system in the field. This allows continuous video data storage for several weeks and delivers full remote access via VPN and LTE to the underwater iFO systems. They are remotely accessible for live video streams, setup and administration, for video file downloads and maintenance (see Fig. 21, Fig. 22).
Fig. 21

Daytime and nighttime video stills at the entrance of fish pots.

Fig. 22

Surface unit of system in the field with LTE-router (FritzBox, NAS, plugs and wires; lid opened).

Daytime and nighttime video stills at the entrance of fish pots. Surface unit of system in the field with LTE-router (FritzBox, NAS, plugs and wires; lid opened).

Summary and outlook

In this document, we present iFO, an open source low-budget underwater infrared video observation system with full documentation and sources to easily reproduce this. We briefly outlined one typical field of application, but we also use this system for other observation tasks, e.g. in fish tanks and off-shore. Of course, the system can be used in other environments and purposes as well: e.g. in harsh environments with the current underwater enclosures or in other environments with adapted ones. As a next step, we will derive a practical method from this work to estimate the underwater range of vision for infrared camera and light systems in general.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Hardware nameiFO- infrared Fish Observation

Subject area

Biological Sciences (Marine and Fishery research)

Educational Tools and Open Source Alternatives to Existing Infrastructure

Hardware type

Underwater imaging tools

Field measurements and sensors

Electrical engineering and computer science

Open source licenseSoftware: MITHardware: SHL-2.0
Cost of hardware1 × camera = 220 € (100 m depth rated housing),2 × infrared lamps = 2 × 155 € = 310 € (100 m depth rated housing)
Source file repositoryhttps://doi.org/10.17605/osf.io/9xuz2
Project repositoryhttps://doi.org/10.17605/osf.io/tckpg
  5 in total

1.  Escape responses in juvenile Atlantic cod Gadus morhua L.: the effects of turbidity and predator speed.

Authors:  Justin J Meager; Paolo Domenici; Alex Shingles; Anne Christine Utne-Palm
Journal:  J Exp Biol       Date:  2006-10       Impact factor: 3.312

2.  Optical Constants of Water in the 200-nm to 200-microm Wavelength Region.

Authors:  G M Hale; M R Querry
Journal:  Appl Opt       Date:  1973-03-01       Impact factor: 1.980

3.  Affordable remote monitoring of plant growth in facilities using Raspberry Pi computers.

Authors:  Brandin Grindstaff; Makenzie E Mabry; Paul D Blischak; Micheal Quinn; J Chris Pires
Journal:  Appl Plant Sci       Date:  2019-08-12       Impact factor: 1.936

4.  Sensitivity differences in fish offer near-infrared vision as an adaptable evolutionary trait.

Authors:  Denis Shcherbakov; Alexandra Knörzer; Svenja Espenhahn; Reinhard Hilbig; Ulrich Haas; Martin Blum
Journal:  PLoS One       Date:  2013-05-15       Impact factor: 3.240

5.  Behavioural responses of krill and cod to artificial light in laboratory experiments.

Authors:  A C Utne-Palm; M Breen; S Løkkeborg; O-B Humborstad
Journal:  PLoS One       Date:  2018-01-25       Impact factor: 3.240

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.