- How to start and shutdown the system
- infoceanus command screen
- Communication specification
- Troubleshooting
- iPad application startup problems
- AIS data display issues
- Display problems of visible light cameras
- Sensor data display issues
- Display problem for object recognition
- Own ship icon display problem
- Map display issues
- Annotation icon display issue
- Compass animation display issue
- Problems with recording function
How to start and shutdown the system
How to start the system
Boot the system using the following steps.
-
An Internet connection is required to start the Edge server. Before starting the system, please make sure that you can connect to the Internet.
-
Start the uninterruptible power supply (UPS).
Press the power button on the front operation panel shown below.
Power button
-
Power on the edge server.
Press the power button inside the front door of the edge server. (The button to the left of the power button is the restart button)
Power button
How to shutdown the system
This system is always running, but when it needs to be shut down, follow the steps below to shut it down.
-
Shutdown the edge server OS.
Click the power icon at the top right of the edge server screen and select “Power Off/Logout”. Furthermore, click “Power Off…” to start the shutdown.
The above steps are performed from the edge server screen, but shutting down can also be started automatically by pressing the edge server’s power button.
-
After the edge server has been shutdown, press the power button on the uninterruptible power supply (UPS) to turn it off.
infoceanus command screen
How to start and close the application
The infoceanus command application is installed on the iPad terminal. Tap the icon shown below (touch the screen lightly with your finger and quickly release it) to start the application.
The map view is displayed when the application starts. The camera image is displayed in the picture-in at the top right of the screen, so tap this to switch to camera view. Also, in camera view, a map icon is displayed at the bottom right of the screen, so tap this to switch to the map menu.
In the map view example above, the Electronic Nautical Chart (ENC) is displayed, but displaying the ENC is optional. Usually a simple map is displayed.
To close the application, swipe your finger upwards from the outer frame at the bottom of the iPad screen and release your finger when the screen becomes smaller. (It will look like the screen below) Next, swipe the reduced application screen up again to remove it from the screen.
(Please refer to section 2.3.1 for swiping instructions)
swipe
=== How to login and logout
The application has a login function. You do not need to log in to use only the normal display functions, but please note that there are some functions that cannot be performed without logging in.
==== How to login
Tap the person-shaped icon
at the top left of the screen.
The login screen will be displayed, so tap on the word "Login".
When you tap the words "Select User" on the user selection screen, a list of registered users will be displayed, so select the user to log in.
Enter the PIN number of the selected user.
==== How to logout
Tap the person-shaped icon
Tap the words "Log Out / Switch User".
=== Map view screen and functions
==== Map display operations
The displayed map can be operated in the following ways.
目的 操作方法 Zoom in on the map
Pinch out the area you want to zoom in with two fingers.
Place two fingers on the screen and spread them apart.
Zoom out on the map
Pinch in with two fingers the area you want to zoom out.
Place two fingers on the screen and move them closer together.
Moving the map
Swipe in the direction you want the map to move.
Sweep your finger across the screen by moving it up, down, left or right.
Rotate the map
Rotate the map by pinching it with two fingers.
Place two fingers on the screen and rotate them.
Center on own ship’s position
Tap the icon at the bottom right of the screen.
Course up display
Tap the icon at the bottom right of the screen.
North up display
Tap the icon at the bottom right of the screen.
==== Map icon
Own ship icon
Own ship is displayed on the map with a blue arrow icon. The direction of the arrow is toward the bow.
Other ship icon
Other ships are displayed as pentagonal icons, and the direction with the sharp corner is the direction of the ship’s bow. Receive AIS information and display it on the map.
The color definitions of other ship icons are as follows.
Color Type of ship Yellow green
Cargo Vessels
Red
Tankers
Blue
Passenger Vessels
Yellow
High Speed Craft
Light blue
Tug & Special Craft
Orange
Fishing
Pink
Pleasure Craft
Gray
Unspecified Ships
Displaying AIS information
If you tap the icon of another ship, information about that ship will be displayed.
DIST (distance from own ship to the selected ship) and SPD (speed of the selected ship) are displayed, and if the AIS information includes CPA (closest point of approach) and BRG (collimation azimuth), that information is also displayed.
Furthermore, by tapping the displayed list, more detailed information about the selected vessel will be displayed on the screen.
Annotation function
Individuals can paste annotation icon on the map. You will need to log in to use this annotation feature, as it will show who created it. You can write comments on the annotations you create, and the icon can be changed depending on the type.
Touch and hold your finger where you want to create the annotation icon.
The annotation screen will be displayed on the screen, so select the sea speak categories.
Select from eight categories: Instruction, Question, Information, Intent, Advice, Request, Answer, and Warning.
When you select a sea speak categories, the comment input screen will appear, so enter your comment. Also, select the sharing and display duration, and press the post button to create the annotation.
Sharing Content Myself Only
The annotation icon you create will only be displayed on your screen.
This Vessel Crew
The created annotation icon will also be displayed on the screens of other users on the same ship.
My Company
The annotation icon you created will be displayed on the screen of all users in the company you belong to.
Public
The annotation icon you created will be displayed on the screen of all users (including users of other companies) using infoceanus command.
Select the display duration from 5h, 12h, 24h, forever, or custom settings.
Custom settings can be specified by year, month, and day.
If you want to delete an annotation icon, tap the annotation icon on the screen and a delete button will appear. Press the delete button to delete it. However, you cannot delete annotation icons created by other users.
Pull-up screen
A pull-up screen is hidden at the bottom of the application screen. Swipe up on this to display the following function screen.
Swipe
Navigation screen
The navigation screen displays information about your own ship. Numerical information includes wind direction and wind speed (true/relative), own ship’s coordinates (latitude and longitude), heading, and ship speed relative to the ground. In addition, an animated compass is displayed, and the wind direction (true/relative) and course direction are displayed as icons. (The heading will be fixed upwards)
The direction of the pointed end is the direction.
T： Ture wind direction
R： Relative wind direction
C： Course
(direction of movement)
Recording screen
You must be logged in to operate this screen.
Record button
Press once to start recording for that camera, press again to stop recording.
While recording, the current recording time will be displayed to the right of the button.
All record button
Start and stop recording for all cameras.
Download button
You can download the recorded data file saved on the edge server to your iPad and play the recorded data.
Upload button
Upload recorded data to cloud storage. This allows you to view recorded data from land. (Storage size on the cloud is limited to a maximum of 500GB)
Delete button
Delete recorded data from the edge server.
-
Camera switching screen
Switch the displayed camera image. By using this function in map view, you can switch the picture-in camera image displayed at the top right of the screen. The currently displayed camera is displayed in green.
-
CPA setting screen
Set DCPA and TCPA values.
By turning on the DCPA Alerts and TCPA Alerts switches, you can set the values.
After changing the settings, press the ‘Apply Settings’ button to confirm the settings.
Camera view screen and function
Bounding box display
A rectangular bounding box will be displayed on ships and navigation buoys recognized by AI from camera images. If the type is a buoy, a triangle mark will be displayed.
Bounding box will be displayed for objects other than buoys.
Buoys are marked with a triangle.
The following types of object are recognized.
Type of recognized object
| Type | Remarks |
|---|---|
Vessel |
Cargo, Tanker, Bulk carrier, etc. |
Passenger Vessel |
Passenger |
Boat |
Small ship such as pleasure boart, yachts, canoes, etc. |
Navigation Buoy |
Navigation buoy in the shape of a triangle. |
Fishing Buoy |
Fishing buoy with round type or flag. |
Fishers Facility |
Fishers facility such as rafts. |
By tapping the bounding box of these recognized objects, you can display their detailed contents. The displayed information includes the type, distance, speed, and direction of movement of the recognized object.
The distance is calculated from the position of the image where the object is recognized. The speed is relative speed as seen from the own ship, and the direction of movement is indicated by an arrow, which is also the relative direction of movement.
Additionally, when this object recognition data and AIS data match, the AIS ship name will be displayed as shown below, and if the CPA setting is enabled, the TCPA and DCPA values will also be displayed. Bearing angle BRG indicates the relative direction from own ship to the object.
Switching camera images
In camera view, the icon shown below is always displayed at the bottom left of the screen. The triangle icon represents the bow, 1 means port camera, 2 means center camera, and 3 means starboard side camera. The currently displayed camera image is displayed in green. By tapping the icon representing this camera, you can switch to the video from each camera.
AIS information display
The following icons are always displayed on the right edge of the camera view screen. By tapping AIS on this icon, a list of AIS that your ship is receiving will be displayed on the camera view.
You can also scroll the AIS list by swiping up or down.
If you want to check the details of a vessel displayed in the AIS list, tap once on the list of vessels you want to check to select it, then tap again to display the AIS information on the right side of the screen.
If an alert has been set using the CPA settings, the AIS list of vessels that will receive an alert based on the conditions will be displayed in red to alert you.
Layer display
You can turn on/off the information displayed on the camera view screen. The types of information are as follows.
-
Horizon+
Displays the AIS information of ships in that direction on the horizon of the camera image as an icon, and turns it ON/OFF.
-
Vessel
Turn on/off the bounding box display of ships recognized by AI.
-
Buoy
Turn on/off the icon display of buoys that AI has recognized as objects.
This operation can be performed using the layer button on the right side of the screen. When you tap the layer icon shown below, a sub-screen will appear where you can perform ON/OFF operations.
Vessel
Horizon+
Image adjustment function
The image adjustment function allows the user to adjust the camera image. There are two types of functions.
-
Defogging
When visibility is poor due to mist or fog, turning on Defogging will make the camera image clearer.
-
Brilliance
You can adjust the brightness of the image at night in 5 levels. Normally, the AI mode is set and the brightness is adjusted automatically, but you can change the brightness level manually.
AI mode is recommended during daytime use.
The Brilliance setting is 0% dark and 100% bright.
If you select AI, the brightness will be adjusted automatically.
Communication specification
Information on objects recognized by infoceanus command can be sent to the outside via the network from the application in the edge server.
The communication algorism uses HTTP RESTful API, and webhooks are used to receive detection results.
-
Register the webhook endpoint URL that receives data recognized by the edge server in the edge server application.
-
The edge server periodically posts detection results in JSON format to the webhook endpoint URL.
Edge Server
Application
External Application
-
Register the webhook endpoint URL
JSON
Webhook endpoint URL for receiving results
-
Continuously posts detection results to the registered webhook endpoint URL.
Initial registration process
How to register a webhook endpoint URL
The edge server will continue to POST (output) detection results from the time you register the webhook endpoint URL.
Note:
If the edge server is stopped due to rebooting, etc., the record of the registered webhook endpoint URL will be lost, so you will need to register it again.
| Item | Value |
|---|---|
Edge Server IP address |
192.168.5.10 (temporary) |
Connection port number |
5888 |
Endpoint URL |
-
‘name’ in the endpoint URL above is the registered name of the endpoint. When registering multiple endpoints, make sure that the registered names do not overlap. Also, the name must be the same as the content written in the registration BODY on the next page.
To register the webhook endpoint URL, PUT the following content.
PUT
Header is ”Content-Type” “application/json”
The BODY of the PUT command is as follows.
\{
"name": "name",
"properties":
\{
"topicName": "ObjectDetectionTopic",
"eventDeliverySchema": "CustomEventSchema",
"retryPolicy":
\{
"eventExpiryInMinutes": 120,
"maxDeliveryAttempts": 30
},
"persistencePolicy": \{
"isPersisted": “false”
},
"destination":
\{
"endpointType": "WebHook",
"properties":
\{
"endpointUrl": "http://{your-url}",
"maxEventsPerBatch": 10,
"preferredBatchSizeInKilobytes": 1033
}
}
}
}
Please use the same registered name
Please enter the webhook endpoint URL to output the detection results here.
Detection results
Contents of detection results
The detection results will be posted in JSON format to the registered webhook endpoint URL.
For example：
\{
"frame_id": "001078",
"inference_time": 1.05351,
"bboxes": [
\{
"location": [
447,
706,
590,
138
],
"class_name": "Vessel",
"class_id": 0,
"score": 0.5651599764823914,
"course_angle": -1.5833088695182274,
"object_id": 11,
"distance": 306.0867636429704,
"angle": 0.029405518541549186,
"angle_to_object": 1.6848121068244561,
"length": 87.83195089404641,
"size": "large",
"speeds": 40,
"object_gps_coordinates": [
33.97075991841673,
130.9717999958437
]
}
],
"timestamp": "2023-04-07T12:14:01.752Z",
"payload_per_second": 0.78,
"gyro_true_heading": 158.6,
"vessel_gps_coordinates": [
33.973371666666665,
130.97067666666666
],
"height": 1080,
"width": 1920,
"source": "udp://239.0.0.3:9556",
"model_id": "Combined_Model",
"stream_id": "GigEStarboardCamZero",
"ais_object": [],
"v_avg": 109.18871865354939,
"horizon_coord": [
0,
1919,
1074,
1074,
"succeeded",
"day"
]
}
Multiple pieces of information about the detected objects are listed in “bboxes”:[] separated by \{ }.
-
In the example on the left, there is only one detected object.
Detection result details
Detected object information : bboxes[ ]
| Item | Value |
|---|---|
location[x, y, w, h] |
Position of detected object in image. x : X coordinate of center of Bounding box (Pixel) y : Y coordinate of center of Bounding box (Pixel) w : Bounding box width (Pixel) h : Bounding box height (Pixel) |
class_name |
Detected object class name (*1) |
class_id |
Number of class (*1) |
score |
Confidence score on detection |
course_angle |
Direction of movement of detected object (Angle relative to camera orientation : radian) |
object_id |
Identification number of detected object |
distance |
Distance to detected object (m) |
Angle_to_object |
Direction in which the detected object was captured (Direction relative to camera orientation: positive on the right, negative on the left : degree) |
length |
Length of object to be detected (m) |
size |
Size of detected object (Less than 10m：small, 10 to Less than 50m：medium, Over 50m：large) |
speeds |
Speed of detected object (km/h) |
object_gps_coordinates[Lat, Long] |
Coordinates of detected object （Lat : Latitude, Long：Longitude） |
(*1) Definition Class id and Class name
| class_id | class_name |
|---|---|
0 |
Vessel |
1 |
Fishing_Buoy |
2 |
Navigation_Buoy |
3 |
Passenger_Vessel |
4 |
Boat |
5 |
Fishers_Facility |
Other informations
| Item | Value |
|---|---|
timestamp |
Detection date and time (UTC) |
payload_per_second |
Number of processes per second |
gyro_true_heading |
Heading direction (true direction) |
vessel_gps_coordinates[Lat, Long] |
Own ship coordinates （Lat : Latitude, Long：Longitude） |
height |
Image height (pixels) |
width |
Image width (pixels) |
source |
Multicast address to receive camera images |
model_id |
ML model name |
stream_id |
Camera name of detected video (*2) |
ais_object[ ] |
AIS Information Enter multiple pieces of AIS information received at the same time. (There may be cases where there is no description as in this example) |
v_arg |
Indicates the brightness level of the image (0-255) |
(*2) Definition camera name
| カメラの場所 | stream_id |
|---|---|
Port camera |
GigEPortCamOne |
Center camera |
GigECenterCam |
Starboard camera |
GigEStarboardCamZero |
Troubleshooting
iPad application startup problems
| Trouble event | Assumed cause | Workaround |
|---|---|---|
iPad applications do not start. |
The version of the iPad application is outdated. |
If the version of the iPad application is old, there may be problems communicating with the edge server and the application may not start. Please check the current version and contact JRCS. |
The iPad application starts, but nothing is displayed. |
iPad is not connected to the network. |
Please check your iPad’s Wi-Fi settings. Open the iPad settings screen and check that the Wi-Fi you are connecting to is "JRCS WiFi AP" in the Wi-Fi item. If not, please connect to "JRCS WiFi AP". |
The Wi-Fi access point is in an abnormal state. |
Please disconnect and reconnect the LAN cable connected to the Wi-Fi access point. When the Wi-Fi access point’s lamp lights up in green, startup is complete, so try starting the application on your iPad after that. |
|
The iPad application is in an abnormal state. |
Please restart the iPad application. |
|
The software on the edge server is not starting. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
AIS data display issues
| Trouble event | Assumed cause | Workaround |
|---|---|---|
AIS information is not displayed. |
There is a connection failure in the cable receiving the AIS signal. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
AIS signal is not output. |
Please check whether AIS data is included in the data sent from VDR. |
|
The object recognition software in the edge server is stopped. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
Display problems of visible light cameras
| Trouble event | Assumed cause | Workaround |
|---|---|---|
可視光カメラ映像が表示されない。 |
There is a poor connection between the visible light camera and the edge server. |
Please check if there is a connection failure between the LAN cable of the visible light camera connected to the PoE HUB (10port) and the LAN cable of the edge server. |
The visible light camera and edge server are unable to communicate. |
Please restart the visible light camera. Please disconnect and reconnect the LAN cables connected to ports 6, 7, and 8 of PoE HUB (10port). The left lamp of each port blinks orange, and the right lamp lights green. |
|
The software on the edge server is in an abnormal state. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
The image from the visible light camera was displayed, but the image stopped. |
The iPad application can no longer receive video. |
Please switch the visible light camera image on iPad application. |
If the above changes do not resolve the issue, please restart the iPad application. |
||
Visible light camera images are displayed with a delay. |
The processing load on the iPad is high. |
Please restart the iPad application. |
The image from the visible light camera moves back and forth on the time axis or contains noise. |
Wi-Fi communication load is high. |
Close the iPad application and reconnect the Wi-Fi connection (turn it OFF and then ON) on the iPad settings screen. Then, start the application on your iPad. |
Sensor data display issues
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Wind direction and wind speed data are not displayed. |
There is a poor connection in the cable receiving the signal from the anemometer. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
Data from the wind direction and speed meter cannot be received. |
Please confirm that the NMEA data ($XXMWV) of the anemometer is being output. *It will not be displayed if the ship does not have a wind direction and speed meter. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
True wind direction and true wind speed data are not displayed. |
Anemometer problem. |
True wind direction and true wind speed are calculated and output by an anemometer. There are wind direction and speed meters that only output relative wind direction and speed, so please check the specifications. |
Latitude and longitude data are not displayed. Ship speed data is not displayed. |
There is a poor connection in the cable receiving the signal from GNSS. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
Data from GNSS cannot be received. |
Please confirm that the NMEA data ($XXGGA) of the GNSS is being output. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
Display problem for object recognition
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Unable to recognize objects. (Bounding boxes are not displayed on ships that can be recognized in visible light camera images) |
The object recognition software in the edge server is stopped. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
Own ship icon display problem
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Own ship is not displayed on the map. Own ship’s icon does not move. |
The map display is shifted from the own ship’s position. |
Tap the arrow icon at the bottom right of the screen. |
Data from GNSS cannot be received. |
Please confirm that the NMEA data ($XXGGA) of the GNSS is being output. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
The bow of own ship is always facing north. |
Data from the GYRO sensor cannot be received. |
Please confirm that the NMEA data ($XXHDT) of the GYRO sensor is output. |
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
Map display issues
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Map is not displayed. |
The map software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
The map software license has expired. (When using ENC for the map) |
You will need to purchase a map software license. Please contact JRCS. |
Annotation icon display issue
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Annotation icons are not displayed on the map. |
You do not have permission to display labeling icons. |
Please log in as a user who has permission to display labeling icons. |
Unable to create annotation icon. |
You do not have permission to create labeling icons. |
Please log in as a user who has permission to create labeling icons. |
Unable to delete annotation icon. |
You do not have permission to delete labeling icons. |
Labeling icons can only be deleted by the user who created them. Please log in as the user who created the labeling icon. |
Compass animation display issue
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Compass ring is not working. |
There is a connection failure in the cable receiving the signal from the GYRO sensor. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
Data from the GYRO sensor cannot be received. |
Please confirm that the NMEA data ($XXHDT) of the GYRO sensor is output. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
The C icon (course) is displayed in gray. |
There is a poor connection in the cable receiving the signal from the GNSS sensor. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
Data cannot be received from the GNSS sensor. |
Please confirm that the NMEA data ($XXGGA) of the GNSS is being output. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
The T icon (true wind direction) is displayed in gray. |
There is a poor connection in the cable receiving the signal from the anemometer. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
The anemometer is not designed to output true wind direction and true wind speed. |
True wind direction and true wind speed are calculated and output by an anemometer. There are wind direction and speed meters that only output relative wind direction and speed, so please check the specifications. |
|
Data from the wind direction and speed meter cannot be received. |
Please confirm that the NMEA data ($XXMWV) of the anemometer is being output. *It will not be displayed if the ship does not have a wind direction and speed meter. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
|
The R icon (relative wind direction) is displayed in gray. |
There is a poor connection in the cable receiving the signal from the anemometer. |
Please check that the LAN cable of the VDR connected to the PoE HUB (5port) and the LAN cable of the edge server are not disconnected. |
Data from the wind direction and speed meter cannot be received. |
Please confirm that the NMEA data ($XXMWV) of the anemometer is being output. *It will not be displayed if the ship does not have a wind direction and speed meter. |
|
The sensor software in the edge server is down. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |
Problems with recording function
| Trouble event | Assumed cause | Workaround |
|---|---|---|
Recording fails. |
The disk size for saving recorded data is full. |
Display the list of recorded data and delete past recorded data to free up disk space. |
The recording software in the edge server is stopped. |
Please restart the edge server. The Edge Server must be connected to the Internet when it starts. Please check the internet connection environment (VSAT etc.) and restart the edge server. |