Background

The Japanese government has put forth its "Space Industry Vision 2030" in hopes of expanding applicability beyond the space equipment industry to other relevant industries as well, with the aim of fast-paced doubling of the overall space industry's size by 2030. Amidst these circumstances, the Ministry of Economy, Trade and Industry launched Japan’s first satellite data platform “Tellus” intended for industry use on February 21, 2019. Tellus facilitates the use of traditionally difficult-to-handle satellite data by everyone from private companies, universities and research institutions through to individuals while also aiding in the creation of businesses in a broad range of industries and business categories made possible with this free access to space data.

The Tellus Satellite Challenge is a data analysis contest aimed at promoting the use of Tellus, namely in the form of producing a visual representation of satellite data use case models, uncovering outstanding human resources specializing in data analysis, and disseminating information and educating others on the types of satellite data and its various formats. This is the 4th time the event has been held.

The theme of this fourth event is the “Coastline extraction using SAR data.”

As an island nation surrounded by oceans, Japan holds a coast line which nearly has 35,000km in total extension. This is the 6th length in the world, and the 2nd after Philippines for the coast length per land area. Also, it is said that the total beach area in Japan is now 19,000ha, but coastal erosion continues on some coasts after the disappearance of about 13%( which is about 2,400ha) of the coast in the 15 years after 1978. If most of the beaches disappears, the reproduction will be a huge cost.

A coast plays an important role in storm surges and tsunami disaster prevention, by weakening the power of the wave. Also, it will affect the plants & animals that use the coast as a habitat. The serious coast erosion in all over the country occurs when the normal supply cycle of the sand collapse. It is caused due to disasters like earthquakes and typhoons, the change of directions of waves and wind due to the change of the weather, sea level rise due to global warming, and due to human factors like port improvement or dam constructions.

Now, the Japanese government is monitoring all of the coast in the nation by a satellite, to study to discover the signs of beach erosion as soon as possible, and prevent it before it gets too late. By using a satellite, it is possible to monitor a wide range of the coast area with high frequency. But the reality is, that a special skill is required to find out the coast area from the observed data. Therefore, in this challenge, we will like to develop an algorithm that can extract a coast line in a high accuracy from a SAR data.

We will use the observed data of PALSAR-2, loaded on the Advanced Land Observing Satellite “ALOS-2” which is for part of the coast in Japan. PALSAR-2 is a sensor called Synthetic aperture radar (SAR) that irradiates a radio wave to the ground surface and gains the information by the reflected radio wave from the ground surface. The feature of the SAR is that it can record the surface day or night, and also regardless of the weather. Check here for details.


Task Description

Extract the coastline from the L-band SAR data.


Data Description

L-band SAR image

    Satellite: ALOS-2 (JAXA)
    Size: 600×600~10000×10000 (Depends on the image)
    resolution: 3m × 3m
    HH polarization, wavelength: About 24 cm
    Number of coasts: 17
    Number of images: 55 images, (Train) 25 images、(Test) 30 images

*Polarization is one indicator of the properties of radio waves and indicates the direction of vibration of an electric field. HH transmits horizontally polarized waves and receives horizontally polarized waves.

Annotation
    Format:JSON


Reference 

 This article summarizes reference papers  regarding coastline extraction.
 https://sorabatake.jp/14130/

Evaluation method

We will evaluate by calculating the error from the actual coast line and the evaluation line, lined vertical from the evaluation point assigned to actual coast line.

 ① For one scene, detect the tangent point in pixel level (● in the picture)  where the extracted coast line and evaluation line overlapped.
 ② Defining the distance from the evaluation point (● n the picture) to the tangent point detected in ① as an error, calculate the error for each evaluation line.
  - In case detecting the tangent point from an evaluation line fails (extraction failure),the maximum value of the length of one side (land side or ocean side) of the whole evaluation line in that scene, will be calculated as an error.
  - In case several tangent points are detected from an evaluation line, the farthest tangent point from the evaluation point on this evaluation line will be adopted to calculate the error.
 ③ Calculate the average value of ② for all evaluation line.
 ④ Calculate the average of ③ of all of the scene in the evaluation target.


    * The number of the evaluation line depends on the image.
    * For information of the formats and terms of the submitting file, check the readme.txt


Determining Winners

1. The final ranking will be determined using evaluation values based on a correct data set that differs from that used during the contest. Score board rankings and scores will automatically change to a final evaluation when the contest ends.
2. In the event of a tie, the participant that submitted their entry first will be declared the higher ranking contestant.
3. Participants on top of the final rankings chart will be contacted by the secretariat as winner candidates.
4. Winner candidates will be required to submit the following on the condition that the submitting party guarantees that the secretariat shall bear no financial burden for such, and shall not be considered to have infringed on any rights.
 ・Source code for model (or the equivalent of such)
 ・Learning-complete model
 ・Procedure description document enabling reproduction of the prediction process (must clearly explain preprocessing, learning, and prediction processes) The source (include details as to the location of the data, links to pertinent theses, etc.) of any data other than the submitted data, learning-complete models, APIs, etc., if used 
 ・Computer/equipment operating environment information, including OS version, software utilized and analysis methods
 ・Random number seed (if Random Forest or similar was used to generate random numbers)
 ・Degree of model contribution for all explanatory variables (when using a method that enables calculation of degree of prediction)
 ・Insights gained through data interpretation, manipulation and modeling
5. Winner candidates will be disqualified should any of the following apply to the winner candidates, or their submitted models, during the reproducibility verification period.
 ・The contestant does not respond within the specified timeframe to contact from, or a request/demand from, the contest administrative office regarding contest-related procedures
 ・The contestant fails to adhere to participant requirements, rules, etc.
 ・The model's prediction results cannot be reproduced
 ・Predictions cannot be made when using new data
 ・Any other reason for which the secretariat deems the candidate unworthy of winning the contest
6. Winners will be selected from candidates for which reproducibility can be verified.


SIGNATE Ranking
・ This competition is subject to SIGNATE rankings (scores and medals).

Contestant Attitude
・We ask that all contestants strive to achieve practical, useful approaches with top priority placed on achieving corporate goals, helping to solve social problems, sharing research results with the public, and other overarching goals.

System Usage
・The maximum number of submission per day is five.
Each person is limited to one account only. Using several accounts with a single user or using a single account with several people is prohibited.
Persons wishing to participate as a team, read here, and  click the “Create Team” button to create a team.(Team creating deadline: 2020/9/30. Up to 5 people including the representative.)
・For the submitted file, the maximum number of pixel will be limited to 30000 for the predicted coast line. Files over 30000 will be an error.

Information handling
・When opening your own algorithm, idea and other materials that were made related to this competition to the public, by specifying that the material was made related to this competition, there will be no restriction.
・But, when opening to the public, specify (including links) that this will be opened in the forum of this competition, so all the participant can browse.

Data Usage
・Submission of manually labeled result data is prohibited.
・Pseudo-labeling evaluation data to use the evaluation data again for learning is prohibited.
・Rewriting of learning data labels and then using said data for model learning is allowed.
・Model learning and predicting using any data aside from that distributed to contestants is prohibited.
・Use of Google Cloud Vision API and other such APIs is prohibited. However, use of open-source learning-complete models, libraries and similar is allowed (source code publicly open and available to anyone, and not designed for commercial use; e.g., Tensorflow, Chainer, Keras, etc.). When using a learning-complete model, clearly cite the source using a hyperlink to relevant documentation or similar. 

Implementation Method
・Learning tools for models are limited to open-source, free tools (Python, R, etc.).
・Divide source code in three parts as shown below (preprocessing, learning and prediction), and carry out implementation for each.
        1. Preprocessing
            Module that reads supplied data, carries out preprocessing, and outputs each file in a format that can be input into the model. Divide into files for learning and files for evaluation ("get_train_data" and "get_test_data" or similar), and define a function for preprocessing. 
        2. Learning
            Module that reads files created in step 1 to enable model learning. Define a function that can output the learning-complete model, feature quantity importance level and cross validation assessment results.
        3. Prediction
            Module that reads the test data created in step 1 and model created in step 2 and outputs prediction results in file format.

Contest sponsor: Japanese Ministry of Economy, Trade and Industry (METI)
Support: SAKURA Internet Inc.
Present: Japan Aerospace eXploration Agency
Cooperation: National Institute for Land and Infrastructure Management

Disclosure policy

As a general rule, in accordance with Article 4, Paragraph 1 of the terms of participation, diclosing any contents such as insights and deliverables transmitted through the information or data provided by our company in relation to this competition is not permitted, however, only after the completion of this competition and for non-commercial purposes, it will be possible to disclose the contents within the score of the table below
Model *1
Public
Analysis results *2
Public
Public : Posting to social media sites, blogs and source repositories, and citing to papers
Restricted : Using in a limited range from research, education to seminars, where many unspecified people cannot access
*1 Execution unit source code and learned models
*2 The insights obtained using the information and data provided, or the solutions including scripts and processed data such as summary statistics

※Notes

・During the competition period, you can publish it on the forum of this competition.
・However, disclosure of the satellite data itself (including some images) is prohibited.
Q. There were missing data in some regions in each image for training and testing. How should I handle the labels of such regions?
A. Please assume that the labels do not exist.

【Additional Notes】
Use of ALOS-2 data:
When using ALOS-2 data, contestants must understand and adhere to the following.
(1) Regarding ALOS-2 data received from SIGNATE Inc., the intellectual property rights and all other rights for this data belong to the Japan Aerospace eXploration Agency (JAXA).
(2) Neither SIGNATE Inc. nor JAXA provides any guarantee regarding the quality of data supplied for this competition, and neither organization will take responsibility for results stemming from ALOS-2 data usage or for any damages incurred through use of said data.

【Matters to be updated】
(The provisions of paragraph 1 of Article 3 [Reward and Vesting of Rights] of the Terms below shall be amended as follows [including the surviving provisions].):
1. Unless otherwise provided for, any Participant shall satisfy the following requirements in order to be entitled to receive a reward in any Competition that offers a reward:
(1) To be a winner;
(2) To grant to the Host and its supporting companies (hereinafter referred to as the “Licensees”) a non-exclusive license without restriction as to term and territory and free of charge to use all rights necessary for modifying the Final Submissions and Submissions for Final Judgment for commercial or non-commercial purposes;
(3) To grant to the Licensees a non-exclusive license without restriction as to term and territory and free of charge to use all rights necessary for publishing and use, the Final Submissions and Submissions for Final Judgment and the Final Submissions and Submissions for Final Judgment as modified on the satellite data platform “Tellus” to be started to be provided in future (hereinafter referred to as “Tellus”) for commercial or non-commercial purposes, and for granting a sublicense to any contractor for the operation of Tellus and user of Tellus (together with the rights as prescribed in the preceding item, hereinafter collectively referred to as the “Rights”);
(4) To agree not to exercise moral rights to the Rights against the Licensees and their sub-licensees;
(5) To enter into agreements for the grant of license of the Rights with the Licensees including the consent to the preceding three (3) items and any other reasonable provisions;
(6) If the Host or any supporting company desires to receive an exclusive license or transfer of the rights contained in the Final Submissions and Submissions for Final Judgment, to accept the consultation about the agreement on such license or transfer;
(7) To have the personal identity of such Participant verified by the Company; and
(8) Not to breach any provision of these Terms and the Terms of Use.

(The provisions of Article 4 [Confidentiality] of the Terms below shall be amended as follows [including the surviving provisions].):
1. Any Participant shall treat any information and data that they receive from the Company in relation to each Competition (hereinafter referred to as the “Company-Provided Information”) as confidential information and shall not disclose the same to any third party and use the same for any purpose other than for such Competition and purpose specified by the Company separately; provided, however, that the confidential information shall not include any information that falls under any of the following items:
(1) Information that is known to the public at the time of the disclosure;
(2) Information that is already possessed by the Participant at the time of the disclosure (only in the case where such Participant may demonstrate such fact by reasonable means);
(3) Information that becomes known to the public without the fault of the Participant after the disclosure;
(4) Information that is independently developed by the Participant without reference to any information as disclosed; or
(5) Information that is rightfully disclosed by any third party having a right to do so without the obligations of confidentiality (only in the case where such Participant may demonstrate such fact by reasonable means).
2. Any Participant shall delete or return to the Company the Company-Provided Information immediately after the completion of each Competition.
3. If there is any separate arrangement in relation to the confidential information in each Competition, the provisions of such arrangement shall prevail over the provisions of these Terms.
4. If any dispute occurs between the Host or other third party and the Company due to the breach by any Participant of the provisions of this Article and such other party makes any claim against the Company, such Participant shall compensate for any damage, loss, expenses (including, but not limited to, attorneys’ fees), lost profits and lost revenues, etc. incurred by the Company.
5. The provisions of this Article shall survive the termination of the relevant Competition or the Participant’s completion of the procedures for withdrawal from the service of the Company, with respect to the Company-Provided Information and the Winner’s Final Submissions and Submissions for Final Judgment for a period of five (5) years thereafter.


In order to participate in the Competition, you are required to agree to these Terms, in addition to the Terms of Use of SIGNATE.JP Site (hereinafter referred to as the “Terms of Use”). You should participate in the Competition after reading carefully and agreeing to these Terms. If you agree, these Terms, the matters that are added to these Terms as "additional matters", the Terms of Use and other terms and conditions that you have agreed to shall be binding on the relevant parties as integral documents.


Article 1. Definitions

1.For the purpose of these Terms, the following terms shall be defined as follows:

(1)"Site" means the website "SIGNATE (https://signate.jp)” on which the Competitions are posted.
(2)"Competition" means any competition on AI development or data analysis on the Site as held by the Host.
(3)"Host" is the host(s) of the Competitions. The Host may be SIGNATE, Inc. (hereinafter referred to as the “Company”) or the Company’s client companies, affiliated companies, schools or organizations, etc. (hereinafter referred to as the “Client(s)”).
(4)"Participant(s)" means the member(s) who participate in a Competition.
(5)"Submissions" means, collectively, the analysis and prediction results and reports, etc. as submitted in the Competition.
(6)"Final Submissions" means the Submissions that are specified by a Participant on the prescribed page in the Site by the time of completion of a Competition.
(7)"Winner Candidate" means the Participant who has received a notice from the Company that he/she is nominated as a winner candidate.
(8)"Submissions for Final Judgment" means the analysis and prediction model and learning data, etc. as submitted by a Winner Candidate pursuant to the instructions of the Company.
(9)"Final Judgment" means the acceptance inspection and judgment, including reproducibility verification, by the Company for the Final Submissions and Submissions for Final Judgment of a Winner Candidate.
(10)"Winner" means the Winner Candidate who is informed by the Company that he/she has won a prize.
2.Unless otherwise defined in these Terms, the terms used in these Terms that are defined in the Terms of Use shall have the same meaning as defined in the Terms of Use.

Article 2. Competition

1.A member who desires to participate in a Competition shall be required to agree to these Terms and to satisfy the conditions for participation as specified in each such Competition. Any person who is not a member shall not participate in any Competition.
2.Participants shall participate in each Competition in the manner as advised by the Company and shall be obligated to comply with the rules as prescribed in each Competition.
3.Participants may submit the Submissions for the assignment of each Competition during the period of such Competition and submit a proposal on the method of solving the problem to the Host by the end of the period of the said Competition.
4.Participants may submit the Final Submissions in the form specified in each Competition by the time specified by the said Competition.
5.The Final Submissions as submitted shall be evaluated by the evaluation method as specified in each Competition and the final rank order shall be determined based on such evaluation.
6.Any Participant may, as a general rule, check the evaluation results of the Participant him/herself and each of the other Participants on the Site for the Submissions that may be evaluated quantitatively.
7.Participants shall be liable or otherwise responsible for their own Submissions, including their legality.
8.Participants shall not submit any Submissions that have no direct relationship to each Competition.
9.Unless otherwise provided for, Participants shall not directly communicate to, consult with, make a request to, solicit or take any other actions with the Host in respect of the matters related to a Competition during the period of the said Competition.
10.Any Participant who has uncertainty or questions about any Competition shall make sure to contact the Company or its designee through the procedures prescribed by the Company as posted on the Site.
11.The Company shall not be obligated to pay any remuneration or other consideration other than those prescribed in the following Article for any act of the Participants as prescribed in paragraphs hereof.

Article 3 Reward and Vesting of Rights

1.Unless otherwise provided for, any Participant shall satisfy the following requirements in order to be entitled to receive a reward in any Competition that offers a reward:

(1)To be a winner;
(2)To agree to transfer to the Host and the relevant transferee of rights in such Competition all transferable rights, such as copyrights, rights to obtain patents and know-how, etc. in and to all analysis and prediction results, reports, analysis and prediction model, algorithm, source code and documentations for the model reproducibility, etc., and the Submissions contained in the Final Submissions and Submissions for Final Judgment (including the rights as prescribed in Article 27 and Article 28 of the Copyright Act and the rights to obtain patents; hereinafter referred to as the "Rights");
(3)To agree that any relevant transferee of rights exclusively has the right to use the know-how contained in the Final Submissions and Submissions for Final Judgment for its own business and other purpose without any restriction;
(4)To agree not to exercise moral rights to the Rights against the relevant transferee of rights;
(5)To enter into an agreement for the transfer of the Rights with the relevant eligible transferee of rights, including the agreement to the matter in the preceding three (3) items and other reasonable provisions;
(6)To have the personal identity of such Participant verified by the Company.
(7)Not to breach any provision of these Terms and the Terms of Use.

2.Any Winner Candidate shall, after having received a notice from the Company that he/she is nominated as a winner candidate, submit the Submissions for Final Judgment on or before the designated date and communicate the matters requiring confirmation or response in relation to the Final Submissions and the Submissions for Final Judgment to the Company on or before the designated date, in accordance with the instructions of the Company. The Company shall carry out the final judgment based on such matters requiring confirmation or response. If the Company receives no confirmation or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the subject of the final judgment.
3.If the Company considers that the Final Submissions or Submissions for Final Judgment need to be amended or modified, or there occur any additional matters requiring confirmation, in the course of the final judgment, any Winner Candidate shall take action or make response in relation to the matters that require amendment, etc. or the detailed information on the matters requiring confirmation, on or before the designated date in accordance with the instructions of the Company. If the Company receives no action or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the final judgment.
4.The Company shall determine the Winner through the final judgment and inform the Winner to that effect.

Article 4 Confidentiality

1.Participants shall treat any information, data, or such contents as insights and deliverables transmitted through the service where they receive from the Company in relation to each Competition (hereinafter referred to as the "Company-Provided Information") as confidential information and shall not disclose the same to any third party and use the same for any purpose other than for such Competition and purpose specified by the Company separately; provided, however, that the confidential information shall not include any information that falls under any of the following items:

(1)Information that is known to the public at the time of the disclosure;
(2)Information that is already possessed by the Participant at the time of the disclosure (only in the case where such Participant may demonstrate such fact by reasonable means);
(3)Information that becomes known to the public without the fault of the Participant after the disclosure;
(4)Information that is independently developed by the Participant without reference to any information as disclosed (except for those Submissions of the person eligible for a prize which are evaluated); or
(5)Information that is rightfully disclosed by any third party having a right to do so without the obligations of confidentiality (only in the case where such Participant may demonstrate such fact by reasonable means).

2.Any Participant shall delete or return to the Company the Company-Provided Information immediately after the completion of each Competition.
3.Any Winner shall handle his/her Final Submissions and Submissions for Final Judgment in the same manner as prescribed in paragraph 1 hereof.
4.If there is any separate arrangement in relation to the confidential information in each Competition, the provisions of such arrangement shall prevail over the provisions of these Terms.
5.If any dispute occurs between the Host or other third party and the Company due to the breach by any Participant of the provisions of this Article and such other party makes any claim against the Company, such Participant shall compensate for any damage, loss, expenses (including, but not limited to, attorneys’ fees), lost profits and lost revenues, etc. incurred by the Company.
6.The provisions of this Article shall survive the termination of the relevant Competition or the Participant’s completion of the procedures for withdrawal from the service of the Company, with respect to the Company-Provided Information and the Winner’s Final Submissions and Submissions for Final Judgment for a period of five (5) years thereafter.

Article 5 Prohibited Acts of Participants

1.The Company shall prohibit Participants from engaging in any of the following acts in any Competition:

(1)An act of cracking, cheating, spoofing other misconduct;
(2)An act of directly communicating to, consulting with, making a request to, soliciting or responding to solicitation or other activities to other Participants or the Host (other than the Company) without the involvement of the Company;
(3)Any profitmaking activities using the Competition (including solicitation or scouting activities, and use for a third party in educational business, etc.) without the prior approval of the Company in writing or any other manner specified by the Company;
(4)Transfer, offering as collateral or other disposition of the status as a Participant or the rights or obligations as a Participant (except with the prior written consent of the Company); and
(5)Any other act in breach of the Terms of Use.

2.If the Company deems that a Participant engages in any of the prohibited acts as prescribed in the preceding paragraph, the Company may, without prior notice to the Participant, disqualify the Participant from the Competition in which the Participant participates, temporarily suspend the Participant from using the service of the Company, withdraw the Participant’s membership, claim damages from the Participant or take any other measures deemed necessary by the Company.

Article 6. Change, Discontinuation or Termination of Provision of Services under These Terms

1.The Company may change or temporarily suspend the services provided by the Company under these Terms without prior notice to the members.
2.Upon one (1) month prior notice to the members, the Company may suspend for a long period of time or terminate the services provided by the Company under these Terms.
3.The Company shall not be liable for any results or damage arising from the measures taken by the Company under this Article.

Article 7 Modification of Terms

1.The Company may modify, add or delete any provisions of these Terms from time to time without the approval of the members.

Enforced on April 1, 2018
Last updated on January 18, 2019