スケートボードトリック分類チャレンジ

課題内容

スケートボードランプのボトム(フラット領域)通過時において、スケートボーダーから得られた頭皮上の生体信号データ(72チャンネル)を用いて、ボトムに続くR面(曲面領域)における下記3つのトリック(運動パターン)の種別を分類していただきます。

  • ポンピング運動(pumping)
  • 前向きキックターン運動(backside kick turn)
  • 後向きキックターン運動(frontside kick turn)

本課題では、生体信号データを以下2種類提供し、データ①②それぞれで作成したモデルでトリックの種別の分類を行うとともに、分析結果等の考察も行っていただき、その内容をレポートで提出いただきます。(詳細は決定次第ご案内します)

  • データ①:記録された生体信号データそのもの
  • データ②:同データに対して測定器からの信号成分等の生体信号に由来しない成分をクレンジング処理した後のデータ


データ①②のダウンロード及び分類結果の投稿は、対応する画面下のボタンのリンク先のページより実施ください。特に、分類結果を投稿する際は、投稿ページに間違いがないかご確認をお願いします。なお、本課題では、暫定評価と最終評価において使用するデータは同一とします。 また、コンテスト開催期間を通して、各データに対して投稿は1チームで3回まで、という制限を設けておりますので、慎重に投稿ください(エラー投稿は回数にはカウントされません)。また、データ①②の相互利用は禁止ですのでご注意ください(例: データ①ページのデータを使用したモデルの予測結果をデータ②ページに投稿する)。

※ASR and ICA (Callan, et al., 2024 doi: 10.3389/fnrgo.2024.1358660




応募の流れ

  1. SIGNATEにログイン(現在会員ではない場合、ページ右上の「会員登録」ボタンより登録ください)
  2. 各データページ内のデータタブ内からデータセットをダウンロードし、課題で要求するアルゴリズムを開発
  3. 開発したアルゴリズムに評価用データを入力して出力された分類結果ファイルを作成し、投稿ボタンから投稿
    • 評価結果がリーダーボードで確認できます。
    • 入賞者は、分類性能と考察内容の総合評価に基づいて決定します。
    • 暫定評価、最終評価には同じに評価用データを使用するため、両評価値は同じ値になります。
    • コンテスト開催期間中の投稿回数は、各データに対して1チームで3回という制限があります。
  4. コンテスト終了日(分類結果の投稿締切)10/28(月)までに必要情報を提出
    • こちらより提出ください。
    • 必要情報は以下を含みます。
      • 入賞した場合は提出物にオープンソースライセンスを付与することへの同意
      • 個人情報
      • 応募要件を満たしていることの確認
  5. 条件を満たす入賞候補の方は、11/5(火)までに必要書類を提出
    • 条件
      • データ①②両方のリーダーボードでの投稿が確認できる方
      • 個人情報を提出いただいた方
      • 最終審査用提出物にオープンソースライセンスを付与いただくことに同意いただいた方
    • 提出物
      • 提出方法は、決定次第ご案内します。
      • 提出物には、コストの申請や考察レポートも含まれます。
      • 提出物には、ソースコード等も含まれます。
※4.5.の提出が確認できない方、データ①②の両リーダーボードでの投稿が確認できない方は入賞対象外となります。

考察レポートの様式

全体でA4で4ページ以内とし、 1ページ目にはSIGNATEのユーザ名(チーム参加の場合はチーム名)とデータ①②のスコア・順位を、2ページ目以降に以下の考察結果を記載してください。フォーマットは自由ですが、読み手に分かりやすくまとめてください。なお、5,6は任意とします。

  1. データ処理の工夫点と考察
  2. モデリングの工夫点と考察
  3. 分析結果から得られたインサイトと考察
  4. データ①②で作成したモデルの分類性能の違いに関する考察
  5. 分析結果の社会課題への応用・展開に関する考察
  6. 生体信号データの取得における課題に対するAIによる解決策に関する考察


スケートボードトリック分類チャレンジ

性能評価に使用する評価関数

  • 分類性能は、分類結果と正解データについて、評価関数Accuracyにより評価します。
  • 評価値は0~1の間の値をとり、性能が高いほど大きな値となります。


入賞者決定の流れ

  1. コンテスト最終日までの評価(暫定評価)及びコンテスト終了後の評価(最終評価)に使用するデータは同一とします。
    ※投稿ファイルは最大2つまで選択可能で、スコアの高いファイルが自動的に採用されます。
  2. スコアが同値の場合は、リーダーボードでは早い日時でご応募いただいた参加者が上位として表示されますが、審査では同等に評価します。
  3. 以下の全ての条件を満たす方を入賞候補者とします。
    • データ①②両方のリーダーボードでの投稿が確認できる方
    • 個人情報を提出いただいた方
    • 最終審査用提出物にオープンソースライセンスを付与いただくことに同意いただいた方
  4. 入賞候補者には以下を提出していただきます。
    • モデルのソースコード
    • 学習済みモデル(常に保存しておくよう注意してください)
    • ソースコードの説明書(前処理部分、学習部分、推論部分が分かるように明記)
    • 学習済みモデルを利用した場合は、そのソース(データの所在、論文のリンク等)
    • 実行環境(OSのバージョン、使用ソフトウェア及び解析手法)
    • 分析に要したコスト
    • 考察レポート
  5. 検収期間中、候補者及び、その提出モデルが下記いずれかに該当する場合は、入賞の資格を失います。
    • 事務局からの手続き上の連絡・要求に対して指定された期限内に対応しない
    • プログラムが動作しない
    • 参加条件やルールを満たしていない
    • その他、事務局が不当と判断した場合
  6. 検収をクリアした方の中から、審査会を経て、入賞者及び順位を確定します。

審査方法

モデルの分類性能及び提出された考察レポートの内容を元に、有識者で協議検討の上、総合点により入賞者と順位を決定します。考察レポートの審査ポイントの例は以下の通りです。

  • アイデアが性能の向上に寄与しているか
  • 性能に関して計測工学や電気生理学的に妥当な考察ができているか
  • ドメイン知識を適切に援用できているか

Disclosure policy

As a general rule, in accordance with Article 4, Paragraph 1 of the terms of participation, diclosing any contents such as insights and deliverables transmitted through the information or data provided by our company in relation to this competition is not permitted, however, only after the completion of this competition and for non-commercial purposes, it will be possible to disclose the contents within the score of the table below
Model *1
Public
Analysis results *2
Public
Public : Posting to social media sites, blogs and source repositories, and citing to papers
Restricted : Using in a limited range from research, education to seminars, where many unspecified people cannot access
*1 Execution unit source code and learned models
*2 The insights obtained using the information and data provided, or the solutions including scripts and processed data such as summary statistics

▼本コンペティションにおける特別規約
下記規約の第3条(懸賞及び権利の帰属)において、最終審査用提出物にオープンソースライセンスを付与いただくか否かを選択していただきます。 当ライセンスにおいては、モデル、ソースコードおよびソースコードに付随する成果物の商業的利用を何ら制限しません。なお、当ライセンスを付与いただけない場合は、コンペティションへの参加は可能ですが、入賞資格を得ることはできません。
また、本コンペティションでは、依頼主である国立研究開発法人 新エネルギー・産業技術総合開発機構(以下、「ホスト」といいます。)による投稿物の審査・投稿者への事務連絡・投稿者を識別特定できない形態に加工した統計データ作成のため、予測結果を提出された方全てに個人情報を提供いただきます。提出された個人情報は、株式会社SIGNATEからホストに提供され、ホストまたは株式会社SIGNATEから参加者に対して、コンタクトがなされる場合があります。
なお、ご回答いただいた内容は、ホストのプライバシーポリシー、及び株式会社SIGNATEのプライバシーポリシーに従って厳重に取り扱います。また、個人情報を提供いただけない場合は、入賞資格を得ることはできません。



Terms of Participation in SIGNATE Competition

In order to participate in the Competition, you are required to agree to these Terms, in addition to the Terms of Use of SIGNATE.JP Site (hereinafter referred to as the “Terms of Use”). You should participate in the Competition after reading carefully and agreeing to these Terms. These Terms, the matters that are displayed as “additional matters” that you have agreed to when participating in a Competition, the Terms of Use and other terms and conditions that you have agreed to (hereinafter collectively referred to as “these Terms, etc.”) shall all be binding on the Participant.


Article 1 Definitions

1. For the purpose of these Terms, the following terms shall be defined as follows:

(1) “Site” means the website “SIGNATE (https://signate.jp)” on which the Competitions are posted.
(2) “Competition” means any competition on AI development or data analysis on the Site as held by the Host.
(3) “Host” is the host(s) of the Competition. The Host may be SIGNATE, Inc. (hereinafter referred to as the “Company”) or the Company’s client companies, affiliated companies, schools or organizations, etc. (hereinafter referred to as the “Client(s)”).
(4) “Participant(s)” means the member(s) (which mean “member(s)” defined in the Terms of Use, and the same shall apply hereinafter) who participate in a Competition.
(5) “Submissions” means, collectively, the analysis and prediction results, prediction models and reports, etc. as submitted in the Competition.
(6) “Final Submissions” means the Submissions submitted by a Participant that the Participant has specified as a final submission on the prescribed page in the Site by the time of completion of a Competition.
(7) “Winner Candidate” means the Participant who has received a notice from the Company that he/she is nominated as a winner candidate.
(8) “Submissions for Final Judgment” means the Submissions and other items designated by the Company as submitted by a Winner Candidate pursuant to the instructions of the Company.
(9) “Final Judgment” means the acceptance inspection and judgment, including reproducibility verification, by the Company for the Final Submissions and Submissions for Final Judgment of a Winner Candidate.
(10) “Winner” means the Winner Candidate who is informed by the Company that he/she has won a prize.
(11) “OSS” means software licensed based on OSS License Terms.
(12) “OSS License Terms” means any of the following license terms
(1) Either the GNU General Public License or the GNU Lesser General Public License published by the Free Software Foundation, Inc.;
(2) License terms listed at www.opensource.org/licenses/ or derivatives thereof;
(3) License terms that regard the software as “free software” or “open source software”; and
(4) License terms or agreements similar to the license terms listed in each of the three preceding items which request the user to disclose, distribute or license to a third party, or not to exercise, etc., the licensed software, its derivatives and the intellectual property rights associated therewith in whole or in part.

Article 2 Competition

1. A member who desires to participate in a Competition shall be required to agree to these Terms, etc. and to satisfy the conditions for participation as specified in each such Competition. Any person who is not a member shall not participate in any Competition.
2. Participants shall participate in each Competition in the manner as advised by the Company and shall be obligated to comply with the rules as prescribed in each Competition.
3. Participants may submit the Submissions for the assignment of a Competition during the period of such Competition and submit as many proposals on the method of solving the problem as specified by the Company to the Host by the end of the period of the said Competition.
4. Participants may submit Submissions in the form specified in the Competition and specify those Submissions as a Final Submission on the prescribed page in the Site by the end time specified by the said Competition.
5. Participants’ Final Submissions shall be evaluated in accordance with the evaluation method specified in the Competition and the final ranking shall be determined based on such evaluation.
6. Participants may, as a general rule, check their own evaluation results and the evaluation results of each of the other Participants for Submissions that may be evaluated quantitatively on the Site.
7. Participants shall be solely liable for their own Submissions, including the legality and non-infringement of the Submission.
8. Participants shall not submit any Submissions that have no direct relationship to each Competition.
9. Unless otherwise provided for, Participants may not directly communicate to, consult with, make a request to, solicit or take any other actions with the Host in respect of the matters related to a Competition during the period of the said Competition.
10. Participants shall direct any questions or concerns regarding any Competition to the Company or the third party designated by the Company in accordance with the procedures prescribed by the Company as posted on the Site.
11. Participants shall produce Submissions in compliance with the OSS License Terms related to the OSS when using or incorporating OSS in a Submission. However, Participants shall not use or incorporate OSS for which commercial use is prohibited in a Submission.
12. The Host shall not be obligated to pay any remuneration or other consideration for any act of the Participants in a Competition under any pretext. And the Company shall not be obligated to pay any remuneration or other consideration other than those prescribed in the following Article for any act of the Participants in a Competition.

Article 3 Reward and Vesting of Rights

1. Unless otherwise provided for, any Participant shall satisfy the requirements set forth in the following items in order to be entitled to receive a reward in any Competition that offers a reward:

(1) To be a winner;
(2) To agree to transfer to the Host and the relevant transferee of rights in such Competition all transferable rights, such as copyrights (including the rights as prescribed in Article 27 and Article 28 of the Copyright Act, and the same shall apply hereinafter), rights to obtain patents and know-how, etc. in and to all analysis and prediction results, prediction models, reports, etc., written explanations on algorithms, source code and reproduction method, etc. (although not limited to these), and the Submissions contained in the Final Submissions and Submissions for Final Judgment (hereinafter referred to as the “Rights”) along with a guarantee that the Participant has the authority to transfer such Rights;
(3) To guarantee that any relevant transferee of rights may use the Rights contained in the Final Submissions and Submissions for Final Judgment for its own business and other purpose without any restriction and to agree to their exclusive use of such Rights;
(4) To agree not to exercise moral rights to the Rights against the relevant transferee of rights;
(5) To enter into an agreement for the transfer of the Rights with the relevant eligible transferee of rights, including the guarantee of and agreement to the matters in the preceding three (3) items and other reasonable provisions;
(6) To have the personal identity of such Participant verified by the Company; and
(7) Not to breach any provision of these Terms, etc.

2. Any Winner Candidate shall, after having received a notice from the Company that he/she is nominated as a winner candidate, submit the Submissions for Final Judgment on or before the designated date and communicate the matters requiring confirmation or response in relation to the Final Submissions and the Submissions for Final Judgment to the Company on or before the designated date, in accordance with the instructions of the Company. The Company shall carry out the final judgment based on such matters requiring confirmation or response. If the Company receives no confirmation or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the subject of the final judgment and the Winner Candidate shall not raise any objection thereto.
3. If the Company considers that the Final Submissions or Submissions for Final Judgment need to be amended or modified, or there occur any additional matters requiring confirmation, in the course of the final judgment, any Winner Candidate shall take action or make response in relation to the matters that require amendment or modification, or the matters requiring confirmation, on or before the designated date in accordance with the instructions of the Company. If the Company receives no action or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the final judgment and the Winner Candidate shall not raise any objection thereto.
4. The Company shall determine the Winner through the final judgment and inform the Winner to that effect.

Article 4 Confidentiality

1. Any Participant shall treat any information and data that they receive from the Company in relation to Competitions as well as knowledge and products, etc. obtained using such information and data (including Participant Submissions; hereinafter referred to as the “Company-Provided Information”) as confidential information and shall not disclose the same to any third party and use the same for any purpose other than for such Competition and purpose specified by the Company separately; provided, however, that the confidential information shall not include any information that falls under any of the following items:

(1) Information that is known to the public at the time it was received;
(2) Information that is already possessed by the Participant at the time it was received (only in the case where such Participant may demonstrate such fact by reasonable means);
(3) Information that becomes known to the public without the fault of the Participant after it was received;
(4) Information that is independently developed by the Participant without reference to any information received; or
(5) Information that is rightfully received from any third party having a right to disclose such information without the obligations of confidentiality (only in the case where such Participant may demonstrate such fact by reasonable means).

2. Any Winner shall handle his/her Final Submissions and Submissions for Final Judgment in the same manner as Company-Provided Information after receiving notification that they are a winner. And Participant Submissions other than the Winner’s Final Submissions and Submissions for Final Judgment shall not be included as Company-Provided Information after the Company has determined the Winner notwithstanding the provisions of the preceding paragraph.
3. Any Participant may publish any algorithms that they have developed as well as any other materials they have created in connection with their participation in a Competition (including Final Submissions and Submissions for Final Judgment) after that Competition in accordance with the Competition Information Disclosure Policy (hereinafter, "Information Disclosure Policy") posted on the Site. However, Participants shall observe the following matters when publishing information and may not publish any materials prohibited by the Information Disclosure Policy:

(1) Clarify that the materials were created in connection with participation in the Competition;
(2) Give credit in accordance with the notation method prescribed in the Information Disclosure Policy when the materials to be published contain part of a dataset; and
(3) Clarify the location accessible to all Participants (including but not limited to the Competition forum and other locations designated by the Company) where the materials are published (including links, etc.) if publishing materials outside the Competition forum.

4. Any Participant shall delete or return to the Company the Company-Provided Information (excluding the information prescribed in paragraph 3) immediately after the completion of a Competition.
5. If there is any separate arrangement in relation to the confidential information in a Competition, the provisions of such arrangement shall prevail over the provisions of these Terms.
6. If any dispute occurs between a third party and the Host or the Company due to the breach by any Participant of the provisions of this Article and such other party makes any claim against the Company or the Host, such Participant shall compensate for any damage, loss, expenses (including, but not limited to, attorneys’ fees), lost profits and lost revenues, etc. incurred by the Company and the Host.
7. The provisions of this Article shall survive the termination of the relevant Competition or the Participant’s completion of the procedures for withdrawal from all services provided by the Company, with respect to the Company-Provided Information and the Winner’s Final Submissions and Submissions for Final Judgment for a period of five (5) years thereafter.

Article 5 Prohibited Acts of Participants

1. The Company shall prohibit Participants from engaging in any of the following acts in any Competition:

(1) An act of cracking, cheating, spoofing and other misconduct;
(2) An act of redistributing data files included in the dataset;
(3) An act of directly communicating to, consulting with, making a request to, soliciting or responding to solicitation or other activities to other Participants or the Host (other than the Company) without the involvement of the Company for the purpose of furthering the Participant’s own interests;
(4) Any profitmaking activities using the Competition (including but not limited to solicitation or scouting activities, and use for a third party in educational business, etc.) without the prior approval of the Company in writing or any other manner specified by the Company;
(5) An Act of transferring, offering as collateral or otherwise disposing of the Participants’ standing, or the rights or obligations, as a Participant in any Competition (except with the prior written consent of the Company);
(6) Acts that infringe upon the intellectual property rights, trade secrets or any other rights of third parties; and
(7) Any other act in breach of these Terms, etc.

2. If the Company deems that a Participant has engaged in, or may engage in, any of the prohibited acts as prescribed in the preceding paragraph, the Company may, without prior notice to the Participant, disqualify the Participant from the Competition in which the Participant participates, temporarily suspend the Participant from using some or all of the services provided by the Company, withdraw the Participant’s membership, claim damages from the Participant or take any other measures deemed necessary by the Company.

Article 6 Modification of Terms

1. The Company may modify, add or delete any provisions of these Terms from time to time without the approval of Participants.

July 25, 2024