タスク説明

食料や飲料には一般的に栄養成分表示があります。具体的には、エネルギー、たんぱく質、脂質、炭水化物、食塩相当量の5項目が義務表示となっていて、義務表示の5項目以外にも、任意で ビタミンやミネラルなどを表示している 場合もあります(実際に購入した際に確認してみてください)。

これらは料理をする際に健康を保つための食事管理をするときに重要な情報となります。実際に商品の栄養成分表示を見て確認をすることはできますが、必要な情報を自動的に読み取れるような仕組みがあれば、食事管理などの生産性が上がると考えられます。

そこで、本コンペでは、食料や飲料などのパッケージ画像に対して、その栄養成分表示からエネルギーの項目を自動的に抽出して読み取るアルゴリズムの作成に挑戦していただきます。


▼提供データ

- 栄養成分表示が映っている商品のパッケージ画像データ
- 対応する栄養成分表の矩形情報
- 映っているエネルギーの数値(kcal)

投稿方法
通常の予測結果ファイルの代わりに、学習済みモデルと推論を実行するためのソースコードを投稿します。投稿すると、自動で予測結果ファイルの作成・推論速度と認識精度の評価が行われます。投稿ファイルの作成方法については、配布データのreadme.mdを参照してください。

※ソースコードの実行を伴うため、評価結果がリーダーボードに反映されるまで時間がかかります。


サイズ・推論速度の評価
投稿ファイル(ソースコードと学習済みモデルをまとめたもの)のサイズと推論時間は、以下の流れに従って評価されます。
 1. 投稿ファイルのサイズが閾値の1GBを超える場合は、評価の対象外となります。
 2. 投稿ファイルは解凍された後、ソースコード(と学習済みモデル)が以下の環境で実行され、推論時間と精度が測定されます。
            - GPU: Tesla T4
        ※ 実行環境のDocker imageはこちらを参照ください。
    3. 推論時間の閾値を10[秒/画像]とし、閾値を超える場合は、評価はされますが順位は付きません。(リーダーボードには順位"-"で表示)
        ※学習済みモデルの読み込みを含めて、全体で3時間以上かかる場合はエラーとなり、評価の対象外となります。
    4. 投稿ファイルのサイズと推論時間が閾値をクリアした場合のみ、予測結果の認識精度を元に順位が決定されます。(リーダーボードに表示される推論時間の単位は、[秒/画像])


認識精度の評価方法

精度に対する評価値は"F1Score"を用いて算出します。


これは0~1の間の値をとり、大きいほど高精度となります。今回は栄養成分表示の熱量を数値として推論しますが、正解の数値との文字列としての一致度により精度評価を行います。
例えば、正解の文字列が

"12345"

で、予測された文字列が

"31254"

だったとします。正解の文字列に対して挿入と削除を繰り返して予測された文字列になるように編集を加えます。このとき、まず正解の文字列の先頭に"3"を挿入し、"2"の次の"3"を削除し、"4"の前に"5"を挿入して、最後の"5"を削除することで、予測された文字列"31254"となります。

正解の文字列に対して削除された文字("3"と"5")を正解の中で認識できなかった文字とし、その数をFN(False Negative)とします(この例の場合は2)。削除されずに残った文字数を正しく認識できた文字数とし、TP(True Positive)とします(この例の場合は3)。予測された文字列の中で正しく認識できた文字を除いた文字を予測の中で正しく認識できなかった文字とし、その数をFP(False Positive)とします(この例の場合は2)。よって"F1Score"は0.6となります。

すべての画像サンプルについてTP, FP, FNを足し合わせたあとに計算される"F1Score"を最終的な精度評価値とします。

入賞者決定の流れ

1.コンペ最終日までの評価(暫定評価)は評価用データセットの一部で評価し、コンペ終了後の評価(最終評価)は評価用データセットの残りの部分で評価します。
リーダーボードはコンテスト終了時に自動的に最終評価に切り替わり、それを元に最終順位を決定します。このため、開催中と終了後では順位が大きく変動する場合もあります。
※投稿ファイルは最大2つまで選択可能で、最終評価のスコアの高いファイルが自動的に採用されます。

2. スコアが同値の場合は、早い日時でご応募いただいた参加者を上位とします。

3. リーダーボードの順位が上位の方から10チームを入賞候補者とし、事務局から連絡いたします。

4. 入賞候補者には、10/14(土)に開催予定のオンラインの審査発表会にて解法プレゼンテーションを行って頂きます。審査発表会では、9月29日(金)時点で上位10位までに選出されたチームのみが参加をすることが出来ます。1チーム持ち時間は15分(10分プレゼンテーション、5分審査員からの質疑応答)で、下記項目を審査項目とします。プレゼンテーションの内容を元にテクノプロ・デザイン社により審査を行い、入賞者及び最終順位を決定します。

  ▼審査観点
       ・1次審査での結果
       ・基礎集計で得られた知見
       ・実施した前処理とそれを行った理由
       ・検討したアプローチ手法
       ・一番工夫した点
       ・資料のストーリー性
       ・今回の技術を応用すると、今後どのような課題を解決することが出来るのか

また、昨年テクノプロ・デザイン社が実施をした審査発表会の様子はYoutubeよりご確認いただけますのでご参照ください。
一般の部:https://youtu.be/zoyhOUsj9FI
学生の部:https://youtu.be/XEYcf9TQ9_U 

・ 審査発表会終了後、発表資料についてコンペティション運営(Yamaguchi.Kosuke02@technopro.com)まで送付をお願いいたします。
・ 審査発表会はZoomウェビナーにて実施をし、審査発表会の様子は一般公開とさせて頂きます。こちらのURLは後日、公開させて頂きます。
・ 9月29日(金)時点のリーダーボードを参照し、各部門に分かれて上位10チームにテクノプロ・デザイン社より上位入賞候補者確定のメールを、10月3日(火)を目処にご登録頂きましたメールアドレス宛にお送りいたします。そちらのメールをご確認の上、10月5日(木)までに参加可否についてそのメールにてご返信ください。
・ 10月6日(金)時点で確認が取れない場合、棄権したものと見なし11位以下のチームから繰り上げを実施し、繰り上げ入賞候補者になった旨をテクノプロ・デザイン社よりご連絡いたします。
・ 10月10日(火)終日にて、繰り上げ候補者の方からのご返信が無かった場合、棄権したものと見なします。ここからの繰り上げは行いません。

5. 入賞者には、10/28(土)に開催予定の表彰式にご出席いただき、表彰させていただきます。

※注意事項※
・入賞候補者であっても、審査発表会及び表彰式への出席が入賞、各種賞品の受賞条件となります。
・ご出席いただけない場合は棄権されたとみなされます。この場合、リーダーボードの順位が次点の方を繰り上げて入賞候補者とします。
・棄権された場合または審査発表会において不正が発覚した場合は、リーダーボードからも削除させていただきます。この場合、メダル・ポイントも付与されません。予めご了承ください。
・解法プレゼンテーションのスケジュールについては後日ご案内いたします。

参加の前提
・チート行為やルールを無視した方法による参加は認められません。
・他者に対する誹謗中傷や公序良俗に反する行為を禁止します。事務局が悪質と判断したケースにおいては、入賞資格や会員資格の剥奪の可能性があることをを予めご了承のうえご参加ください。
・データダウンロード時に表示されるコンペティション参加規約に同意の上、登録フォームには正しい情報を入力してください。
・入賞候補となった場合、審査発表会にて解法のプレゼンテーションができなければ入賞はできません。

システムの利用
・1人につき1アカウントのみ利用可能です。
・チーム人数は最大で3人、2023/9/29 まで作成可能です(チーム作成方法はこちら

情報の取り扱い
コンペ開催期間中
・コード・学習済みモデル・データ分析結果のチーム外への共有を禁止します。ただし、全ての参加者が参照可能であるフォーラムでの開示は可能です。
コンペ終了後
・「情報公開ポリシー」ページを参照ください。

データの利用
・外部データは利用可能(第三者の権利を侵害しないオープンかつ無料で利用可能なもの)ですが、利用した場合は、出典と利用用途は保存しておいてください。
・学習用データの修正(手動でのラベル付けやラベルの書き換え等)は可能です。修正した場合は、後に再現できるよう手順を保存しておいてください。
・評価用データをモデルの学習に用いること(推論実行時における疑似ラベリングなどの行為)は禁止です。

ツールの利用
ツールの利用は、商業利用が可能で、オープンかつ無料なもの(python, tensorflow 等)に限定します。

実装方法
配布データのreadme.mdの指定に従って実装してください。

Disclosure policy

As a general rule, in accordance with Article 4, Paragraph 1 of the terms of participation, diclosing any contents such as insights and deliverables transmitted through the information or data provided by our company in relation to this competition is not permitted, however, only after the completion of this competition and for non-commercial purposes, it will be possible to disclose the contents within the score of the table below
Model *1
Public
Analysis results *2
Public
Public : Posting to social media sites, blogs and source repositories, and citing to papers
Restricted : Using in a limited range from research, education to seminars, where many unspecified people cannot access
*1 Execution unit source code and learned models
*2 The insights obtained using the information and data provided, or the solutions including scripts and processed data such as summary statistics

【本コンペ特記事項】
本コンペティションは、依頼主である株式会社テクノプロ テクノプロ・デザイン社(以下、「クライアント」といいます。)による人材発掘も目的としています。そのため、本コンペティションの参加者には、会員登録時の入力情報に追加して、個人情報をご入力いただきます。本コンペティションにおける参加者の情報は、株式会社SIGNATEからクライアントに対して提供されます。これに伴い、当該クライアントから、参加者に対して、採用や業務委託などに関する連絡がなされる場合があります。


Terms of Participation in SIGNATE Competition

In order to participate in the Competition, you are required to agree to these Terms, in addition to the Terms of Use of SIGNATE.JP Site (hereinafter referred to as the “Terms of Use”). You should participate in the Competition after reading carefully and agreeing to these Terms. These Terms, the matters that are displayed as “additional matters” that you have agreed to when participating in a Competition, the Terms of Use and other terms and conditions that you have agreed to (hereinafter collectively referred to as “these Terms, etc.”) shall all be binding on the Participant.


Article 1 Definitions

1. For the purpose of these Terms, the following terms shall be defined as follows:

(1) “Site” means the website “SIGNATE (https://signate.jp)” on which the Competitions are posted.
(2) “Competition” means any competition on AI development or data analysis on the Site as held by the Host.
(3) “Host” is the host(s) of the Competition. The Host may be SIGNATE, Inc. (hereinafter referred to as the “Company”) or the Company’s client companies, affiliated companies, schools or organizations, etc. (hereinafter referred to as the “Client(s)”).
(4) “Participant(s)” means the member(s) (which mean “member(s)” defined in the Terms of Use, and the same shall apply hereinafter) who participate in a Competition.
(5) “Submissions” means, collectively, the analysis and prediction results, prediction models and reports, etc. as submitted in the Competition.
(6) “Final Submissions” means the Submissions submitted by a Participant that the Participant has specified as a final submission on the prescribed page in the Site by the time of completion of a Competition.
(7) “Winner Candidate” means the Participant who has received a notice from the Company that he/she is nominated as a winner candidate.
(8) “Submissions for Final Judgment” means the Submissions and other items designated by the Company as submitted by a Winner Candidate pursuant to the instructions of the Company.
(9) “Final Judgment” means the acceptance inspection and judgment, including reproducibility verification, by the Company for the Final Submissions and Submissions for Final Judgment of a Winner Candidate.
(10) “Winner” means the Winner Candidate who is informed by the Company that he/she has won a prize.
(11) “OSS” means software licensed based on OSS License Terms.
(12) “OSS License Terms” means any of the following license terms
(1) Either the GNU General Public License or the GNU Lesser General Public License published by the Free Software Foundation, Inc.;
(2) License terms listed at www.opensource.org/licenses/ or derivatives thereof;
(3) License terms that regard the software as “free software” or “open source software”; and
(4) License terms or agreements similar to the license terms listed in each of the three preceding items which request the user to disclose, distribute or license to a third party, or not to exercise, etc., the licensed software, its derivatives and the intellectual property rights associated therewith in whole or in part.

Article 2 Competition

1. A member who desires to participate in a Competition shall be required to agree to these Terms, etc. and to satisfy the conditions for participation as specified in each such Competition. Any person who is not a member shall not participate in any Competition.
2. Participants shall participate in each Competition in the manner as advised by the Company and shall be obligated to comply with the rules as prescribed in each Competition.
3. Participants may submit the Submissions for the assignment of a Competition during the period of such Competition and submit as many proposals on the method of solving the problem as specified by the Company to the Host by the end of the period of the said Competition.
4. Participants may submit Submissions in the form specified in the Competition and specify those Submissions as a Final Submission on the prescribed page in the Site by the end time specified by the said Competition.
5. Participants’ Final Submissions shall be evaluated in accordance with the evaluation method specified in the Competition and the final ranking shall be determined based on such evaluation.
6. Participants may, as a general rule, check their own evaluation results and the evaluation results of each of the other Participants for Submissions that may be evaluated quantitatively on the Site.
7. Participants shall be solely liable for their own Submissions, including the legality and non-infringement of the Submission.
8. Participants shall not submit any Submissions that have no direct relationship to each Competition.
9. Unless otherwise provided for, Participants may not directly communicate to, consult with, make a request to, solicit or take any other actions with the Host in respect of the matters related to a Competition during the period of the said Competition.
10. Participants shall direct any questions or concerns regarding any Competition to the Company or the third party designated by the Company in accordance with the procedures prescribed by the Company as posted on the Site.
11. Participants shall produce Submissions in compliance with the OSS License Terms related to the OSS when using or incorporating OSS in a Submission. However, Participants shall not use or incorporate OSS for which commercial use is prohibited in a Submission.
12. The Host shall not be obligated to pay any remuneration or other consideration for any act of the Participants in a Competition under any pretext. And the Company shall not be obligated to pay any remuneration or other consideration other than those prescribed in the following Article for any act of the Participants in a Competition.

Article 3 Reward and Vesting of Rights

1. Unless otherwise provided for, any Participant shall satisfy the requirements set forth in the following items in order to be entitled to receive a reward in any Competition that offers a reward:

(1) To be a winner;
(2) To agree to transfer to the Host and the relevant transferee of rights in such Competition all transferable rights, such as copyrights (including the rights as prescribed in Article 27 and Article 28 of the Copyright Act, and the same shall apply hereinafter), rights to obtain patents and know-how, etc. in and to all analysis and prediction results, prediction models, reports, etc., written explanations on algorithms, source code and reproduction method, etc. (although not limited to these), and the Submissions contained in the Final Submissions and Submissions for Final Judgment (hereinafter referred to as the “Rights”) along with a guarantee that the Participant has the authority to transfer such Rights;
(3) To guarantee that any relevant transferee of rights may use the Rights contained in the Final Submissions and Submissions for Final Judgment for its own business and other purpose without any restriction and to agree to their exclusive use of such Rights;
(4) To agree not to exercise moral rights to the Rights against the relevant transferee of rights;
(5) To enter into an agreement for the transfer of the Rights with the relevant eligible transferee of rights, including the guarantee of and agreement to the matters in the preceding three (3) items and other reasonable provisions;
(6) To have the personal identity of such Participant verified by the Company; and
(7) Not to breach any provision of these Terms, etc.

2. Any Winner Candidate shall, after having received a notice from the Company that he/she is nominated as a winner candidate, submit the Submissions for Final Judgment on or before the designated date and communicate the matters requiring confirmation or response in relation to the Final Submissions and the Submissions for Final Judgment to the Company on or before the designated date, in accordance with the instructions of the Company. The Company shall carry out the final judgment based on such matters requiring confirmation or response. If the Company receives no confirmation or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the subject of the final judgment and the Winner Candidate shall not raise any objection thereto.
3. If the Company considers that the Final Submissions or Submissions for Final Judgment need to be amended or modified, or there occur any additional matters requiring confirmation, in the course of the final judgment, any Winner Candidate shall take action or make response in relation to the matters that require amendment or modification, or the matters requiring confirmation, on or before the designated date in accordance with the instructions of the Company. If the Company receives no action or response satisfactory to the Company on or before the designated date, the Company may exclude such Winner Candidate from the final judgment and the Winner Candidate shall not raise any objection thereto.
4. The Company shall determine the Winner through the final judgment and inform the Winner to that effect.

Article 4 Confidentiality

1. Any Participant shall treat any information and data that they receive from the Company in relation to Competitions as well as knowledge and products, etc. obtained using such information and data (including Participant Submissions; hereinafter referred to as the “Company-Provided Information”) as confidential information and shall not disclose the same to any third party and use the same for any purpose other than for such Competition and purpose specified by the Company separately; provided, however, that the confidential information shall not include any information that falls under any of the following items:

(1) Information that is known to the public at the time it was received;
(2) Information that is already possessed by the Participant at the time it was received (only in the case where such Participant may demonstrate such fact by reasonable means);
(3) Information that becomes known to the public without the fault of the Participant after it was received;
(4) Information that is independently developed by the Participant without reference to any information received; or
(5) Information that is rightfully received from any third party having a right to disclose such information without the obligations of confidentiality (only in the case where such Participant may demonstrate such fact by reasonable means).

2. Any Winner shall handle his/her Final Submissions and Submissions for Final Judgment in the same manner as Company-Provided Information after receiving notification that they are a winner. And Participant Submissions other than the Winner’s Final Submissions and Submissions for Final Judgment shall not be included as Company-Provided Information after the Company has determined the Winner notwithstanding the provisions of the preceding paragraph.
3. Any Participant may publish any algorithms that they have developed as well as any other materials they have created in connection with their participation in a Competition (including Final Submissions and Submissions for Final Judgment) after that Competition in accordance with the Competition Information Disclosure Policy (hereinafter, "Information Disclosure Policy") posted on the Site. However, Participants shall observe the following matters when publishing information and may not publish any materials prohibited by the Information Disclosure Policy:

(1) Clarify that the materials were created in connection with participation in the Competition;
(2) Give credit in accordance with the notation method prescribed in the Information Disclosure Policy when the materials to be published contain part of a dataset; and
(3) Clarify the location accessible to all Participants (including but not limited to the Competition forum and other locations designated by the Company) where the materials are published (including links, etc.) if publishing materials outside the Competition forum.

4. Any Participant shall delete or return to the Company the Company-Provided Information (excluding the information prescribed in paragraph 3) immediately after the completion of a Competition.
5. If there is any separate arrangement in relation to the confidential information in a Competition, the provisions of such arrangement shall prevail over the provisions of these Terms.
6. If any dispute occurs between a third party and the Host or the Company due to the breach by any Participant of the provisions of this Article and such other party makes any claim against the Company or the Host, such Participant shall compensate for any damage, loss, expenses (including, but not limited to, attorneys’ fees), lost profits and lost revenues, etc. incurred by the Company and the Host.
7. The provisions of this Article shall survive the termination of the relevant Competition or the Participant’s completion of the procedures for withdrawal from all services provided by the Company, with respect to the Company-Provided Information and the Winner’s Final Submissions and Submissions for Final Judgment for a period of five (5) years thereafter.

Article 5 Prohibited Acts of Participants

1. The Company shall prohibit Participants from engaging in any of the following acts in any Competition:

(1) An act of cracking, cheating, spoofing and other misconduct;
(2) An act of redistributing data files included in the dataset;
(3) An act of directly communicating to, consulting with, making a request to, soliciting or responding to solicitation or other activities to other Participants or the Host (other than the Company) without the involvement of the Company for the purpose of furthering the Participant’s own interests;
(4) Any profitmaking activities using the Competition (including but not limited to solicitation or scouting activities, and use for a third party in educational business, etc.) without the prior approval of the Company in writing or any other manner specified by the Company;
(5) An Act of transferring, offering as collateral or otherwise disposing of the Participants’ standing, or the rights or obligations, as a Participant in any Competition (except with the prior written consent of the Company);
(6) Acts that infringe upon the intellectual property rights, trade secrets or any other rights of third parties; and
(7) Any other act in breach of these Terms, etc.

2. If the Company deems that a Participant has engaged in, or may engage in, any of the prohibited acts as prescribed in the preceding paragraph, the Company may, without prior notice to the Participant, disqualify the Participant from the Competition in which the Participant participates, temporarily suspend the Participant from using some or all of the services provided by the Company, withdraw the Participant’s membership, claim damages from the Participant or take any other measures deemed necessary by the Company.

Article 6 Modification of Terms

1. The Company may modify, add or delete any provisions of these Terms from time to time without the approval of Participants.

August 11, 2023