Evaluation Metric

Hello I have a question about evaluation metric. Could you please tell me if there are any weights for specific values in the evaluation metric? Or is it done by ranking all the evaluations and then averaging the rankings? I would appreciate it if you could explain both Task1 and Task2. Thank you.

Created by Sungchul On SungchulOn
Hi @Sungchul, For both Task 1 and 2, all cases and evaluation metrics are weighted equally. We will rank evaluations by averaging across rankings. We will also perform a permutation analysis to evaluate uncertainties for rankings. Evaluation details can be found here: https://github.com/LISA2024Challenge/EvaluationMetrics Best regards, LISA 2024 Challenge Organizers

Your web browser must have JavaScript enabled in order for this application to display correctly.
If you are an automated web crawler from a search engine, follow this AJAX application crawl link

Hello I have a question about evaluation metric. Could you please tell me if there are any weights for specific values in the evaluation metric? Or is it done by ranking all the evaluations and then averaging the rankings? I would appreciate it if you could explain both Task1 and Task2. Thank you.

Drop files to upload

Evaluation Metric page is loading…