Hello, With the deadlines approaching, I wanted to ask whether the compute resources and runtime limits for Task 4 have been defined yet. Given the generative nature of the task, knowing these constraints in advance is important, as some methods may require substantial inference time or GPU memory. Additionally, are the final ranking criteria known already, particularly the accuracy metrics that will be used for evaluation? Thank you.

Created by Tomás Guija Valiente tomasguija
Perfect! :)
Hello Paula, thank you very much for your answers! Sounds great, that will be way more than needed.
Hi Tomás, I have some additional information for you. We have decided that the **absolute maximum time** of inference per sample **must not exceed 1h.** You can look up the precise size of the testing dataset in the Challenge ArXiv paper here: https://arxiv.org/pdf/2305.08992v3 if that is of interest, too. Also, in case the GPUs I specified in my last message are not sufficient for you, we will try and find a way to run your algorithm on an A100 with a maximum of 80GB VRAM. Ideally, you could contact us again as soon as you know more about the requirements of your algorithm, so we'll be able to try our best to make it work :) Please don't hesitate to contact us here in the forum anytime! Best Paula
Hello Tomás - Thank you very much for reaching out! Absolutely, those are valid questions. Here is a precise description of the hardware requirements for you: **The evaluation environment provides NVIDIA GPUs with up to 48 GB of GPU memory. Containers should be able to run on a single GPU with at most 48 GB VRAM. The current evaluation machines use NVIDIA RTX A5000 (24 GB) and Quadro RTX 8000 (48 GB) GPUs with CUDA 12.5-compatible drivers.** Regarding the metrics that are used for the final ranking; As in previous years, we are using SSIM, RMSE and PSNR to determine the ranking. Regarding inference time; We have not fixed a definite limit as of now. We will discuss this internally and I will get back to. We hope this clears your questions - feel free to reach out again anytime in case further questions arise! Best of luck for your submission. Paula for the BraTS 2026 Team

Task 4: Compute Resources, Runtime Limits, and Evaluation Metrics page is loading…