thank you for sharing! For the approaches you mentioned in task balancing section, which one is the best? Never heard of these approaches before. How did you find these papers?
From the papers and information I collected, there is no silver bullet for task balancing. Some approaches work better in certain scenarios. But there are some best practices. I will share more details later.
Regarding how to find these papers, at first I was just curious about how to balance the loss and do some search. Then I found there are several most mentioned approaches and also found a good survey paper talking about multi-task models. Here is the link https://arxiv.org/pdf/2004.13379.pdf. From this paper, I further exploited the relevant papers about each approach.
thank you for sharing! For the approaches you mentioned in task balancing section, which one is the best? Never heard of these approaches before. How did you find these papers?
From the papers and information I collected, there is no silver bullet for task balancing. Some approaches work better in certain scenarios. But there are some best practices. I will share more details later.
Regarding how to find these papers, at first I was just curious about how to balance the loss and do some search. Then I found there are several most mentioned approaches and also found a good survey paper talking about multi-task models. Here is the link https://arxiv.org/pdf/2004.13379.pdf. From this paper, I further exploited the relevant papers about each approach.
thank you!