We invite researchers and students to participate in the task. The task details will be updated soon.
Classification system’s performance will be measured in terms of weighted averaged Precision, weighted averaged Recall and weighted averaged F-Score across all the classes. Weighted averages assign weights for each class based on its relative importance to the final average. They average the support-weighted mean per label. Participants are encouraged to check their system with Sklearn classification report - https://scikit-learn.org/stable/modules/generated/sklearn.metrics.classification_report.html
The participants are required to submit the predicted data in a tab-separated single file named 'predictions.tsv’.
The ‘predictions.tsv’ file should have two columns named Comment (text), Sentiment Polarity (Positive, Negative, Neutral, Mixed feelings and Non-Malayalam or Non-Tamil)