{"repo":"kite99520/DialSummEval","free":true,"listed":false,"github":"https://github.com/kite99520/DialSummEval","clone":"git clone https://github.com/kite99520/DialSummEval.git","description":"Resources for paper \"DialSummEval: Revisiting summarization evaluation for dialogues\"","language":"Python","stars":14,"topics":["analysis","annotations","metrics"],"license":"MIT","category":"analytics","readme_excerpt":"DialSummEval This is the Repo for the paper DialSummEval: Revisiting summarization evaluation for dialogues The human judgments we used are under annotation campus , you can also download them through Link. The annotations from AMT we did not use are under annotation AMT . The whole output summaries generated by the models on the test set of SAMSum can be download through Link The code under ./reproduce/metrics is used to compute the values of metrics and the files under ./reproduce/analysis/models eval new record the outputs of the metrics. analysis.py contains some functions about analysis, such as the correlation calculation. Summarization Models model id model ---------- -------------- A Reference B LONGEST-3 C LEAD-3 D PGN E Transformer F BART G PEGASUS H UniLM I CODS J ConvoSumm K MV-BART L PLM-BART M Ctrl-DiaSumm N S-BART Citation Contact If you have any questions, you can send emails to gaomingqi[AT]pku[DOT]edu[DOT]cn.","default_branch":null,"files":null,"tree":[],"storefront":"/r/kite99520","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kite99520/DialSummEval/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}