Computation and Language

Authors and titles for February 2024

[1] arXiv:2402.00075 [pdf, html, other]

Title: D-Nikud: Enhancing Hebrew Diacritization with LSTM and Pretrained Models

Adi Rosenthal, Nadav Shaked

Subjects: Computation and Language (cs.CL)

[2] arXiv:2402.00123 [pdf, html, other]

Title: Comparing Template-based and Template-free Language Model Probing

Sagi Shaier, Kevin Bennett, Lawrence E Hunter, Katharina von der Wense

Comments: Accepted to EACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[3] arXiv:2402.00143 [pdf, html, other]

Title: Making a Long Story Short in Conversation Modeling

Yufei Tao, Tiernan Mines, Ameeta Agrawal

Comments: This paper was accepted by TEICAI workshop at EACL 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[4] arXiv:2402.00149 [pdf, html, other]

Title: The Impact of Language Adapters in Cross-Lingual Transfer for NLU

Jenny Kunz, Oskar Holmström

Journal-ref: Proceedings of the 1st Workshop on Modular and Open Multilingual NLP (MOOMIN 2024)

Subjects: Computation and Language (cs.CL)

[5] arXiv:2402.00157 [pdf, html, other]

Title: Large Language Models for Mathematical Reasoning: Progresses and Challenges

Janice Ahn, Rishu Verma, Renze Lou, Di Liu, Rui Zhang, Wenpeng Yin

Comments: EACL 2024 Student Research Workshop, 8 pages

Subjects: Computation and Language (cs.CL)

[6] arXiv:2402.00159 [pdf, other]

Title: Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo

Comments: Accepted at ACL 2024; Dataset: this https URL Code: this https URL

Subjects: Computation and Language (cs.CL)

[7] arXiv:2402.00160 [pdf, html, other]

Title: Emergency Department Decision Support using Clinical Pseudo-notes

Simon A. Lee, Sujay Jain, Alex Chen, Kyoka Ono, Jennifer Fang, Akos Rudas, Jeffrey N. Chiang

Subjects: Computation and Language (cs.CL)

[8] arXiv:2402.00179 [pdf, other]

Title: De-identification is not enough: a comparison between de-identified and synthetic clinical notes

Atiquer Rahman Sarkar, Yao-Shun Chuang, Noman Mohammed, Xiaoqian Jiang

Comments: this https URL

Journal-ref: Scientific Reports 14.1 (2024): 29669; Springer Nature

Subjects: Computation and Language (cs.CL)

[9] arXiv:2402.00235 [pdf, html, other]

Title: Exploring the limits of decoder-only models trained on public speech recognition corpora

Ankit Gupta, George Saon, Brian Kingsbury

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[10] arXiv:2402.00263 [pdf, html, other]

Title: Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better

Shengchao Liu, Xiaoming Liu, Yichen Wang, Zehua Cheng, Chengzhengxu Li, Zhaohan Zhang, Yu Lan, Chao Shen

Subjects: Computation and Language (cs.CL)

[11] arXiv:2402.00271 [pdf, other]

Title: A Crucial Parameter for Rank-Frequency Relation in Natural Languages

Chenchen Ding

Subjects: Computation and Language (cs.CL)

[12] arXiv:2402.00322 [pdf, other]

Title: Bias in Opinion Summarisation from Pre-training to Adaptation: A Case Study in Political Bias

Nannan Huang, Haytham Fayek, Xiuzhen Zhang

Comments: 15 pages, 1 figure, 6 tables, Accepted to EACL 2024

Subjects: Computation and Language (cs.CL)

[13] arXiv:2402.00345 [pdf, html, other]

Title: IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicators

Luyang Lin, Lingzhi Wang, Xiaoyan Zhao, Jing Li, Kam-Fai Wong

Subjects: Computation and Language (cs.CL)

[14] arXiv:2402.00367 [pdf, html, other]

Title: Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaboration

Shangbin Feng, Weijia Shi, Yike Wang, Wenxuan Ding, Vidhisha Balachandran, Yulia Tsvetkov

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[15] arXiv:2402.00371 [pdf, html, other]

Title: What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection

Shangbin Feng, Herun Wan, Ningnan Wang, Zhaoxuan Tan, Minnan Luo, Yulia Tsvetkov

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[16] arXiv:2402.00385 [pdf, other]

Title: Computational Morphology and Lexicography Modeling of Modern Standard Arabic Nominals

Christian Khairallah, Reham Marzouk, Salam Khalifa, Mayar Nassar, Nizar Habash

Comments: Findings of the Association for Computational Linguistics: EACL 2024

Subjects: Computation and Language (cs.CL)

[17] arXiv:2402.00402 [pdf, other]

Title: Investigating Bias Representations in Llama 2 Chat via Activation Steering

Dawn Lu, Nina Rimsky

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[18] arXiv:2402.00412 [pdf, other]

Title: Hidding the Ghostwriters: An Adversarial Evaluation of AI-Generated Student Essay Detection

Xinlin Peng, Ying Zhou, Ben He, Le Sun, Yingfei Sun

Comments: Accepted by EMNLP 2023 Main conference, Oral Presentation

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[19] arXiv:2402.00414 [pdf, html, other]

Title: Prompt-Time Symbolic Knowledge Capture with Large Language Models

Tolga Çöplü, Arto Bendiken, Andrii Skomorokhov, Eduard Bateiko, Stephen Cobb, Joshua J. Bouw (Haltia, Inc.)

Comments: 8 pages, 5 figures, 1 table preprint. Under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[20] arXiv:2402.00421 [pdf, html, other]

Title: From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models

Jung-Mei Chu, Hao-Cheng Lo, Jieh Hsiang, Chun-Chieh Cho

Comments: 28 pages, 5 figures, typos corrected, references added, under review

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[21] arXiv:2402.00446 [pdf, other]

Title: Improving Dialog Safety using Socially Aware Contrastive Learning

Souvik Das, Rohini K. Srihari

Comments: SCI-CHAT@EACL2024

Subjects: Computation and Language (cs.CL)

[22] arXiv:2402.00474 [pdf, other]

Title: SA-MDKIF: A Scalable and Adaptable Medical Domain Knowledge Injection Framework for Large Language Models

Tianhan Xu, Zhe Hu, Ling Chen, Bin Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[23] arXiv:2402.00530 [pdf, html, other]

Title: Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning

Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao, Jianzong Wang, Ning Cheng, Tianyi Zhou

Comments: ACL2024 main, Camera-ready

Subjects: Computation and Language (cs.CL)

[24] arXiv:2402.00559 [pdf, html, other]

Title: A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains

Alon Jacovi, Yonatan Bitton, Bernd Bohnet, Jonathan Herzig, Or Honovich, Michael Tseng, Michael Collins, Roee Aharoni, Mor Geva

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[25] arXiv:2402.00620 [pdf, html, other]

Title: Actor Identification in Discourse: A Challenge for LLMs?

Ana Barić, Sean Papay, Sebastian Padó

Comments: Proceedings of the EACL 2024 workshop on Computational Models of Discourse (St. Julian's, Malta)

Subjects: Computation and Language (cs.CL)

[26] arXiv:2402.00632 [pdf, html, other]

Title: Prosody in Cascade and Direct Speech-to-Text Translation: a case study on Korean Wh-Phrases

Giulio Zhou, Tsz Kin Lam, Alexandra Birch, Barry Haddow

Comments: Accepted at Findings of EACL 2024

Subjects: Computation and Language (cs.CL)

[27] arXiv:2402.00667 [pdf, other]

Title: Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning

Jitao Sang, Yuhang Wang, Jing Zhang, Yanxu Zhu, Chao Kong, Junhong Ye, Shuyu Wei, Jinlin Xiao

Subjects: Computation and Language (cs.CL)

[28] arXiv:2402.00707 [pdf, other]

Title: Non-Exchangeable Conformal Language Generation with Nearest Neighbors

Dennis Ulmer, Chrysoula Zerva, André F.T. Martins

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[29] arXiv:2402.00723 [pdf, other]

Title: Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders

Yingji Zhang, Danilo S. Carvalho, Marco Valentino, Ian Pratt-Hartmann, Andre Freitas

Subjects: Computation and Language (cs.CL)

[30] arXiv:2402.00742 [pdf, html, other]

Title: Transforming and Combining Rewards for Aligning Large Language Models

Zihao Wang, Chirag Nagpal, Jonathan Berant, Jacob Eisenstein, Alex D'Amour, Sanmi Koyejo, Victor Veitch

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[31] arXiv:2402.00745 [pdf, other]

Title: Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement

Xin Quan, Marco Valentino, Louise A. Dennis, André Freitas

Comments: Camera-ready for EACL 2024

Subjects: Computation and Language (cs.CL)

[32] arXiv:2402.00746 [pdf, html, other]

Title: Health-LLM: Personalized Retrieval-Augmented Disease Prediction System

Qinkai Yu, Mingyu Jin, Dong Shu, Chong Zhang, Lizhou Fan, Wenyue Hua, Suiyuan Zhu, Yanda Meng, Zhenting Wang, Mengnan Du, Yongfeng Zhang

Subjects: Computation and Language (cs.CL)

[33] arXiv:2402.00786 [pdf, html, other]

Title: CroissantLLM: A Truly Bilingual French-English Language Model

Manuel Faysse, Patrick Fernandes, Nuno M. Guerreiro, António Loison, Duarte M. Alves, Caio Corro, Nicolas Boizard, João Alves, Ricardo Rei, Pedro H. Martins, Antoni Bigata Casademunt, François Yvon, André F.T. Martins, Gautier Viaud, Céline Hudelot, Pierre Colombo

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[34] arXiv:2402.00794 [pdf, html, other]

Title: ReAGent: A Model-agnostic Feature Attribution Method for Generative Language Models

Zhixue Zhao, Boxuan Shan

Comments: Accepted at AAAI24 workshop ReLM

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[35] arXiv:2402.00835 [pdf, other]

Title: ALISON: Fast and Effective Stylometric Authorship Obfuscation

Eric Xing, Saranya Venkatraman, Thai Le, Dongwon Lee

Comments: 10 pages, 6 figures, 4 tables. To be published in the Proceedings of the 38th Annual AAAI Conference on Artificial Intelligence (AAAI-24)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[36] arXiv:2402.00838 [pdf, html, other]

Title: OLMo: Accelerating the Science of Language Models

Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

Subjects: Computation and Language (cs.CL)

[37] arXiv:2402.00841 [pdf, html, other]

Title: Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization?

Xue-Yong Fu, Md Tahmid Rahman Laskar, Elena Khasanova, Cheng Chen, Shashi Bhushan TN

Comments: Accepted by NAACL 2024 (Industry Track). The first two authors contributed equally to this work

Subjects: Computation and Language (cs.CL)

[38] arXiv:2402.00856 [pdf, html, other]

Title: Towards Efficient Exact Optimization of Language Model Alignment

Haozhe Ji, Cheng Lu, Yilin Niu, Pei Ke, Hongning Wang, Jun Zhu, Jie Tang, Minlie Huang

Comments: 24 pages, 9 figures

Journal-ref: Forty-first International Conference on Machine Learning (ICML 2024)

Subjects: Computation and Language (cs.CL)

[39] arXiv:2402.00858 [pdf, html, other]

Title: Can Large Language Models Understand Context?

Yilun Zhu, Joel Ruben Antony Moniz, Shruti Bhargava, Jiarui Lu, Dhivya Piraviperumal, Site Li, Yuan Zhang, Hong Yu, Bo-Hsiang Tseng

Comments: Findings of EACL 2024

Subjects: Computation and Language (cs.CL)

[40] arXiv:2402.00861 [pdf, other]

Title: Evaluating Large Language Models for Generalization and Robustness via Data Compression

Yucheng Li, Yunhao Guo, Frank Guerin, Chenghua Lin

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[41] arXiv:2402.00888 [pdf, html, other]

Title: Security and Privacy Challenges of Large Language Models: A Survey

Badhan Chandra Das, M. Hadi Amini, Yanzhao Wu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[42] arXiv:2402.00956 [pdf, html, other]

Title: Exploring Spatial Schema Intuitions in Large Language and Vision Models

Philipp Wicke, Lennart Wachowiak

Comments: ACL Findings 2024

Subjects: Computation and Language (cs.CL)

[43] arXiv:2402.00969 [pdf, html, other]

Title: SPARQL Generation with Entity Pre-trained GPT for KG Question Answering

Diego Bustamante, Hideaki Takeda

Comments: 7 pages, 1 figure, 2 tables. For the implementation, see this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)

[44] arXiv:2402.00978 [pdf, html, other]

Title: An Information-Theoretic Approach to Analyze NLP Classification Tasks

Luran Wang, Mark Gales, Vatsal Raina

Comments: 21 pages, 10 figures, 11 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[45] arXiv:2402.01018 [pdf, html, other]

Title: HR-MultiWOZ: A Task Oriented Dialogue (TOD) Dataset for HR LLM Agent

Weijie Xu, Zicheng Huang, Wenxiang Hu, Xi Fang, Rajesh Kumar Cherukuri, Naumaan Nayyar, Lorenzo Malandri, Srinivasan H. Sengamedu

Comments: 13 pages, 9 figures

Journal-ref: EACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[46] arXiv:2402.01019 [pdf, html, other]

Title: Domain-Independent Deception: A New Taxonomy and Linguistic Analysis

Rakesh M. Verma, Nachum Dershowitz, Victor Zeng, Dainis Boumber, Xuting Liu

Comments: 33 pages. arXiv admin note: text overlap with arXiv:2207.01738

Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY)

[47] arXiv:2402.01025 [pdf, html, other]

Title: Graph-based Clustering for Detecting Semantic Change Across Time and Languages

Xianghe Ma, Michael Strube, Wei Zhao

Comments: EACL2024 Camera Ready (20 pages)

Subjects: Computation and Language (cs.CL)

[48] arXiv:2402.01030 [pdf, html, other]

Title: Executable Code Actions Elicit Better LLM Agents

Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji

Comments: Accepted by ICML 2024; Code, data, model, and demo are available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[49] arXiv:2402.01035 [pdf, html, other]

Title: Getting the most out of your tokenizer for pre-training and domain adaptation

Gautier Dagan, Gabriel Synnaeve, Baptiste Rozière

Subjects: Computation and Language (cs.CL)

[50] arXiv:2402.01051 [pdf, html, other]

Title: Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model

Andrew Brown, Jiading Zhu, Mohamed Abdelwahab, Alec Dong, Cindy Wang, Jonathan Rose

Comments: Accepted to EACL 2024 Long Paper

Subjects: Computation and Language (cs.CL)