How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account
Ruize Xu, Xiao Yu, Yujin Tang, Chenming Shang, Nikhil Singh
EMNLP 2026 Findings
Publications
For a complete bibliography, see our PI’s Google Scholar profile.
Asterisk denotes equal contribution
Filter by venue field
Showing all 312026
13 publications so farDMV-Bench: Diagnosing Long-Horizon Multimodal Agents' Visual Memory with Incidental Cue Injection
Yujin Tang, Chenming Shang, Ruize Xu, Nikhil Singh
EMNLP 2026
Improving Information Extraction with Learned Queries
Omar Sharif, Soroush Vosoughi, Nikhil Singh
EMNLP 2026 Findings
RIME: Enabling Large-Scale Agentic Music Post-Production
Noah Schaffer, Nikhil Singh
ICML 2026 Workshop on Machine Learning for Audio
Dual-Contrastive Sparse Autoencoders Reveal Features of Musical Interpretation
Jan Chen, Manuel Cherep, Patricia Maes, Nikhil Singh
ICML 2026 Mechanistic Interpretability Workshop
OpenForgeRL: Train Harness-native Agents in Any Environment
Xiao Yu, Baolin Peng, Ruize Xu, Hao Zou, Qianhui Wu, Hao Cheng, Wenlin Yao, Nikhil Singh, Zhou Yu, Jianfeng Gao
arXiv preprint arXiv:2607.21557
AI Agents are Sensitive to Nudges
Manuel Cherep, Pattie Maes, Nikhil Singh
Proceedings of the National Academy of Sciences
Visual Persuasion: What Influences Decisions of Vision-Language Models?
Manuel Cherep, equal contribution, Pranav M R, equal contribution, Pattie Maes, Nikhil Singh
International Conference on Machine Learning
Behavioral Systems Require Behavioral Tests
Manuel Cherep, equal contribution, Nikhil Singh, equal contribution, Pattie Maes
International Conference on Machine Learning (Position Track)
If Only My CGM Could Speak: A Privacy-Preserving Agent for Question Answering over Continuous Glucose Data
Yanjun Cui, Ali Emami, Temiloluwa Prioleau, equal contribution, Nikhil Singh, equal contribution
ACL Findings
Reinforcement World Model Learning for LLM-based Agents
Xiao Yu, Baolin Peng, Ruize Xu, Yelong Shen, Pengcheng He, Suman Nath, Nikhil Singh, Jiangfeng Gao, Zhou Yu
arXiv Preprint
A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
Manuel Cherep, Chengtian Ma, Abigail Xu, Maya Shaked, Pattie Maes, Nikhil Singh
International Conference on Learning Representations
Discovering and Steering Interpretable Concepts in Large Generative Music Models
Nikhil Singh, equal contribution, Manuel Cherep, equal contribution, Pattie Maes
International Conference on Learning Representations
2025
2 publicationsContrastive Learning from Synthetic Audio Doppelgangers
Manuel Cherep, equal contribution, Nikhil Singh, equal contribution
International Conference on Learning Representations
Bridging the Data Provenance Gap Across Text, Speech and Video
Shayne Longpre, Nikhil Singh, Manuel Cherep, Kushagra Tiwary, Joanna Materzynska, William Brannon, Robert Mahari, Manan Dey, Mohammed Hamdy, Nayan Saxena, Ahmad Anis, Emad Alghamdi, Vu Minh Chien, Naana Obeng-Marnu, Da Yin, Kun Qian, Yizhi Li, Minnie Liang, An Dinh, Shrestha Mohanty, Deividas Mataciunas, Tobin South, Jianguo Zhang, Ariel N Lee, Campbell S Lund, Christopher Klamm, Damien Sileo, Diganta Misra, Enrico Shippole, Kevin Klyman, Lester JV Miranda, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Vipul Gupta, Vivek Sharma, Xuhui Zhou, Caiming Xiong, Luis Villa, Stella Biderman, Alex Pentland, Sara Hooker, Jad Kabbara
International Conference on Learning Representations
2024
8 publicationsCreative Text-to-Audio Generation via Synthesizer Programming
Manuel Cherep, equal contribution, Nikhil Singh, equal contribution, Jessica Shand
International Conference on Machine Learning
FigurA11y: AI Assistance for Writing Scientific Alt Text
Nikhil Singh, Lucy Lu Wang, Jonathan Bragg
Proceedings of the 29th International Conference on Intelligent User Interfaces
Superficial Alignment and Subtle Divergence in LLM Decision-Making
Manuel Cherep, equal contribution, Nikhil Singh, equal contribution, Pattie Maes
NeurIPS 2024 Workshop on Behavioral Machine Learning
Human detection of political speech deepfakes across transcripts, audio, and video
Matthew Groh, equal contribution, Aruna Sankaranarayanan, equal contribution, Nikhil Singh, Dong Young Kim, Andrew Lippman, Rosalind Picard
Nature Communications
Looking similar sounding different: Leveraging counterfactual cross-modal pairs for audiovisual representation learning
Nikhil Singh, Chih-Wei Wu, Iroro Orife, Mahdi Kalayeh
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization
Luke Mo, equal contribution, Manuel Cherep, equal contribution, Nikhil Singh, equal contribution, Quinn Langford, Pattie Maes
NeurIPS Audio Imagination Workshop
Consent in Crisis: The Rapid Decline of the AI Data Commons
Shayne Longpre, Robert Mahari, Ariel Lee, Campbell Lund, Hamidah Oderinwale, William Brannon, Nayan Saxena, Naana Obeng-Marnu, Tobin South, Cole Hunter, Kevin Klyman, Christopher Klamm, Hailey Schoelkopf, Nikhil Singh, Manuel Cherep, Ahmad Anis, An Dinh, Caroline Chitongo, Da Yin, Damien Sileo, Deividas Mataciunas, Diganta Misra, Emad Alghamdi, Enrico Shippole, Jianguo Zhang, Joanna Materzynska, Kun Qian, Kush Tiwary, Lester Miranda, Manan Dey, Minnie Liang, Mohammed Hamdy, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Shrestha Mohanty, Vipul Gupta, Vivek Sharma, Vu Minh Chien, Xuhui Zhou, Yizhi Li, Caiming Xiong, Luis Villa, Stella Biderman, Hanlin Li, Daphne Ippolito, Sara Hooker, Jad Kabbara, Sandy Pentland
NeurIPS (Datasets & Benchmarks Track)
Ellie Talks About the Weather: Toward Evaluating the Expressive and Enrichment Potential of a Tablet-Based Speech Board in a Single Goffin’s Cockatoo
Jennifer Cunha, Corinne C Renguette, Nikhil Singh, Lily Stella, Megan Mcmahon, Hao Jin, Rebecca Kleinberger
Proceedings of the CHI Conference on Human Factors in Computing Systems
2023
2 publicationsSynthAX: A Fast Modular Synthesizer in JAX
Manuel Cherep, equal contribution, Nikhil Singh, equal contribution
Audio Engineering Society Convention 155
Investigating the Physiological and Psychological Effect of an Interactive Musical Interface for Stress and Anxiety Reduction
Kimaya Lecamwasam, Samantha Gutierrez Arango, Nikhil Singh, Neska Elhaouij, Max Addae, Rosalind Picard
Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
2022
3 publicationsVoice at NIME: a Taxonomy of New Interfaces for Vocal Musical Expression
Rébecca Kleinberger, Nikhil Singh, Xiao Xiao, Akito van Troyer
NIME 2022
Where to hide a stolen elephant: Leaps in creative writing with multimodal machine intelligence
Nikhil Singh, equal contribution, Guillermo Bernal, equal contribution, Daria Savchenko, equal contribution, Elena L Glassman
ACM Transactions on Computer-Human Interaction
A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level
Iddo Drori, Sarah Zhang, Reece Shuttleworth, Leonard Tang, Albert Lu, Elizabeth Ke, Kevin Liu, Linda Chen, Sunny Tran, Newman Cheng, Roman Wang, Nikhil Singh, Taylor L Patti, Jayson Lynch, Avi Shporer, Nakul Verma, Eugene Wu, Gilbert Strang
Proceedings of the National Academy of Sciences
2021
3 publicationsImage2Reverb: Cross-Modal Reverb Impulse Response Synthesis
Nikhil Singh, Jeff Mentch, Jerry Ng, Matthew Beveridge, Iddo Drori
IEEE/CVF International Conference on Computer Vision (ICCV)
Image2Lego: Customized LEGO Set Generation from Images
Kyle Lennon, Katharina Fransen, Alexander O'Brien, Yumeng Cao, Matthew Beveridge, Yamin Arefeen, Nikhil Singh, Iddo Drori
arXiv preprint arXiv: 2108.08477
The Sound Sketchpad: Expressively Combining Large and Diverse Audio Collections
Nikhil Singh
26th International Conference on Intelligent User Interfaces (IUI)