2026
DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priors
TB Abdur Rakib,
A Mehrish,
LK Soon,
WH Lim,
S Poria
AAAI
2026
Affective Computing Agentic AI Dialogue Systems
10 Open Challenges Steering the Future of Vision-Language-Action Models
S Poria ,
N Majumder,
CY Hung,
AA Bagherzadeh,
C Li,
K Kwok,
Z Wang
AAAI
2026
Agentic AI Embodied AI Reasoning Safety Survey
Chain-of-Glimpse: Search-Guided Progressive Object-Grounded Reasoning for Video Understanding
Z Wu,
Q Zha,
T Wang,
G Xu,
W Gu,
W Rao,
N Ma,
B Cheng,
S Poria
ICML
2026
Multimodality Reasoning
Data Agent: Learning to Select Data via End-to-End Dynamic Optimization
S Yang,
F Su,
H Gan,
Z Ye,
J Li,
B Xu,
F Shen,
S Poria
ICML
2026
Agentic AI
Demystifying deep search: a holistic evaluation with hint-free multi-hop questions and factorised metrics
M Song,
R Liu,
X Wang,
Y Jiang,
P Xie,
F Huang,
J Zhou,
D Herremans,
S Poria
ICLR
2026
Agentic AI Evaluation Hypothesis Discovery RAG Reasoning
Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems
R Zhou,
M Song,
X Wu,
S Cheng,
X Yin,
Y Xie,
Z Hao,
W Hua,
L Pan,
S Poria
arXiv preprint arXiv:2601.21742
2026
Agentic AI Reasoning Trustworthiness
From Perception to Action: An Interactive Benchmark for Vision Reasoning
Y Wu,
M Song,
Y Lan,
L Wang,
Z Hu,
Y Xiao,
H Zhou,
W Zheng,
D Raharja,
S Poria
arXiv preprint arXiv:2602.21015
2026
Agentic AI Embodied AI Multimodality Question Answering Reasoning
LLM Alignment should go beyond Harmlessness–Helpfulness and incorporate Human Agency
U Naseem,
T Chakraborty,
KW Chang,
M Dras,
P Nakov,
N Peng,
S Poria
Cognitive Computation
2026
Alignment Safety
Measuring and Mitigating Rapport Bias of Large Language Models under Multi-Agent Social Interactions
M Song,
TD Pala,
R Zhou,
W Jin,
A Zadeh,
C Li,
D Herremans,
S Poria
ICLR
2026
Agentic AI
OffTopicEval: When Large Language Models Enter the Wrong Chat, Almost Always!
J Lei,
V Gumma,
R Bhardwaj,
SM Lim,
C Li,
A Zadeh,
S Poria
ICLR
2026
Agentic AI Alignment Evaluation Safety
Stacked from One: Multi-Scale Self-Injection for Context Window Extension
W Han,
P Zhou,
S Poria ,
S Yan
arXiv preprint arXiv:2603.04759
2026
Linear Attention
Tangoflux: Super fast and faithful text to audio generation with flow matching and clap-ranked preference optimization
CY Hung,
N Majumder,
Z Kong,
A Mehrish,
AA Bagherzadeh,
C Li,
S Poria
ICLR
2026
99 citations
Alignment GenAI Speech & Audio
Tracking the Evolution of Multimodal Reasoning on Visual Puzzles
V Toh,
YK Chia,
D Ghosal,
S Poria
Logical and Symbolic Reasoning in Language Models @ AAAI 2026
2026
Evaluation Multimodality Reasoning
Post Reasoning: Improving the Performance of Non-Thinking Models at No Cost
R Sin Jing Xuan,
R Bhardwaj,
S Poria
arXiv preprint arXiv:2605.06165
2026
ML Efficiency Reasoning
δ-mem: Efficient Online Memory for Large Language Models
J Lei,
D Zhang,
J Li,
W Wang,
K Fan,
X Liu,
Q Liu,
X Ma,
B Chen,
S Poria
arXiv preprint arXiv:2605.12357
2026
ML Efficiency Reasoning Long Context
Beyond What to Select: A Plug-and-play Oscillatory Data-Volume Scheduling for Efficient Model Training
S Yang,
H Zhu,
H Gan,
F Su,
G Li,
F Shen,
S Poria
arXiv preprint arXiv:2605.14773
2026
ML Efficiency
GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards
TD Pala,
V Toh,
S Poria
arXiv preprint arXiv:2606.04889
2026
Alignment ML Efficiency Reasoning
On the Limits of LLM-as-Judge for Scientific Novelty Assessment
S Sinhahajari,
N Majumder,
S Poria
arXiv preprint arXiv:2606.12071
2026
AI for Science Evaluation Trustworthiness
IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
V Gumma,
N Majumder,
S Sinhahajari,
S Poria
arXiv preprint arXiv:2607.22375
2026
AI for Science Agentic AI Hypothesis Discovery
Σ-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems
P Feng,
S Yang,
S Poria
arXiv preprint arXiv:2607.27958
2026
Agentic AI Reasoning Trustworthiness
MNIST-PRO: MNIST is Back as a Partially Observable World for AI Agents
V Toh,
N Majumder,
Z Liu,
NF Chen,
S Poria
arXiv preprint arXiv:2608.31022
2026
Agentic AI Evaluation Multimodality Reasoning
ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step
V Toh,
N Majumder,
Z Liu,
NF Chen,
S Poria
arXiv preprint arXiv:2608.02358
2026
Agentic AI Evaluation Reasoning
Not All Tokens Are Equal: Intrinsic Loss Reweighting for Verifiable Reinforcement Learning
TD Pala,
V Toh,
S Poria
3rd AI for Math Workshop @ ICML 2026
2026
Reasoning Reinforcement Learning
GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
AgiBot Research Team,
R Liu,
W Zhao,
Z Yang,
L Chen,
P Zhou,
S Chen,
G Ren,
Y Peng,
R Jin,
N Wang,
S Wang,
X He,
J Feng,
Z Xiong,
L Zhong,
Y Wei,
F Han,
L Zhang,
D Huang,
N Zhao,
C Yin,
M Wu,
Z Yan,
K Hu,
Y Yan,
A Niyazi,
Y Fang,
J Zeng,
L Meng,
D Lv,
H Cao,
Z Hou,
L Ye,
Y Niu,
Z Cai,
X Hu,
H Min,
X Cai,
Y Liao,
J Wu,
S Poria ,
Y Li,
S Zhou,
M Yao
arXiv preprint arXiv:2609.05588
2026
Embodied AI Multimodality
2025
Action-guided prompt tuning for video grounding
J Wang,
R Tsao,
X Wang,
X Wang,
F Feng,
S Tian,
S Poria
Information Fusion
2025
Multimodality
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning
D Ghosal,
VTY Han,
CY Ken,
S Poria
NAACL
2025
Multimodality Reasoning
Content extraction based on hop distance within a graph model
Y Dong,
Y Deng,
J Zhang,
F Gelli,
T Lin,
Y Zhuo,
H Wang,
S Poria
US Patent 12,277,788
2025
Document AI
DiffPO: Diffusion-styled Preference Optimization for Inference Time Alignment of Large Language Models
R Chen,
W Chai,
Z Yang,
X Zhang,
Z Wang,
T Quek,
JT Zhou,
S Poria
ACL
2025
Alignment Reasoning
Emma-x: An embodied multimodal action model with grounded chain of thought and look-ahead spatial reasoning
Q Sun,
P Hong,
TD Pala,
V Toh,
U Tan,
D Ghosal,
S Poria
ACL
2025
54 citations
Embodied AI Multimodality Reasoning Trustworthiness
Error Typing for Smarter Rewards: Improving Process Reward Models with Error-Aware Hierarchical Supervision
TD Pala,
P Sharma,
A Zadeh,
C Li,
S Poria
EMNLP Findings
2025
Reasoning Trustworthiness
Exact Flow Linear Attention: Exact Solution from Continuous-Time Dynamics
J Lei,
D Zhang,
S Poria
arXiv preprint arXiv:2512.12602
2025
Linear Attention
Evaluating AI for Finance: Is AI Credible at Assessing Investment Risk Appetite?
D Chawla,
A Bhutada,
DA Do,
A Raghunathan,
V Sp,
C Guo,
DW Liew,
S Poria
EMNLP
2025
Trustworthiness
Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions
P Hong,
N Majumder,
D Ghosal,
S Aditya,
R Mihalcea,
S Poria
ACL (Findings)
2025
Knowledge Graphs Reasoning
Ferret: Faster and effective automated red teaming with reward-based scoring technique
TD Pala,
V Toh,
R Bhardwaj,
S Poria
EMNLP (Findings)
2025
Safety
From grounding to manipulation: Case studies of foundation model integration in embodied robotic systems
X Sui,
D Tian,
Q Sun,
R Chen,
D Choi,
K Kwok,
S Poria
EMNLP (Findings)
2025
Agentic AI Embodied AI Multimodality
Harnessing large language models for scientific novelty detection
Y Liu,
Z Yang,
S Poria ,
TS Nguyen,
E Cambria
arXiv preprint arXiv:2505.24615
2025
Hypothesis Discovery
JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment
R Liu,
CY Hung,
N Majumder,
T Gautreaux,
AA Bagherzadeh,
C Li,
S Poria
arXiv preprint arXiv:2507.20880
2025
Alignment GenAI Speech & Audio
Lessons from Training Grounded LLMs with Verifiable Rewards
SH Sim,
TD Pala,
V Toh,
HL Chieu,
A Zadeh,
C Li,
N Majumder,
S Poria
arXiv preprint arXiv:2506.15522
2025
ML Efficiency RAG Reasoning Trustworthiness
Libra-leaderboard: Towards responsible AI through a balanced leaderboard of safety and capability
H Li,
X Han,
Z Zhai,
H Mu,
H Wang,
Z Zhang,
Y Geng,
S Lin,
R Wang,
S Poria
NAACL
2025
Evaluation Responsible AI Safety
M-longdoc: A benchmark for multimodal super-long document understanding and a retrieval-aware tuning framework
YK Chia,
L Cheng,
HP Chan,
C Liu,
M Song,
SM Aljunied,
S Poria ,
L Bing
EMNLP
2025
52 citations
Evaluation Multimodality RAG
Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse
M Song,
SH Sim,
R Bhardwaj,
HL Chieu,
N Majumder,
S Poria
ICLR
2025
50 citations
RAG Trustworthiness
MM-InstructEval: Zero-shot evaluation of (Multimodal) Large Language Models on multimodal reasoning tasks
X Yang,
W Wu,
S Feng,
M Wang,
D Wang,
Y Li,
Q Sun,
Y Zhang,
X Fu,
S Poria
Information Fusion
2025
66 citations
Evaluation Multimodality Reasoning
MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypotheses
Z Yang,
W Liu,
B Gao,
T Xie,
Y Li,
W Ouyang,
S Poria ,
E Cambria,
D Zhou
ICLR
2025
117 citations
AI for Science Agentic AI Hypothesis Discovery
Multimodal analysis combining monitoring modalities to elicit cognitive states and perform screening for mental disorders
N Howard,
S Poria ,
N Majumder,
S Kanareykin,
S Rawlley,
T Juarez
US Patent App. 18/887,228
2025
Affective Computing Multimodality
Nora-1.5: A vision-language-action model trained using world model-and action-based preference rewards
CY Hung,
N Majumder,
H Deng,
L Renhang,
Y Ang,
A Zadeh,
C Li,
S Poria
arXiv preprint arXiv:2511.14659
2025
Agentic AI Alignment Embodied AI
Nora: A small open-sourced generalist vision language action model for embodied tasks
CY Hung,
Q Sun,
P Hong,
A Zadeh,
C Li,
U Tan,
N Majumder,
S Poria
arXiv preprint arXiv:2504.19854
2025
120 citations
Embodied AI Multimodality Reasoning
Not all votes count! Translated program for verification improves self-consistency of language models for math reasoning
V Toh,
D Ghosal,
S Poria
AI for Math Workshop @ ICML 2025
2025
Reasoning
Pixel-level reasoning segmentation via multi-turn conversations
D Cai,
X Yang,
Y Liu,
D Wang,
S Feng,
Y Zhang,
S Poria
ACL
2025
Dialogue Systems Reasoning
PREMISE: Matching-based Prediction for Accurate Review Recommendation
W Han,
H Chen,
S Poria
NAACL Findings
2025
Multimodality
PROEMO: Prompt-driven text-to-speech synthesis based on emotion and intensity control
S Zhang,
A Mehrish,
Y Li,
S Poria
arXiv preprint arXiv:2501.06276
2025
Affective Computing Speech & Audio
PromptDistill: Query-based Selective Token Retention in Intermediate Layers for Efficient Large Language Model Inference
W Jin,
M Song,
TD Pala,
YK Chia,
A Zadeh,
C Li,
S Poria
arXiv preprint arXiv:2503.23274
2025
Linear Attention
Reward-Guided Tree Search for Inference Time Alignment of Large Language Models
CY Hung,
N Majumder,
A Mehrish,
S Poria
NAACL
2025
Alignment Reasoning
The ACM Multimedia 2025 Grand Challenge of Multimodal Conversational Aspect-based Sentiment Analysis
M Luo,
H Fei,
B Li,
S Wu,
Q Liu,
S Poria ,
E Cambria,
ML Lee,
W Hsu
ACM MM
2025
Dialogue Systems Multimodality Sentiment Analysis
The jumping reasoning curve? Tracking the evolution of reasoning performance in GPT-[n] and o-[n] models on multimodal puzzles
V Toh,
YK Chia,
D Ghosal,
S Poria
arXiv preprint arXiv:2502.01081
2025
Evaluation Multimodality Reasoning
Toward robust multimodal sentiment analysis using multimodal foundational models
X Zhao,
S Poria ,
X Li,
Y Chen,
B Tang
Expert Systems with Applications
2025
Multimodality Sentiment Analysis
Training vision-language process reward models for test-time scaling in multimodal reasoning: Key insights and lessons learned
B Ong,
TD Pala,
V Toh,
WC Tjhi,
S Poria
arXiv preprint arXiv:2509.23250
2025
Evaluation Multimodality Reasoning Speech & Audio
Why AI is weird and should not be this way: Towards AI for everyone, with everyone, by everyone
R Mihalcea,
O Ignat,
L Bai,
A Borah,
L Chiruzzo,
Z Jin,
C Kwizera,
J Nwatu,
S Poria
AAAI
2025
77 citations
Responsible AI
2024
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond
AR Kashyap,
TT Nguyen,
V Schlegel,
S Winkler,
SK Ng,
S Poria
EACL
2024
Survey
Mustango: Toward controllable text-to-music generation
J Melechovsky,
Z Guo,
D Ghosal,
N Majumder,
D Herremans,
S Poria
NAACL
2024
194 citations
GenAI Speech & Audio
Can-do! A dataset and neuro-symbolic grounded framework for embodied planning with large multimodal models
YK Chia,
Q Sun,
L Bing,
S Poria
arXiv preprint arXiv:2409.14277
2024
Commonsense Embodied AI Multimodality Reasoning Safety
Chain-of-Knowledge: Grounding large language models via dynamic knowledge adapting over heterogeneous sources
X Li,
R Zhao,
YK Chia,
B Ding,
S Joty,
S Poria ,
L Bing
ICLR
2024
325 citations
RAG Reasoning Trustworthiness
CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Models
X Li,
F Bu,
A Mehrish,
Y Li,
J Han,
B Cheng,
S Poria
NAACL Findings
2024
Speech & Audio
Consistency Guided Knowledge Retrieval and Denoising in LLMs for Zero-shot Document-level Relation Triplet Extraction
Q Sun,
K Huang,
X Yang,
R Tong,
K Zhang,
S Poria
WWW
2024
74 citations
RAG Reasoning Relation Extraction
DELLA-Merging: Reducing interference in model merging through magnitude-based sampling
PT Deep,
R Bhardwaj,
S Poria
arXiv preprint arXiv:2406.11617
2024
85 citations
ML Efficiency
Domain-expanded ASTE: Rethinking generalization in aspect sentiment triplet extraction
YK Chia,
H Chen,
G Chen,
W Han,
SM Aljunied,
S Poria ,
L Bing
Workshop on Social Influence in Conversations
2024
Sentiment Analysis Trustworthiness
Hate speech detection: A comprehensive review of recent works
A Gandhi,
P Ahir,
K Adhvaryu,
P Shah,
R Lohiya,
E Cambria,
S Poria ,
A Hussain
Expert Systems
2024
105 citations
Social NLP Survey
HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworks
Y Li,
R Bhardwaj,
A Mehrish,
B Cheng,
S Poria
COLING
2024
ML Efficiency Speech & Audio
Improving text-to-audio models with synthetic captions
Z Kong,
S Lee,
D Ghosal,
N Majumder,
A Mehrish,
R Valle,
S Poria ,
B Catanzaro
arXiv preprint arXiv:2406.15487
2024
GenAI Speech & Audio
INSTRAUG: Automatic Instruction Augmentation for Multimodal Instruction Fine-tuning
W Han,
H Chen,
S Poria
arXiv
2024
Multimodality
InstructEval: Towards holistic evaluation of instruction-tuned large language models
YK Chia,
P Hong,
L Bing,
S Poria
Workshop on the Scaling Behavior of Large Language Models
2024
168 citations
Agentic AI Alignment Dialogue Systems Evaluation Reasoning
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic
R Bhardwaj,
DD Anh,
S Poria
ACL
2024
146 citations
Alignment ML Efficiency Reasoning Safety
Large language models for automated open-domain scientific hypotheses discovery
Z Yang,
X Du,
J Li,
J Zheng,
S Poria ,
E Cambria
ACL
2024
161 citations
Commonsense Reasoning
Leveraging Parameter-Efficient Transfer Learning for Multi-Lingual Text-to-Speech Adaptation
Y Li,
A Mehrish,
B Chew,
B Cheng,
S Poria
arXiv preprint arXiv:2406.17257
2024
ML Efficiency Speech & Audio
Lightweight Spatial Modeling for Combinatorial Information Extraction From Documents
Y Dong,
L Deng,
J Zhang,
X Yu,
T Lin,
F Gelli,
S Poria ,
WS Lee
EACL
2024
Document AI ML Efficiency Relation Extraction
PanoSent: A Panoptic Sextuple Extraction Benchmark for Multimodal Conversational Aspect-based Sentiment Analysis
M Luo,
H Fei,
B Li,
S Wu,
Q Liu,
S Poria ,
E Cambria,
ML Lee,
W Hsu
ACM MM
2024
59 citations
Dialogue Systems Evaluation Multimodality Reasoning Sentiment Analysis
PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns
YK Chia,
VTY Han,
D Ghosal,
L Bing,
S Poria
ACL
2024
88 citations
Evaluation Multimodality Reasoning
Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths
YK Chia,
G Chen,
W Xu,
LA Tuan,
S Poria ,
L Bing
EMNLP
2024
Reasoning
Reward Steering with Evolutionary Heuristics for Decoding-time Alignment
CY Hung,
N Majumder,
A Mehrish,
S Poria
arXiv
2024
Alignment Reasoning
Ruby teaming: Improving quality diversity search with memory for automated red teaming
VTY Han,
R Bhardwaj,
S Poria
arXiv preprint arXiv:2406.11654
2024
Safety
Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations
R Hazra,
S Layek,
S Banerjee,
S Poria
EMNLP
2024
Alignment Question Answering Safety
Self-adaptive sampling for accurate video question answering on image text models
W Han,
H Chen,
MY Kan,
S Poria
NAACL Findings
2024
Multimodality Question Answering
Sowing the wind, reaping the whirlwind: The impact of editing language models
R Hazra,
S Layek,
S Banerjee,
S Poria
ACL
2024
Safety
Tango 2: Aligning diffusion-based text-to-audio generations through direct preference optimization
N Majumder,
CY Hung,
D Ghosal,
WN Hsu,
R Mihalcea,
S Poria
ACM MM
2024
208 citations
Alignment GenAI Multimodality Speech & Audio
Towards robust instruction tuning on multimodal large language models
W Han,
H Chen,
S Poria
arXiv preprint arXiv:2402.14492
2024
Multimodality
Two are better than one: Context window extension with multi-grained self-injection
W Han,
P Zhou,
S Poria ,
S Yan
arXiv preprint arXiv:2410.19318
2024
Linear Attention
Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsense
S Shen,
L Logeswaran,
M Lee,
H Lee,
S Poria ,
R Mihalcea
NAACL (Social Impact Award)
2024
99 citations
Commonsense
Understanding, Leveraging, and Improving Large Language Models
S Poria
Companion Proceedings of the ACM Web Conference
2024
Alignment Knowledge Graphs Reasoning Safety
Video2music: Suitable music generation from videos using an affective multimodal transformer model
J Kang,
S Poria ,
D Herremans
Expert Systems with Applications
2024
118 citations
Affective Computing GenAI Multimodality
Walledeval: A comprehensive safety evaluation toolkit for large language models
P Gupta,
LQ Yau,
HH Low,
IS Lee,
HM Lim,
YX Teoh,
KJ Hng,
DW Liew,
R Bhardwaj,
S Poria
EMNLP
2024
Evaluation Safety
2023
A Review of Deep Learning Techniques for Speech Processing
A Mehrish,
N Majumder,
R Bhardwaj,
R Mihalcea,
S Poria
Information Fusion
2023
576 citations
Affective Computing ML Efficiency Multimodality Speech & Audio
A Robust Information-Masking Approach for Domain Counterfactual Generation
P Hong,
R Bhardwaj,
N Majumder,
S Aditya,
S Poria
ACL Findings
2023
Text Style Transfer
Adapter Pruning using Tropical Characterization
R Bhardwaj,
T Vaidya,
S Poria
EMNLP Findings
2023
ML Efficiency
ADAPTERMIX: Exploring the Efficacy of Mixture of Adapters for Low-Resource TTS Adaptation
A Mehrish,
AR Kashyap,
L Yingting,
N Majumder,
S Poria
Interspeech
2023
ML Efficiency Speech & Audio
Contrastive chain-of-thought prompting
YK Chia,
G Chen,
LA Tuan,
S Poria ,
L Bing
arXiv preprint arXiv:2311.09277
2023
133 citations
Reasoning
Dialogue relation extraction with document-level heterogeneous graph attention networks
H Chen,
P Hong,
W Han,
N Majumder,
S Poria
Cognitive Computation
2023
71 citations
Dialogue Systems Reasoning Relation Extraction
Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech understanding
Y Li,
A Mehrish,
R Bhardwaj,
N Majumder,
B Cheng,
S Zhao,
A Zadeh,
R Mihalcea,
S Poria
ICASSP
2023
Evaluation ML Efficiency
Few-shot joint multimodal aspect-sentiment analysis based on generative multimodal prompt
X Yang,
S Feng,
D Wang,
Q Sun,
W Wu,
Y Zhang,
P Hong,
S Poria
ACL Findings
2023
61 citations
Multimodality Sentiment Analysis
Few-shot multimodal sentiment analysis based on multimodal probabilistic fusion prompts
X Yang,
S Feng,
D Wang,
Y Zhang,
S Poria
ACM MM
2023
65 citations
Multimodality Sentiment Analysis
Flacuna: Unleashing the problem solving power of vicuna using flan fine-tuning
D Ghosal,
YK Chia,
N Majumder,
S Poria
arXiv preprint arXiv:2307.02053
2023
Dialogue Systems Evaluation Reasoning
kNN-CM: A Non-parametric Inference-Phase Adaptation of Parametric Text Classifiers
R Bhardwaj,
Y Li,
N Majumder,
B Cheng,
S Poria
EMNLP Findings
2023
NLI Sentiment Analysis
Language guided visual question answering: Elevate your multimodal language model using knowledge-enriched prompts
D Ghosal,
N Majumder,
RKW Lee,
R Mihalcea,
S Poria
EMNLP
2023
Commonsense Embodied AI Multimodality Question Answering Reasoning
Language model unalignment: Parametric red-teaming to expose hidden harms and biases
R Bhardwaj,
S Poria
arXiv preprint arXiv:2310.14303
2023
Alignment Safety
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models
Z Hu,
Y Lan,
L Wang,
W Xu,
EP Lim,
RKW Lee,
L Bing,
S Poria
EMNLP
2023
893 citations
Commonsense ML Efficiency Reasoning
MM-BigBench: Evaluating multimodal models on multimodal content comprehension tasks
X Yang,
W Wu,
S Feng,
M Wang,
D Wang,
Y Li,
Q Sun,
Y Zhang,
X Fu,
S Poria
arXiv preprint arXiv:2310.09036
2023
Evaluation Multimodality Reasoning
Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions
A Gandhi,
K Adhvaryu,
S Poria ,
E Cambria,
A Hussain
Information Fusion
2023
1023 citations
Multimodality Sentiment Analysis Survey
Red-teaming large language models using chain of utterances for safety-alignment
R Bhardwaj,
S Poria
arXiv preprint arXiv:2308.09662
2023
292 citations
Alignment Dialogue Systems Safety
Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding
YX Tan,
N Majumder,
S Poria
Interspeech
2023
Dialogue Systems ML Efficiency Speech & Audio
Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model
D Ghosal,
N Majumder,
A Mehrish,
S Poria
ACM MM
2023
387 citations
GenAI Reasoning Speech & Audio
UDApter: Efficient Domain Adaptation Using Adapters
B Malik,
AR Kashyap,
MY Kan,
S Poria
EACL
2023
ML Efficiency NLI Sentiment Analysis Text Style Transfer
Uncertainty Guided Label Denoising for Document-level Distant Relation Extraction
Q Sun,
K Huang,
X Yang,
P Hong,
K Zhang,
S Poria
ACL
2023
Relation Extraction
WikiDes: A Wikipedia-based dataset for generating short descriptions from paragraphs
HT Ta,
ABS Rahman,
N Majumder,
A Hussain,
L Najjar,
N Howard,
S Poria ,
A Gelbukh
Information Fusion
2023
Multimodality Sentiment Analysis
2022
A dataset for hyper-relational extraction and a cube-filling approach
YK Chia,
L Bing,
SM Aljunied,
L Si,
S Poria
EMNLP
2022
Knowledge Graphs Relation Extraction
Analyzing Modality Robustness in Multimodal Sentiment Analysis
D Hazarika,
Y Li,
B Cheng,
S Zhao,
R Zimmermann,
S Poria
NAACL
2022
94 citations
Multimodality Sentiment Analysis
CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues
D Ghosal,
S Shen,
N Majumder,
R Mihalcea,
S Poria
ACL
2022
72 citations
Affective Computing Commonsense Conversational Reasoning Dialogue Systems Reasoning
DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification
H Chen,
W Han,
D Yang,
S Poria
COLING
2022
Sentiment Analysis
Exemplars-guided empathetic response generation controlled by the elements of human communication
N Majumder,
D Ghosal,
D Hazarika,
A Gelbukh,
R Mihalcea,
S Poria
IEEE Access
2022
Affective Computing Sentiment Analysis
Improving aspect-level sentiment analysis with aspect extraction
N Majumder,
R Bhardwaj,
S Poria ,
A Gelbukh,
A Hussain
Neural Computing and Applications
2022
52 citations
Sentiment Analysis
Improving zero-shot learning baselines with commonsense knowledge
A Roy,
D Ghosal,
E Cambria,
N Majumder,
R Mihalcea,
S Poria
Cognitive Computation
2022
Commonsense Knowledge Graphs
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
R Bhardwaj,
T Vaidya,
S Poria
COLING
2022
ML Efficiency
Knowledge enhanced reflection generation for counseling dialogues
S Shen,
V Pérez-Rosas,
C Welch,
S Poria ,
R Mihalcea
ACL
2022
Commonsense Dialogue Systems
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences
W Han,
H Chen,
MY Kan,
S Poria
EMNLP
2022
Alignment Multimodality
Multimodal Research in Vision and Language: A Review of Current and Emerging Trends
S Uppal,
S Bhagat,
D Hazarika,
N Majumdar,
S Poria ,
R Zimmermann,
A Zadeh
Information Fusion
2022
172 citations
Multimodality Survey
Multiview contextual commonsense inference: A new dataset and task
S Shen,
D Ghosal,
N Majumder,
H Lim,
R Mihalcea,
S Poria
arXiv preprint arXiv:2210.02890
2022
Affective Computing Commonsense Dialogue Systems
PIP: Physical Interaction Prediction via mental simulation with span selection
J Duan,
S Yu,
S Poria ,
B Wen,
C Tan
ECCV
2022
Embodied AI
Proceedings of the 3rd Workshop on Figurative Language Processing (FLP)
D Ghosh,
BB Klebanov,
S Muresan,
A Feldman,
S Poria ,
T Chakrabarty
Workshop on Figurative Language Processing
2022
Survey
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction
YK Chia,
L Bing,
S Poria ,
L Si
ACL
2022
191 citations
Relation Extraction
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning
W Han,
H Chen,
Z Hai,
S Poria ,
L Bing
COLING
2022
Multimodality
SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Training
H Chen,
W Han,
S Poria
COLING
2022
Sentiment Analysis
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer
AR Kashyap,
D Hazarika,
MY Kan,
R Zimmermann,
S Poria
ACL
2022
Text Style Transfer
Towards solving NLP tasks with optimal transport loss
R Bhardwaj,
T Vaidya,
S Poria
Journal of King Saud University-Computer and Information Sciences
2022
Alignment
Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering
D Ghosal,
N Majumder,
R Mihalcea,
S Poria
EMNLP
2022
Commonsense Question Answering Reasoning
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding
R Bhardwaj,
A Saha,
SCH Hoi,
S Poria
EMNLP
2022
ML Efficiency
2021
Affect recognition for multimodal natural language processing
S Poria ,
OY Soon,
B Liu,
L Bing
Cognitive Computation
2021
Affective Computing Dialogue Systems Multimodality Speech & Audio
Aspect sentiment triplet extraction using reinforcement learning
S Yu Bai Jian,
T Nayak,
N Majumder,
S Poria
CIKM
2021
55 citations
Sentiment Analysis
Bi-bimodal modality fusion for correlation-controlled multimodal sentiment analysis
W Han,
H Chen,
A Gelbukh,
A Zadeh,
L Morency,
S Poria
ICMI
2021
359 citations
Affective Computing Multimodality Sentiment Analysis
Causal augmentation for causal sentence classification
FA Tan,
D Hazarika,
SK Ng,
S Poria ,
R Zimmermann
Workshop on Causal Inference and NLP
2021
Sentiment Analysis
CIDER: Commonsense inference for dialogue explanation and reasoning
D Ghosal,
P Hong,
S Shen,
N Majumder,
R Mihalcea,
S Poria
SIGDIAL
2021
Commonsense Conversational Reasoning Dialogue Systems Reasoning
Deep neural approaches to relation triplets extraction: a comprehensive survey
T Nayak,
N Majumder,
P Goyal,
S Poria
Cognitive Computation
2021
82 citations
Relation Extraction Survey
Discriminative dictionary design for action classification in still images and videos
A Roy,
B Banerjee,
A Hussain,
S Poria
Cognitive Computation
2021
Reasoning
DOZEN: Cross-domain zero shot named entity recognition with knowledge graph
HV Nguyen,
F Gelli,
S Poria
SIGIR
2021
Knowledge Graphs
Exploring the role of context in utterance-level emotion, act and intent classification in conversations: An empirical study
D Ghosal,
N Majumder,
R Mihalcea,
S Poria
ACL Findings
2021
Affective Computing Conversational Reasoning Dialogue Systems
Improving distantly supervised relation extraction with self-ensemble noise filtering
T Nayak,
N Majumder,
S Poria
RANLP
2021
Relation Extraction
Improving multimodal fusion with hierarchical mutual information maximization for multimodal sentiment analysis
W Han,
H Chen,
S Poria
EMNLP
2021
851 citations
Multimodality Sentiment Analysis
Information fusion for affective computing and sentiment analysis
A Hussain,
E Cambria,
S Poria ,
A Hawalah,
F Herrera
Information Fusion
2021
Affective Computing Embodied AI ML Efficiency Multimodality Sentiment Analysis
Investigating gender bias in BERT
R Bhardwaj,
N Majumder,
S Poria
Cognitive Computation
2021
173 citations
Affective Computing Responsible AI Sentiment Analysis Social NLP
M2H2: A multimodal multiparty hindi dataset for humor recognition in conversations
DS Chauhan,
GV Singh,
N Majumder,
A Zadeh,
A Ekbal,
P Bhattacharyya,
S Poria
ICMI
2021
Dialogue Systems Multimodality Speech & Audio
More identifiable yet equally performant transformers for text classification
R Bhardwaj,
N Majumder,
S Poria ,
E Hovy
ACL
2021
Trustworthiness
Persuasive dialogue understanding: The baselines and negative results
H Chen,
D Ghosal,
N Majumder,
A Hussain,
S Poria
Neurocomputing
2021
Conversational Reasoning Dialogue Systems
Phonetic-enriched text representation for Chinese sentiment analysis with reinforcement learning
H Peng,
Y Ma,
S Poria ,
Y Li,
E Cambria
Information Fusion
2021
69 citations
Multimodality Sentiment Analysis
Recognizing emotion cause in conversations
S Poria ,
N Majumder,
D Hazarika,
D Ghosal,
R Bhardwaj,
SYB Jian,
P Hong,
R Ghosh,
A Roy,
N Chhaya,
A Gelbukh,
R Mihalcea
Cognitive Computation
2021
205 citations
Affective Computing Dialogue Systems
Retrieving and reading: A comprehensive survey on open-domain question answering
F Zhu,
W Lei,
C Wang,
J Zheng,
S Poria ,
TS Chua
arXiv preprint arXiv:2101.00774
2021
455 citations
Question Answering Survey
STACK: Sentence ordering with temporal commonsense knowledge
D Ghosal,
N Majumder,
R Mihalcea,
S Poria
EMNLP
2021
Commonsense
2020
Anaphora and coreference resolution: A review
R Sukthanker,
S Poria ,
E Cambria,
R Thirunavukarasu
Information Fusion
2020
310 citations
Multimodality Relation Extraction Sentiment Analysis Survey
Beneath the tip of the iceberg: Current challenges and new directions in sentiment analysis research
S Poria ,
D Hazarika,
N Majumder,
R Mihalcea
IEEE Transactions on Affective Computing
2020
469 citations
Affective Computing Sentiment Analysis
CMU-MOSEAS: A multimodal language dataset for Spanish, Portuguese, German and French
AAB Zadeh,
Y Cao,
S Hessner,
PP Liang,
S Poria ,
LP Morency
EMNLP
2020
104 citations
Affective Computing Multimodality Sentiment Analysis
Conversational Transfer Learning for Emotion Recognition
D Hazarika,
S Poria ,
R Zimmermann,
R Mihalcea
Information Fusion
2020
152 citations
Affective Computing Dialogue Systems Multimodality
COSMIC: Commonsense knowledge for emotion identification in conversations
D Ghosal,
N Majumder,
A Gelbukh,
R Mihalcea,
S Poria
EMNLP Findings
2020
569 citations
Affective Computing Commonsense Conversational Reasoning Dialogue Systems
Dialogue systems with audio context
T Young,
V Pandelea,
S Poria ,
E Cambria
Neurocomputing
2020
Dialogue Systems GenAI Multimodality
KinGDOM: Knowledge-Guided DOMain adaptation for sentiment analysis
D Ghosal,
D Hazarika,
A Roy,
N Majumder,
R Mihalcea,
S Poria
ACL
2020
99 citations
Commonsense Knowledge Graphs Sentiment Analysis Text Style Transfer
MIME: MIMicking emotions for empathetic response generation
N Majumder,
P Hong,
S Peng,
J Lu,
D Ghosal,
A Gelbukh,
R Mihalcea,
S Poria
EMNLP
2020
346 citations
Affective Computing Sentiment Analysis
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
D Hazarika,
R Zimmermann,
S Poria
ACM MM
2020
1795 citations
Affective Computing Multimodality Sentiment Analysis
MTAG: Modal-temporal attention graph for unaligned human multimodal language sequences
J Yang,
Y Wang,
R Yi,
Y Zhu,
A Rehman,
A Zadeh,
S Poria ,
LP Morency
NAACL
2020
193 citations
Affective Computing Multimodality Sentiment Analysis
SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis
E Cambria,
Y Li,
FZ Xing,
S Poria ,
K Kwok
CIKM
2020
635 citations
Commonsense Reasoning Sentiment Analysis
Social media marketing and financial forecasting
F Xing,
S Poria ,
E Cambria,
R Welsch
Information Processing & Management
2020
Multimodality
Utterance-level dialogue understanding: An empirical study
D Ghosal,
N Majumder,
R Mihalcea,
S Poria
NAACL
2020
Affective Computing Dialogue Systems
2019
An Attention-Based Model for Learning Dynamic Interaction Networks
S Cavallari,
S Poria ,
E Cambria,
VW Zheng,
H Cai
IJCNN
2019
ML Efficiency
DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation
D Ghosal,
N Majumder,
S Poria ,
N Chhaya,
A Gelbukh
EMNLP
2019
1126 citations
Affective Computing Dialogue Systems
DialogueRNN: An attentive RNN for emotion detection in conversations
N Majumder,
S Poria ,
D Hazarika,
R Mihalcea,
A Gelbukh,
E Cambria
AAAI
2019
1327 citations
Affective Computing Dialogue Systems Sentiment Analysis
Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances
S Poria ,
N Majumder,
R Mihalcea,
E Hovy
IEEE Access
2019
742 citations
Affective Computing Dialogue Systems
Factorized multimodal transformer for multimodal sequential learning
A Zadeh,
C Mao,
K Shi,
Y Zhang,
PP Liang,
S Poria ,
LP Morency
arXiv preprint arXiv:1911.09826
2019
71 citations
Multimodality Speech & Audio
MELD: A multimodal multi-party dataset for emotion recognition in conversations
S Poria ,
D Hazarika,
N Majumder,
G Naik,
E Cambria,
R Mihalcea
ACL
2019
2514 citations
Affective Computing Dialogue Systems Multimodality Sentiment Analysis
Multi-task Learning for Multi-Modal Emotion Recognition and Sentiment Analysis
MS Akhtar,
DS Chauhan,
D Ghosal,
S Poria ,
A Ekbal,
P Bhattacharyya
NAACL
2019
314 citations
Affective Computing Multimodality Sentiment Analysis Speech & Audio
Sentiment and Sarcasm Classification with Multitask Learning
N Majumder,
S Poria ,
H Peng,
N Chhaya,
E Cambria,
A Gelbukh
IEEE Intelligent Systems
2019
284 citations
Affective Computing Sarcasm Detection Sentiment Analysis Social NLP
The Nitty-GRITties of Success: Computational Analysis of Grit From Language
T Maheshwari,
A Reganti,
S Poria ,
R Mihalcea
IEEE Access
2019
Reasoning
Towards Multimodal Sarcasm Detection (An Obviously Perfect Paper)
S Castro,
D Hazarika,
V Pérez-Rosas,
R Zimmermann,
R Mihalcea,
S Poria
ACL
2019
554 citations
Dialogue Systems Multimodality Sarcasm Detection Social NLP
Variational Fusion for Multimodal Sentiment Analysis
N Majumder,
S Poria ,
G Krishnamurthy,
N Chhaya,
R Mihalcea,
A Gelbukh
arXiv preprint arXiv:1908.06008
2019
Multimodality Sentiment Analysis
WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation
A Zadeh,
T Ma,
S Poria ,
LP Morency
arXiv preprint arXiv:1911.09783
2019
Speech & Audio