DeCLaRe Lab · NTU Singapore
Research
We study how models understand language, images and sound, learn from experience, and act reliably.
Safety
We test whether AI systems stay within their job and follow safety rules after further training.
Trustworthiness
We check whether answers are supported by evidence, cite it correctly and stop when the evidence is not enough.
Multimodality
We build models that connect language with speech, sound, images, video and music.
AI for Science
A model can generate many research ideas, but which are worth testing? MOOSE-Chem studies how hypotheses can be assembled from the literature. RQ-Bench tests whether model judges agree with experts about novelty. IDEAgent searches for distinct proposals and revises them using feedback, while leaving their scientific value to be checked.
Efficiency
We reduce training and inference cost through better data selection, compact memory, model merging and faster attention.
Embodied AI
We turn visual and language instructions into robot actions, and test whether those actions work outside familiar settings.
Safety
SafetyTrustworthiness2023–2026
CoU, RESTA, WalledEval + OffTopicEval
We test conversational attacks, restore safety after further training, and check whether deployed agents stay within their assigned roles.
Trustworthiness
TrustworthinessSafety2025–2026
KAIROS + Epistemic Context Learning
KAIROS tests when peers change an agent's answer; ECL teaches the agent to judge those peers from their earlier decisions.
TrustworthinessEfficiency2023–2025
Chain-of-Knowledge + Trust-Align
Chain-of-Knowledge retrieves evidence to correct intermediate reasoning. Trust-Align trains answers and citations against supplied documents, including refusal when those documents are insufficient.
Multimodality
ScrambleToolBench + MNIST-PRO
These benchmarks ask whether an agent can learn unfamiliar tools and build a reliable picture from small glimpses.
MultimodalityEfficiency2023–2026
Tango, Mustango + JAM
Tango generates sound from descriptions. Mustango adds beat and chord controls; TangoFlux reduces sampling time; JAM uses word timings to generate songs.
MultimodalityTrustworthiness2024–2025
PuzzleVQA, AlgoPuzzleVQA + M-LongDoc
PuzzleVQA and AlgoPuzzleVQA test visual patterns and algorithms. M-LongDoc asks models to find and explain evidence in long documents.
MultimodalityAffective computing2018–2019
MELD + DialogueRNN
Understanding an emotion often means following who said what, how they said it, and what happened earlier.
Multimodal representation learning
TFN, MISA and Multimodal-InfoMax study how to combine language, vision and audio: by modelling their interactions, separating shared and modality-specific information, or preserving information during fusion.
Multimodality2017
Tensor Fusion Network (TFN)
TFN combines words, facial expressions and vocal cues so their interactions can change the predicted sentiment.
Multimodality2020
MISA
MISA gives language, vision and audio both shared and modality-specific representations, then combines all six vectors to predict sentiment or humour.
Multimodality2021
Multimodal-InfoMax
Multimodal-InfoMax trains a fused representation to retain information from the transcript, face and voice.
AI for Science
AI for Science2025–2026
MOOSE-Chem, RQ-Bench + IDEAgent
MOOSE-Chem generates hypotheses from the literature. RQ-Bench checks whether novelty judges agree with scientists. IDEAgent develops sets of distinct ideas through repair and refinement.
Efficiency
δ-mem + Σ-Mem
δ-mem compresses earlier context into a fixed-size state. Σ-Mem updates task-specific records of peer correctness and uses them to select, route or combine answers.
Embodied AI
GE-Act 2.0
GE-Act 2.0 predicts future visual states and uses them to generate robot actions. The real-robot study covers 100 tasks without task-specific fine-tuning.
An AgiBot–DeCLaRe Lab collaboration, with Renhang Liu as DeCLaRe's lead core contributor and Soujanya Poria contributing as an academic advisor.
Methods and results
NORA + NORA-1.5
NORA turns an image and an instruction into robot actions; NORA-1.5 learns from comparisons between candidate actions.
Code, models and data
-
Audio and music generation · Model · ICLR 2026
TangoFlux
Text-to-audio generation with flow matching and CRPO preference optimisation. Generates 30 seconds of 44.1 kHz audio in a few seconds on a single A40.
-
Audio and music generation · Model · ACM MM 2023
Tango
An open latent-diffusion model for text-to-audio, built on an instruction-tuned LLM text encoder rather than a contrastive one.
-
Audio and music generation · Model · NAACL 2024
Mustango
Text-to-music generation conditioned on explicit musical structure — chords, beats, tempo and key — rather than free-text mood alone.
-
Audio and music generation · Model · 2025
JAM
A compact flow-based song generator with word-level lyric timing control and aesthetic alignment from synthetic preference pairs.
-
Audio and music generation · Dataset · 2023
TangoPromptBank
The text-audio caption corpus Tango was pretrained on.
4,497/mo
-
Embodied AI and robotics · Model · 2025
NORA
A 3B-parameter open generalist vision-language-action model trained on 970k real-world robot demonstrations, built for low inference cost.
-
Embodied AI and robotics · Model · 2025
NORA-1.5
NORA with a flow-matching action expert, post-trained against world-model and action-based preference rewards.
-
Embodied AI and robotics · Model · 2025
Emma-X
An embodied multimodal action model that plans with grounded chain-of-thought and look-ahead spatial reasoning.
-
Trustworthiness and safety · Model + data · ICLR 2025
Trust-Align
Measures whether RAG answers are supported and fully cited, and trains models to refuse when the retrieved evidence is insufficient.
-
Trustworthiness and safety · Code · ACL 2024
RESTA
Restoring safety in fine-tuned language models by adding a safety vector back through task arithmetic, without losing downstream capability.
-
Trustworthiness and safety · Code + data · 2023
Red-Instruct
Chain-of-Utterances red-teaming, with the RED-EVAL benchmark and the HarmfulQA dataset for probing and repairing harmful behaviour.
-
Trustworthiness and safety · Benchmark · ICLR 2026
OffTopicEval
Measures whether a task-scoped LLM agent accepts what falls inside its remit and refuses what falls outside it.
-
Efficiency, memory and agents · Code · ICML 2026
Data Agent
Learns which training examples to select as the target model changes, using difficulty and uncertainty as feedback.
-
Efficiency, memory and agents · Model · 2026
δ-mem
Online associative memory for LLMs — a 0.12% parameter addition that modulates attention through a low-rank interface while the backbone stays frozen.
-
Efficiency, memory and agents · Code · 2026
IDEAgent
Searches for a set of research ideas that meet quality thresholds without repeating one another.
-
Efficiency, memory and agents · Code · 2026
EFLA
Error-free linear attention derived as an exact solution from continuous-time dynamics rather than an approximation.
77 stars
-
Efficiency, memory and agents · Model · 2023
Flan-Alpaca
Extending Stanford Alpaca's synthetic instruction tuning to Flan-T5, with the Flan-mini instruction collection released alongside.
-
Efficiency, memory and agents · Benchmark · 2023
InstructEval
Evaluates instruction-tuned models on problem solving, writing and alignment to human values.
-
Multimodal understanding · Dataset · ACL 2019
MELD
Multimodal multi-party emotion recognition in conversation, used in later audio and multimodal evaluation work.
-
Multimodal understanding · Code · 2019
conv-emotion
Reference implementations of emotion-recognition-in-conversation models, including DialogueRNN.
1,523 stars
-
Multimodal understanding · Code · 2020
multimodal-deep-learning
A collection of multimodal representation-learning and fusion models for sentiment and emotion, kept as a single reference implementation set.
920 stars
-
Multimodal understanding · Code · ACM MM 2020
MISA
Decomposes multimodal representations into modality-invariant and modality-specific subspaces before fusion.
-
Multimodal understanding · Dataset · 2021
RECCON
Recognising the cause of an emotion in conversation, not only the emotion itself.
191 stars
-
Multimodal understanding · Dataset · 2022
CICERO
Dialogue-level commonsense inference — causes, motivations, reactions and consequences drawn from conversation.
-
Multimodal understanding · Benchmark · 2024
PuzzleVQA
Abstract visual puzzles and algorithmic reasoning tasks that separate perception from inductive reasoning in multimodal models.
119 stars 454/mo
-
Reading lists · Reading list · 2018
Awesome Sentiment Analysis
537 stars
-
Reading lists · Reading list · 2019
Awesome ERC
283 stars
No releases match that search.
Updated 14 September 2026 · All 80 public GitHub repositories · 51 models and 21 datasets on Hugging Face