Publications

Metrics for Holistic Evaluation of LLM Reasoning about Action, Change, and Planning

Published in NeurIPS 2025 Workshop on Evaluating the Evolving LLM Lifecycle: Benchmarks, Emergent Abilities, and Scaling, 2025

New informative Metrics for Evaluation of LLM Responses in Planning and Reasoning tasks.

LLMs Need to Go Beyond Computational Confidence Metrics to Establish Trust

Published in AAAI Symposium on AI Trustworthiness and Risk Assessment for Challenged Contexts (ATRACC-25), 2025

Perspective Paper on highlighting the Insufficiency of Computational Assessments of Trust and the need for Human-Centered Evaluations of Trustworthiness in Generative AI Systems.

Incorporating Human Flexibility Through Reward Preferences in Human-AI Teaming

Published in Arxiv, 2024

This work establishes a human~Al preference-based reinforcement learning cooperation game where the RL agent queries the human-in»the-Ioop to elicit task objectives and human preferences on joint team behavior.

Download Paper

Position: LLMs can’t plan, but can help planning in LLM-modulo frameworks

Published in International Conference on Machine Learning (ICML) as Spotlight, 2024

This work proposes a novel neuro-symbolic approach for reliable planning with LLMs by having external model-based verifiers and critics in a bi-directional interaction regime.

Recommended citation: Kambhampati, S., Valmeekam, K., Guan, L., Verma, M., Stechly, K., Bhambri, S., ... & Murthy, A. B. (2024, June). Position: LLMs can’t plan, but can help planning in LLM-modulo frameworks. In Forty-first International Conference on Machine Learning.
Download Paper