Activation-Steered Personas in Task-Oriented LLM Agent Simulations
Abstract
Large language models are increasingly used to simulate both user and system behavior in task-oriented dialogue (TOD). Yet personality control in these simulations remains largely prompt-based, making trait expression difficult to regulate and verify across dialogue turns. We investigate activation steering as an inference-time mechanism for inducing and adapting personality in TOD simulation. In our framework, user-side steering (US) applies fixed Big Five trait-pole activation vectors with scalar coefficients to generate users with different trait intensities. System-side adaptive steering (SA) dynamically adapts the system agent at each turn by predicting system-side steering coefficients from the dialogue context. We evaluate four steering conditions: an unsteered Baseline, SA, US, and US+SA, using the Schema-Guided Dialogue benchmark across the Restaurants and Movies domains. Qwen2.5-7B-Instruct is used as the primary model, and Llama-3.1-8B-Instruct is used as a robustness setting. Our results show that activation-level personality control affects TOD behavior, but its benefits depend on domain, trait observability, and steering strength. Compared with the unsteered Baseline, SA improves standard task metrics slightly, with larger gains in pairwise-judged user satisfaction and truthfulness, mainly in Restaurants, where dialogues contain richer personality-relevant slots and preferences. User-side steering produces observable personality expression only for some traits: socially or affectively expressive traits such as careless, outgoing, compassionate, and nervous become more detectable at stronger steering, while consistent and solitary remain difficult to observe in short TOD interactions. Adding SA to steered users yields modest task-level changes but a statistically significant improvement in pairwise-judged truthfulness (+8.3 pp) and user satisfaction (+2.7 pp). System-side composition analysis further shows that SA does not directly mirror the user's trait; it usually defaults to Conscientiousness-centered system behavior and becomes more socially adaptive when user trait expression is observable especially at higher steering scalar. Overall, activation steering is a viable alternative to prompt-based personality conditioning for controlled TOD simulation, but its effects must be evaluated with respect to trait observability, steering strength, and the personality relevance of the task domain.