%AGlazier, Arie%ALoreggia, Andrea%AMattei, Nicholas%ARahgooy, Taher%ARossi, Francesca%AVenable, Brent%D2021%I %K %MOSTI ID: 10309918 %PMedium: X %TLearning Behavioral Soft Constraints from Demonstrations %XMany real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? These scenarios force us to evaluate the trade-off between collective norms and our own personal objectives. To create effective AI-human teams, we must equip AI agents with a model of how humans make trade-offs in complex, constrained environments. These agents will be able to mirror human behavior or to draw human attention to situations where decision making could be improved. To this end, we propose a novel inverse reinforcement learning (IRL) method for learning implicit hard and soft constraints from demonstrations, enabling agents to quickly adapt to new settings. In addition, learning soft constraints over states, actions, and state features allows agents to transfer this knowledge to new domains that share similar aspects. Country unknown/Code not availableOSTI-MSA