A crucial requirement for effective human-AI teaming is the ability to form mutually compatible mental models that help humans discern when the AI can be relied upon and how to best complement each other. To understand the impact of having this mutual understanding, we conducted an experiment where participants (N=125), tasked as disaster relief planners, were assisted by an AI agent that recommends optimal allocation of a resource based on several information sources. The interaction effects of mental models between the human and the AI were studied.