The lifespan of buildings extends for a long time. During this life-time, changes occur along various time scales – the inhabitants will change, usually in cycles of decades; the needs of the inhabitants change in cycles of years; their activities and ways of using the building change per season; they have their weekly and daily rhythms, and during the day many different things happen inside the building. This principle applies for all types of buildings; domestic, work, industry, entertainment, and so on. Changing buildings often is costly, involving much time and labor; therefore, the physical alteration of buildings is avoided rather than embraced. Yet conventional design methods are ill-equipped to take the changes described above into account, nor are there methods able to deliver building designs that appropriately incorporate such changes. Some attempts have been undertaken to deal with change, mainly through conventional means. Advances in contemporary technology have brought the notion of interactive architecture to a completely new level. We need to conceive buildings as agents, not as passive technology containers. In consequence, the architectural discourse should include research and understanding derived from computer science, interaction design, cognitive science, and many other disciplines. In this paper, we provide a concise critical reading of such sources, to arrive at our claim that interaction narratives form an approach to unify such concepts in an architecturally productive way.