If users consider intelligent systems not as tools but as intelligent agents that take on some tasks in a more autonomous way, the design of such systems must consider the interplay between human and non-human agents from a socio-technical perspective. How can we use established requirements methods and conceptual frameworks to model such an extended context of use? Instead of extending the traditional task-oriented context of use itself, we are proposing to embed the task context into an additional team context and the larger organizational context. With such a three-layer context framework, we provide a conceptual framework that supports designers to identify stakeholder requirements for the application of intelligent system agents. These requirements should be related to these context layers or originate from the dynamics and tensions between those layers. This framework will help formalize and model the interaction dynamics between intelligent system agents and human stakeholders along the different levels of task, team, and organizational context. This holistic design focus is necessary to support the dynamic evolution of task sharing between human and non-human agents within a work environment.