A value-centered approach to science, technology and society (STS) education illuminates the need of reflexive and relational learning through communication and public engagement. Visualization is a key to represent and compare mental models such as assumptions, background theories and value systems that tacitly shape our own understanding, interests and interactions. Yet conventional approaches including concept mapping and multi-criteria value elicitation methods often have little suggestion or implication as to how participants themselves can address and deliberate the incompatibility of their perceptions, preferences and perspectives. This study proposes Q workshop as a legitimate eliciting and deliberation technique that can be employed in pluralistic discourse, exploring systematic divergences of perspective by constructing the participant‘s self in a formative, emergent and contingent manner. For this it introduces Q mapping as a novel visualization tool for the hybridity of qualitative and quantitative methods derived from Q methodology. Q mapping is a two-factor solution that transforms the similarities in participants’ individual Q scores into distances represented in two-dimensional space, for the sake of illustrating the relative positioning and partitioning of perspectives in a schematic figure. A case study on STS education for postgraduate students demonstrates that Q workshop can play a heuristic and abductive role in providing independent illumination of distinguishable perspectives and facilitating individual and collective learning among participants, suggesting a schematic two-dimensional basis for resolving the key differences.

Addams, H., & Proops, J. (Eds.) (2000). Social discourse and environmental policy: An application of Q methodology. Edward Elgar.

Al-Diban, S., & Ifenthaler, D. (2011). Comparison of two analysis approaches for measuring externalized mental models. Educational Technology & Society, 14(2), 16-30.

Allchin, D. (1999). Values in science: an educational perspective. Science & Education, 8, 1-12.

Aoki, S. (2006). Principal component analysis. Downloaded from
http://aoki2.si.gunma-u.ac.jp/lecture/stats-by-excel/vba/xls/pca.xls

Argyris, C., & Schön, D. (1978). Organizational learning: A theory of action perspective. Addison-Wesley.

Arrindel, W. A., van der Ende, J. (1985). An empirical test of the utility of the observations-to-variables ration in factor and components analysis. Applied Psychological Measurement, 9, 165-178.

Barker, J. H. (2008). Q-methodology: an alternative approach to research in nurse education. Nurse Education Today, 28, 917-925.

Bell, R. L. & Lederman, N. G. (2003). Understandings of the nature of science and decision making on science and technology based issues. Science Education, 87, 352-377. doi:10.1002/sce.10063

Bowen, C. W. (2000). A quantitative literature review of cooperative learning effects on high school and college chemistry achievement. Journal of Chemical Education, 77, 116-119.

Brouwer, M. (1992-93). Validity: Q vs. R. Operant Subjectivity, 16, 1-17.

Brown, S. R. (1980). Political subjectivity: Applications of Q methodology in political science. New Haven, CT: Yale University Press.

Brown, S. R. (1996). Q methodology and qualitative research. Qualitative Health Research, 6, 561-567.

Brown, S. R. (2009). Q technique, method, and methodology: comments on Stentor Danielson’s article. Field Methods, 21, 238-241.

Brown, S. R., Danielson, S., & van Exel, J. (2015). Overly ambitious critics and the Medici Effect: a reply to Kampen and Tamás. Quality & Quantity, 49, 523-537.

Brown, S. R., Durning, D. W., Selden, S. C. (2008). Q methodology. In G. J. Miller & K. Yang (Eds.), Handbook of research methods in public administration (pp. 721-763). CRC Press.

Bruine de Bruin, W., & Bostrom, A. (2013). Assessing what to address in science communication. Proceedings of the National Academy of Sciences, 110, 14062-14068. doi:10.1073/pnas.1212729110

Burgess, J., Stirling, A., Clark, J., Davies, G., Eames, M., Staley, K., & Williamson, S. (2007). Deliberative mapping: a novel analytic-deliberative methodology to support contested science-policy decisions. Public Understanding of Science, 16, 299-322.

Burt, C., & Stephenson, W. (1939). Alternative views on correlations between persons. Psychometrika, 4, 269-281.

Cairns, R. C. (2012). Understanding science in conservation: a Q method approach on the Galápagos Islands. Conservation and Society, 10, 217-31.

Cairns, R. C., & Stirling, A. (2014). ‘Maintaining planetary systems’ or ‘concentrating global power?’ High stakes in contending framings of climate geoengineering. Global Environmental Change, 28, 25-38.

Capdevila, R. and Stainton Rogers, R. (2000). If you go down to the woods today ... narratives of Newbury. In H. Addams & J. Proops (Eds.), Social discourse and environmental policy: An application of Q methodology (pp. 152-173). Edward Elgar.

Carley, K., & Palmquist, M. (1992). Extracting, representing, and analyzing mental models. Social Forces, 70, 601-636.

Chatterji, S., Mukerjee, M. (1986). Isolation of profile pattern of successful individuals using cluster analysis and Q-technique. Japanese Psychological Research, 28, 161-167.

Chen, L., Chen, T.-L., & Chen, N.-S. (2015). Students’ perspectives of using cooperative learning in a flipped statistics classroom. Australasian Journal of Educational Technology, 31, 621-640.

Chi, M. T. H. (2008). Three types of conceptual change: belief revision, mental model transformation, and categorical shift. In S. Vosniadou (Ed.), Handbook of research on conceptual change (pp. 61-82). Hillsdale, NJ: Erlbaum.

Chilvers, J. (2013). Reflexive engagement? Actors, learning, and reflexivity in public dialogue on science and technology. Science Communication, 35, 283-310. doi:10.1177/1075547012454598

Chilvers, J., & Burgess, J. (2008). Power relations: the politics of risk and procedure in nuclear waste governance. Environment and Planning A, 40, 1881-1900.

Chilvers, J., & Kearnes, M. (2016). Remaking participation: Science, environment and emergent publics. Abingdon & New York: Routledge.

Cobern, W. W. (1996). Worldview theory and conceptual change in science education. Science Education, 80, 579-610.

Cooper, M. M. (1995). Cooperative learning: an approach for large enrollment courses. Journal of Chemical Education, 72, 162-164.

Cothran, D. J., & Ennis, C. D. (1998). Curricula of mutual worth: comparisons of students’ and teachers’ curricular goals. Journal of Teaching in Physical Education, 17, 307-326.

Cotton, M. D., & Mahroos-Alsaiari, A. A. (2015). Key actor perspectives on stakeholder engagement in Omani Environment Impact Assessment: an application of Q-methodology. Journal of Environmental Planning and Management, 58, 91-112.

Cross, R. M. (2005). Exploring attitudes: the case for Q methodology. Health Education Research, 20, 206-213.

Cuppen, E. (2012a). Diversity and constructive conflict in stakeholder dialogue: Considerations for design and methods. Policy Sciences, 45, 23-46.

Cuppen, E. (2012b). A quasi-experimental evaluation of learning in a stakeholder dialogue on bio-energy. Research Policy, 41, 624-637.

Cuppen, E., Breukers, S., Hisschemöller, M., Bergsma, E. (2010). Q methodology to select participants for a stakeholder dialogue on energy options from biomass in the Netherlands. Ecological Economics, 69, 579-591.

Daley, B. J., & Torre, D. M. (2010). Concept maps in medical education: an analytical literature review. Medical Education, 44, 440-448.

Danielson, S. (2009). Q method and surveys: three ways to combine Q and R. Field Methods, 21, 219-237.

Danermark, B., Ekström, M., Jakobsen, L., Karlsson, J. Ch. (2002). Explaining society: Critical realism in the social sciences. Routledge.

Day, S. (2008). Applications of Q methodology to a variety of policy process theories and frameworks. International Journal of Organization Theory and Behavior, 11, 141-171.

De Haas, M., & Algera, J. A. (2002). Demonstrating the effect of the strategic dialogue: participation in designing the management control system. Management Accounting Research, 13, 41-69.

Dietz, T. (2013). Bringing values and deliberation to science communication. Proceedings of the National Academy of Sciences, 110, 14081-14087. doi:10.1073/pnas.1212740110

Dijkstra, L., van Eijnatten, F.M. (2009). Agreement and consensus in a Q-mode research design: an empirical comparison of measures, and an application. Quality and Quantity, 43, 757-771.

Donnelly, J. F. (2004). Humanizing science education. Science Education, 88, 762-784.

Doyle, J. K., & Ford, D. H. (1998). Mental models concepts for systems dynamics research. System Dynamics Review, 14, 3-29.

Driver, R., Newton, P. & Osborne, J. (2000). Establishing the norms of scientific argumentation in classrooms. Science Education, 84, 287-312.

Dryzek, J. S. (1990). The measure of political man – and woman. In Discursive democracy: Politics, policy, and political science (pp. 173-189). Cambridge: Cambridge University Press.

Dryzek, J. S., Niemeyer, S. (2008). Discursive representation. American Political Science Review, 102, 481-493.

Duit, R., & Treagust, D. F. (2003). Conceptual change: a powerful framework for improving science teaching and learning. International Journal of Science Education, 25, 671-688. doi:10.1080/09500690305016

Durning, D. (1999). The transition from traditional to postpositivist policy analysis: a role for Q-methodology. Journal of Policy Analysis and Management, 18, 389-410.

Durning, D. W., & Brown, S. R. (2006). Q methodology and decision making. In G. Morçöl (Ed.), Handbook of decision making (pp. 537-563). CRC Press.

Dziopa, F., Ahern, K. (2011). A systematic literature review of the applications of Q-technique and its methodology. Methodology, 7, 39-55.

Espejo, R. (1996). Requirements for effective participation in self-constructed organizations. European Management Journal, 14, 414-422.

Felt, U., & Wynne, B. (2007). Taking European knowledge society seriously. Brussels: European Commission.

Franz, A., Worrell, M., Vögele, C. (2013). Integrating mixed method data in psychological research: combining Q methodology and questionnaires in a study investigating cultural and psychological influences on adolescent sexual behavior. Journal of Mixed Methods Research, 7, 370-389.

Gallagher, K., Porock, D. (2010). The use of interviews in Q methodology: card content analysis. Nursing Research, 59, 295-300.

Gentner, D., & Stevens, A. (Eds.). (1983). Mental models. Hillsdale, NJ: Erlbaum.

Giannoulis, C., Botetzagias, I., & Skanavis, C. (2010). Newspaper reporters’ priorities and beliefs about environmental journalism: an application of Q-methodology. Science Communication, 32, 425-466.

Goldman, I. (1999). Q methodology as process and context in interpretivism, communication, and psychoanalytic psychotherapy research. Psychological Record, 49, 589-604.

Greca, I. M., & Moreira, M. A. (2000). Mental models, conceptual models, and modelling. International Journal of Science Education, 22, 1-11.

Hair, J. F., Jr., Anderson, R. E., Tatham, R. L., Black, W. C. (1998). Multivariate data analysis, 5th ed. Prentice-Hall International.

Hay, D., Kinchin, I., & Lygo-Baker, S. (2008). Making learning visible: The role of concept mapping in higher education. Studies in Higher Education, 33, 295-311.

Hermans, L. M., & Thissen, W. A. H. (2009). Actor analysis methods and their use for public policy analysts. European Journal of Operational Research, 196, 808-818.

Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work. Theory Into Practice, 38, 67-73.

Jonassen, D. H., & Cho, Y. H. (2008). Externalizing mental models with mind tools. In D. Ifenthaler, P. Pirnay-Dummer & J. M. Spector (Eds.), Understanding models for learning and instruction. Essays in honor of Norbert M. Seel (pp. 145-160). New York, NY: Springer.

Jones, N. A., Ross, H., Lynam, T., Perez, P., & Leitch, A. (2011). Mental models: An interdisciplinary synthesis of theory and methods. Ecology and Society, 16, 46.

Kampen, J. K., & Tamás, P. (2014). Overly ambitious: contributions and current status of Q methodology. Quality & Quantity, 48, 3109-3126.

Kim, D. H. (1993). The link between individual and organizational learning. Management Review, 35, 37-50.

Kim, D. H. (2009). In search of a mental model-like concept for group-level modeling. System Dynamics Review, 25, 207-223.

Kim, K. Y., Lee, B. G. (2015). Marketing insights for mobile advertising and consumer segmentation in the cloud era: a Q-R hybrid methodology and practices. Technological Forecasting & Social Change, 91, 78-92.

Kolkman, M. J., Kok, M., & van der Veen, A. (2005). Mental model mapping as a new tool to analyse the use of information in decision-making in integrated water management. Physics and Chemistry of the Earth, 30, 317-332.

Kolstø, S. D. (2001). Scientific literacy for citizenship: tools for dealing with the science dimension of controversial socioscientific issues. Science Education, 85, 291-310.

Kolstø, S. D. (2006). Patterns in students’ argumentation confronted with a risk-focused socio-scientific issue. International Journal of Science Education, 28, 1689-1716.

Lacey, H. (2009). The interplay of scientific activity, worldviews and value outlooks. Science & Education, 18, 839-860.

Lecouteur, A., & Delfabbro, P. H. (2001). Repertoires of teaching and learning: a comparison of university teachers and students using Q methodology. Higher Education, 42, 205-235.

Lu, Y.-L., Lian, I.-B., & Lien, C.-J. (2015). The application of the analytic hierarchy process for evaluating creative product in science class and its modification for educational evaluation. International Journal of Science and Mathematics Education, 13(Suppl. 2), S413-S435.

Lumpkin, D. A. (1999). Demystifying expert disputes with cognitive maps. In P. Lenca (Ed.), Proceedings of the Human Centered Processes Conference (pp. 369-375).

McKenzie, J., Braswell, B., Jelsma, J., & Naidoo, N. (2011). A case for the use of Q-methodology in disability research: lessons from learned from a training workshop. Disability and Rehabilitation, 33, 2134-2141.

McKeown, B., Thomas, D. B. (1988). Q Methodology. Sage.

McNeil, S. (2015). Visualizing mental models: Understanding cognitive change to support teaching and learning of multimedia design and development. Education Technology Research and Development, 63, 73-96.

Martin, I. M., & Steelman, T. A. (2004). Using multiple methods to understand agency values and objectives: lessons for public lands management. Policy Sciences, 37, 37-69.

Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Cannon-Bowers, J. A., & Salas, E. (2005). Scaling the quality of teammates’ mental models: equifinality and normative comparisons. Journal of Organizational Behavior, 26, 37-56. doi:10.1002/job.296

Mattson, D. J., Byrd, K. L., Rutherford, M. B., Brown, S. R., & Clark, T. W. (2006). Finding common ground in large carnivore conservation: mapping contending perspectives. Environmental Science & Policy, 9, 392-405.

Mattson, D. J., Clark, S. G., Byrd, K. L., Brown, S. R., & Robinson, B. (2011). Leaders’ perspectives in the Yellowstone to Yukon Conservation Initiative. Policy Sciences, 44, 103-133.

Miyake, N. (1986). Constructive interaction and the iterative process of understanding. Cognitive Science, 10, 151-177.

Miyake, N. (2008). Conceptual change through collaboration. In S. Vosniadou (Ed.), International handbook of research on conceptual change (pp. 453-478). New York, NY: Routledge.

Mnguni, L. E. (2014). The theoretical cognitive process of visualization for science education. SpringerPlus, 3, 184.

Morf, M. E., Miller, C. M., Syrotuik, J. M. (1976). A comparison of cluster analysis and Q-factor analysis. Journal of Clinical Psychology, 32, 59-64.

Moscovici, S. (1981). On social representations. In J. P. Forgas (Ed.), Social cognition: Perspectives on everyday understanding (pp. 181-209). Academic Press.

Niemeyer, S., Petts, J., Hobson, K. (2005). Rapid climate change and society: assessing responses and thresholds. Risk Analysis, 25, 1443-1455.

Nisbet, M. C. (2009). Communicating climate change: why frames matter public engagement. Environment: Science and Policy for Sustainable Development, 51(2), 12-23.

Nisbet, M. C., & Scheufele, D. A. (2009). What’s next for science communication? Promising directions and lingering distractions. American Journal of Botany, 96, 1767-1778.

Novak, J. D. (1990). Concept mapping: a useful tool for science education. Journal of Research in Science Teaching, 27, 937-949.

Ockwell, D. G. (2008). ‘Opening up’ policy to reflexive appraisal: a role for Q methodology? A case study of fire management in Cape York, Australia. Policy Sciences, 41, 263-292.

Pedretti, E. & Nazir, J. (2011). Currents in STSE education: Mapping a complex field, 40 years on. Science Education, 95, 601-626.

Raadgever, G. T., Mostert, E., & Van de Giesen, N. C. (2008). Measuring perspectives on future flood management on the Rhine: application and discussion of Q methodology. Hydrology and Earth System Sciences Discussions, European Geosciences Union, 5, 437-474.

Ramadas, J. (2009). Visual and spatial modes in science learning. International Journal of Science Education, 31, 301-318.

Ramlo, S. (2012). Inservice science teachers’ views of a professional development workshop and their learning of force and motion concepts. Teaching and Teacher Education, 28, 928-935.

Ramlo, S. E., McConnell, D., Duan, Z.-H., & Moore, F. B. (2008). Evaluating an inquiry-based bioinformatics course using Q methodology. Journal of Science Education and Technology, 17, 219-225. doi:10.1007/s10956-008-9090-x

Rutherfold, M. B. Gibeau, M. L., Clark, S. G., Chamberlain, E. C. (2009). Interdisciplinary problem solving workshops for grizzly bear conservation in Banff National Park, Canada. Policy Sciences, 42, 163-187.

Sadler, T. D. (2004). Informal reasoning regarding socioscientific issues: a critical review of research. Journal of Research in Science Teaching, 41, 513-536.

Sadler, T. D., Barab, S. A., & Scott, B. (2007). What do students gain by engaging in socioscientific inquiry? Research in Science Education, 37, 371-391. doi:10.1007/s11165-006-9030-9

Sadler, T. D., & Donnelly, L. A. (2006). Socioscientific argumentation: the effects of content knowledge and morality. International Journal of Science Education, 28, 1463-1488.

Scardamalia, M., & Bereiter, C. (1987). Knowledge telling and knowledge transforming in written composition. In S. Rosenberg (Ed.), Advances in applied psycholinguistics, volume 2: Reading, writing, and language learning (pp. 142-175). Cambridge: Cambridge University Press.

Schaffernicht, M., & Groesser, S. N. (2011). A comprehensive method for comparing mental models of dynamic systems. European Journal of Operational Research, 210, 57-67.

Schmolck, P. (2011). PQMethod (Version 2.20). Downloaded from
http://schmolck.userweb.mwn.de/qmethod/downpqwin.htm

Schnotz, W., Kürschner, C. (2008). External and internal representations in the acquisition and use of knowledge: Visualization effects on mental model construction. Instructional Science, 36, 175-190.

Scholz, G., Austermann, M., Kaldrack, K., & Pahl-Wostl, C. (2015). Evaluating group model building exercises: a method for comparing externalized mental models and group models. System Dynamics Review, 31, 28-45.

Shirouzu, H. (2010). Collaboration as constructive interaction and the jigsaw method as its enhancer. International Reports on Socio-Informatics, 7, 65-69.

Slavin, R. E. (1996). Research on cooperative learning and achievement: what we know, what we need to know. Contemporary Educational Psychology, 21, 43-69.

Sleenhoff, S., Cuppen, E., & Osseweijer, P. (2015). Unravelling emotional viewpoints on a bio-based economy using Q methodology. Public Understanding of Science, 24, 858-877.

Stenner, P. H. D., Dancey, C. P., Watts, S. (2000). The understanding of their illness amongst people with irritable bowel syndrome: a Q methodological study. Social Science & Medicine, 51, 439-452.

Stenner, P., & Stainton Rogers, R. (2004). Q methodology and qualiquantology: the example of discriminating between emotions. In Z. Todd, B. Nerlich, S. McKeown, & D. D. Clark (Eds.), Mixing methods in psychology: The integration of qualitative and quantitative methods in theory and practice (pp. 99-118). Hove: Psychology Press.

Stephenson, W. (1953). The study of behavior: Q-technique and its methodology. Chicago, IL: University of Chicago Press.

Stephenson, W. (1967). The play theory of mass communication. Chicago, IL: University of Chicago Press.

Stephenson, W. (1969). Foundations of communication theory. Psychological Record, 19, 65-82.

Stephenson, W. (1978). Concourse theory of communication. Communication, 3, 21-40.

Stephenson, W. (1982). Q-methodology, interbehavioral psychology, and quantum theory. Psychological Record, 32, 235-248.

Stephenson, W. (1986). Protoconcursus: the concourse theory of communication. Operant Subjectivity, 9, 37-58.

Stirling, A. (2008). “Opening up” and “closing down”: power, participation, and pluralism in the social appraisal of technology. Science, Technology, & Human Values, 33, 262-294.

Stirling, A., Leach, M., Mehta, L., Scoones, I., Smith, A., Stagl, S., & Thompson, J. (2007). Empowering designs: Towards more progressive appraisal of sustainability (STEPS Working Paper No. 3). Brighton: STEPS Centre.

Stirling, A., & Mayer, S. (2001). A novel approach to the appraisal of technological risk: a multicriteria mapping study of a genetically modified crop. Environment and Planning C: Government and Policy, 19, 529-555.

Swaab, R. I., Postmes, T., Neijens, P., Kiers, M. H., & Dumay, A. C. M. (2002). Multiparty negotiation support: the role of visualization’s influence on the development of shared mental models. Journal of Management Information Systems, 19, 129-150.

Tamás, P. A., & Kampen, J. K. (2015). Heresy and the church of Q: a reply. Quality & Quantity, 49, 539-540.

Thompson, A. W., Dumyahn, S., Prokopy, L. S., Amberg, S., Baumgart-Getz, A., Jackson-Tyree, J., … Mase, A. S. (2012). Comparing random sample Q and R methods for understanding natural resource attitudes. Field Methods, 25, 25-46.

Treagust, D. F., & Duit, R. (2008). Conceptual change: a discussion of theoretical, methodological and practical challenges for science education. Cultural Studies of Science Education, 3, 297-328.

Voß, J.-P., & Kemp, R. (2006). Sustainability and reflexive governance: introduction. In: J.-P. Voß & R. Kemp (Eds.) Reflexive governance for sustainable development (pp. 3-28). Edward Elgar.

Watts, S., & Stenner, P. (2005). Doing Q methodology: theory, method and interpretation. Qualitative Research in Psychology, 2, 67-91.

Watts, S., & Stenner, P. (2012). Doing Q methodological research: Theory, method and interpretation. Sage.

Yoshizawa, G. (2007). What is the use of policy analysis? Plurality and context in perspectives on strategic intelligence in Japan (doctoral thesis). University of Sussex, Brighton.

Zeidler, D. L., Sadler, T. D., Simmons, M. L., & Howes, E. V. (2005). Beyond STS: A research-based framework for socioscientific issues education. Science Education, 89, 357-377.

Zeidler, D. L., Walker, K. A., Ackett, W. A., & Simmons, M. L. (2002). Tangled up in views: beliefs in the nature of science and responses to socioscientific dilemmas. Science Education, 86, 343-367. doi:10.1002/sce.10025

Zeidler, D. L. (Ed.). (2003). The role of moral reasoning on socioscientific issues and discourse in science education. Dordrecht: Kluwer Academic.

Zeidler, D. L., Sadler, T. D., Applebaum, S., & Callahan, B. E. (2009). Advancing reflective judgment through socioscientific issues. Journal of Research in Science Teaching, 46, 74-101.