research articles on problem solving

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals

Problem solving articles from across Nature Portfolio

Problem solving is the mental process of analyzing a situation, learning what options are available, and then choosing the alternative that will result in the desired outcome or some other selected goal.

Latest Research and Reviews

Interplay between preclinical indices of obesity and neural signatures of fluid intelligence in youth

Standardized indices of obesity are associated with alterations in neural oscillatory activity and functional connectivity in brain regions supporting abstract reasoning and fluid intelligence in typically developing youth.

• Thomas W. Ward
• Mikki Schantell
• Tony W. Wilson

A geometrical solution underlies general neural principle for serial ordering

How the brain sequentially encodes knowledge is not fully understood. Here authors propose a geometric framework for the elusive neural principles of serial reasoning and sequence encoding. Neural representations are theorized to align along a learned mental line, solving serial position and transitive inference tasks.

• Gabriele Di Antonio
• Sofia Raglio
• Maurizio Mattia

The effect of sports expertise on the performance of orienteering athletes’ real scene image recognition and their visual search characteristics

Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement

• Annika Lübbert
• Malte Sengelmann
• Florian Göschl

Patients recovering from COVID-19 who presented with anosmia during their acute episode have behavioral, functional, and structural brain alterations

• Leonie Kausel
• Alejandra Figueroa-Vargas
• Pablo Billeke

Toddlers strategically adapt their information search

Humans adaptively seek information to navigate their world. Here, the authors demonstrate toddlers’ advanced, adaptive information-seeking from 24 months, showcasing early emergence of complex exploration strategies.

• Francesco Poli
• Azzurra Ruggeri

News and Comment

Reliable social switch.

The macaque homologue of the dorsal medial prefrontal cortex tracks the reliability of social information and determines whether this information is used to guide choices during decision making.

• Jake Rogers

DishBrain plays Pong and promises more

An in vitro biological system of cultured brain cells has learned to play Pong. This feat opens up an avenue towards the convergence of biological and machine intelligence.

• Joshua Goldwag

Tinkering with tools leads to more success

• Teresa Schubert

Parallel processing of alternative approaches

Neuronal activity in the secondary motor cortex of mice engaged in a foraging task simultaneously represents multiple alternative decision-making strategies.

• Katherine Whalley

Teaching of 21st century skills needs to be informed by psychological research

The technological advancements and globalization of the 21st century require a broad set of skills beyond traditional subjects such as mathematics, reading, and science. Research in psychological science should inform best practice and evidence-based recommendations for teaching these skills.

• Samuel Greiff
• Francesca Borgonovi

Simulated brain solves problems

Quick links.

• Explore articles by subject
• Guide to authors
• Editorial policies

An official website of the United States government

Official websites use .gov A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

• Publications
• Account settings
• Advanced Search
• Journal List

Analysing Complex Problem-Solving Strategies from a Cognitive Perspective: The Role of Thinking Skills

Gyöngyvér molnár.

• Author information
• Article notes
• Copyright and License information

Correspondence: [email protected]

Received 2022 May 31; Accepted 2022 Jul 21; Collection date 2022 Sep.

Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license ( https://creativecommons.org/licenses/by/4.0/ ).

Complex problem solving (CPS) is considered to be one of the most important skills for successful learning. In an effort to explore the nature of CPS, this study aims to investigate the role of inductive reasoning (IR) and combinatorial reasoning (CR) in the problem-solving process of students using statistically distinguishable exploration strategies in the CPS environment. The sample was drawn from a group of university students (N = 1343). The tests were delivered via the eDia online assessment platform. Latent class analyses were employed to seek students whose problem-solving strategies showed similar patterns. Four qualitatively different class profiles were identified: (1) 84.3% of the students were proficient strategy users, (2) 6.2% were rapid learners, (3) 3.1% were non-persistent explorers, and (4) 6.5% were non-performing explorers. Better exploration strategy users showed greater development in thinking skills, and the roles of IR and CR in the CPS process were varied for each type of strategy user. To sum up, the analysis identified students’ problem-solving behaviours in respect of exploration strategy in the CPS environment and detected a number of remarkable differences in terms of the use of thinking skills between students with different exploration strategies.

Keywords: complex problem solving, thinking skills, logfile analysis, process data

1. Introduction

Problem solving is part and parcel of our daily activities, for instance, in determining what to wear in the morning, how to use our new electronic devices, how to reach a restaurant by public transport, how to arrange our schedule to achieve the greatest work efficiency and how to communicate with people in a foreign country. In most cases, it is essential to solve the problems that recur in our study, work and daily lives. These situations require problem solving. Generally, problem solving is the thinking that occurs if we want “to overcome barriers between a given state and a desired goal state by means of behavioural and/or cognitive, multistep activities” ( Frensch and Funke 1995, p. 18 ). It has also been considered as one of the most important skills for successful learning in the 21st century. This study focuses on one specific kind of problem solving, complex problem solving (CPS). (Numerous other terms are also used ( Funke et al. 2018 ), such as interactive problem solving ( Greiff et al. 2013 ; Wu and Molnár 2018 ), and creative problem solving ( OECD 2010 ), etc.).

CPS is a transversal skill ( Greiff et al. 2014 ), operating several mental activities and thinking skills (see Molnár et al. 2013 ). In order to explore the nature of CPS, some studies have focused on detecting its component skills ( Wu and Molnár 2018 ), whereas others have analysed students’ behaviour during the problem-solving process ( Greiff et al. 2018 ; Wu and Molnár 2021 ). This study aims to link these two fields by investigating the role of thinking skills in learning by examining students’ use of statistically distinguishable exploration strategies in the CPS environment.

1.1. Complex Problem Solving: Definition, Assessment and Relations to Intelligence

According to a widely accepted definition proposed by Buchner ( 1995 ), CPS is “the successful interaction with task environments that are dynamic (i.e., change as a function of users’ intervention and/or as a function of time) and in which some, if not all, of the environment’s regularities can only be revealed by successful exploration and integration of the information gained in that process” ( Buchner 1995, p. 14 ). A CPS process is split into two phases, knowledge acquisition and knowledge application. In the knowledge acquisition (KAC) phase of CPS, the problem solver understands the problem itself and stores the acquired information ( Funke 2001 ; Novick and Bassok 2005 ). In the knowledge application (KAP) phase, the problem solver applies the acquired knowledge to bring about the transition from a given state to a goal state ( Novick and Bassok 2005 ).

Problem solving, especially CPS, has frequently been compared or linked to intelligence in previous studies (e.g., Beckmann and Guthke 1995 ; Stadler et al. 2015 ; Wenke et al. 2005 ). Lotz et al. ( 2017 ) observed that “intelligence and [CPS] are two strongly overlapping constructs” (p. 98). There are many similarities and commonalities that can be detected between CPS and intelligence. For instance, CPS and intelligence share some of the same key features, such as the integration of information ( Stadler et al. 2015 ). Furthermore, Wenke et al. ( 2005 ) stated that “the ability to solve problems has featured prominently in virtually every definition of human intelligence” (p. 9); meanwhile, from the opposite perspective, intelligence has also been considered as one of the most important predictors of the ability to solve problems ( Wenke et al. 2005 ). Moreover, the relation between CPS and intelligence has also been discussed from an empirical perspective. A meta-analysis conducted by Stadler et al. ( 2015 ) selected 47 empirical studies (total sample size N = 13,740) which focused on the correlation between CPS and intelligence. The results of their analysis confirmed that a correlation between CPS and intelligence exists with a moderate effect size of M(g) = 0.43.

Due to the strong link between CPS and intelligence, assessments of these two domains have been connected and have overlapped to a certain extent. For instance, Beckmann and Guthke ( 1995 ) observed that some of the intelligence tests “capture something akin to an individual’s general ability to solve problems (e.g., Sternberg 1982 )” (p. 184). Nowadays, some widely used CPS assessment methods are related to intelligence but still constitute a distinct construct ( Schweizer et al. 2013 ), such as the MicroDYN approach ( Greiff and Funke 2009 ; Greiff et al. 2012 ; Schweizer et al. 2013 ). This approach uses the minimal complex system to simulate simplistic, artificial but still complex problems following certain construction rules ( Greiff and Funke 2009 ; Greiff et al. 2012 ).

The MicroDYN approach has been widely employed to measure problem solving in a well-defined problem context (i.e., “problems have a clear set of means for reaching a precisely described goal state”, Dörner and Funke 2017, p. 1 ). To complete a task based on the MicroDYN approach, the problem solver engages in dynamic interaction with the task to acquire relevant knowledge. It is not possible to create this kind of test environment with the traditional paper-and-pencil-based method. Therefore, it is currently only possible to conduct a MicroDYN-based CPS assessment within the computer-based assessment framework. In the context of computer-based assessment, the problem-solvers’ operations were recorded and logged by the assessment platform. Thus, except for regular achievement-focused result data, logfile data are also available for analysis. This provides the option of exploring and monitoring problem solvers’ behaviour and thinking processes, specifically, their exploration strategies, during the problem-solving process (see, e.g., Chen et al. 2019 ; Greiff et al. 2015a ; Molnár and Csapó 2018 ; Molnár et al. 2022 ; Wu and Molnár 2021 ).

Problem solving, in the context of an ill-defined problem (i.e., “problems have no clear problem definition, their goal state is not defined clearly, and the means of moving towards the (diffusely described) goal state are not clear”, Dörner and Funke 2017, p. 1), involved a different cognitive process than that in the context of a well-defined problem ( Funke 2010 ; Schraw et al. 1995 ), and it cannot be measured with the MicroDYN approach. The nature of ill-defined problem solving has been explored and discussed in numerous studies (e.g., Dörner and Funke 2017 ; Hołda et al. 2020 ; Schraw et al. 1995 ; Welter et al. 2017 ). This will not be discussed here as this study focuses on well-defined problem solving.

1.2. Inductive and Combinatorial Reasoning as Component Skills of Complex Problem Solving

Frensch and Funke ( 1995 ) constructed a theoretical framework that summarizes the basic components of CPS and the interrelations among the components. The framework contains three separate components: problem solver, task and environment. The impact of the problem solver is mainly relevant to three main categories, which are memory contents, dynamic information processing and non-cognitive variables. Some thinking skills have been reported to play an important role in dynamic information processing. We can thus describe them as component skills of CPS. Inductive reasoning (IR) and combinatorial reasoning (CR) are the two thinking skills that have been most frequently discussed as component skills of CPS.

IR is the reasoning skill that has been covered most commonly in the literature. Currently, there is no universally accepted definition. Molnár et al. ( 2013 ) described it as the cognitive process of acquiring general regularities by generalizing single and specific observations and experiences, whereas Klauer ( 1990 ) defined it as the discovery of regularities that relies upon the detection of similarities and/or dissimilarities as concerns attributes of or relations to or between objects. Sandberg and McCullough ( 2010 ) provided a general conclusion of the definitions of IR: it is the process of moving from the specific to the general.

Csapó ( 1997 ) pointed out that IR is a basic component of thinking and that it forms a central aspect of intellectual functioning. Some studies have also discussed the role of IR in a problem-solving environment. For instance, Mayer ( 1998 ) stated that IR will be applied in information processing during the process of solving general problems. Gilhooly ( 1982 ) also pointed out that IR plays a key role in some activities in the problem-solving process, such as hypothesis generation and hypothesis testing. Moreover, the influence of IR on both KAC and KAP has been analysed and demonstrated in previous studies ( Molnár et al. 2013 ).

Empirical studies have also provided evidence that IR and CPS are related. Based on the results of a large-scale assessment (N = 2769), Molnár et al. ( 2013 ) showed that IR significantly correlated with 9–17-year-old students’ domain-general problem-solving achievement (r = 0.44–0.52). Greiff et al. ( 2015b ) conducted a large-scale assessment project (N = 2021) in Finland to explore the links between fluid reasoning skills and domain-general CPS. The study measured fluid reasoning as a two-dimensional model which consisted of deductive reasoning and scientific reasoning and included inductive thinking processes ( Greiff et al. 2015b ). The results drawing on structural equation modelling indicated that fluid reasoning which was partly based on IR had significant and strong predictive effects on both KAC (β = 0.51) and KAP (β = 0.55), the two phases of problem solving. Such studies have suggested that IR is one of the component skills of CPS.

According to Adey and Csapó ’s ( 2012 ) definition, CR is the process of creating complex constructions out of a set of given elements that satisfy the conditions explicitly given in or inferred from the situation. In this process, some cognitive operations, such as combinations, arrangements, permutations, notations and formulae, will be employed ( English 2005 ). CR is one of the basic components of formal thinking ( Batanero et al. 1997 ). The relationship between CR and CPS has frequently been discussed. English ( 2005 ) demonstrated that CR has an essential meaning in several types of problem situations, such as problems requiring the systematic testing of alternative solutions. Moreover, Newell ( 1993 ) pointed out that CR is applied in some key activities of problem-solving information processing, such as strategy generation and application. Its functions include, but are not limited to, helping problem solvers to discover relationships between certain elements and concepts, promoting their fluency of thinking when they are considering different strategies ( Csapó 1999 ) and identifying all possible alternatives ( OECD 2014 ). Moreover, Wu and Molnár ’s ( 2018 ) empirical study drew on a sample (N = 187) of 11–13-year-old primary school students in China. Their study built a structural equation model between CPS, IR and CR, and the result indicated that CR showed a strong and statistically significant predictive power for CPS (β = 0.55). Thus, the results of the empirical study also support the argument that CR is one of the component skills of CPS.

1.3. Behaviours and Strategies in a Complex Problem-Solving Environment

Wüstenberg et al. ( 2012 ) stated that the creation and implementation of strategic exploration are core actions of the problem-solving task. Exploring and generating effective information are key to successfully solving a problem. Wittmann and Hattrup ( 2004 ) illustrated that “riskier strategies [create] a learning environment with greater opportunities to discover and master the rules and boundaries [of a problem]” (p. 406). Thus, when gathering information about a complex problem, there may be differences between exploration strategies in terms of efficacy. The MicroDYN scenarios, a simplification and simulation of the real-world problem-solving context, will also be influenced by the adoption and implementation of exploration strategies.

The effectiveness of the isolated variation strategy (or “Vary-One-Thing-At-A-Time” strategy—VOTAT; Vollmeyer et al. 1996 ) in a CPS environment has been hotly debated ( Chen et al. 2019 ; Greiff et al. 2018 ; Molnár and Csapó 2018 ; Molnár et al. 2022 ; Wu and Molnár 2021 ; Wüstenberg et al. 2014 ). To use the VOTAT strategy, a problem solver “systematically varies only one input variable, whereas the others remain unchanged. This way, the effect of the variable that has just been changed can be observed directly by monitoring the changes in the output variables” ( Molnár and Csapó 2018, p. 2 ). Understanding and using VOTAT effectively is the foundation for developing more complex strategies for coordinating multiple variables and the basis for some phases of scientific thinking (i.e., inquiry, analysis, inference and argument; Kuhn 2010 ; Kuhn et al. 1995 ).

Some previous studies have indicated that students who are able to apply VOTAT are more likely to achieve higher performance in a CPS assessment ( Greiff et al. 2018 ), especially if the problem is a well-defined minimal complex system (such as MicroDYN) ( Fischer et al. 2012 ; Molnár and Csapó 2018 ; Wu and Molnár 2021 ). For instance, Molnár and Csapó ( 2018 ) conducted an empirical study to explore how students’ exploration strategies influence their performance in an interactive problem-solving environment. They measured a group (N = 4371) of 3rd- to 12th-grade (aged 9–18) Hungarian students’ problem-solving achievement and modelled students’ exploration strategies. This result confirmed that students’ exploration strategies influence their problem-solving performance. For example, conscious VOTAT strategy users proved to be the best problem-solvers. Furthermore, other empirical studies (e.g., Molnár et al. 2022 ; Wu and Molnár 2021 ) achieved similar results, thus confirming the importance of VOTAT in a MicroDYN-based CPS environment.

Lotz et al. ( 2017 ) illustrated that effective use of VOTAT is associated with higher levels of intelligence. Their study also pointed out that intelligence has the potential to facilitate successful exploration behaviour. Reasoning skills are an important component of general intelligence. Based on Lotz et al. ’s ( 2017 ) statements, the roles IR and CR play in the CPS process might vary due to students’ different strategy usage patterns. However, there is still a lack of empirical studies in this regard.

2. Research Aims and Questions

Numerous studies have explored the nature of CPS, some of them discussing and analysing it from behavioural or cognitive perspectives. However, there have barely been any that have merged these two perspectives. From the cognitive perspective, this study explores the role of thinking skills (including IR and CR) in the cognition process of CPS. From the behavioural perspective, the study focuses on students’ behaviour (i.e., their exploration strategy) in the CPS assessment process. More specifically, the research aims to fill this gap and examine students’ use of statistically distinguishable exploration strategies in CPS environments and to detect the connection between the level of students’ thinking skills and their behaviour strategies in the CPS environment. The following research questions were thus formed.

What exploration strategy profiles characterise the various problem-solvers at the university level?

Can developmental differences in CPS, IR and CR be detected among students with different exploration strategy profiles?

What are the similarities and differences in the roles IR and CR play in the CPS process as well as in the two phases of CPS (i.e., KAC and KAP) among students with different exploration strategy profiles?

3.1. Participants and Procedure

The sample was drawn from one of the largest universities in Hungary. Participation was voluntary, but students were able to earn one course credit for taking part in the assessment. The participants were students who had just started their studies there (N = 1671). 43.4% of the first-year students took part in the assessment. 50.9% of the participants were female, and 49.1% were male. We filtered the sample and excluded those who had more than 80% missing data on any of the tests. After the data were cleaned, data from 1343 students were available for analysis. The test was designed and delivered via the eDia online assessment system ( Csapó and Molnár 2019 ). The assessment was held in the university ICT room and divided into two sessions. The first session involved the CPS test, whereas the second session entailed the IR and CR tests. Each session lasted 45 min. The language of the tests was Hungarian, the mother tongue of the students.

3.2. Instruments

3.2.1. complex problem solving (cps).

The CPS assessment instrument adopted the MicroDYN approach. It contains a total of twelve scenarios, and each scenario consisted of two items (one item in the KAC phase and one item in the KAP phase in each problem scenario). Twelve KAC items and twelve KAP items were therefore delivered on the CPS test for a total of twenty-four items. Each scenario has a fictional cover story. For instance, students found a sick cat in front of their house, and they were expected to feed the cat with two different kinds of cat food to help it recover.

Each item contains up to three input and three output variables. The relations between the input and output variables were formulated with linear structural equations ( Funke 2001 ). Figure 1 shows a MicroDYN sample structure containing three input variables (A, B and C), three output variables (X, Y and Z) and a number of possible relations between the variables. The complexity of the item was defined by the number of input and output variables, and the number of relations between the variables. The test began with the item with the lowest complexity. The complexity of each item gradually increased as the test progressed.

A typical MicroDYN structure with three input variables and three output variables ( Greiff and Funke 2009 ).

The interface of each item displays the value of each variable in both numerical and figural forms (See Figure 2 ). Each of the input variables has a controller, which makes it possible to vary and set the value between +2 (+ +) and −2 (− −). To operate the system, students need to click the “+” or “−” button or use the slider directly to select the value they want to be added to or subtracted from the current value of the input variable. After clicking the “Apply” button in the interface, the input variables will add or subtract the selected value, and the output variables will show the corresponding changes. The history of the values for the input and output variables within the same problem scenario is displayed on screen. If students want to withdraw all the changes and set all the variables to their original status, they can click the “Reset” button.

Screenshot of the MicroDYN item Cat—first phase (knowledge acquisition). (The items were administered in Hungarian.)

In the first phase of the problem-solving process, the KAC phase, students are asked to interact with the system by changing the value of the input variables and observing and analysing the corresponding changes in the output variables. They are then expected to determine the relationship between the input and output variables and draw it in the form of (an) arrow(s) on the concept map at the bottom of the interface. To avoid item dependence in the second phase of the problem-solving process, the students are provided with a concept map during the KAP phase (see Figure 3 ), which shows the correct connections between the input and output variables. The students are expected to interact with the system by manipulating the input variables to make the output variables reach the given target values in four steps or less. That is, they cannot click on the “Apply” button more than four times. The first phase had a 180 s time limit, whereas the second had a 90 s time limit.

Screenshot of the MicroDYN item Cat—second phase (knowledge application). (The items were administered in Hungarian).

3.2.2. Inductive Reasoning (IR)

The IR instrument (see Figure 4 ) was originally designed and developed in Hungary ( Csapó 1997 ). In the last 25 years, the instrument has been further developed and scaled for a wide age range ( Molnár and Csapó 2011 ). In addition, figural items have been added, and the assessment method has evolved from paper-and-pencil to computer-based ( Pásztor 2016 ). Currently, the instrument is widely employed in a number of countries (see, e.g., Mousa and Molnár 2020 ; Pásztor et al. 2018 ; Wu et al. 2022 ; Wu and Molnár 2018 ). In the present study, four types of items were included after test adaptation: figural series, figural analogies, number analogies and number series. Students were expected to ascertain the correct relationship between the given figures and numbers and select a suitable figure or number as their answer. Students used the drag-and-drop operation to provide their answers. In total, 49 inductive reasoning items were delivered to the participating students.

Sample items for the IR test. (The items were administered in Hungarian.).

3.2.3. Combinatorial Reasoning (CR)

The CR instrument (see Figure 5 ) was originally designed by Csapó ( 1988 ). The instrument was first developed in paper-and-pencil format and then modified for computer use ( Pásztor and Csapó 2014 ). Each item contained figural or verbal elements and a clear requirement for combing through the elements. Students were asked to list every single combination based on a given rule they could find. For the figural items, students provided their answers using the drag-and-drop operation; for the verbal items, they were asked to type their answers in a text box provided on screen. The test consisted of eight combinatorial reasoning items in total.

Sample item for the CR test. (The items were administered in Hungarian).

3.3. Scoring

Students’ performance was automatically scored via the eDia platform. Items on the CPS and IR tests were scored dichotomously. In the first phase (KAC) of the CPS test, if a student drew all the correct relations on the concept map provided on screen within the given timeframe, his/her performance was assigned a score of 1 or otherwise a score of 0. In the second phase (KAP) of the CPS test, if the student successfully reached the given target values of the output variables by manipulating the level of the input variables within no more than four steps and the given timeframe, then his/her performance earned a score of 1 or otherwise a score of 0. On the IR test items, if a student selected the correct figure or number as his/her answer, then he or she received a score of 1; otherwise, the score was 0.

Students’ performance on the CR test items was scored according to a special J index, which was developed by Csapó ( 1988 ). The J index ranges from 0 to 1, where 1 means that the student provided all the correct combinations without any redundant combinations on the task. The formula for computing the J index is the following:

x stands for the number of correct combinations in the student’s answer,

T stands for the number of all possible correct combinations, and

y stands for the number of redundant combinations in the student’s answer.

Furthermore, according to Csapó ’s ( 1988 ) design, if y is higher than T, then the J index will be counted as 0.

3.4. Coding and Labelling the Logfile Data

Beyond concrete answer data, students’ interaction and manipulation behaviour were also logged in the assessment system. This made it possible to analyse students’ exploration behaviour in the first phase of the CPS process (KAC phase). Toward this aim, we adopted a labelling system developed by Molnár and Csapó ( 2018 ) to transfer the raw logfile data to structured data files for analysis. Based on the system, each trial (i.e., the sum of manipulations within the same problem scenario which was applied and tested by clicking the “Apply” button) was modelled as a single data entity. The sum of these trials within the same problem was defined as a strategy. In our study, we only consider the trials which were able to provide useful and new information for the problem-solvers, whereas the redundant or operations trials were excluded.

In this study, we analysed students’ trials to determine the extent to which they used the VOTAT strategy: fully, partially or not at all. This strategy is the most successful exploration strategy for such problems; it is the easiest to interpret and provides direct information about the given variable without any mediation effects ( Fischer et al. 2012 ; Greiff et al. 2018 ; Molnár and Csapó 2018 ; Wüstenberg et al. 2014 ; Wu and Molnár 2021 ). Based on the definition of VOTAT noted in Section 1.3 , we checked students’ trials to ascertain if they systematically varied one input variable while keeping the others unchanged, or applied a different, less successful strategy. We considered the following three types of trials:

“Only one single input variable was manipulated, whose relationship to the output variables was unknown (we considered a relationship unknown if its effect cannot be known from previous settings), while the other variables were set at a neutral value like zero […]

One single input variable was changed, whose relationship to the output variables was unknown. The others were not at zero, but at a setting used earlier. […]

One single input variable was changed, whose relationship to the output variables was unknown, and the others were not at zero; however, the effect of the other input variable(s) was known from earlier settings. Even so, this combination was not attempted earlier” ( Molnár and Csapó 2018, p. 8 )

We used the numbers 0, 1 and 2 to distinguish the level of students’ use of the most effective exploration strategy (i.e., VOTAT). If a student applied one or more of the above trials for every input variable within the same scenario, we considered that they had used the full VOTAT strategy and labelled this behaviour 2. If a student had only employed VOTAT on some but not all of the input variables, we concluded that they had used a partial VOTAT strategy for that problem scenario and labelled it 1. If a student had used none of the trials noted above in their problem exploration, then we determined that they had not used VOTAT at all and thus gave them a label of 0.

3.5. Data Analysis Plan

We used LCA (latent class analysis) to explore students’ exploration strategy profiles. LCA is a latent variable modelling approach that can be used to identify unmeasured (latent) classes of samples with similarly observed variables. LCA has been widely used in analysing logfile data for CPS assessment and in exploring students’ behaviour patterns (see, e.g., Gnaldi et al. 2020 ; Greiff et al. 2018 ; Molnár et al. 2022 ; Molnár and Csapó 2018 ; Mustafić et al. 2019 ; Wu and Molnár 2021 ). The scores for the use of VOTAT in the KAC phase (0, 1, 2; see Section 3.4 ) were used for the LCA analysis. We used Mplus ( Muthén and Muthén 2010 ) to run the LCA analysis. Several indices were used to measure the model fit: AIC (Akaike information criterion), BIC (Bayesian information criterion) and aBIC (adjusted Bayesian information criterion). With these three indicators, lower values indicate a better model fit. Entropy (ranging from 0 to 1, with values close to 1 indicating high certainty in the classification). The Lo–Mendell–Rubin adjusted likelihood ratio was used to compare the model containing n latent classes with the model containing n − 1 latent classes, and the p value was the indicator for whether a significant difference could be detected ( Lo et al. 2001 ). The results of the Lo–Mendell–Rubin adjusted likelihood ratio analysis were used to decide the correct number of latent classes in LCA models.

ANOVA was used to analyse the performance differences for CPS, IR and CR across the students from the different class profiles. The analysis was run using SPSS. A path analysis (PA) was employed in the structural equation modelling (SEM) framework to investigate the roles of CR and IR in CPS and the similarities and differences across the students from the different exploration strategy profiles. The PA models were carried out with Mplus. The Tucker–Lewis index (TLI), the comparative fit index (CFI) and the root-mean-square error of approximation (RMSEA) were used as indicators for the model fit. A TLI and CFI larger than 0.90 paired with a RMSEA less than 0.08 are commonly considered as an acceptable model fit ( van de Schoot et al. 2012 ).

4.1. Descriptive Results

All three tests showed good reliability (Cronbach’s α: CPS: 0.89; IR: 0.87; CR: 0.79). Furthermore, the two sub-dimensions of the CPS test, KAC and KAP, also showed satisfactory reliability (Cronbach’s α: KAC: 0.86; KAP: 0.78). The tests thus proved to be reliable. The means and standard deviations of students’ performance (in percentage) on each test are provided in Table 1 .

The means and standard deviations of students’ performance on each test.

4.2. Four Qualitatively Different Exploration Strategy Profiles Can Be Distinguished in CPS

Based on the labelled logfile data for CPS, we applied latent class analyses to identify the behaviour patterns of the students in the exploration phase of the problem-solving process. The model fits for the LCA analysis are listed in Table 2 . Compared with the 2 or 3 latent class models, the 4 latent class model has a lower AIC, BIC and aBIC, and the likelihood ratio statistical test (the Lo–Mendell–Rubin adjusted likelihood ratio test) confirmed it has a significantly better model fit. The 5 and 6 latent class models did not show a better model fit than the 4 latent class model. Therefore, based on the results, four qualitatively different exploration strategy profiles can be distinguished, which covered 96% of the students.

Fit indices for latent class analyses.

The patterns for the four qualitatively different exploration strategy profiles are shown in Figure 6 . In total, 84.3% of the students were proficient exploration strategy users, who were able to use VOTAT in each problem scenario independent of its difficulty level (represented by the red line in Figure 5 ). In total, 6.2% of the students were rapid learners. They were not able to apply VOTAT at the beginning of the test on the easiest problems but managed to learn quickly, and, after a rapid learning curve by the end of the test, they reached the level of proficient exploration strategy users, even though the problems became much more complex (represented by the blue line). In total, 3.1% of the students proved to be non-persistent explorers, and they employed VOTAT on the easiest problems but did not transfer this knowledge to the more complex problems. Finally, they were no longer able to apply VOTAT when the complexity of the problems increased (represented by the green line). In total, 6.5% of the students were non-performing explorers; they barely used any VOTAT strategy during the whole test (represented by the pink line) independent of problem complexity.

Four qualitatively different exploration strategy profiles.

4.3. Better Exploration Strategy Users Showed Better Performance in Reasoning Skills

Students with different exploration strategy profiles showed different kinds of performance in each reasoning skill under investigation. Results (see Table 3 ) showed that more proficient strategy users tended to have higher achievement in all the domains assessed as well as in the two sub-dimensions in CPS (i.e., KAC and KAP; ANOVA: CPS: F(3, 1339) = 187.28, p < 0.001; KAC: F(3, 1339) = 237.15, p < 0.001; KAP: F(3, 1339) = 74.91, p < 0.001; IR: F(3, 1339) = 48.10, p < 0.001; CR: F(3, 1339) = 28.72, p < 0.001); specifically, students identified as “proficient exploration strategy users” achieved the highest level on the reasoning skills tests independent of the domains. On average, they were followed by rapid learners, non-persistent explorers and, finally, non-performing explorers. Tukey’s post hoc tests revealed more details on the performance differences of students with different exploration profiles in each of the domains being measured. Proficient strategy users proved to be significantly more skilled in each of the reasoning domains. They were followed by rapid learners, who outperformed non-persistent explorers and non-performing explorers in CPS. In the domains of IR and CR, there were no achievement differences between rapid learners and non-persistent explorers, who significantly outperformed non-performing strategy explorers.

Students’ performance on each test—grouped according to the different exploration strategy profiles.

4.4. The Roles of IR and CR in CPS and Its Processes Were Different for Each Type of Exploration Strategy User

Path analysis was used to explore the predictive power of IR and CR for CPS and its processes, knowledge acquisition and knowledge application, for each group of students with different exploration strategy profiles. That is, four path analysis models were built to indicate the predictive power of IR and CR for CPS (see Figure 7 ), and another four path analyses models were developed to monitor the predictive power of IR and CR for the two empirically distinguishable phases of CPS (i.e., KAC and KAP) (see Figure 8 ). All eight models had good model fits, the fit indices TLI and CFI were above 0.90, and RMSEA was less than 0.08.

Path analysis models (with CPS, IR and CR) for each type of strategy user; * significant at 0.05 ( p   <  0.05); ** significant at 0.01 ( p   <  0.01); N.S.: no significant effect can be found.

Path analysis models (with KAC, KAP, IR and CR) for each type of strategy user; * significant at 0.05 ( p  <  0.05); ** significant at 0.01 ( p  <  0.01); N.S.: no significant effect can be found.

Students’ level of IR significantly predicted their level of CPS in all four path analysis models independent of their exploration strategy profile ( Figure 7 ; proficient strategy users: β = 0.432, p < 0.01; rapid learners: β = 0.350, p < 0.01; non-persistent explorers: β = 0.309, p < 0.05; and non-performing explorers: β = 0.386, p < 0.01). This was not the case for CR, which only proved to have predictive power for CPS among proficient strategy users (β = 0.104, p < 0.01). IR and CR were significantly correlated in all four models.

After examining the roles of IR and CR in the CPS process, we went further to explore the roles of these two reasoning skills in the distinguishable phases of CPS. The path analysis models ( Figure 8 ) showed that the predictive power of IR and CR for KAC and KAP was varied in each group. Levels of IR and CR among non-persistent explorers and non-performing explorers failed to predict their achievement in the KAC phase of the CPS process. Moreover, rapid learners’ level of IR significantly predicted their achievement in the KAC phase (β = 0.327, p < 0.01), but their level of CR did not have the same predictive power. Furthermore, the proficient strategy users’ levels of both reasoning skills had significant predictive power for KAC (IR: β = 0.363, p < 0.01; CR: β = 0.132, p < 0.01). In addition, in the KAP phase of the CPS problems, IR played a significant role for all types of strategy users, although with different power (proficient strategy users: β = 0.408, p < 0.01; rapid learners: β = 0.339, p < 0.01; non-persistent explorers: β = 0.361, p < 0.01; and non-performing explorers: β = 0.447, p < 0.01); by contrast, CR did not have significant predictive power for the KAP phase in any of the models.

5. Discussion

The study aims to investigate the role of IR and CR in CPS and its phases among students using statistically distinguishable exploration strategies in different CPS environments. We examined 1343 Hungarian university students and assessed their CPS, IR and CR skills. Both achievement data and logfile data were used in the analysis. The traditional achievement indicators formed the foundation for analysing the students’ CPS, CR and IR performance, whereas process data extracted from logfile data were used to explore students’ exploration behaviour in various CPS environments.

Four qualitatively different exploration strategy profiles were distinguished: proficient strategy users, rapid learners, non-persistent explorers and non-performing explorers (RQ1). The four profiles were consistent with the result of another study conducted at university level (see Molnár et al. 2022 ), and the frequencies of these four profiles in these two studies were very similar. The two studies therefore corroborate and validate each other’s results. The majority of the participants were identified as proficient strategy users. More than 80% of the university students were able to employ effective exploration strategies in various CPS environments. Of the remaining students, some performed poorly in exploration strategy use in the early part of the test (rapid learners), some in the last part (non-persistent explorers) and some throughout the test (non-performing explorers). However, students with these three exploration strategy profiles only constituted small portions of the total sample (with proportions ranging from 3.1% to 6.5%). The university students therefore exhibited generally good performance in terms of exploration strategy use in a CPS environment, especially compared with previous results among younger students (e.g., primary school students, see Greiff et al. 2018 ; Wu and Molnár 2021 ; primary to secondary students, see Molnár and Csapó 2018 ).

The results have indicated that better exploration strategy users achieved higher CPS performance and had better development levels of IR and CR (RQ2). First, the results have confirmed the importance of VOTAT in a CPS environment. This finding is consistent with previous studies (e.g., Greiff et al. 2015a ; Molnár and Csapó 2018 ; Mustafić et al. 2019 ; Wu and Molnár 2021 ). Second, the results have confirmed that effective use of VOTAT is strongly tied to the level of IR and CR development. Reasoning forms an important component of human intelligence, and the level of development in reasoning was an indicator of the level of intelligence ( Klauer et al. 2002 ; Sternberg and Kaufman 2011 ). Therefore, this finding has supplemented empirical evidence for the argument that effective use of VOTAT is associated with levels of intelligence to a certain extent.

The roles of IR and CR proved to be varied for each type of exploration strategy user (RQ3). For instance, the level of CPS among the best exploration strategy users (i.e., the proficient strategy users) was predicted by both the levels of IR and CR, but this was not the case for students with other profiles. In addition, the results have indicated that IR played important roles in both the KAC and KAP phases for the students with relatively good exploration strategy profiles (i.e., proficient strategy users and rapid learners) but only in the KAP phase for the rest of the students (non-persistent explorers and non-performing explorers); moreover, the predictive power of CR can only be detected in the KAC phase of the proficient strategy users. To sum up, the results suggest a general trend of IR and CR playing more important roles in the CPS process among better exploration strategy users.

Combining the answers to RQ2 and RQ3, we can gain further insights into students’ exploration strategy use in a CPS environment. Our results have confirmed that the use of VOTAT is associated with the level of IR and CR development and that the importance of IR and CR increases with proficiency in exploration strategy use. Based on these findings, we can make a reasonable argument that IR and CR are essential skills for using VOTAT and that underdeveloped IR and CR will prevent students from using effective strategies in a CPS environment. Therefore, if we want to encourage students to become better exploration strategy users, it is important to first enhance their IR and CR skills. Previous studies have suggested that establishing explicit training in using effective strategies in a CPS environment is important for students’ CPS development ( Molnár et al. 2022 ). Our findings have identified the importance of IR and CR in exploration strategy use, which has important implications for designing training programmes.

The results have also provided a basis for further studies. Future studies have been suggested to further link the behavioural and cognitive perspectives in CPS research. For instance, IR and CR were considered as component skills of CPS (see Section 1.2 ). The results of the study have indicated the possibility of not only discussing the roles of IR and CR in the cognitive process of CPS, but also exploration behaviour in a CPS environment. The results have thus provided a new perspective for exploring the component skills of CPS.

6. Limitations

There are some limitations in the study. All the tests were low stake; therefore, students might not be sufficiently motivated to do their best. This feature might have produced the missing values detected in the sample. In addition, some students’ exploration behaviour shown in this study might theoretically be below their true level. However, considering that data cleaning was adopted in this study (see Section 3.1 ), we believe this phenomenon will not have a remarkable influence on the results. Moreover, the CPS test in this study was based on the MicroDYN approach, which is a well-established and widely used artificial model with a limited number of variables and relations. However, it does not have the power to cover all kinds of complex and dynamic problems in real life. For instance, the MicroDYN approach cannot measure ill-defined problem solving. Thus, this study can only demonstrate the influence of IR and CR on problem solving in well-defined MicroDYN-simulated problems. Furthermore, VOTAT is helpful with minimally complex problems under well-defined laboratory conditions, but it may not be that helpful with real-world, ill-defined complex problems ( Dörner and Funke 2017 ; Funke 2021 ). Therefore, the generalizability of the findings is limited.

7. Conclusions

In general, the results have shed new light on students’ problem-solving behaviours in respect of exploration strategy in a CPS environment and explored differences in terms of the use of thinking skills between students with different exploration strategies. Most studies discuss students’ problem-solving strategies from a behavioural perspective. By contrast, this paper discusses them from both behavioural and cognitive perspectives, thus expanding our understanding in this area. As for educational implications, the study contributes to designing and revising training methods for CPS by identifying the importance of IR and CR in exploration behaviour in a CPS environment. To sum up, the study has investigated the nature of CPS from a fresh angle and provided a sound basis for future studies.

Author Contributions

Conceptualization, H.W. and G.M.; methodology, H.W. and G.M.; formal analysis, H.W.; writing—original draft preparation, H.W.; writing—review and editing, G.M.; project administration, G.M.; funding acquisition, G.M. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Ethical approval was not required for this study in accordance with the national and institutional guidelines. The assessments which provided data for this study were integrated parts of the educational processes of the participating university. The participation was voluntary.

Informed Consent Statement

All of the students in the assessment turned 18, that is, it was not required or possible to request and obtain written informed parental consent from the participants.

Data Availability Statement

The data used to support the findings cannot be shared at this time as it also forms part of an ongoing study.

Conflicts of Interest

Authors declare no conflict of interest.

Funding Statement

This study has been conducted with support provided by the National Research, Development and Innovation Fund of Hungary, financed under the OTKA K135727 funding scheme and supported by the Research Programme for Public Education Development, Hungarian Academy of Sciences (KOZOKT2021-16).

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

• Adey Philip, Csapó Benő. Developing and Assessing Scientific Reasoning. In: Csapó Benő, Szabó Gábor., editors. Framework for Diagnostic Assessment of Science. Nemzeti Tankönyvkiadó; Budapest: 2012. pp. 17–53. [ Google Scholar ]
• Batanero Carmen, Navarro-Pelayo Virginia, Godino Juan D. Effect of the implicit combinatorial model on combinatorial reasoning in secondary school pupils. Educational Studies in Mathematics. 1997;32:181–99. doi: 10.1023/A:1002954428327. [ DOI ] [ Google Scholar ]
• Beckmann Jens F., Guthke Jürgen. Complex problem solving, intelligence, and learning ability. In: Frensch Peter A., Funke Joachim., editors. Complex Problem Solving: The European Perspective. Erlbaum; Hillsdale: 1995. pp. 177–200. [ Google Scholar ]
• Buchner Axel. Basic topics and approaches to the study of complex problem solving. In: Frensch Peter A., Funke Joachim., editors. Complex Problem Solving: The European Perspective. Erlbaum; Hillsdale: 1995. pp. 27–63. [ Google Scholar ]
• Chen Yunxiao, Li Xiaoou, Liu Jincheng, Ying Zhiliang. Statistical analysis of complex problem-solving process data: An event history analysis approach. Frontiers in Psychology. 2019;10:486. doi: 10.3389/fpsyg.2019.00486. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Csapó Benő. A kombinatív képesség struktúrája és fejlődése. Akadémiai Kiadó; Budapest: 1988. [ Google Scholar ]
• Csapó Benő. The development of inductive reasoning: Cross-sectional assessments in an educational context. International Journal of Behavioral Development. 1997;20:609–26. doi: 10.1080/016502597385081. [ DOI ] [ Google Scholar ]
• Csapó Benő. Teaching and Learning Thinking Skills. Swets & Zeitlinger; Lisse: 1999. Improving thinking through the content of teaching; pp. 37–62. [ Google Scholar ]
• Csapó Benő, Molnár Gyöngyvér. Online diagnostic assessment in support of personalized teaching and learning: The eDia System. Frontiers in Psychology. 2019;10:1522. doi: 10.3389/fpsyg.2019.01522. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Dörner Dietrich, Funke Joachim. Complex problem solving: What it is and what it is not. Frontiers in Psychology. 2017;8:1153. doi: 10.3389/fpsyg.2017.01153. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• English Lyn D. Combinatorics and the development of children’s combinatorial reasoning. In: Jones Graham A., editor. Exploring Probability in School: Challenges for Teaching and Learning. Springer; New York: 2005. pp. 121–41. [ Google Scholar ]
• Fischer Andreas, Greiff Samuel, Funke Joachim. The process of solving complex problems. Journal of Problem Solving. 2012;4:19–42. doi: 10.7771/1932-6246.1118. [ DOI ] [ Google Scholar ]
• Frensch Peter A., Funke Joachim. Complex Problem Solving: The European Perspective. Psychology Press; New York: 1995. [ Google Scholar ]
• Funke Joachim. Dynamic systems as tools for analysing human judgement. Thinking and Reasoning. 2001;7:69–89. doi: 10.1080/13546780042000046. [ DOI ] [ Google Scholar ]
• Funke Joachim. Complex problem solving: A case for complex cognition? Cognitive Processing. 2010;11:133–42. doi: 10.1007/s10339-009-0345-0. [ DOI ] [ PubMed ] [ Google Scholar ]
• Funke Joachim. It Requires More Than Intelligence to Solve Consequential World Problems. Journal of Intelligence. 2021;9:38. doi: 10.3390/jintelligence9030038. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Funke Joachim, Fischer Andreas, Holt Daniel V. Competencies for complexity: Problem solving in the twenty-first century. In: Care Esther, Griffin Patrick, Wilson Mark., editors. Assessment and Teaching of 21st Century Skills. Springer; Dordrecht: 2018. pp. 41–53. [ Google Scholar ]
• Gilhooly Kenneth J. Thinking: Directed, Undirected and Creative. Academic Press; London: 1982. [ Google Scholar ]
• Gnaldi Michela, Bacci Silvia, Kunze Thiemo, Greiff Samuel. Students’ complex problem solving profiles. Psychometrika. 2020;85:469–501. doi: 10.1007/s11336-020-09709-2. [ DOI ] [ PubMed ] [ Google Scholar ]
• Greiff Samuel, Funke Joachim. Measuring complex problem solving-the MicroDYN approach. In: Scheuermann Friedrich, Björnsson Julius., editors. The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities; Luxembourg: 2009. pp. 157–63. [ Google Scholar ]
• Greiff Samuel, Holt Daniel V., Funke Joachim. Perspectives on problem solving in educational assessment: Analytical, interactive, and collaborative problem solving. Journal of Problem Solving. 2013;5:71–91. doi: 10.7771/1932-6246.1153. [ DOI ] [ Google Scholar ]
• Greiff Samuel, Molnár Gyöngyvér, Martina Romain, Zimmermann Johannes, Csapó Benő. Students’ exploration strategies in computer-simulated complex problem environments: A latent class approach. Computers & Education. 2018;126:248–63. [ Google Scholar ]
• Greiff Samuel, Wüstenberg Sascha, Avvisati Francesco. Computer-generated log-file analyses as a window into students’ minds? A showcase study based on the PISA 2012 assessment of problem solving. Computers & Education. 2015a;91:92–105. [ Google Scholar ]
• Greiff Samuel, Wüstenberg Sascha, Funke Joachim. Dynamic problem solving: A new measurement perspective. Applied Psychological Measurement. 2012;36:189–213. doi: 10.1177/0146621612439620. [ DOI ] [ Google Scholar ]
• Greiff Samuel, Wüstenberg Sascha, Csapó Benő, Demetriou Andreas, Hautamäki Jarkko, Graesser Arthur C., Martin Romain. Domain-general problem solving skills and education in the 21st century. Educational Research Review. 2014;13:74–83. doi: 10.1016/j.edurev.2014.10.002. [ DOI ] [ Google Scholar ]
• Greiff Samuel, Wüstenberg Sascha, Goetz Thomas, Vainikainen Mari-Pauliina, Hautamäki Jarkko, Bornstein Marc H. A longitudinal study of higher-order thinking skills: Working memory and fluid reasoning in childhood enhance complex problem solving in adolescence. Frontiers in Psychology. 2015b;6:1060. doi: 10.3389/fpsyg.2015.01060. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Hołda Małgorzata, Głodek Anna, Dankiewicz-Berger Malwina, Skrzypińska Dagna, Szmigielska Barbara. Ill-defined problem solving does not benefit from daytime napping. Frontiers in Psychology. 2020;11:559. doi: 10.3389/fpsyg.2020.00559. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Klauer Karl Josef. Paradigmatic teaching of inductive thinking. Learning and Instruction. 1990;2:23–45. [ Google Scholar ]
• Klauer Karl Josef, Willmes Klaus, Phye Gary D. Inducing inductive reasoning: Does it transfer to fluid intelligence? Contemporary Educational Psychology. 2002;27:1–25. doi: 10.1006/ceps.2001.1079. [ DOI ] [ Google Scholar ]
• Kuhn Deanna. What is scientific thinking and how does it develop? In: Goswami Usha., editor. The Wiley-Blackwell Handbook of Childhood Cognitive Development. Wiley-Blackwell; Oxford: 2010. pp. 371–93. [ Google Scholar ]
• Kuhn Deanna, Garcia-Mila Merce, Zohar Anat, Andersen Christopher, Sheldon H. White, Klahr David, Carver Sharon M. Strategies of knowledge acquisition. Monographs of the Society for Research in Child Development. 1995;60:1–157. doi: 10.2307/1166059. [ DOI ] [ Google Scholar ]
• Lo Yungtai, Mendell Nancy R., Rubin Donald B. Testing the number of components in a normal mixture. Biometrika. 2001;88:767–78. doi: 10.1093/biomet/88.3.767. [ DOI ] [ Google Scholar ]
• Lotz Christin, Scherer Ronny, Greiff Samuel, Sparfeldt Jörn R. Intelligence in action—Effective strategic behaviors while solving complex problems. Intelligence. 2017;64:98–112. doi: 10.1016/j.intell.2017.08.002. [ DOI ] [ Google Scholar ]
• Mayer Richard E. Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science. 1998;26:49–63. doi: 10.1023/A:1003088013286. [ DOI ] [ Google Scholar ]
• Molnár Gyöngyvér, Csapó Benő. Az 1–11 évfolyamot átfogó induktív gondolkodás kompetenciaskála készítése a valószínűségi tesztelmélet alkalmazásával. Magyar Pedagógia. 2011;111:127–40. [ Google Scholar ]
• Molnár Gyöngyvér, Csapó Benő. The efficacy and development of students’ problem-solving strategies during compulsory schooling: Logfile analyses. Frontiers in Psychology. 2018;9:302. doi: 10.3389/fpsyg.2018.00302. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Molnár Gyöngyvér, Alrababah Saleh Ahmad, Greiff Samuel. How we explore, interpret, and solve complex problems: A cross-national study of problem-solving processes. Heliyon. 2022;8:e08775. doi: 10.1016/j.heliyon.2022.e08775. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Molnár Gyöngyvér, Greiff Samuel, Csapó Benő. Inductive reasoning, domain specific and complex problem solving: Relations and development. Thinking Skills and Creativity. 2013;9:35–45. doi: 10.1016/j.tsc.2013.03.002. [ DOI ] [ Google Scholar ]
• Mousa Mojahed, Molnár Gyöngyvér. Computer-based training in math improves inductive reasoning of 9- to 11-year-old children. Thinking Skills and Creativity. 2020;37:100687. doi: 10.1016/j.tsc.2020.100687. [ DOI ] [ Google Scholar ]
• Mustafić Maida, Yu Jing, Stadler Matthias, Vainikainen Mari-Pauliina, Bornstein Marc H., Putnick Diane L., Greiff Samuel. Complex problem solving: Profiles and developmental paths revealed via latent transition analysis. Developmental Psychology. 2019;55:2090–101. doi: 10.1037/dev0000764. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Muthén Linda K., Muthén Bengt O. Mplus User’s Guide. Muthén & Muthén; Los Angeles: 2010. [ Google Scholar ]
• Newell Allen. Reasoning, Problem Solving, and Decision Processes: The Problem Space as a Fundamental Category. MIT Press; Boston: 1993. [ Google Scholar ]
• Novick Laura R., Bassok Miriam. Problem solving. In: Holyoak Keith James, Morrison Robert G., editors. The Cambridge Handbook of Thinking and Reasoning. Cambridge University Press; New York: 2005. pp. 321–49. [ Google Scholar ]
• OECD . PISA 2012 Field Trial Problem Solving Framework. OECD Publishing; Paris: 2010. [ Google Scholar ]
• OECD . Results: Creative Problem Solving—Students’ Skills in Tackling Real-Life Problems (Volume V) OECD Publishing; Paris: 2014. [ Google Scholar ]
• Pásztor Attila. Ph.D. thesis. Doctoral School of Education, University of Szeged; Szeged, Hungary: 2016. Technology-Based Assessment and Development of Inductive Reasoning. [ Google Scholar ]
• Pásztor Attila, Csapó Benő. Improving Combinatorial Reasoning through Inquiry-Based Science Learning; Paper presented at the Science and Mathematics Education Conference; Dublin, Ireland. June 24–25; 2014. [ Google Scholar ]
• Pásztor Attila, Kupiainen Sirkku, Hotulainen Risto, Molnár Gyöngyvér, Csapó Benő. Comparing Finnish and Hungarian Fourth Grade Students’ Inductive Reasoning Skills; Paper presented at the EARLI SIG 1 Conference; Helsinki, Finland. August 29–31; 2018. [ Google Scholar ]
• Sandberg Elisabeth Hollister, McCullough Mary Beth. The development of reasoning skills. In: Sandberg Elisabeth Hollister, Spritz Becky L., editors. A Clinician’s Guide to Normal Cognitive Development in Childhood. Routledge; New York: 2010. pp. 179–89. [ Google Scholar ]
• Schraw Gregory, Dunkle Michael E., Bendixen Lisa D. Cognitive processes in well-defined and ill-defined problem solving. Applied Cognitive Psychology. 1995;9:523–38. doi: 10.1002/acp.2350090605. [ DOI ] [ Google Scholar ]
• Schweizer Fabian, Wüstenberg Sascha, Greiff Samuel. Validity of the MicroDYN approach: Complex problem solving predicts school grades beyond working memory capacity. Learning and Individual Differences. 2013;24:42–52. doi: 10.1016/j.lindif.2012.12.011. [ DOI ] [ Google Scholar ]
• Stadler Matthias, Becker Nicolas, Gödker Markus, Leutner Detlev, Greiff Samuel. Complex problem solving and intelligence: A meta-analysis. Intelligence. 2015;53:92–101. doi: 10.1016/j.intell.2015.09.005. [ DOI ] [ Google Scholar ]
• Sternberg Robert J. Handbook of Human Intelligence. Cambridge University Press; New York: 1982. [ Google Scholar ]
• Sternberg Robert J., Kaufman Scott Barry. The Cambridge Handbook of Intelligence. Cambridge University Press; New York: 2011. [ Google Scholar ]
• van de Schoot Rens, Lugtig Peter, Hox Joop. A checklist for testing measurement invariance. European Journal of Developmental Psychology. 2012;9:486–92. doi: 10.1080/17405629.2012.686740. [ DOI ] [ Google Scholar ]
• Vollmeyer Regina, Burns Bruce D., Holyoak Keith J. The impact of goal specificity on strategy use and the acquisition of problem structure. Cognitive Science. 1996;20:75–100. doi: 10.1207/s15516709cog2001_3. [ DOI ] [ Google Scholar ]
• Welter Marisete Maria, Jaarsveld Saskia, Lachmann Thomas. Problem space matters: The development of creativity and intelligence in primary school children. Creativity Research Journal. 2017;29:125–32. doi: 10.1080/10400419.2017.1302769. [ DOI ] [ Google Scholar ]
• Wenke Dorit, Frensch Peter A., Funke Joachim. Complex Problem Solving and intelligence: Empirical relation and causal direction. In: Sternberg Robert J., Pretz Jean E., editors. Cognition and Intelligence: Identifying the Mechanisms of the Mind. Cambridge University Press; New York: 2005. pp. 160–87. [ Google Scholar ]
• Wittmann Werner W., Hattrup Keith. The relationship between performance in dynamic systems and intelligence. Systems Research and Behavioral Science. 2004;21:393–409. doi: 10.1002/sres.653. [ DOI ] [ Google Scholar ]
• Wu Hao, Molnár Gyöngyvér. Interactive problem solving: Assessment and relations to combinatorial and inductive reasoning. Journal of Psychological and Educational Research. 2018;26:90–105. [ Google Scholar ]
• Wu Hao, Molnár Gyöngyvér. Logfile analyses of successful and unsuccessful strategy use in complex problem-solving: A cross-national comparison study. European Journal of Psychology of Education. 2021;36:1009–32. doi: 10.1007/s10212-020-00516-y. [ DOI ] [ Google Scholar ]
• Wu Hao, Saleh Andi Rahmat, Molnár Gyöngyvér. Inductive and combinatorial reasoning in international educational context: Assessment, measurement invariance, and latent mean differences. Asia Pacific Education Review. 2022;23:297–310. doi: 10.1007/s12564-022-09750-z. [ DOI ] [ Google Scholar ]
• Wüstenberg Sascha, Greiff Samuel, Funke Joachim. Complex problem solving—More than reasoning? Intelligence. 2012;40:1–14. doi: 10.1016/j.intell.2011.11.003. [ DOI ] [ Google Scholar ]
• Wüstenberg Sascha, Greiff Samuel, Molnár Gyöngyvér, Funke Joachim. Cross-national gender differences in complex problem solving and their determinants. Learning and Individual Differences. 2014;29:18–29. doi: 10.1016/j.lindif.2013.10.006. [ DOI ] [ Google Scholar ]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

• View on publisher site
• PDF (3.0 MB)
• Collections

Similar articles

Cited by other articles, links to ncbi databases.

• Download .nbib .nbib
• Format: AMA APA MLA NLM

Add to Collections

BRIEF RESEARCH REPORT article

Effects of online problem-solving instruction and identification attitude toward instructional strategies on students' creativity.

• College of International Relations, Huaqiao University, Xiamen, China

Problem-solving ability is an essential part of daily life. Thus, curiosity and a thirst for knowledge should be cultivated in students to help them develop problem solving and independent thinking skills. Along with positive attitudes and an active disposition, these abilities are needed to solve problems throughout the lifespan and develop -confidence. To achieve educational objectives in the context of globalization, creative ability is necessary for generating competitive advantages. Therefore, creative thinking, critical thinking, and problem-solving ability are important basic competencies needed for future world citizens. Creativity should also be integrated into subject teaching to cultivate students' lifelong learning and a creative attitude toward life. A questionnaire was distributed to 420 students in colleges and universities in Fujian, China. After removing invalid and incomplete responses, 363 copies were found to be valid yielding a response rate of 86%. Findings indicate that the new generation requires high levels of support to develop creativity and integrate diverse subjects such as nature, humanities, and technology. A rich imagination is needed to root creativity in the new generation.

Introduction

Problem solving is ubiquitous in modern life and an essential skill for overcoming the problems we encounter daily. Problems can be overcome using problem-solving principles and creative inspiration from individuals ( Hao et al., 2016 ). Thus, students' curiosity and thirst for knowledge should be cultivated to develop their problem solving and independent thinking abilities. An active approach and positive attitude to solving problems may enhance self-confidence and the ability to cope with challenges.

Education aims to cultivate healthy personalities, thinking, judgment, and creativity ( Su et al., 2014 ). Essentially, education is the learning process to expand students' potential and cultivate their ability to adapt to—and improve—their environment. Basic goals of education should include self-expression, independent thinking, active inquiry, and problem solving. The curriculum goals should be life-centered to develop individuals' potential, cultivate scientific knowledge and skills, and help students adapt to the demands of modern life ( Atmatzidou et al., 2018 ). Education aims to deliver basic knowledge, cultivate physical and mental development, inquiry, and reflection, and create healthy citizens through activities involving interaction between individuals, individuals and society, and society and nature. To achieve educational objectives, students should be guided to develop their performance and creation abilities, research and active exploration abilities, independent thinking and problem-solving abilities. In the current globalization context, creative abilities are required for building competitive advantages. Accordingly, creative thinking, critical thinking, and problem-solving abilities are key skills for future world citizens. The cultivation of creativity should also be integrated into subject instruction, so that students develop their lifelong learning and creative attitudes toward life. Many countries are eager to cultivate creative new generations and promote the development of local business and humanistic technological education. It has become a national platform for the new generations of international technological art ( Zhang and Chu, 2016 ). In particular, the traditional productivity-oriented competition model is slowly being transformed to creativity-oriented industries. Innovation capability is likely to bring competitive advantages in the Internet information age. As the field of information technology grows exponentially, innovation capability has become more important. However, if opportunities for development are missed, it can be difficult to catch up as the need for creativity is likely to grow in the foreseeable future.

In this study we focus on student creativity and how it is affected by online problem-solving instruction and identification of attitudes toward instructional strategies. Our purpose is to help the new generation develop creativity and a rich imagination to integrate the power of nature, humanities, and technology.

Literature Review and Hypothesis

Su et al. (2017) proposed that teachers who use effective instructional strategies allow students to successfully negotiate the challenges of life, as effective instructional strategies may enhance students' problem-solving ability. Deeper relationships between teachers and students also result in better learning motivation for students. Art-related activities were used to observe the factors affecting preschool children's problem-solving ability ( Calvo et al., 2018 ). These factors included the cognition of problem goals, the development of perception ability, individual experience, interaction among peers, and resource assistance provided by teachers' instructional strategies. ( LaForce et al., 2017 ) pointed out that identifying problem-related data is an essential step in the problem-solving process, i.e., the process of acquiring data, judging data, reducing data coverage, or linking relevant data ( Wu et al., 2020a ). Teachers' instructional strategies for online problem solving also affect student performance. The following hypothesis was therefore established for this study.

H1: Online problem-solving instruction has a significant positive correlation with identification attitude.

Lu et al. (2017) consider that teachers can enhance students' problem-solving ability and cultivate their problem-finding skills through instructional strategies guiding discussion of current affairs. Instructional strategies and the use of multimedia in technology education can induce students' identification attitudes and learning motivation, ultimately enhancing learning effectiveness and facilitating the development of imagination and creativity. Students with identification attitudes toward strategies could design problem-solving methods using science ( Newhouse, 2017 ). The students understood that innovation was not necessarily the novel creation of “something from nothing” but might involve modification and new development based on existing affairs ( Wu et al., 2020b ). Achilleos et al. (2019) regard attitude toward education instructional strategies as the most important factor in students' creativity learning, where teachers, social and cultural factors, and experience in learning a foreign language revealed significant correlations. Our second hypothesis was therefore presented for this study.

H2: Identification attitude shows strong positive correlations with creativity.

Hsieh et al. (2017) posit that science-related thinking, discovery, and creation can be regarded as the research component of problem solving. Creativity is characterized by keenness, fluency, flexibility, originality, and elaboration—a kind of mental intelligence to generate distinct new concepts from known experiences or knowledge to solve problems with creative methods. Creativity can also be the application of known information, based on targeted outcomes, to generate novel, unique, and valuable new concepts or a new product or technology, unexplored innovative concepts or problem-solving abilities ( Wu et al., 2021 ). Joachim et al. (2018) consider creativity as a part of problem solving, as problem-solving characteristics often involve novel thinking, strong motivation and determination to present the important status of the solution in the latent process of problem solving. However, Joachim et al.'s (2018) views on creativity and problem-solving have largely been unexplored to date. Novel performance at any level of the creative process could be considered as creation. Rietz et al. (2019) stated that life brings diverse problems and the key to addressing these lies in creativity. Only when people invest more attention in creativity can problems be solved leading to optimum solutions for life's challenges. This gives rise to our third hypothesis.

H3: Online problem-solving instruction reveals strong positive correlations with creativity

Methodology

Operational definitions, online problem-solving instruction.

Referring to Chen et al. (2019) , the dimensions of online problem-solving instruction in this study were as follows.

1. Exercise example: Examples to illustrate teaching goals are provided as part of teachers' instruction. Students can learn effective problem-solving skills by observing experts' problem-solving interpretation and demonstration step-by-step.

2. Problem orientation: Problem-oriented learning refers to teachers giving carefully-designed situational problems to students, who start from a problem and proceed to problem solving and learning. After self-learning, students participate in team discussion or discussions with teachers. With constant trials, solutions are eventually proposed.

Identification Attitude

The dimensions for identification attitude toward learning are based on Tang et al. (2019) and contain the following three components.

1. Cognitive component: This refers to an individual's belief in or knowledge of specific matters. The cognition of attitude refers to evaluation of meaning from factual statements presented, i.e., an individual may form an attitude for or against a particular object. For instance, students understand that teachers have rich professional knowledge and can present materials with good organization.

2. Affective component: The affective or emotional component refers to an individual's emotions and feelings, including positive and negative feelings of respect and contempt, like and dislike, sympathy and exclusion. For example, students evaluating a teacher as a friendly person would have positive feelings about the teacher and want to develop that relationship.

3. Behavioral component: Behavior refers to an individual's response tendency to attitude objects, i.e., an individual's explicit behavioral performance when acting in relation to objects. Possible responses include approach, avoidance, or indifference. For instance, students might accept their teachers' arrangement of an activity with respect and actively ask teachers questions.

Kim et al. (2019) consider creativity includes basic cognitive abilities of divergent thinking, and that such abilities can be understood through testing tools or observation.

1. Fluency: Fluency refers to the quantity of a person's concept output, i.e., the ability to generate possible programs or solutions. A student with fluent thinking would propose several responses at the concept generation stage.

2. Flexibility: Flexibility is the ability to change thinking direction, i.e., being able to think of different methods when problems occur, to find out distinct applications or new concepts.

3. Originality: Originality refers to generation of unique and novel ideas, i.e., doing unexpected things or having the ability to see others' points of view.

4. Elaboration: Elaboration is a supplementary idea that refers to the ability to add new ideas to an original concept, i.e., the ability to increase novel concepts or build on existing ideas or basic concepts.

Research Objective

There are 89 colleges and universities in Fujian, China (50 colleges and 39 universities). Students in these institutions in Fujian comprised the research sample, and we distributed 420 copies of our questionnaire to them. After removing invalid and incomplete questionnaires, a total of 363 valid copies were returned, with a response rate of 86%.

This research focused on discussing online problems about teaching and teaching strategies. It used experimental design and online problem solving to do experimental research for 2 hours every week for 24 weeks (48 hours in total). To analyze data from the questionnaire, Structural Equation Modeling (SEM) was used. We followed a two-stage analysis of goodness-of-fit and model verification. Confirmatory Factor Analysis (CFA) was first executed, aiming to test complex variables in the model by deleting measured variables with negative effects on the cause-and-effect analysis. We then proceeded with path analysis with the modified model. Path analysis aims to estimate the path relationship among variables. Without testing complex variables through CFA, the path analysis might be affected by complex variables resulting in poor goodness-of-fit or an insignificant model path. Amos 18.0 was used in this study for the model fit test. The measurement result of CMIN/DF is considered good if lower than five and excellent if lower than three; Goodness-of-Fit Index (GFI), Adjusted Goodness-of-Fit index (AGFI), Normed Fit Index (NFI), Incremental Fit Index (IFI), Tucker-Lewis Index (TLI), and Comparative Fit Index (CFI) are considered good if higher than 0.9; and Root Mean Square Residual (RMR), Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residual (SRMR) are good if values are lower than 0.05.

Factor Analysis

Two factors of “exercise example” (eigenvalue = 4.638, α = 0.88) and “problem orientation” (eigenvalue = 3.751, α = 0.85) were extracted from the scale of instructional strategies for online problem solving. The cumulative covariance accounted for was 72.683%. Three factors were extracted from the identification attitude scale: “cognitive component” (eigenvalue = 2.463, α = 0.81), “affective component” (eigenvalue = 1.754, α = 0.83), and “behavioral component” (eigenvalue = 1.491, α = 0.84). The cumulative covariance reached 73.942%. Four factors were extracted from the creativity scale: “fluency” (eigenvalue = 2.461, α = 0.84), “flexibility” (eigenvalue = 2.055, α = 0.82), “originality” (eigenvalue = 1.976, α = 0.87), and “elaboration” (eigenvalue = 1.689, α = 0.86). The cumulative covariance accounted for was 79.317%.

Empirical Analysis of SEM

CFA results indicated the convergent and discriminant validity of the model were first observed, with convergent validity describing the reliability of individually observed variables, construct reliability (CR), and average variances extracted (AVE). Values of more than 0.5 indicate good reliability of individually observed variables. The factor loadings of the observed variables in the empirical analysis model were higher than the suggested value. CR should exceed 0.6, although some researchers suggest that 0.5 or above is acceptable. The model calibration results reveal CR was higher than 0.6, and AVE higher than 0.5, thus conforming to the suggested values.

Regarding the calibration results of structural equations, χ 2 / df , RMSEA, GFI, AGFI, RMR, and NFI were also calculated. For χ 2 / df a standard ≦5 is suggested and χ 2 / df = 2.422 ≦ 5 in this study. The standard for RMSEA is ≦0.08; reported here as 0.044 ≦ 0.08. GFI has a suggested standard of ≧0.9 and here it is reported as 0.951 ≧ 0.9. AGFI's suggested standard ≧0.9; it shows AGFI = 0.927 ≧ 0.9 in this study. RMR has a suggested standard of ≦0.05, and here it was reported as 0.023 ≦ 0.05. The NFI standard is ≧0.9; here it presents NFI = 0.937 ≧ 0.9 in this study. The overall model fit is good. The parameter calibration of the structural equation is shown in Table 1 and Figure 1 . The research results reveal instructional strategies for online problem solving → identification attitude: 0.346 *** , that is, H1 was supported. Identification attitude → creativity: 0.375 *** , that is, H2 was supported, and instructional strategies for online problem solving → creativity: 0.425 *** , that is, H3 was supported.

Table 1 . Structural equation modeling result.

Figure 1 . FigureModel path diagram.

The results show that online instructional strategies for online problem solving can enhance students' creativity. Apparently, an expository teaching style is no longer sufficient to cope with challenges encountered. Rather, teachers need to be willing to constantly learn and change their teaching behavior to cope with the rapid development of new technology and enhance teaching efficiency. When conveying new knowledge to beginners, the provision of exercise examples may help students establish new schema to benefit the application to similar situations. When lacking relevant schema, beginners may try to solve problems with trial and error. In this case, exercise examples with experts demonstrating problem-solving steps could benefit students' learning performance in the new field. Problems studied in real life may facilitate students' creativity, drawing on their existing knowledge as they use available resources and unconsciously apply existing knowledge to enhance creative ability. The solutions to problems are unpredictable but require the ability to cope with interaction between people in a given culture or society in different situations. As a result, teachers should make decisions with the consideration of situational changes in the teaching site, i.e., students' ability, performance and teaching schedule, rather than generalizing across all situations. We do not suggest limiting creative thinking or defining set times for enhancing students' creative thinking. Instead, factors that influence creative efficiency, creative value, and curriculum schedules should be taken into account. As teachers plan their teaching activities, they should pay particular attention to students' academic performance and the vicarious experience of teachers or peers. Uysal (2014) believed people can develop their mental ability through learning even without any creative invention. When we face any new concept, it is better to keep an open mind. That way we will realize there is still a lot to be created ( Fernández et al., 2018 ). Labusch et al. (2019) said the development of creativity is not only creating positive thoughts but also turning these advantages into something more refined and broader. Teachers need to provide learning opportunities that students can apply in their daily lives leading to a re-evaluation of their identification attitudes toward instructional strategies. In this case, enhancing students' self-efficacy may assist them in overcoming learning challenges and cultivating a more positive learning attitude.

The research results demonstrate that online problem solving supports students to examine their ideas, chase after knowledge and continually improve their learning. They can freely develop their imaginations and make choices without being limited to find tools suitable for self-performance. They can concentrate on details, retain memories, and calmly think of more elaborate problem-solving approaches. Students draw on plans and organization to make significant progress in their thinking depth, novelty, flexibility, unique style, and diversity of function. To cultivate students' habits of brainstorming and thinking, they must become familiar with the general use of contextual information, and flexibility to change approaches and seek answers. Training flexible thinking is essential so that students can cope with problems with ease, propose various options and generate solutions. Lumsdaine and Lumsdaine (1995) let students learn from each other and modify their own thought. This transition could help them to achieve their potential. Solitary and monotonous learning material can no longer attract students' attention. Teachers need to provide a wider variety of materials and free choices without limit. They could also find more suitable tools for teaching. Therefore, Treffinger and Isaksen (1992) no longer provide model answers. They want students to explore and develop without any restriction. This could also amplify their personal experience and bring more options into it. It enhances student's uniqueness, and this needs overall growth, subjectively and objectively. People should never venerate one over the other. We should also learn to make good use of the conditions and things we already have. The same thing could have an entirely different outcome depending on how we use it ( Aşik and Erktin, 2019 ). Consequently, problem-solving instruction could assist in the cultivation of creativity in students' practice ability or cultivation of independent thinking and problem-solving ability. Teachers should attempt to create beneficial educational environments, cultivating students' learning interests, and enhancing their mental development. With accumulated experience, students can then be encouraged to develop more flexible skills, sensitive perception, and active thinking along with the ability to appropriately express these experiences. This would provide comprehensive preparation for enhancing students' creative thinking ability. Instructional strategies for online problem solving heavily emphasize cooperative discussion, brainstorming, and presentation. Tasks focusing on students' favorite novels and other relevant interests are valuable for sustaining long-term attention. Success in learning does not simply rely on rich knowledge and skillful techniques; affective attitudes also play an important part. Such characteristics may encourage students to positively and actively face problems and logically enhance their learning attitudes step-by-step.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethical Committee of the Huaqiao University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

Y-PW performed the initial analyses and approved the submitted version of the manuscript.

Conflict of Interest

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors thank the reviewers for their valuable comments.

Achilleos, A. P., Mettouris, C., Yeratziotis, A., Papadopoulos, G. A., Pllana, S., Huber, F., et al. (2019). SciChallenge: a social media aware platform for contest-based STEM education and motivation of young students. IEEE Trans. Learn. Technol . 12, 98–111. doi: 10.1109/TLT.2018.2810879

CrossRef Full Text | Google Scholar

Aşik, G., and Erktin, E. (2019). Metacognitive experiences: mediating the relationship between metacognitive knowledge and problem solving. Egitim ve Bilim 44, 85–103. doi: 10.15390/EB.2019.7199

Atmatzidou, S., Demetriadis, S., and Nika, P. (2018). How does the degree of guidance support students' metacognitive and problem solving skills in educational robotics? J. Sci. Educ. Technol. 27, 70–85. doi: 10.1007/s10956-017-9709-x

Calvo, I., Cabanes, I., Quesada, J., and Barambones, O. (2018). A multidisciplinary PBL approach for teaching industrial informatics and robotics in engineering. IEEE Trans. Educ . 61, 21–28. doi: 10.1109/TE.2017.2721907

Chen, S.-Y., Lai, C.-F., Lai, Y.-H., and Su Y, S. (2019). Effect of project-based learning on development of students' creative thinking. Int. J. Electr. Eng. Educ . doi: 10.1177/0020720919846808

Fernández, J., Zúñiga, M. E., Rosas, M. V., and Guerrero, R. A. (2018). Experiences in learning problem-solving through computational thinking. J. Comput. Sci. Technol. 18, 136–142. doi: 10.24215/16666038.18.e15

Hao, J., Liu, L., von Davier, A., Kyllonen, P., and Kitchen, C. (2016). “Collaborative problem solving skills vs. collaboration outcomes: findings from statistical analysis and data mining,” in Proceedings of the 9th International Conference on Educational Data Mining (Raleigh, NC), 382–387.

Google Scholar

Hsieh, J. S. C., Huang, Y.-M., and Wu, W.-C. V. (2017). Technological acceptance of LINE in flipped EFL oral training. Comput. Hum. Behav . 70, 178–190. doi: 10.1016/j.chb.2016.12.066

Joachim, V., Spieth, P., and Heidenreich, S. (2018). Active innovation resistance: an empirical study on functional and psychological barriers to innovation adoption in different contexts. Ind. Mark. Manag. 71, 95–107. doi: 10.1016/j.indmarman.2017.12.011

Kim, J., Jordan, S. S., Franklin, C., and Froerer, A. (2019). Is solution-focused brief therapy evidence-based: an update 10 years later. Fam. Soc. 100, 127–138. doi: 10.1177/1044389419841688

Labusch, A., Eickelmann, B., and Vennemann, M. (2019). “Computational thinking processes and their congruence with problem-solving and information processing,” in Proceedings of the Computational Thinking Education , 65–78. doi: 10.1007/978-981-13-6528-7_5

LaForce, M., Noble, E., and Blackwell, C. K. (2017). Problem-based learning (PBL) and student interest in STEM careers: the roles of motivation and ability beliefs. Educ. Sci. 7:92. doi: 10.3390/educsci7040092

Lu, X., Wang, D., and Yu, D. (2017). Effect of solution-focused brief therapy-based on exercise prescription intervention on adolescent mental health. Rev. Argentina de Clin. Psicol . 26, 347–354. doi: 10.24205/03276716.2017.1035

Lumsdaine, E., and Lumsdaine, M. (1995). Creative Problem Solving-Thinking Skills for Changing World . New York, NY: McGRAW-Hill. doi: 10.1109/45.464655

Newhouse, C. (2017). STEM the boredom: engage students in the Australian curriculum using ICT with problem-based learning and assessment. J. Sci. Educ. Technol. 26, 44–57. doi: 10.1007/s10956-016-9650-4

Rietz, T., Benke, I., and Maedche, A. (2019). “The impact of anthropomorphic and functional chatbot design features in enterprise collaboration systems on user acceptance,” in Proceedings of the 14th International Conference Wirtschaftsinformatik (Siegen), 1642-1656.

Su, Y.-S., Ding, T.-J., and Lai, C.-F. (2017). Analysis of students' engagement and learning performance in a social community supported computer programming course. Eurasia J. Math. Sci. Technol. Educ . 13, 6189–6201. doi: 10.12973/eurasia.2017.01058a

Su, Y. S., Yang, J. H., Hwang, W. Y., Huang, S. J., and Tern, M. Y. (2014). Investigating the role of computer-supported annotation in problem solving based teaching: an empirical study of a scratch programming pedagogy. Br. J. Educ. Technol. 45, 647–665. doi: 10.1111/bjet.12058

Tang, K. Y., Hsiao, C. H., and Su, Y. S. (2019). Networking for educational innovations: a bibliometric survey of international publication patterns. Sustainability 11:4608. doi: 10.3390/su11174608

Treffinger, D. J., and Isaksen, S. G. (1992). Creative Problem Solving: An Introduction . Montgomery: Center of Creative Learning, Inc.

Uysal, M. P. (2014). Improving first computer programming experiences: the case of adapting a web-supported and well-structured problem-solving method to a traditional course. Contemp. Educ. Technol . 5, 198–217. doi: 10.30935/cedtech/6125

Wu, T. J., Yuan, K. S., and Yen, D. C. (2021). Leader-member exchange, turnover intention and presenteeism–the moderated mediating effect of perceived organizational support. Curr. Psychol . doi: 10.1007/s12144-021-01825-1

Wu, T. J., Gao, J. Y., Wang, L. Y., and Yuan, K. S. (2020a). Exploring links between polychronicity and job performance from the person–environment fit perspective-the mediating role of well-being. Int. J. Environ. Res. Public Health 17, 3711–3722. doi: 10.3390/ijerph17103711

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, T. J., Xu, T., Li, L. Q., and Yuan, K. S. (2020b). “Touching with heart, reasoning by truth”! The impact of Brand cues on mini-film advertising effect. Int. J. Advert . 39, 1322–1350. doi: 10.1080/02650487.2020.1755184

Zhang, Y., and Chu, S. K. W. (2016). New ideas on the design of the web-based learning system oriented to problem solving from the perspective of question chain and learning community. Int. Rev. Res. Open Dis. 17, 176–189. doi: 10.19173/irrodl.v17i3.2115

Keywords: online problem, instructional strategies, identification attitude, affective component, creativity

Citation: Wang Y-P (2021) Effects of Online Problem-Solving Instruction and Identification Attitude Toward Instructional Strategies on Students' Creativity. Front. Psychol. 12:771128. doi: 10.3389/fpsyg.2021.771128

Received: 05 September 2021; Accepted: 27 September 2021; Published: 14 October 2021.

Reviewed by:

Copyright © 2021 Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yi-Ping Wang, 1487774578@qq.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Problem Solving

• Reference work entry
• pp 2680–2683
• Cite this reference work entry

• David H. Jonassen 2 &
• Woei Hung 3  

1971 Accesses

12 Citations

Cognition ; Problem typology ; Problem-based learning ; Problems ; Reasoning

Problem solving is the process of constructing and applying mental representations of problems to finding solutions to those problems that are encountered in nearly every context.

Theoretical Background

Problem solving is the process of articulating solutions to problems. Problems have two critical attributes. First, a problem is an unknown in some context. That is, there is a situation in which there is something that is unknown (the difference between a goal state and a current state). Those situations vary from algorithmic math problems to vexing and complex social problems, such as violence in society (see Problem Typology ). Second, finding or solving for the unknown must have some social, cultural, or intellectual value. That is, someone believes that it is worth finding the unknown. If no one perceives an unknown or a need to determine an unknown, there is no perceived problem. Finding...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save.

• Get 10 units per month
• Download Article/Chapter or eBook
• 1 Unit = 1 Article or 1 Chapter
• Cancel anytime
• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Durable hardcover edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bransford, J., & Stein, B. S. (1984). The IDEAL problem solver: A guide for improving thinking, learning, and creativity . New York: WH Freeman.

Google Scholar  

Frensch, P. A., & Funke, J. (Eds.). (1995). Complex problem solving: The European perspective . Hillsdale: Erlbaum.

Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15 , 1–38.

Article   Google Scholar  

Jonassen, D. H. (2010). Learning to solve problems: A handbook . New York: Routledge.

Jonassen, D. H., & Hung, W. (2008). All problems are not equal: Implications for PBL. Interdisciplinary Journal of Problem-Based Learning, 2 (2), 6–28.

Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology: Research & Development, 48 (4), 63–85.

Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments . New York: Routledge.

Klein, G. A. (1998). Sources of power: How people make decisions . Cambridge, MA: MIT Press.

Lehman, D., Lempert, R., & Nisbett, R. E. (1988). The effects of graduate training on reasoning: Formal discipline and thinking about everyday-life events. Educational Psychologist, 43 , 431–442.

Newell, A., & Simon, H. (1972). Human problem solving . Englewood Cliffs: Prentice Hall.

Rumelhart, D. E., & Norman, D. A. (1988). Representation in memory. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.), Steven’s handbook of experimental psychology (Learning and cognition 2nd ed., Vol. 2, pp. 511–587). New York: Wiley.

Sinnott, J. D. (1989). Everyday problem solving: Theory and applications (pp. 72–99). New York: Praeger.

Wood, P. K. (1983). Inquiring systems and problem structures: Implications for cognitive development. Human Development, 26 , 249–265.

Download references

Author information

Authors and affiliations.

School of Information Science and Learning Technologies, University of Missouri, 221C Townsend Hall, 65211, Columbia, MO, USA

Dr. David H. Jonassen

College of Education and Human Development, University of North Dakota, 231 Centennial Drive, Stop 7189, 58202, Grand Forks, ND, USA

Dr. Woei Hung

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to David H. Jonassen .

Editor information

Editors and affiliations.

Faculty of Economics and Behavioral Sciences, Department of Education, University of Freiburg, 79085, Freiburg, Germany

Norbert M. Seel

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media, LLC

About this entry

Cite this entry.

Jonassen, D.H., Hung, W. (2012). Problem Solving. In: Seel, N.M. (eds) Encyclopedia of the Sciences of Learning. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-1428-6_208

Download citation

DOI : https://doi.org/10.1007/978-1-4419-1428-6_208

Publisher Name : Springer, Boston, MA

Print ISBN : 978-1-4419-1427-9

Online ISBN : 978-1-4419-1428-6

eBook Packages : Humanities, Social Sciences and Law Reference Module Humanities and Social Sciences Reference Module Education

Share this entry

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research