Introduction
============

Netball is one of the most popular women's sports, and is played by more than 20 million people across more than 80 countries ([@B56]). Since 1963 a netball World Championship tournament has been played every 4 years. In 1990 netball first featured in the Commonwealth Games as a demonstration sport, and has since been played competitively for medals since 1998 ([@B56]). Despite substantial international popularity, netball remained an amateur sport for several decades. However, netball now has 61 countries recognized by the International Netball Federation, which includes several professional netball leagues. This recently obtained professional status of netball will no doubt generate new pressures and demands common within professional sport, one of which will be the increased demand for successful on-court match performance. To optimize match performance, it is necessary to assess performance variables in order to provide practical feedback to players and coaches, which will guide coaches decision making and subsequently the coaching process ([@B5]).

Performance analysis (PA) in sport involves analysing and evaluating the technical, tactical, physical, and cognitive aspects of performance in training and competition to better understand the components of successful performance ([@B34]; [@B5]). There is a substantial body of PA research associated with long standing professional sports such as football ([@B74], [@B73]), basketball ([@B7]; [@B25]; [@B72]), handball ([@B52]; [@B58]; [@B41]), rugby ([@B83]; [@B6]; [@B29]), water polo ([@B26]; [@B42]; [@B67]), and Australian rules football ([@B66], [@B65]). In netball, research has focused on understanding the players' physical ([@B19]; [@B14]; [@B1]; [@B80]), biomechanical ([@B23]; [@B75]), and anthropometric ([@B33]) characteristics in isolation, rates of injury occurrence, and injury prevention strategies ([@B38]; [@B51]; [@B44]). Although these studies have been important for understanding the physical demands of netball and have demonstrated the differences in variables between different levels of competition, they do little to describe on-court performance. As such, there is a paucity of PA research in netball that has attempted to integrate multiple components of match performance, or to understand team functioning. However, recent research has demonstrated that a complex system approach is necessary to understand sports performance, which requires a more holistic approach than isolated measurement of performance variables ([@B49]; [@B68]; [@B37]).

Previous research on the technical and tactical components of PA in netball has typically used descriptive notational analysis (frequencies and percentages) of isolated performance variables for individual players such as passing, turnovers, and shooting to determine successful netball performance ([@B57]; [@B59]). This suggests that the current understanding of the composition of successful netball performance, and the appropriate methods to measure them is limited ([@B16]). A limitation of this approach in netball, and generally for team sports, is that components of performance are often investigated in isolation without consideration of the interactions between other components of performance ([@B62]; [@B49]). This represents a deterministic and reductionist approach to PA and does not consider interdependencies or the relational perspectives within and between teams that is required to understand and describe complex team performance ([@B43]; [@B49]).

In sports PA research, it is becoming increasingly accepted that measuring isolated PA variables without considering the interactions between them, and the influence of match context, is limited and cannot appropriately explain team sports performance ([@B49]; [@B73]). In addition, such analyses contribute to a research-practice gap, whereby the reductionist analyses are of limited use to coaches for the design of training practices ([@B5]; [@B49]). Invasion sports such as netball represent complex systems, where multiple human and non-human components are operating within a dynamic and constantly changing match environment ([@B20], [@B21]; [@B49]). Investigating sporting performance as complex systems allows an understanding of the cooperative behaviors of team members in space and time, as well as emergent behaviors based on the opposition actions ([@B3]; [@B81]). Traditional sport science research applications that measure individual performance variables cannot provide a complete understanding of the complexity of performance or the factors influencing it, nor do they allow the detection of new emergent behaviors that could improve performance, or how performance can be measured ([@B11]). Recent studies have demonstrated the benefit of analysing and understanding sporting performance using methods specifically designed for analysing complex systems ([@B49]; [@B68]; [@B37]). Systems ergonomics methods are specifically designed to understand complex system behavior, for example, one study used cognitive work analysis (CWA), a systems ergonomics method, to model the football performance system to identify the components of football performance, and the interactions between them ([@B49]). Importantly, the use of subject matter experts (SMEs) in the development of the football performance model helped to provide practical insights for coaches that are both important to measure that are representative of the state of the system, and those that have a limited use for coaches ([@B49]). In addition, over the past 5 years, there has been a progressive increase in team analysis measures based on positional data ([@B4]; [@B24]; [@B53]), and teamwork interactions based on network analysis, in football and basketball ([@B12]; [@B28]; [@B50]). Moreover, at an elite level, coaches prefer emergent team PA measures compared to individual player analyses ([@B49]). As such, the use of analysis methods to investigate group behaviors have improved our understanding of the complex and dynamic nature of team sports, and have provided usable information for coaches regarding team functioning ([@B73]).

The infancy of professional netball, and the subsequent lack of integrated PA research in elite level netball provides a unique opportunity to obtain a more complete understanding of the composition of performance in elite netball, to understand the interactions between components, emergent properties ([@B16]), and to develop a conceptual base for future research and PA in netball. By building on established PA research in other areas, it will be possible to optimize PA in netball, potentially skipping decades of research describing isolated and independent performance components, as has been the case in other sports ([@B43]). Therefore, the primary aim of the current study is to describe and model the netball performance system via the application of CWA, a systems ergonomic method that has been used to understand complex systems, and in the design and re-design of complex systems across multiple domains (see "Materials and Methods" section). This first-of-its-kind analysis will allow the identification of the different components of performance and how they interact to influence performance in netball. In turn, the model will support identification of appropriate PA measures for netball.

Materials and Methods {#s1}
=====================

Participants
------------

Ethical approval for this study was granted by the Human Research Ethics Committee at the University of the Sunshine Coast (A/17/1043). Eleven elite level SMEs participated in structured workshops to develop a systems analysis model of the netball match performance system. The SMEs were experienced elite level netball coaches (C), professional netball players (PL), netball performance analysts (PA), an exercise physiologist (EP), a sports psychologist (SP), a skill acquisition specialist (SA), a high-performance manager of a professional netball team (HPM), and a strength and conditioning coach (S&C) ([Table 1](#T1){ref-type="table"}).

###### 

Subject matter expert (SME) characteristics.

  SME     Professional experience (years)   Professional games played   Professional games coached   International games played   International tournaments   Number of other sports worked in   National sport academy (years)   Accreditation
  ------- --------------------------------- --------------------------- ---------------------------- ---------------------------- --------------------------- ---------------------------------- -------------------------------- --------------------------
  C       18                                ∼350                        ∼250                         42                           --                          --                                 --                               --
  C       12                                ∼50                         76                           --                           --                          --                                 8                                HPC
  PL      7                                 32                          --                           63                           2                           --                                 --                               --
  PL      3                                 35                          --                           10^∗^                        1^∗^                        --                                 --                               --
  PA      15                                --                          --                           --                           3                           4                                  --                               Ph.D.; ISPAS (L5)
  PA      10                                --                          --                           --                           5                           4                                  5                                Ph.D.; AspS2; ISPAS (L5)
  SP      22                                --                          --                           --                           --                          7                                  --                               AHPRA
  EP      23                                --                          --                           --                           --                          --                                 --                               Ph.D.
  S&C     2                                 --                          --                           --                           2                           3                                  --                               ASCA (L2)
  HPM     20                                --                          --                           --                           2                           17                                 20                               ASCA (L3)
  SA      14                                --                          --                           --                           --                          12                                 10                               Ph.D.
  Total   146                               67                          250                          115                          15                          36                                 43                               
  Mean    13.3                              33.5                                                     38.3                         2.5                         9                                  10.8                             

∗

World youth cup,

∼

self-reported estimates. 'Professional games coached' includes assistant coach. ISPAS, International Society of Performance Analysis of Sport; ASCA, Australian Strength and Conditioning Association; AHPRA, Australian Health Practitioners Registration Agency; Ph.D., Doctor of Philosophy; HPC, High Performance Coach; ASpS2, Accredited Sports Scientist Level 2 -- Exercise and Sports Science Australia. International tournaments include: Olympic Games, World Championships, Commonwealth Games, South Asian Games, World Youth Cups, Asian Champions Trophy.

Study Design
------------

In the current study, WDA, the first phase of a systems ergonomics method, CWA, was used to develop a model of the netball match performance system to describe in detail the composition of netball performance ([@B55]). CWA ([@B84]) is a systems analysis and design framework that has previously been used in sport to analyze the football match performance system ([@B49]) and other complex sociotechnical systems ([@B61]; [@B70], [@B69]), and to inform system design or redesign activities ([@B15]; [@B76]). The framework comprises five phases; however, the phases applied is dependent on the purpose of the analysis. This study uses the first phase of CWA ([@B84]), WDA. WDA is used to provide an event and actor independent model of the system under analysis: in this case the elite netball match performance system. The aim is to understand the constraints imposed on the actions of any player performing activities within a netball match environment. This is achieved by describing systems at five conceptual levels using the abstraction hierarchy (AH) method ([@B49]) ([Table 2](#T2){ref-type="table"}).

###### 

Abstraction hierarchy descriptions.

  Abstraction hierarchy level        Question
  ---------------------------------- -------------------------------------------------------------------------------------------------
  1\. Functional purposes            What is the reason for playing?
  2\. Values and priority measures   How can players, coaches assess whether the functional purposes are being achieved?
  3\. Purpose-related functions      What functions must be performed to achieve the purposes of the netball match system?
  4\. Object-related processes       What processes or affordances are provided by the physical objects in the netball match system?
  5\. Physical objects               What physical objects are in the netball match system?

Within the WDA model the specific functional purposes, measures, functions, processes and physical objects are displayed as nodes. The nodes are linked across the AH levels via means-ends relationships (indicated by connecting lines in [Figure 1](#F1){ref-type="fig"}). This indicates that linked nodes above a node in the hierarchy relate to why the content of the node is required, and the linked nodes below a node relate to how the node is achieved ([@B69]). For example, in the netball model the function 'Attack' might have links to values and priorities such as 'Number of goals scored' and 'Scoring streak' above, and links from object-related processes such as 'Target for scoring' and 'Physical performance' below.

![The work domain analysis of the netball performance system.](fpsyg-10-00201-g001){#F1}

Procedure
---------

The procedure for conducting a WDA requires an accepted nine step methodology ([@B54]). The following section outlines the steps followed during the development of the current WDA.

### Step 1: Establish Aims and Purpose

The purpose of the analysis was to develop a systems model of netball match performance, including a description of on-court performance, current measures used to assess performance, and to identify novel measures of performance.

### Step 2: Anticipate Project Constraints

The main constraint considered was limited access to elite level SMEs due to the high demands placed on their time during training and competition. To manage this, we used multiple SMEs, including players, coaches, match analysts, and strength and conditioning coaches and held three separate workshops to provide as much opportunity for participation as possible.

### Step 3: Define the System Boundary

To develop the WDA, it was necessary to set analysis boundaries. The boundary for the current analysis was confined to professional women's netball match-play. Factors related to performance that occur outside of the match, such as training, nutrition, sleep, etc., were not considered in the analysis. A second aspect of the analysis boundary was a specific focus on elite level women's netball.

### Step 4: Classify System Constraints

For the purpose of this study, the WDA constraints represent the specific types of relationships that are to be modeled between the different components of netball match performance. For example, the physical context in which netball players operate imposes constraints on the actions of individual and group behaviors, whether this be via a need to adapt to the opposing team or the pressure to perform under stressful passages of play. Given that the relationships among performance-based components are largely non-deterministic (i.e., players continuously exhibit large degrees of freedom and latitude for behavior), the type of data sources and development of the analysis needed to include the firsthand experience of 'real' people who could reflect on why certain actions and behaviors occur during on court performances.

### Step 5: Locate Data Sources

Existing scientific research in elite-level netball and wider sports performance peer-reviewed academic literature, as well as the identified SMEs were considered appropriate data sources to develop an initial WDA. In addition, the first author attended multiple training sessions of a professional netball team prior to the analysis to assist in understanding what comprises netball performance. The knowledge gained enabled recommendations of PA measures from other sports that could be modified and used in netball to assess performance.

### Step 6: Construct the WDA

An initial model of the netball match system was developed by the research team based on the data collected in step five. The research team comprised four researchers experienced in applying systems ergonomics methods to sporting domains ([@B36]; [@B49]; [@B68]), two of which are human factors (HFs) practitioners with extensive experience in applying CWA in systems analysis and design across a range of safety critical domains ([@B60]; [@B70]), and two experienced netball performance analysts. Due to the scarcity of netball specific PA measures, several of the nodes within the initial WDA were derived from the PA literature on well-established professional sports. The research team applied the means-ends-links to the final model, to show the connections between the nodes across the levels of the AH using the how-what-why prompts.

### Step 7: Refine the Analysis

The draft WDA model was reviewed and refined by the SMEs in three separate workshops. The SMEs were questioned on the appropriateness of the nodes in the draft model, including whether each node should be included or excluded from the model, and if the terms used were applicable to netball practitioners and coaches. Where required nodes and relationships were either removed, modified, or added.

### Steps 8 and 9: Review and Validate the WDA

The completed WDA was presented to the two expert netball performance analysts for review. They were asked to review each node within the model, starting at the functional purposes level and proceeding downward to the physical objects level. The analysts agreed with the nodes at each level and provided no further modifications to the WDA model. To determine the novelty of included PA measures, the first author reviewed the existing literature on PA in netball, and items that have not previously been assessed in netball literature were considered to be novel to netball PA.

Results
=======

Modifications to the WDA
------------------------

Based on the feedback from the SMEs during the workshops, there were modifications to the original WDA model of the netball performance system that was developed by the research team. See Appendix [1](#A1){ref-type="app"} for a summary of the SME modifications to the WDA model.

Work Domain Analysis
--------------------

The 'netball match performance model' is presented in [Figure 1](#F1){ref-type="fig"}.

### Functional Purposes

Five functional purposes identified highlighting the importance of winning the match, continual team improvement, adherence to the game plans, the demonstration of team values, and a need to entertain audiences.

### Values and Priority Measures

Nineteen values and priority measures were identified. These included measures of goal scoring and passing, defense, cognitive measures of psychological flow and scoreboard pressure, team structure measures of space creation, and the strategic use of time outs.

### Purpose Related Functions

Eighteen general functions were deemed necessary for achieving the functional purposes. These included match phase measures such as such as attack, defend, and transition. Functions of cognitive and physical performance, and tactical measures including controlling momentum, maintenance of structures, and adaptability.

### Object Related Processes and Physical Objects

The two lower levels of the WDA show the physical objects in the system and the processes that each object supports in order to achieve the purpose-related functions. For example, the 'Goal post and goal' provides a 'Target for scoring,' and 'Footwear' provides 'Protection from injury.'

### Means-End-Links

The means-end links in the WDA provide an indication of the relationships between the nodes across the five levels in terms of a how-what-why triad ([Figure 2](#F2){ref-type="fig"}). The many-to-many means-end-links demonstrate the numerous possibilities for action available to the actors within the system ([Figure 1](#F1){ref-type="fig"}).

![Example means-end-links pathway. The relationship between levels of the abstraction hierarchy are indicated by the means-end-links using a how-what-why triad. Working from bottom to top, the physical object 'Game plan,' enables the object related process of 'Define match tactics,' which includes the purpose related function of 'Adaptability' of which can be assessed by the 'Passing networks' which can be measured to determine its influence on the functional purpose 'Win the match.' This approach is completed for all components in the developed netball performance system model.](fpsyg-10-00201-g002){#F2}

Discussion
==========

The primary aim of this study was to develop, using WDA, a first-of-its-kind model of the netball performance system to determine the composition and interactions between the components of netball performance. Furthermore, the study aimed to identify components of performance that are not currently measured that have potential to advance PA in netball.

Issues Identified With Current PA in Netball
--------------------------------------------

The discussions with SMEs in the workshops, and information from the relevant netball PA literature, indicates that PA in elite level netball primarily uses isolated notational analysis measures of individual players to describe performance. For example, commonly used measures identified included successful and unsuccessful passes, offensive and defensive rebounds, and number of penalties received. This reductionist approach is further problematic as the SMEs identified a lack of integration of these measures. It is our contention that PA in netball can be enhanced by addressing these issues by incorporating measures to analyze team behaviors. These measures can be extracted from the WDA. The following sections will discuss the results from across the levels of the WDA, with a specific focus on the functions and measures novel to PA in netball. The discussed functions and measures will highlight potential analysis methods aimed at increasing the quality of feedback to coaches, and subsequently improve coach's decision making to improve the coaching process. The measures and functions presented in the following sections are those that are deemed to be novel to netball, based on the current literature and from the workshop discussions with the SMEs. The two lower levels; object related processes and the physical objects from the WDA are not discussed further as they do not represent specific measures and functions of performance, which is the main focus of the study. They do, however, influence the behavior of the system which is indicated by the means-end-links ([Figure 2](#F2){ref-type="fig"}).

Functional Purposes
-------------------

Five functional purposes were identified in the WDA ([Figure 1](#F1){ref-type="fig"}). Although winning the match would logically be considered as the most important functional purpose, other functional purposes were identified, which were seen as changing in priority depending upon contextual factors. For example, the coaching staff and players may still be satisfied when losing if the team has implemented the game plan, progressively improved from previous performances, and demonstrated team values. The means-end links in the WDA demonstrate the interactions between the measures and functions, and the core functional purposes. However, it is questionable as to how appropriately the functional purposes within the system are currently measured, due to the reductionist tendencies of the notational analysis measures typically used for PA in netball. Using performance measures that cannot comprehensively measure the functional purposes identified in the WDA indicates that at present coaches may be required to subjectively assess the functional purposes of a match. This is potentially problematic as coaches use match performance statistics to reinforce their opinions of match events for decisions relating to future matches ([@B35]). As such, basing decisions on variables that cannot fully capture the interactions of the components of performance, may lead to incorrect or misinformed decision making by coaches. In other words, "Most of us only see what we expect to see, and what we expect to see is what we are conditioned to see when we have learned the definitions and classifications of our culture" ([@B82]). Therefore, to optimize PA in netball, more sophisticated measures used in other more established professional sports (that are presented in the WDA) could be modified and used to objectively describe if the functional purposes are being achieved. In addition, the SMEs emphasized that as a relatively new professional women's sport, it is important that netball matches provide entertainment in order to develop a strong supporter base, to gain sponsors, and to compete with other women's sports to ensure long-term sustainability.

Values and Priority Measures
----------------------------

Several of the values and priority measures from the WDA, including passing and goal scoring variables, turnovers, and rebounds have previously been measured to assess netball performance ([@B57]; [@B59]; [@B16]). Although these match actions are important for successful performance in netball, they are often measured in isolation and without context, which limits their use for coaches ([@B49]). Therefore, the model was used to identify novel measures of performances including group behaviors, measures from other sports that could be modified and applied to netball, outcome measures related to physical performance, and measures to optimize cognitive performance.

Passing, Possession, and Shooting
---------------------------------

Research on passing in netball has previously used descriptive notational analysis methods to determine performance ([@B59]). Using isolated passing success or frequency to assess performance has decreased in many other sports and been replaced with more sophisticated methods ([@B28]; [@B50], [@B47]; [@B64]; [@B45]). Therefore, to enhance PA in netball, the WDA included passing metrics used in other team sports to assess performance which have potential to be used for PA in netball. One of the aims of invasion team sports is to score points by overcoming the opposition through intra team coordination and passing ([@B22]). Therefore, for the passing analyses to be effective, the methods applied need to explain this team connectivity and coordination. Network analysis is a commonly used method to assess passing interactions in other sports ([@B64]). Network analysis is used to analyze passing networks and provides quantifiable metrics of the connectivity of the team, and identifies the influential players within the team ([@B12],[@B13]; [@B48],[@B50], [@B46]). The advantage of measuring passing networks over traditional approaches is the consideration of interdependencies and relational perspectives relative to the entire team, compared to individual assessment of passing ([Figure 3](#F3){ref-type="fig"}) ([@B87]). This provides information to coaches regarding team functioning, and potentially assesses whether match tactics are being achieved, or require changing. Therefore, the use of passing networks rather than isolated passing metrics (e.g., successful and unsuccessful passes) will provide additional information on team functioning in netball. In addition, the passing network analyses could be further enhanced when integrated with the location on the court where the passing networks commence, progress through the court, and break down ([@B50]). This allows the identification of the areas of the court where passing networks were successful, the vectors of the passing network, or potentially where the opposition focuses their passing networks and their vectors ([@B50]).

![Network analysis diagram of passing in a netball match. The direction of attack is from left to right. In this conceptual example, the node (player) size is based on degree centrality (number of outward passes in the match). The larger nodes represent more passes made, and the edges (passes) are weighted by frequency of passes completed between players, e.g., thicker lines indicate a greater frequency of passes. GK (goalkeeper), GD (goal defense), WD (wing defense), C (center), WA (wing attack), GA (goal attack), GS (goal shooter).](fpsyg-10-00201-g003){#F3}

Passing metrics that identify and describe the penetration through opposition defenses, and spatial dominance are beginning to be used in other sports as a measure to assess the quality of passes ([@B49]; [@B63]; [@B79]). These metrics consider the number of opposition players bypassed by a single pass, which is an effective pass compared to a sideways or backward pass that enables the defenders to still be involved in that specific moment of the game. Given the use of these measure in other team sports, penetrative passes would be a useful measure in netball, which prompted its inclusion in the WDA. Although this approach represents a somewhat isolated passing metric, it is a good example of how isolated passing analysis can be used alongside contextual details to provide a detailed analysis of the effectiveness of a pass.

The analysis indicated that isolated types of passing that are currently measured, such as center passes, and goal circle edge feeds, should be reported with a shooting outcome. For example, instead of simply counting the center passes, and goal circle edge feeds, measuring the center passes that were converted, or the goal circle edge feeds that were converted would provide a more detailed analysis, and could be incorporated into the passing network analysis.

Physical Performance Measures
-----------------------------

Measuring physical performance in isolation, such as distance covered or the number of accelerations performed, also has limitations in relation to PA in sport, as physical outputs alone are not good indicators of overall performance ([@B49]). Netball performance requires repeat explosive actions ([@B14]), however, simply measuring the accelerations does not provide any information for how the accelerations benefit performance. In the model, strong takes were identified as a potential measure that has a performance outcome related to physical performance. Strong takes was defined as a received pass preceded by a rapid acceleration. Furthermore, acceleration data derived from motion tracking micro-technology could be a useful measure to determine effective defensive pressure, as it has been shown that percentage of passing occurrences is less in high compared to low defensive pressure for expert netball players ([@B9]). Therefore, a measurement that describes the speed to apply defensive pressure, based on accelerations of the players may be a potential future measure when analysing performance in netball. Understanding physical match demands is important, especially from a load and injury prevention perspective ([@B1]), however, more work is needed to integrate physical measures to performance outcome measures. Furthermore, the PA measures incorporating physical demands proposed here are somewhat subjective, suggesting that more sophisticated and objective methods are required.

Optimizing Cognitive Performance
--------------------------------

The SMEs indicated that based on previous experience psychological flow was identified as a key component of performance in elite level netball. Psychological flow in sport is explained as the optimal psychological state for performance ([@B17]). Experiencing flow for an athlete is characterized by an intense focus and absorption in an activity, at the exclusion of all other thoughts and emotions ([@B77]). As a result, players acquire a sense of 'everything coming together' even in the most demanding situations ([@B77]). Interestingly, psychological flow in netball is not represented in the literature and the SMEs indicated that flow is not routinely assessed in professional netball. The absence of such measures are despite the existence of flow state scales developed to measure flow ([@B39]). Understanding the mechanisms of flow, and the behaviors and actions of players and teams demonstrated during flow states could enhance performance in netball. Importantly, as players share common experiences such as the same opponent, the same coach, and the same conditions of play, flow can be experienced at a team level ([@B2]).

Minimizing scoreboard pressure errors was included in the WDA as an area where players' cognitive performance could be enhanced. The effect of scoreboard pressure on the players, which typically occurs toward the end of quarters, was described by the SMEs as a critical phase in the match that can have a direct influence on netball performance and match outcome. For example, toward the end of matches and in overtime of close matches, basketball players may be overstimulated (anxiety and self-doubt) and therefore vulnerable to distractions ([@B30], [@B31]; [@B27]). This results in poorer decision making and subsequently turnovers of possession, compared to an optimally stimulated state ([@B30], [@B31]; [@B8]). Although, no research exits on scoreboard pressure in netball, coaches could improve this component of performance in training using time and match status constraints to replicate these periods of a match.

Purpose Related Functions
-------------------------

The functions identified at this level included the high-level functions of attack, defend, gain and maintain possession, and components of these functions have been previously measured using a variety of methods ([@B57]; [@B59]). However, several novel functions of netball performance were identified in the current model and require further investigation to optimize netball performance. These include controlling momentum, spatial awareness, unpredictability to opponents, and maintaining unit structures. Importantly, these functions consider the relational perspective of team members, and reduce the isolated type of analysis used so far in PA in netball research.

Unpredictability to Opponents
-----------------------------

Unpredictability to opponents in attack was identified and included as a function of performance in the WDA. Commonly termed entropy in sport science, unpredictability has been measured in other sports to determine the predictability of ball movements during play ([@B32]). In basketball, there is a relationship between teams who display entropy in offensive phases and the probability of a shot for an undefended player ([@B18]). A separate study investigating entropy of ball movements in basketball showed that in matches won, the team displayed increased entropy in the front court (scoring zone) compared to matches lost ([@B32]). This result not only shows the importance of being unpredictable in and around the scoring areas, but also the importance of analysing unpredictability in relation to elements of match context such as the location of actions. Given the use of entropy as measure of performance in basketball, it is logical that entropy could be a useful measure in netball to assess performance due to the similarities of the sports. In addition, this could be optimized in netball to include the entropy of the players spatial movements ([@B71]) in combination with the ball trajectories ([@B32]). An interesting future direction would be to investigate entropy as a function of match status, to assess differences in entropy whilst winning and losing netball matches.

Maintenance of Unit Structures
------------------------------

The maintenance of team structures in sport is an integral component of successful performance ([@B49]). As such, maintaining unit structure in netball is a critical strategy to (a) be compact defensively, and (b) destabilize the opposing teams' defensive structures by increasing the distance between the opposition defenders when attacking ([@B53]). In football, during attacking phases of a match the players are more dispersed across the length and width of the pitch compared to defending situations where they are more compact ([@B53]). As an attacking team, an aim is to increase the dispersion of the defenders to attempt to create space for a shot at goal. For example, when the distance between defensive players in football is increased, more attempts at goal are conceded compared to when the distance between defenders is decreased ([@B53]). Although there is no research of this type in netball, research into team structures in other sports has shown the value of such information to understand the necessary components of creating attempts at goal. A difference between netball and other sports is that the match constraints in netball allow players of only certain positions to attack or defend. For example, only four players from each team can occupy the defensive zone, and only four players from each team can occupy the attacking zone of the court. For this reason, maintaining attacking or defensive units was included in the WDA rather than maintaining the entire team structure. There are various existing methods of assessing the maintenance of team structure, including stretch index, measurements of surface area, playing area, effective playing area, and centroid measures ([@B73]), all of which have potential to determine the maintenance of unit structures in elite netball.

Controlling Momentum
--------------------

The ability to control momentum in netball was supported in this analysis. The SMEs described controlling momentum in netball as the ability to slow down or speed up play as the match situation demands. Synonymous with controlling momentum is match tempo, which has not been clearly defined in sport science research ([@B49]). There are conflicting definitions of tempo, and attempts to define it have included time in possession, speed of the ball, and speed of the players ([@B78]; [@B10]; [@B86]). However, a comprehensive definition of tempo, and the relationship between tempo and performance in sport is yet to be established ([@B49]). The SMEs indicated that understanding the mechanisms of controlling momentum in netball would be beneficial to performance. Firstly, an appropriate method to determine how to measure tempo in netball is required, followed by methods to understand the player behaviors required to control it. This represents an opportunity for future research, and such results that would be informative and useable for coaches.

This first-of-its-kind WDA of the elite women's netball performance system has demonstrated that netball is a complex system, which consists of multiple interacting and competing components of performance. The purpose of the WDA is not to determine the relative importance of individual nodes, but to capture all of the possibilities that influence performance. One of the strengths of WDA is that it does not attempt to describe or predict the behavior of the individuals within the analysis, but instead describes the constraints in the system that can influence and effect behavior ([@B49]). This is important because coaches each have their own philosophies and preferred coaching styles. In the current study, it was important to model the existing measures of PA in netball, as well as to include novel functions of performance and potential measures that would exist in the optimal netball performance system. It is noted that the necessary resources required for measuring some of the proposed performance variables from the current study may not be readily available for many netball performance analysts at this early point in professional netball. This should represent a challenge to researchers to develop methods that are sophisticated and inexpensive, yet useable in practice. For instance, valid and reliable observational instruments for the technical and tactical analysis of rugby performance have been designed and could be extended to many of the novel netball performance measures proposed in this study ([@B85]). It has been shown here that by understanding the PA variables of other sports more advanced in terms of PA than netball, there are possibilities to modify variables to be appropriate for netball. By enhancing the PA methods in netball, a more detailed analysis is achieved which will subsequently improve the feedback to coaches and players, and improves coach's knowledge of PA. By using elite level netball SMEs to develop the model ensures that the novel methods identified here will be usable in practice.

A final point of consideration relates to the lack of sports science research that has applied systems thinking approaches in women's sports contexts. Thus, this research addresses two important needs. First, netball is an under-researched area relative to other team-based sports contexts, and the use of a systems-based PA framework has been beneficial at identifying non-traditional aspects of on-court performances that require the attention of coaches and players. Secondly, this research should encourage sports scientists to apply other systems thinking approaches to optimize performance in women's sports contexts -- whether this be netball or otherwise. For example, the next step following this research may be to explore how best to measure, test and validate the novel performance components identified and question the feasibility of doing so from a practical and coaching standpoint. This way, the growth of women's sport can parallel scientific advancement and innovation in the sports sciences, bringing with it the formalization of systems thinking approaches in a underrepresented athletic group.

Limitations
-----------

A potential limitation of the current study is the small number of SMEs used to develop the WDA model of elite level netball. However, the SMEs who participated in the current study have extensive experience in elite level netball including participation in national and international competitions as coaches, analysts, and players. Furthermore, a similar model of football performance used eight SMEs in their analysis ([@B49]), and other research using this method has ranged from three to eleven SMEs to develop similar models ([@B40]; [@B70]). In addition, the demographics of the SMEs spanned three of the top nations in world netball (Australia, New Zealand, and South Africa). A limitation of the WDA method is that is does not weight the relationships between the nodes to determine nodal importance. However, the purpose of the WDA phase of the CWA framework is to model the entire netball performance system, and in doing so identify all the components within the system that influence the functions and measures of performance. Future research could attempt to weight the relationships between nodes to determine nodal importance.

Conclusion
==========

The current study provided a first-of-its-kind complex systems model of the elite women's netball match performance system. The model depicts the key components of netball match performance along with the means-ends relationships between them. It is concluded that, whilst netball performance is complex in nature, there are various opportunities to understand this complexity through the introduction of new PA measures. Further investigation is recommended, particularly the development, testing and validation of the new measures discussed. It is hoped that researchers and practitioners use the model presented in this article to facilitate this, and that netball PA is optimized as a result.

Author Contributions
====================

SM, AH, GR, and PS conceived the study. SM, AH, GR, AB, and PS performed the study. SM, AH, MM, GR, AB, and PS analyzed the data, wrote and revised the manuscript.

Conflict of Interest Statement
==============================

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

**Funding.** PS's contribution to this research was supported by his current ARC Future Fellowship (FT140100681). GR's contribution to the research was funded through her Australian Research Council Discovery Early Career Research Award (DE DE180101449).

  -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  Level of abstraction           Action taken
  ------------------------------ ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  Functional purposes            ***Minor rewording:***\
                                 'Play in line with club values' \> 'demonstrate team values'

                                 ***Added nodes:***\
                                 'Provide entertainment'

  Values and priority measures   ***Minor rewording:***\
                                 'Goals scored/conceded' \> 'goals scored/missed/conceded'; 'center restarts' \> 'center pass conversions'

                                 ***Removed nodes:***\
                                 'Distance covered'; 'center restarts'; 'goal assists'; 'goal attempt blocks'; 'number of possessions'

                                 ***Added nodes:***\
                                 'Psychological flow'; 'player workload'; 'penetrative passes'; 'converted edge feeds'; 'contested errors/uncontested errors'; 'time outs'; 'scoreboard pressure'; 'passing chains'; 'defensive/offensive pressure'

                                 ***Nodes incorporated elsewhere:***\
                                 'Handling errors'; 'intercepts'; 'loose ball wins' incorporated into 'turnovers to score' 'Discipline' incorporated into 'penalties received/conceded' 'Defensive block'; 'goal attempt blocks' incorporated into 'defensive pressure'

  Purpose related functions      ***Minor rewording:***\
                                 'Mange tempo' \> 'control momentum' 'Maintain structures' \> 'maintain unit structures' 'Adhere to team culture' \> 'value team culture'

                                 ***Removed node:***\
                                 'Gain and maintain possession'

                                 ***Added nodes:***\
                                 'Spatial awareness'; 'gain possession'; 'maintain possession'; 'optimize cognitive performance'; 'optimize physical performance'; 'unpredictability to opponents'

  Object related processes       ***Minor rewording:***\
                                 'Team support/hinderance' \> 'team and player support/hinderance' 'Visual communication' \> 'communicates playing position' 'Implement rules' \> 'enactment of game rules' 'Stadium atmosphere' \> 'controls stadium environment'

  Physical objects               ***Minor rewording:***\
                                 'Game plan and tactics' \> 'game plan'

                                 ***Removed node:***\
                                 'Air conditioning'

                                 ***Added nodes:***\
                                 'Benches'; 'stadium utilities'

                                 ***Nodes incorporated elsewhere:***\
                                 'GPS' incorporated into 'data capturing equipment'
  -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

[^1]: Edited by: Guy Cheron, Free University of Brussels, Belgium

[^2]: Reviewed by: Annette Raynor, Edith Cowan University, Australia; Miguel-Angel Gomez-Ruano, Polytechnic University of Madrid, Spain

[^3]: This article was submitted to Movement Science and Sport Psychology, a section of the journal Frontiers in Psychology
