<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.0/JATS-journalpublishing1.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"
	article-type="research-article" dtd-version="1.0" specific-use="sps-1.8" xml:lang="en">
	<front>
		<journal-meta>
			<journal-id journal-id-type="publisher-id">ram</journal-id>
			<journal-title-group>
				<journal-title>RAM. Revista de Administração Mackenzie</journal-title>
				<abbrev-journal-title abbrev-type="publisher">RAM, Rev. Adm. Mackenzie</abbrev-journal-title>
			</journal-title-group>
			<issn pub-type="ppub">1518-6776</issn>
			<issn pub-type="epub">1678-6971</issn>
			<publisher>
				<publisher-name>Universidade Presbiteriana Mackenzie</publisher-name>
			</publisher>
		</journal-meta>
		<article-meta>
			<article-id pub-id-type="other">00303</article-id>
			<article-id pub-id-type="doi">10.1590/1678-6971/eRAMG180100</article-id>
			<article-categories>
				<subj-group subj-group-type="heading">
					<subject>Human and Social Management</subject>
				</subj-group>
			</article-categories>
			<title-group>
				<article-title>AUTO EVALUATIONS OF DISTANCE MANAGEMENT TRAINING IN A FEDERAL AUTARCHY</article-title>
				<trans-title-group xml:lang="pt">
					<trans-title>A TRÍPLICE ALIANÇA EM AUTOAVALIAÇÃO DE TREINAMENTOS GERENCIAIS</trans-title>
				</trans-title-group>
			</title-group>
			<contrib-group>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">0000-0003-1165-2971</contrib-id>
					<name>
						<surname>RICHTER</surname>
						<given-names>LEOVANIR D. D.</given-names>
					</name>
					<xref ref-type="aff" rid="aff1"/>
					<xref ref-type="corresp" rid="c1"><sup>*</sup></xref>
					<xref ref-type="fn" rid="fn1"/>
				</contrib>
			</contrib-group>
				<aff id="aff1">
					<institution content-type="orgname">Ministério da Transparência e Controladoria Geral da União</institution>
					<addr-line>
						<named-content content-type="city">Brasília</named-content>
						<named-content content-type="state">DF</named-content>
					</addr-line>
					<country country="BR">Brazil</country>
					<institution content-type="original">Ministério da Transparência e Controladoria Geral da União (CGU), Brasília, DF, Brazil</institution>
				</aff>
			<author-notes>
				<corresp id="c1">
				<label>*</label> Correspondence concerning this article should be addressed to Leovanir D. D. Richter, Quadra Interna QI 09, Conjunto R, Casa 15, Guará, Brasília, DF, Brazil, CEP 71020-188. E-mail:
				<email>leovanir@yahoo.com.br</email>
				</corresp>
				<fn fn-type="current-aff" id="fn1">
					<p>Leovanir D. D. Richter, Mestre em Administração, Faculdade de Economia, Administração e Contabilidade (FACE), Universidade de Brasília (UnB), ORCID: 0000-0003-1165-2971.</p>
				</fn>
			</author-notes>
			<pub-date pub-type="epub-ppub">
				<day>23</day>
				<month>04</month>
				<year>2018</year>
			</pub-date>
			<volume>19</volume>
			<issue>2</issue>
			<elocation-id>eRAMG180100</elocation-id>
			<history>
				<date date-type="received">
					<day>26</day>
					<month>09</month>
					<year>2017</year>
				</date>
				<date date-type="accepted">
					<day>19</day>
					<month>12</month>
					<year>2017</year>
				</date>
			</history>
			<permissions>
				<license license-type="open-access"
					xlink:href="http://creativecommons.org/licenses/by/4.0/" xml:lang="en">
					<license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited</license-p>
				</license>
			</permissions>
			<abstract>
				<title>ABSTRACT</title>
				<sec>
					<title>Purpose:</title>
					<p>The self-evaluation of management training had the objective of verifying the influence of the learning support and of the management training offered to managers of a Brazilian federal autarchy on the expression of competences required for the performance of their duties.</p>
				</sec>
				<sec>
					<title>Originality/value:</title>
					<p>To reach this objective, the hypothesized theoretical model of research was elaborated having as variables the criteria of training impacts in the labor, measured both in depth and in amplitude, measured on what was the importance and contribution of two evaluated courses for the acquisition and expression of management-labor skills.</p>
				</sec>
				<sec>
					<title>Design/methodology/approach:</title>
					<p>Regarding the methodology, two courses were offered in the distance modality, in this autarchy, which dealt with strategic management and teams. Data collection was performed at a distance. The final sample (N = 291) was predominantly male, between 31 and 50 years old, and with complete graduate education.</p>
				</sec>
				<sec>
					<title>Findings:</title>
					<p>The results showed a valid and construct evidence for the used measures, as well as pointed out that learning support was an important predictor in the final empirical models. Having a constant investment in actions to improve learning support in the organizational environment, such managers can apply in their routines the skills acquired in a training situation, in a more persistent, impactful and aligned with the strategic objectives of the autarchy.</p>
				</sec>
			</abstract>
			<trans-abstract xml:lang="pt">
				<title>RESUMO</title>
				<sec>
					<title>Objetivo:</title>
					<p>A tríplice aliança na autoavaliação de treinamentos gerenciais teve como objetivo geral verificar a influência do suporte à aprendizagem e dos treinamentos gerenciais ofertados a gestores de uma entidade pública federal brasileira sobre a expressão de competências requeridas para o desempenho de suas funções.</p>
				</sec>
				<sec>
					<title>Originalidade/relevância:</title>
					<p>Para o alcance deste objetivo, foi elaborado o modelo teórico hipotetizado de pesquisa tendo como variáveis critérios de impacto de treinamento no trabalho, medido tanto em profundidade quanto em amplitude, mensurado sobre qual foi a importância e contribuição de dois cursos avaliados para a aquisição e expressão das competências laborais gerenciais.</p>
				</sec>
				<sec>
					<title>Principais aspectos metodológicos:</title>
					<p>Quanto à metodologia, foram investigados dois cursos ofertados na modalidade à distância, nesta entidade, que tratavam sobre gestão estratégica e de equipes. A coleta de dados foi realizada à distância. A amostra final (N=291) era predominantemente masculina, entre 31 a 50 anos e com ensino superior completo.</p>
				</sec>
				<sec>
					<title>Síntese dos principais resultados:</title>
					<p>Os resultados sinalizaram evidências de validade e de construto para as medidas utilizadas, bem como apontaram que suporte à aprendizagem foi importante preditora nos modelos empíricos finais. Tendo constante investimento em ações de melhoria do suporte à aprendizagem no ambiente organizacional, tais gestores podem aplicar em suas rotinas as competências adquiridas em situação de treinamento, de uma forma mais perene, impactante e alinhada com os objetivos estratégicos da entidade.</p>
				</sec>
			</trans-abstract>
			<kwd-group xml:lang="en">
				<title>KEYWORDS</title>
				<kwd>Impact of training at work</kwd>
				<kwd>Support to learning</kwd>
				<kwd>Organizational competences</kwd>
				<kwd>Training results</kwd>
				<kwd>People management</kwd>
			</kwd-group>
			<kwd-group xml:lang="pt">
				<title>PALAVRAS-CHAVE</title>
				<kwd>Impacto do treinamento no trabalho</kwd>
				<kwd>Suporte à aprendizagem</kwd>
				<kwd>Competências organizacionais</kwd>
				<kwd>Resultados de treinamento</kwd>
				<kwd>Gestão de pessoas</kwd>
			</kwd-group>
		</article-meta>
	</front>
	<body>
		<sec sec-type="intro">
			<title>1. INTRODUCTION</title>
			<p>The changing nature of leadership in public organizations has been particularly
				important in the development of the new public service, according to <xref
					ref-type="bibr" rid="B24">Denhardt (2012, p. 262)</xref>. Practical public
				managers, who seek greater commitment to values, focus on public service,
				empowerment, shared leadership, pragmatic increments and dedication to the public
				service, consequently reflecting a business model that makes the public service
				different through the promotion of dignity and value of the new public service.</p>
			<p>With the initial awakening of the characteristics of the practical public manager,
				this research was developed in a federal autarchy, to the occupants of a
				commissioned function of executive manager and customer service manager. This public
				was selected because it performs management activities in the various administrative
				and service areas that exist in the Brazilian territory, with needs and
				characteristics that need to be considered in training carried out by this autarchy
				and that was shown in this research.</p>
			<p>The problem identified by this research was what the contributions of distance
				management training are expressed by the managers of the autarchy around their
				competences required for the performance of their duties. The importance attributed
				to each of the two distance courses analyzed on the development of management
				competencies within the researched individuals was investigated. Furthermore, it was
				intended to measure how far each distance course in specific contributed,
				effectively, to the development of these management competencies. It was concluded
				that the impact of the two distance courses would be measured on the importance of
				these courses to the development of management competencies and how, in fact, under
				the perception of the respondents, these courses contributed to the development of
				these competencies. This perspective (considering the effects of the impact of
				training on the development of professional competencies) can be considered
				relatively innovative since little instructional technology refers to the later
				development and expression of the competences, especially those of management level.
				The theoretical perspective assumed in this research is based on <xref
					ref-type="bibr" rid="B26">Elnaga and Imran (2013)</xref> and <xref
					ref-type="bibr" rid="B8">Alfandi (2016)</xref>.</p>
			<p>This problem guided the general objective of evaluating the effectiveness of distance
				management training in light of the skills required from autarchy managers through
				self-evaluation measures and variables that predict training results.</p>
			<p>The social relevance of the proposed study is to evaluate the educational actions
				aimed at the training of managers, which may favor the evolution of distance
				courses, allowing the increase of the quality of the services provided by the
				autarchy. Regarding the organizational relevance, the research can contribute to
				improving the TD&amp;E (training, development and performance improvement) actions
				of this autarchy, making it possible the rationalization of public resources and the
				improvement of services provided to the Brazilian population, as well as encouraging
				the increase of the evaluation culture of the courses to distance promoted by
				it.</p>
		</sec>
		<sec>
			<title>2. THEORETICAL SUBSTANTIATION</title>
			<p>The authors <xref ref-type="bibr" rid="B7">Aguinis and Kraiger (2009)</xref> present
				a literature review on the benefits of training and development of people and teams,
				organizations and society. They bring a review of assessment needs and training
				projects. They point out that there is documentary evidence that training activities
				have a positive impact on the performance of individuals and teams.</p>
			<p>In Brazil, the review of human resource management by <xref ref-type="bibr" rid="B36"
					>Meneses, Coelho Junior, Ferreira, Paschoal, and Silva Filho (2014, p.
					129)</xref> is marked by theoretical-empirical studies aimed at describing
				certain facets - the management of human resources functions, such as training,
				development and education, from the perception of diverse audiences sampled in a
				non-probabilistic way in one organization at a time.</p>
			<p>Considering such revisionary researches, it is perceived that human learning at work
				has a plurality of concepts and definitions, in which the concept of <xref
					ref-type="bibr" rid="B4">Abbad and Borges-Andrade (2014, p. 244)</xref> was
				adopted in this study, which maintains that learning "is a psychological process
				understood as the changes that occur in the behavior of the individual as a function
				of the relationship of the individual with the environment and not only changes
				resulting solely from maturation."</p>
			<p>By observing the importance of the transfer of learning at work with the use of
				knowledge, skills and attitudes (KSAs), in terms of effectiveness in the performance
				of the trained competence, there are factors to be explained, according to <xref
					ref-type="bibr" rid="B37">Noe, Clarke, and Klein (2014)</xref>, to know: 1.
				whether the evaluation of the transfer takes place sometime after the training or if
				it is soon after the training, 2. if the evaluation of the transfer is a result of
				the perception of the trainees themselves or of their peers; 3. if the concept of
				transference is operationalized as an application in the work of what was learned by
				the individual or in terms of performance effectiveness of the trained
				competence.</p>
			<p>According to <xref ref-type="bibr" rid="B32">Kraiger and Cavanagh (2015)</xref>, this
				is a systematic process managed by organizations, with constant changes in the
				knowledge, skills, and attitudes of their occupants. This process occurs through 1.
				management of the education system (as a process), 2. conducting a needs assessment
				training to define the content of the training, 3. training project, 4. provision of
				training, 5. management of the transfer of the training back to work, and 6.
				assessment of the impact of the training and review of the education system based on
				these data.</p>
			<p>Training is considered an activity materialized by different rhythms, with different
				visions, implemented according to various ends and regulated by the dynamics of
				economic competition, according to <xref ref-type="bibr" rid="B8">Alfandi
					(2016)</xref>. As an institutionalized service, training is structured on labor
				activity, being a transcendent object that has covered the societies, contingencies,
				political systems, and economic conditions.</p>
			<p>Training has always been a mandatory means to promote the qualification of the
				workers needed for each management logic. <xref ref-type="bibr" rid="B34">Malvezzi
					(2015)</xref> emphasizes that throughout its historical trajectory, training has
				faced several types of challenges that only served to enrich it and allowed it to
				evolve, integrated around work performance and the emancipation of the individual as
				a human being and not a mere human resource in organizations.</p>
			<p>When observing the e-learning (electronic learning), object of this research, it is
				perceived that it is a modality usually turned to the learning of adults. In Brazil,
				e-learning is being adopted in education, in qualification and professional training
				programs, and incorporate education (<xref ref-type="bibr" rid="B3">Abbad,
					2007</xref>).</p>
			<p>When considering the necessary e-learning and viable its use for the management
				capacities in the structure of the selected autarchy, the assessment of the
				teaching-learning process also needs to be weighed.</p>
			<p>According to the studies of <xref ref-type="bibr" rid="B10">Bloom, Hastings, and
					Madaus (1983)</xref>, the evaluation of the teaching-learning process presents
				three types of functions: diagnostic (analytical), formative (controlling) and
				summative (classificatory). The summative evaluation that is the object of this
				research, according to <xref ref-type="bibr" rid="B12">Borges-Andrade (2006, p.
					344)</xref>, "is the process of planning, obtaining and analyzing information in
				order to provide useful inputs to decide on the adoption or rejection of a program
				or event isolated from TD&amp;E, thought as an instructional system."</p>
			<p>In the scientific literature, two models of training evaluation are pointed out.
					<xref ref-type="bibr" rid="B31">Kirkpatrick (1976)</xref> suggests four levels
				of evaluation: 1. reactions; 2. learning; 3. performance in the position; 4.
				results. The <xref ref-type="bibr" rid="B30">Hamblin model (1978)</xref> subdivides
				the results item, with the following presentation: 1. reactions; 2. learning; 3.
				performance in the position; 4. organizational change; and 5. final value.</p>
			<p>The more contemporary models mix training results with environment variables. In this
				line, CIRO (<xref ref-type="bibr" rid="B43">Warr, Bird, &amp; Rackham, 1970</xref>),
				CIPP 48 (Stufflebeam, 1978), MAIS (<xref ref-type="bibr" rid="B11">Borges-Andrade,
					1982</xref>) and IMPACT (<xref ref-type="bibr" rid="B1">Abbad, 1999</xref>;
					<xref ref-type="bibr" rid="B2">Abbad, 2014</xref>) can be cited.</p>
			<p>The Integrated Impact Assessment of Training (IMPACT), elaborated by <xref
					ref-type="bibr" rid="B1">Abbad (1999)</xref> and revised in 2014, based on the
				MAIS of <xref ref-type="bibr" rid="B11">Borges-Andrade (1982)</xref>, was the model
				chosen in this study as a variable training impact criterion (in amplitude), also
				encompassing context variables of learning support. The IMPACT Model consists of ten
				components: 1. external environment; 2. support; 3. needs; 4. customer
				characteristics; 5. training characteristics; 6. reactions; 7. learning; 8. impact
				of training on the job; 9. change in the organization; and 10. final value. The
				first seven components are predictive variables of the impact of training at
				work.</p>
			<p>The amplitude impact assessment contains items related to the frequency of use of
				learning, improvement of the quality of task performance, reduction of errors in the
				execution of the task and items that evaluate the impact of training on the
				motivation and self-efficacy of the trained professional. The in-depth impact
				assessment has items drawn from the instructional objectives (transformed into
				expected performance objectives) specific to each training.</p>
			<p>In addition to the training impact assessment, it is necessary to conceptualize the
				learning support variable, which is one of the critical factors for the effective
				use of training in the work environment.</p>
			<p>According to Coelho Jr. (2004, p. 56), support for learning is an evaluation of
				psychosocial support (peers, peers and bosses) for learning and applying new skills
				in the work environment, acquired not only through previously planned training
				(induced learning), but also by learning in unstructured or unintentional
				organizational situations (natural learning).</p>
			<p>For <xref ref-type="bibr" rid="B6">Abbad et al. (2012, p. 247)</xref>, learning
				support is "evaluated in terms of stimulating the organizational environment to new
				spontaneous learning at work through contact with more experienced people,
				self-learning or imitation behavior" and deals with dimensions of support as
				creating positive expectations about the benefits of learning and its application,
				providing feedback, and disseminating information about competent performance.</p>
			<p>When dealing with competences, it is opportune to start the theoretical basis from
				the contributions of <xref ref-type="bibr" rid="B35">McClelland (1973)</xref> and
					<xref ref-type="bibr" rid="B13">Boyatzis (1982)</xref>, since they are
				considered the forerunners in this theme. They depart from the American school and
				propose competences as inputs, that is, the qualities required for the exercise of a
				position, related only to the set of KSAs.</p>
			<p>
				<xref ref-type="bibr" rid="B41">Sandberg (1996)</xref> criticizes the traditional
				concept of competences, where it understands that the development of competences
				must be understood based on organizational practices, focusing its analysis on the
				enrichment of experiences and experiences (interpretative approach).</p>
			<p>Due to the importance of such concept of competences, it is observed that in the
				literature there are many definitions of respect. To identify differences and
				convergences in the technical use of such concept, <xref ref-type="bibr" rid="B16"
					>Campos (2015)</xref> carried out a systematic analysis in the specialized
				scientific literature.</p>
			<p>In this analysis, <xref ref-type="bibr" rid="B16">Campos (2015)</xref> identified
				three dimensions along the concept of competences around attributes underlying the
				dimension of knowledge, skills, and attitudes. This concept of competences is an
				observable performance in the dimension of behaviors and results; performance in the
				dimension of excellence and recognition.</p>
			<p>
				<xref ref-type="bibr" rid="B16">Campos (2015, p. 34)</xref> points out that:</p>
			<p>
				<disp-quote>
					<p>The concept of competence expresses individual attributes depending on the
						context, which vary according to the situation (unforeseen, changes) and
						with the work to be performed. For this reason, evaluating only facts or
						isolated occurrences of human work performance and results are inadequate
						and inadequate methodological strategies for the measurement of human
						competences. Also, the concept of competence includes standards and
						reference values adopted by a particular social unit (organization, team,
						other people) to judge whether a given performance is competent and whether
						or not the result of that performance is an indicator of success.</p>
				</disp-quote>
			</p>
			<p>In this research, competence, as conceptualized by <xref ref-type="bibr" rid="B17"
					>Carbone (2009)</xref>, is considered a set of synergetic combinations of
				knowledge, skills, and attitudes expressed by professional performance within an
				organizational context, which adds value to people and organizations.</p>
			<p>For <xref ref-type="bibr" rid="B14">Brandão, Borges-Andrade, Freitas, and Vieira
					(2010)</xref> management skills are a category that has attracted growing
				interest from theorists, organizations, and researchers, perhaps because of the
				supposition that they exert considerable influence on the performance of work teams,
				and therefore on organizational outcomes. Despite the efforts that have been made,
				mainly in the theoretical field, to explain the nature of management competence,
				many questions remain unanswered, lacking research to investigate antecedents and
				consequent of the expression of competences at work, wherein this research variable
				is contemplated.</p>
			<p>In light of the brief theoretical background presented, it is intended to fix the
				work on the impact of training, support to learning and skills, wherein the next
				section, the methodological procedures of this research are presented.</p>
		</sec>
		<sec sec-type="methods">
			<title>3. METHODOLOGY</title>
			<p>The proposed theoretical research model had as variables the criteria of training
				impacts in work both in depth and breadth, including verifying their effects on
				competences required from the managers of a certain Brazilian federal autarchy. It
				is expected that the greater the perceived influence (training impact in depth and
				breadth) there will be greater importance and contribution of the two courses
				evaluated against the competences required from such managers.</p>
			<p>With the favorable perception of the influences of training in the work environment,
				more skills can be aggregated and related to the training and the professional day
				to day. It is already emphasized here that the measure of the breadth of
				competencies was built based on the competences established for the occupants of the
				executive manager and service manager of the selected autarchy, based on the
				management skills scale proposed by <xref ref-type="bibr" rid="B14">Brandão,
					Borges-Andrade, Freitas, and Vieira (2010)</xref>. In this research, unlike
					<xref ref-type="bibr" rid="B14">Brandão et al. (2010)</xref>, only
				self-evaluation measures were used.</p>
			<p>The empirical model developed here (which has as variables the criterion of depth and
				amplitude of training impacts on the acquisition and expression of management
				competences in work) was conceived from variables contained in the IMPACT model
					(<xref ref-type="bibr" rid="B1">Abbad, 1999</xref>).</p>
			<p>The following predictors were tested: 1. clientele profile, which contains the
				biographical and functional information regarding the participants of the two
				training sessions under analysis; 2. learning support (psychosocial support of
				colleagues and leadership to the application of new learning in work
				performance).</p>
			<p>According to <xref ref-type="bibr" rid="B6">Abbad et al. (2012)</xref>, learning
				support has been considered as the main predictor of the impact of training, since
				it assumes that the existence of an organizational context favorable to the use of
				new skills learned in training generates conditions for impact.</p>
			<p>The impact was not measured only in the way traditional TD&amp;E literature does, but
				also considered the outcome of each of the impacts reported on the development of
				management competences. It was considered the importance attributed to each training
				to the improvement of post-qualification work performance as well as how
				effectively, from the perspective of individuals, each of the two courses evaluated
				contributed to the improvement of this professional performance.</p>
			<p>Therefore, it was verified, in this model, the relationship of personal, professional
				and learning support predictor variables along with the variables of the impact
				criterion of training in depth and amplitude on acquisition and expression of
				management competences with executive managers and managers of this autarchy.</p>
			<p>To operationalize the empirical investigation of such theoretical variables, a single
				questionnaire was designed for such managers, considering all the items of each of
				the measures under study, duly grouped. This questionnaire also included demographic
				and functional information.</p>
			<p>The theoretical hypothesized model was conceived based on the analysis of the
				literature described in the theoretical foundation. He considered that in a
				management and peer support environment, with the deep impact and breadth of
				management skills, there would be acquisition and expression (stages conceived here
				as equivalents of competency domain) of skills and knowledge acquired from these
				training in the work routine.</p>
			<p>For a better visualization of the proposed research, the hypothesized theoretical
				model is presented in <xref ref-type="fig" rid="f1">Figure 3.1</xref>.</p>
			<p>
				<fig id="f1">
					<label>Figure 3.1</label>
					<caption>
						<title>Hypothesized theoretical model of training impact, learning support
							and personal and professional characteristics</title>
					</caption>
					<graphic xlink:href="1678-6971-ram-19-02-eRAMG180100-gf01.jpg"/>
				</fig>
			</p>
			<p>The typification of this research had an applied, theoretical/empirical nature and a
				descriptive research delineation from a correlational perspective, analyzing the
				self - perceptions of the training impact, the learning support and the skills
				required from certain managers of a Brazilian federal autarchy. Being correlational
				this research, statistical indices were used to verify the possible influence among
				the identified variables with analysis of the questionnaire responses sent to the
				104 executive managers and 1,506 service managers.</p>
			<p>The scope was of the case, through the evaluation of two management capacities at a
				distance in the autarchy regarding the impact and the learning support, verifying if
				they promote the established management competencies.</p>
			<p>The approach is classified as quantitative, since the data were obtained through
				indirect contact between the researcher and the situation of the study, with a
				cross-sectional data collection, cross-sectional (cross-sectional), since the data
				were collected at a given time, from July 2016 to August 2016, with no intention of
				tracing evolution or identifying changes over time (<xref ref-type="bibr" rid="B18"
					>Churchill Junior, 1999</xref>, p. 66). It was done through the use of an
				electronic questionnaire - survey type in a field environment, applied to the
				executive managers and managers of distributed service of the autarchy in the
				Brazilian territory.</p>
			<p>In this research, the primary data collected by the researcher were used, considering
				that descriptive research was carried out on the distance training required for the
				104 executive managers and 1,506 service managers to generate hypotheses regarding
				the efficiency, effectiveness and effectiveness of these distance training models
				front the skills required to perform these functions in the autarchy, resulting in
				an intentional non-probabilistic sample, according to <xref ref-type="bibr"
					rid="B23">Creswell (2010)</xref>, with managers participating in distance
				training from January/2013 to March/2016.</p>
			<sec>
				<title>3.1. Collection of primary data</title>
				<p>The research questionnaire, covering all variables that were searched in this
					study, contained a total of 111 items. The items concerning the learning support
					scale have already been previously tested and validated empirically (<xref
						ref-type="bibr" rid="B19">Coelho Junior, 2004</xref>), and it is still
					necessary to adopt procedures for semantic validation and adequacy of these
					items to the language and culture of the Organization under study.</p>
				<p>The in-depth impact items were elaborated according to the instructional
					objectives of each selected course, having five questions that assessed both the
					importance and the contribution of the course to the professional performance.
					These instructional objectives were elaborated by the autarchy itself in 2010
					and transformed in this research into performance objectives. It should be noted
					that for data analysis, all the items contained in the measure made available by
					the Organization were not used because they are not of interest to this research
					at the moment.</p>
				<p>The amplitude impact questionnaire items were structured on <xref ref-type="bibr"
						rid="B1">Abbad's (1999)</xref> Integrated Impact Assessment (Impact) model
					and recently revised by <xref ref-type="bibr" rid="B2">Abbad (2014)</xref>. In
					this dimension of the questionnaire, in addition to the 13 questions of the
					Impact model, four additional questions were added to the reality of the
					autarchy searched.</p>
				<p>In <xref ref-type="table" rid="t1">Table 3.1.1</xref>, below, is a summary of the
					theoretical dimensions of all the items that composed the research instrument
					made available electronically to the graduates of the two distance courses
					selected.</p>
					<p>
				<table-wrap id="t1">
					<label>Table 3.1.1</label>
					<caption>
						<title>CHARACTERISTICS OF THE QUESTIONNAIRE</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t1.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="20%"/>
							<col width="60%"/>
							<col width="20%"/>
						</colgroup>
						<thead>
							<tr>
								<th align="left" style="background-color:#bbc7d6">Scale Name</th>
								<th style="background-color:#bbc7d6">Instrument Dimensions</th>
								<th style="background-color:#bbc7d6">Number of Correspondent
									Items</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="3">Impact of <break/> Amplitude <break/>
									Training</td>
								<td align="left">Impact of Amplitude Training - Reference IMPACT
									Model</td>
								<td align="center">13</td>
							</tr>
							<tr>
								<td align="left">Adequacy of reality</td>
								<td align="center">3</td>
							</tr>
							<tr>
								<td align="left">Reaction Rating</td>
								<td align="center">1</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Impact of <break/> Training <break/> in
									Depth</td>
								<td align="left">Strategic Management Course - Scales of Importance
									and Contribution</td>
								<td align="center">10</td>
							</tr>
							<tr>
								<td align="left">Course Team Management - Scales of Importance and
									Contribution</td>
								<td align="center">10</td>
							</tr>
							<tr>
								<td align="left" rowspan="3">Learning Support</td>
								<td align="left">Perceptions of the Work Unit</td>
								<td align="center">9</td>
							</tr>
							<tr>
								<td align="left">Perceptions of the Immediate Manager</td>
								<td align="center">9</td>
							</tr>
							<tr>
								<td align="left">Perceptions of the Work Team</td>
								<td align="center">5</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Impact of <break/> Amplitude <break/>
									Training on Competencies</td>
								<td align="left">Competencies of the Executive Manager - Scales of
									Importance and Contribution</td>
								<td align="center">34</td>
							</tr>
							<tr>
								<td align="left">Competencies of the Service Manager - Scales of
									Importance and Contribution</td>
								<td align="center">34</td>
							</tr>
							<tr>
								<td align="left" rowspan="3">Training <break/> Requests</td>
								<td align="left">Self-Training</td>
								<td align="center">1</td>
							</tr>
							<tr>
								<td align="left">Work Team</td>
								<td align="center">1</td>
							</tr>
							<tr>
								<td align="left">Substitute Manager</td>
								<td align="center">1</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Functional Manager</td>
								<td align="left">Profile</td>
								<td align="center">11</td>
							</tr>
							<tr>
								<td align="left">Biography</td>
								<td align="center">3</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t1b">
					<label>Table 3.1.1(Cont.)</label>
					<caption>
						<title>CHARACTERISTICS OF THE QUESTIONNAIRE</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t1b.jpg"/>
					</alternatives>
				</table-wrap>
			</p>
				<p>The application of the electronic questionnaire was done through the electronic
					mail of the autarchy and occurred in July and August 2016, inviting the 104
					executive managers and 1,506 service managers to participate in the survey, with
					a population and total target audience of 1,610 managers, through the provision
					of a link in the free software <italic>LimeSurvey</italic>. Instructions for
					completing the instrument were self-explanatory since the collection was
					performed at a distance.</p>
				<p>Considering 1,610 managers linked to this research, a return of 291 respondents
					(18% return rate) was obtained, where the questionnaires were sent to the
					population. The return was spontaneous, generating a non-random sample of
					respondents. Of the 291 participants, 30 identified themselves as executive
					managers and 261 as service managers, representing 29% and 17%, respectively,
					compared to the population of 104 executive managers and 1,506 service
					managers.</p>
				<p>Of these 291 participants, 114 were females and 177 males, with schooling
					distributed in high school with 15 participants, incomplete superior with 36,
					complete superior with 161, specialization with 74 and masters with 5
					participants. The public service time of the 291 participants was more
					representative with 30% in the period superior to 15 years and in the management
					function with the greater representativeness of 35% in the period of 1 to 3
					years.</p>
				<p>Geographic participation was representative and balanced throughout the country,
					with 28% in the North and Midwest, 34% in the Southeast, 15% in the South and
					22% in the Northeast. The state with the largest participation was Minas Gerais
					with 14%.</p>
			</sec>
		</sec>
		<sec sec-type="results">
			<title>4. ANALYSIS OF RESULTS</title>
			<p>First, evidence of the internal validity of the questionnaire used focuses on the
				specific analysis of its underlying theoretical dimensions (learning support and
				training impact on breadth and depth). Subsequently, the final empirical models
				obtained were presented. Procedures involving the tabulation of data and
				calculations were performed using the SPSS program (Statistical Package for the
				Social Sciences).</p>
			<sec>
				<title>4.1. Factorial analyzes of the questionnaire</title>
				<p>The factorability was tested by the Kaiser-Meyer-Olkin index, known as the
					suitability index of the sample, and by Bartlett's sphericity test, as
					recommended by <xref ref-type="bibr" rid="B42">Tabachnick and Fidell
						(2007)</xref>. After that, the data were submitted to principal component
					analysis (PCA), main axis factoring (MAF) and factors reliability were estimated
					by Cronbach's alphas, via SPSS.</p>
				<p>According to <xref ref-type="bibr" rid="B29">Hair Junior, Black, Babin, Anderson,
						&amp; Tatham (2006)</xref>, it is important to point out that the criterion
					used for eigenvalues must have at least one associated eigenvalue equal to 1.
					The tested rotation between the factors for each dimension (learning support and
					impacts) was Varimax. <xref ref-type="table" rid="t2">Table 4.1.1</xref>. shows
					the psychometric indicators of each block.</p>
					<p>
				<table-wrap id="t2">
					<label>Table 4.1.1</label>
					<caption>
						<title>SYNTHESIS OF FACTORIAL ANALYZES</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t2.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="16%"/>
							<col width="16%"/>
							<col width="16%"/>
							<col width="16%"/>
							<col width="16%"/>
							<col width="16%"/>
						</colgroup>
						<thead>
							<tr>
								<th style="background-color:#bbc7d6">Block</th>
								<th style="background-color:#bbc7d6">Items</th>
								<th style="background-color:#bbc7d6">KMO</th>
								<th style="background-color:#bbc7d6">Factorial Charges</th>
								<th style="background-color:#bbc7d6">Cronbach's <break/> Alpha</th>
								<th style="background-color:#bbc7d6">Variance <break/>
									Explained</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="4">Learning Support</td>
								<td align="left"> Unit of work - 8</td>
								<td align="center" rowspan="4">0,85</td>
								<td align="center" rowspan="4">0,41 to 0,81</td>
								<td align="center">0,82</td>
								<td align="center" rowspan="4">54%</td>
							</tr>
							<tr>
								<td align="left">Immediate Manager - 5</td>
								<td align="center">0,85</td>
							</tr>
							<tr>
								<td align="left">Work Team - 5</td>
								<td align="center">0,79</td>
							</tr>
							<tr>
								<td align="left">Inadequate Support - 5</td>
								<td align="center">0,65</td>
							</tr>
							<tr>
								<td align="left">Impact amplitude</td>
								<td align="left"> Impact - 16</td>
								<td align="center">0,96</td>
								<td align="center">0,75 to 0,90</td>
								<td align="center">0,95</td>
								<td align="center">66%</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Impact in depth - Strategic
									Management</td>
								<td align="left"> Importance - 5</td>
								<td align="center">0,89</td>
								<td align="center">0,85 to 0,92</td>
								<td align="center">0,93</td>
								<td align="center">78%</td>
							</tr>
							<tr>
								<td align="left">Contribuiton - 5</td>
								<td align="center">0,87</td>
								<td align="center">0,80 to 0,91</td>
								<td align="center">0,92</td>
								<td align="center">76%</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Impact in depth - Team Management</td>
								<td align="left"> Importance - 5</td>
								<td align="center">0,87</td>
								<td align="center">0,82 to 0,90</td>
								<td align="center">0,92</td>
								<td align="center">76%</td>
							</tr>
							<tr>
								<td align="left">Contribuiton - 5</td>
								<td align="center">0,89</td>
								<td align="center">0,87 to 0,92</td>
								<td align="center">0,94</td>
								<td align="center">80%</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">Impact on breadth of responsibilities
									<break/> of the service manager</td>
								<td align="left"> Importance - 17</td>
								<td align="center">0,87</td>
								<td align="center">0,30 to 0,73</td>
								<td align="center">0,87</td>
								<td align="center">32%</td>
							</tr>
							<tr>
								<td align="left">Contribuiton - 17</td>
								<td align="center">0,87</td>
								<td align="center">0,43 to 0,73</td>
								<td align="center">0,88</td>
								<td align="center">34%</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t2b">
					<label>Table 4.1.1(Cont.)</label>
					<caption>
						<title>SYNTHESIS OF FACTORIAL ANALYZES</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t2b.jpg"/>
					</alternatives>
				</table-wrap>
			</p>
				<p>In <xref ref-type="app" rid="app1">Appendix I</xref>, we present parts of the
					factorial loads of each research block, describing the items of learning
					support, impact on breadth, depth of impact, and breadth of impact on the
					competencies of the service manager.</p>
				<p>For a better understanding of the factorial analyzes carried out in this
					research, it is shown that the learning support block presents values ​​not so
					close to 0 and not as close to 1 in the analysis of the commonality matrix,
					characterizing a satisfactory factorial solution. The component matrix
					identified in the learning support block is formed by the four factors: 1. Work
					Unit, 2. Immediate Manager, 3. Work Team, and 4. Inadequate Support; that
					explain 54% of the variance already mentioned, generating factorial loads
					between 0.13 and 0.81; the partial results of which are given in <xref
						ref-type="table" rid="t7">Table 1</xref> of <xref ref-type="app" rid="app1"
						>Appendix I</xref>.</p>
				<p>It should be noted that it was not possible to perform the factorial analysis of
					the executive managers, considering the answers given by the 30 executive
					managers in relation to the importance perceived by the course to the
					development of competences and how much the courses allowed the domain of
					professional competences be related to the work. This is because sufficient
					variability (small sample) was not found.</p>
			</sec>
			<sec>
				<title>4.2. Empirical models</title>
				<p>We present here the empirical results obtained with the statistical regression
					models, which are separated by the variable training impact criterion and the
					predictive variable of learning support with their respective factors of the
					work unit, immediate manager, work team and support. In <xref ref-type="table"
						rid="t9">Tables 3</xref> to 6, the final and significant results of such
					models generated in the SPSS are synthesized, using as a criterion of permanence
					in the model the probability values of F &lt;0.05, starting with the Impact in
					Amplitude criterion.</p>
					<p>
				<table-wrap id="t3">
					<label>Table 4.2.1</label>
					<caption>
						<title>SYNTHESIS OF THE EMPIRICAL MODEL - VARIABLE IMPACT CRITERION IN
							AMPLITUDE AND PREDICTIVE VARIABLE OF LEARNING SUPPORT</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t3.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="14%"/>
							<col width="14%"/>
							<col width="14%"/>
							<col width="14%"/>
							<col width="14%"/>
							<col width="14%"/>
							<col width="14%"/>
						</colgroup>
						<thead>
							<tr>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Variable Criterion</th>
								<th colspan="2" rowspan="2" style="background-color:#bbc7d6"
									>Model</th>
								<th colspan="2" style="background-color:#bbc7d6">Non-standardized
									coefficients</th>
								<th style="background-color:#bbc7d6">Standardized Coefficient</th>
								<th rowspan="2" style="background-color:#bbc7d6"><italic>R
										squared</italic></th>
							</tr>
							<tr>
								<th style="background-color:#bbc7d6">B</th>
								<th style="background-color:#bbc7d6">Standard Template</th>
								<th style="background-color:#bbc7d6">Beta</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="5" style="background-color:#bbc7d6"
										><bold>Impact on amplitude</bold></td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,59</td>
								<td align="center">0,43</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of work</td>
								<td align="center">0,61</td>
								<td align="center">0,06</td>
								<td align="center">0,50</td>
								<td align="center">0,25</td>
							</tr>
							<tr>
								<td align="center" rowspan="3">2</td>
								<td align="left">Constant</td>
								<td align="center">2,12</td>
								<td align="center">0,46</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of work</td>
								<td align="center">0,51</td>
								<td align="center">0,07</td>
								<td align="center">0,41</td>
								<td align="center">0,27</td>
							</tr>
							<tr>
								<td align="left">Factor: Immediate Manager</td>
								<td align="center">0,17</td>
								<td align="center">0,06</td>
								<td align="center">0,17</td>
								<td align="center">&#x00A0;</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
				<p>Regarding the variable criterion impact of training in amplitude the final
					empirical model indicated that only Workplace Learning Support (&#x03b2; = 0.41)
					and the Boss (&#x03b2; = 0.17) predicted significantly Impact measured in
					Amplitude. This finding is in line with what <xref ref-type="bibr" rid="B22"
						>Coelho Junior, Abbad, &amp; Todeschini (2005)</xref> point out, where the
					support variable is, in fact, the one that most explains the impact of the
					training.</p>
				<p>In-depth training impact was analyzed considering the two courses currently
					investigated (strategic management and team management). This impact was
					analyzed here in terms of the importance and contribution of each of the two
					courses for the development of competences and later performance of the
					manager.</p>
				<p>The final model indicated that only the learning support of the immediate manager
					was able to significantly predict the impact in depth in the distance course of
					strategic management in terms of its importance for the development of
					professional skills oriented to the manager's job performance. It also indicated
					that the support to the immediate manager's learning and the lack of support
					significantly predicted the impact in depth in the strategic management course,
					in terms of their perceived contribution to the acquisition and mastery of
					professional skills oriented to the manager's job performance.</p>
					<p>
				<table-wrap id="t4">
					<label>Table 4.2.2</label>
					<caption>
						<title>SYNTHESIS OF THE EMPIRICAL MODEL - VARIABLE IMPACT CRITERION IN DEPTH
							AND VARIABLE PREDICTOR OF LEARNING SUPPORT - DISTANCE COURSE OF
							STRATEGIC MANAGEMENT</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t4.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
						</colgroup>
						<thead>
							<tr>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Variable Criterion</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Model</th>
								<th colspan="2" style="background-color:#bbc7d6">Non-standardized
									coefficients</th>
								<th style="background-color:#bbc7d6">Standardized Coefficient</th>
								<th rowspan="2" style="background-color:#bbc7d6"><italic>R
										squared</italic></th>
							</tr>
							<tr>
								<th style="background-color:#bbc7d6">B</th>
								<th style="background-color:#bbc7d6">Standard Template</th>
								<th style="background-color:#bbc7d6">Beta</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="7" style="background-color:#bbc7d6"
										><bold>Impact in Depth -Course of Strategic Management
									</bold></td>
								<td align="left" rowspan="2">scale of importance</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,20</td>
								<td align="center">0,15</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Immediate Manager</td>
								<td align="center">0,13</td>
								<td align="center">0,02</td>
								<td align="center">0,36</td>
								<td align="center">0,13</td>
							</tr>
							<tr>
								<td align="left" rowspan="5">scale of contribution</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,06</td>
								<td align="center">0,15</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Immediate Manager</td>
								<td align="center">0,14</td>
								<td align="center">0,02</td>
								<td align="center">0,37</td>
								<td align="center">0,14</td>
							</tr>
							<tr>
								<td align="center" rowspan="3">2</td>
								<td align="left">Constant</td>
								<td align="center">1,75</td>
								<td align="center">0,17</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Immediate Manager</td>
								<td align="center">0,15</td>
								<td align="center">0,02</td>
								<td align="center">0,39</td>
								<td align="center">0,17</td>
							</tr>
							<tr>
								<td align="left">Factor: Lack of Support</td>
								<td align="center">0,08</td>
								<td align="center">0,02</td>
								<td align="center">0,18</td>
								<td align="center">&#x00A0;</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
				<p>In the distance course of team management, it was verified that the only
					predictor identified for the variable criterion was the support to the perceived
					learning in the work unit, in the importance and contribution scales, as shown
					in <xref ref-type="table" rid="t5">Table 4.2.3</xref>.</p>
					<p>
				<table-wrap id="t5">
					<label>Table 4.2.3</label>
					<caption>
						<title>SYNTHESIS OF THE EMPIRICAL MODEL - VARIABLE IMPACT CRITERION IN DEPTH
							AND VARIABLE PREDICTIVE OF LEARNING SUPPORT - DISTANCE COURSE OF TEAM
							MANAGEMENT</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t5.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
						</colgroup>
						<thead>
							<tr>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Variable Criterion</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Model</th>
								<th colspan="2" style="background-color:#bbc7d6">Non-standardized
									coefficients</th>
								<th style="background-color:#bbc7d6">Standardized Coefficient</th>
								<th rowspan="2" style="background-color:#bbc7d6"><italic>R
										squared</italic></th>
							</tr>
							<tr>
								<th style="background-color:#bbc7d6">B</th>
								<th style="background-color:#bbc7d6">Standard Template</th>
								<th style="background-color:#bbc7d6">Beta</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="4" style="background-color:#bbc7d6">Impact
									in Depth  Team Management Course</td>
								<td align="left" rowspan="2">scale of importance</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,23</td>
								<td align="center">0,15</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of Work</td>
								<td align="center">0,17</td>
								<td align="center">0,02</td>
								<td align="center">0,43</td>
								<td align="center">0,18</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">scale of<break/> contribution</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,02</td>
								<td align="center">0,16</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of Work</td>
								<td align="center">0,19</td>
								<td align="center">0,02</td>
								<td align="center">0,43</td>
								<td align="center">0,19</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
				<p>With respect to the variable of the impact of training in amplitude on
					competences of the manager of care, the only predictor was a support to the
					perceived learning in the unit of work, both in the scale of importance and in
					the scale of contribution, according to <xref ref-type="table" rid="t6">Table
						4.2.4</xref>.</p>
						<p>
				<table-wrap id="t6">
					<label>Table 4.2.4</label>
					<caption>
						<title>SYNTHESIS OF THE EMPIRICAL MODEL - VARIABLE IMPACT CRITERION IN
							AMPLITUDE ON COMPETENCIES OF THE ATTENDANCE MANAGER AND PREDICTIVE
							VARIABLE OF LEARNING SUPPORT</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t6.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
							<col width="12%"/>
						</colgroup>
						<thead>
							<tr>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Variable Criterion</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" style="background-color:#bbc7d6">&#x00a0;</th>
								<th rowspan="2" align="left" style="background-color:#bbc7d6"
									>Model</th>
								<th colspan="2" style="background-color:#bbc7d6">Non-standardized
									coefficients</th>
								<th style="background-color:#bbc7d6">Standardized Coefficient</th>
								<th rowspan="2" style="background-color:#bbc7d6"><italic>R
										squared</italic></th>
							</tr>
							<tr>
								<th style="background-color:#bbc7d6">B</th>
								<th style="background-color:#bbc7d6">Standard Template</th>
								<th style="background-color:#bbc7d6">Beta</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left" rowspan="4" style="background-color:#bbc7d6"
										><bold>Impact on Range of Competencies of the Customer
										Service Manager</bold></td>
								<td align="left" rowspan="2">importance scale</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">3,11</td>
								<td align="center">0,08</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of Work</td>
								<td align="center">0,07</td>
								<td align="center">0,01</td>
								<td align="center">0,36</td>
								<td align="center">0,13</td>
							</tr>
							<tr>
								<td align="left" rowspan="2">scale of contribution</td>
								<td align="center" rowspan="2">1</td>
								<td align="left">Constant</td>
								<td align="center">2,26</td>
								<td align="center">0,10</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Factor: Unit of Work</td>
								<td align="center">0,15</td>
								<td align="center">0,01</td>
								<td align="center">0,53</td>
								<td align="center">0,28</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
				<p>After the presentation of the empirical results regarding both the evidence of
					the validity of the questionnaire used and its theoretical dimensions, as well
					as the statistical regression models, the standard of answers was analyzed among
					the 291 respondents considering the unit of stocking of the same ones.
					Basically, ANOVA (analysis of variance) was performed considering as parameter
					two functions: commissioned function of executive manager and function of
					manager of the service.</p>
			</sec>
			<sec>
				<title>4.3. ANOVA test results</title>
				<p>In order to analyze the possible influence of contextual factors on the pattern
					of responses given by the respondents, we chose to perform ANOVA. Firstly, the
					means of the responses of the training impact items in amplitude were compared
					between the groups of executive managers and service managers. The total sample
					contained 30 executive managers and 261 service managers. Although there was a
					marked difference in the size of the groups, no statistically significant
					results were observed for the Levene test, which leads to the conclusion that
					the variances between the groups were homogeneous.</p>
				<p>A comparison of means by means of ANOVA showed a non-significant result, F (1,
					289) = 0.16, p = 0.69, which leads to the conclusion that service managers and
					executive managers did not differ on the evaluations issued regarding impact in
					amplitude.</p>
				<p>When comparing the two types of function in relation to the assessment of
					contribution and importance of the strategic management course, it was
					identified that service managers and executive managers differed in relation to
					strategic importance assessments (F (1,289) = 7, 12, p = 0.01), and for the
					evaluation of the contribution of the strategic management course, (F (1,289) =
					6.43, p = 0.01).</p>
				<p>The average number of evaluations of care managers for importance of the
					strategic management course in the development of their competences was lower (M
					= 3.10, SD = 0.67, 95% CI [3.02, 3.18]) then (M = 3.44, SD = 0.61, Bca 95% CI
					[3.22, 3.65]). The average contribution evaluations of care managers were also
					lower (M = 3.02, SD = 0.68, 95% CI [2.93, 3.10]) than of the executive managers
					(M = 3.35, SD = 0.62, 95% CI [3.10, 3.56]).</p>
				<p>No significant differences were identified between service managers and executive
					managers regarding the evaluation of contribution and importance of the Team
					Management course. This result signals homogeneity in perceptions. The next
					section presents the discussion of the empirical findings reported here.</p>
			</sec>
		</sec>
		<sec sec-type="discussion">
			<title>5. DISCUSSION</title>
			<p>The psychometric indicators obtained in the measures currently discussed were
				satisfactory and resemble the original measures (<xref ref-type="bibr" rid="B19"
					>Coelho Junior, 2004</xref>; <xref ref-type="bibr" rid="B39">Pilati &amp; Abbad,
					2005</xref>). The data support evidence of internal validity in the measures
				used.</p>
			<p>The empirical models obtained in this research are in agreement with the scientific
				literature on TD&amp;E in demonstrating the importance of psychosocial support to
				learning in predicting the impact of training at work (<xref ref-type="bibr"
					rid="B8">Alfandi, 2016</xref>; <xref ref-type="bibr" rid="B28">Galanou, &amp;
					Priporas, 2009</xref>). The variables of training impact, both in terms of
				amplitude, depth and competences presented acceptable results since the factors unit
				of work and immediate manager of the predictive variable of learning support
				demonstrated that it has a strong influence on the training results in the
				environment job. This is evidenced by the result of the unit work factor (&#x03b2; =
				0.41) and the immediate management factor (&#x03b2; = 0.17) in the amplitude impact;
				in &#x03b2; = 0.36 in the immediate management factor of the impact in depth of the
				scale of importance and in &#x03b2; = 0.39 in the factor of the immediate manager
				and &#x03b2; = 0.18 of the factor lacking support of the scale of contribution of
				the course of strategic management. In the course of team management, we can see
				similar results, with &#x03b2; = 0.43 in the unit of work factor of the importance
				scale and the same unit work factor with &#x03b2; = 0.43 in the contribution scale.
				The variable criterion of the impact of training in amplitude on competences was
				measured as the manager of service, where the result of &#x03b2; = 0.36 was in the
				unit of work factor of importance scale and of &#x03b2; = 0.53 in the scale of
				contribution.</p>
			<p>In fact, the work environment, represented here by the unit of a work factor, is
				extremely important to the impact of training actions, and must already be
				considered in the evaluation of learning needs (<xref ref-type="bibr" rid="B44"
					>Yotamo, 2014</xref>). <xref ref-type="bibr" rid="B28">Galanou and Priporas
					(2009)</xref> also identified that training contributed to increased
				productivity and that the satisfaction level of the team was increased by the
				training evaluated by the authors. The impact of training on the job generates, in
				fact, effective contributions to the acquisition and mastery of professional skills
				of managers (<xref ref-type="bibr" rid="B25">D'Netto, Bakas, &amp; Bordia,
					2008</xref>).</p>
			<p>Distance training is capable of impacting performance (Vargas, 2003). According to
				Joia and Costa (2007), it is important to note that there is no single model or
				formula to guarantee the success of corporate distance training programs. Each
				company and each training program is unique, with specific characteristics that must
				be observed, so that it is possible to adopt the correct strategies and achieve the
				desired goals.</p>
			<p>Learning support is indispensable in this context since individuals can be the agents
				that provide or receive the support of colleagues and managers. The meeting with
					<xref ref-type="bibr" rid="B21">Coelho Junior and Borges-Andrade (2011)</xref>
				identified that support for learning predicts the impact, and this is capable of
				influencing the development of professional skills.</p>
			<p>According to <xref ref-type="bibr" rid="B4">Abbad and Borges-Andrade (2014)</xref>,
					<xref ref-type="bibr" rid="B9">Balarin et al. (2014)</xref>, and <xref
					ref-type="bibr" rid="B22">Coelho Junior et al. (2005)</xref>, the support for
				learning provided in the workplace usually refers to the opportunities for exposing
				ideas from each server; the time destined for the search of new ways of carrying out
				the work; the autonomy to argue about leadership demands; error tolerance when
				trying to apply new knowledge and skills; encouraging the search for new learning;
				and the availability of material, human, financial and/or informational resources
				sufficient for the application of new knowledge and skills. The reasons for this
				lack of support need to be understood qualitatively within this entity.</p>
			<p>
				<xref ref-type="bibr" rid="B25">D'Netto, Bakas, and Bordia (2008)</xref> also found
				predictive relationships between line manager support and the opportunity to
				effectively use management development actions. The support of the high management
				level appeared as a strong predictor of the link with the strategy, the latter being
				the best variable predicting the effectiveness of management development.</p>
			<p>None of the personal and professional variables contributed significantly to the
				empirical models. This result is curious, but it is in line with <xref
					ref-type="bibr" rid="B5">Abbad and Carvalho (2006)</xref> and <xref
					ref-type="bibr" rid="B44">Yotamo (2014)</xref>, who also did not identify
				effects of variables of this nature (gender, age group, educational level, and
				public prediction of impact.</p>
			<p>In summary, the results suggest the need to invest heavily in management actions to
				provide support for learning, since this support is capable of predicting the impact
				and influencing the domain of professional skills. By perceiving the organizational
				environment as sports, workers will be able to apply, in their routines, the skills
				acquired in a training situation.</p>
		</sec>
		<sec sec-type="conclusions">
			<title>6. FINAL CONSIDERATIONS</title>
			<p>The contributions and limitations of the research are presented, as well as a
				research agenda for continuity of studies on the impact of training in the work
				environment, since the expectation of finding in the managers' greater control of
				competences caused by the impact of the training in the work was validated,
				according to results and discussion presented.</p>
			<p>It is salutary to consider the selected public, who at first has decision-making
				power in the organization, not depending on the environment rule to apply the
				knowledge received in training. However, the statistical regressions, performed and
				limited in the self-assessment of the research participants, support the need for
				workplace support to the executive manager and service manager of this autarchy to
				apply such knowledge.</p>
			<p>The present research also allowed the expansion and diversification of samples in the
				investigations of training impact in the organizations, thus contributing to
				increase the generalization of the national research results of TD &amp; E, as
				recommended by <xref ref-type="bibr" rid="B20">Coelho Junior and Abbad
				(2010)</xref>.</p>
			<p>Another no less important contribution is the scope of the research carried out,
				involving a target audience distributed in all Brazilian states - both in capitals
				and in countryside cities. With this unprecedented event, expectations have arisen,
				and new needs for training actions have arisen in the autarchy, which is in
				progress.</p>
			<p>The verification of the effectiveness of management training in the light of the
				competences required from managers of this autarchy, as a general objective of this
				research, was reached in the specific audience of service manager, since it was
				possible to perform all the factorial analyzes and planned regressions in the sample
				of this type of manager.</p>
			<p>A limitation identified but not impeding its validity and utility, since the
				elaboration of the research project, was the question of the research being only
				self-evaluating, disregarding the hetero evaluations, preventing comparisons
				regarding the effectiveness of the training and the convergence of the answers
				obtained.</p>
			<p>The time interval for the completion of the evaluated training and the accomplishment
				of this research was also dispersed, averaging ten months, being the ideal to carry
				out an in-depth impact research before carrying out the specific course, to gauge
				expectations, another adjacent after the course finished, and another one after six
				months; thus having an effective evaluation of the impact of training in the work
				environment. Thus the research would have had a longitudinal rather a transverse
				cut.</p>
			<p>According to the results presented and discussed, the following research agenda is
				proposed for future studies:</p>
			<p>
				<list list-type="bullet">
					<list-item>
						<p>Evaluate the use of more than one research instrument, in addition to the
							electronic questionnaire. A mixed research approach could be adopted,
							avoiding the quantitative approach in these cases with restricted public
							and decision-making power in organizations.</p>
					</list-item>
					<list-item>
						<p>Perform segmented searches, when there are complex questionnaires with
							more than one hundred items, where the participant would respond in
							blocks. Such a division would require a comparative pilot test to gauge
							the degree of the response rate of the completed and segmented
							questionnaire, thus deciding on the best return model.</p>
					</list-item>
					<list-item>
						<p>Continue to apply the instruments built and validated in this study in
							new organizations, courses, and methodologies, in face-to-face and
							distance training, using different criteria variables, to confirm their
							reliability and replication.</p>
					</list-item>
				</list>
			</p>
		</sec>
	</body>
	<back>
		<fn-group>
			<fn fn-type="other">
				<p>Leovanir D. D. Richter is now at Ministério da Transparência e Controladoria
					Geral da União (CGU) as an Analist from the Executive Secretary.</p>
			</fn>
		</fn-group>
		<app-group>
			<title>APPENDIX</title>
			<app id="app1">
				<label>Appendix I</label>
				<p>PARTIAL FACTORIAL LOADS OF SUPPORT BLOCKS FOR TRAINING LEARNING AND IMPACT</p>
				<p>
				<table-wrap id="t7">
					<label>Table 1</label>
					<caption>
						<title>PARTIAL FACTORIAL LOADS OF THE LEARNING SUPPORT BLOCK</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t7.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="60%"/>
							<col width="10%"/>
							<col width="10%"/>
							<col width="10%"/>
							<col width="10%"/>
						</colgroup>
						<thead>
							<tr>
								<th rowspan="2" style="background-color:#bbc7d6">Learning Support
									Item</th>
								<th colspan="4" style="background-color:#bbc7d6">Factor<xref
										ref-type="table-fn" rid="TFN2">*</xref></th>
							</tr>
							<tr>
								<th style="background-color:#bbc7d6">1</th>
								<th style="background-color:#bbc7d6">2</th>
								<th style="background-color:#bbc7d6">3</th>
								<th style="background-color:#bbc7d6">4</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left">There is opportunity to display ideas for each
									server</td>
								<td align="center">0,68</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">It assumes with me the risks of trying new ways of 
									doing <break/> the work</td>
								<td align="center">&#x00A0;</td>
								<td align="center">0,81</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
							</tr>
							<tr>
								<td align="left">Ignores the changes that I propose based on what I
									learned <break/> in training</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
								<td align="center">0,44</td>
							</tr>
							<tr>
								<td align="left">It gives me the freedom to decide on how to perform
									<break/> my tasks</td>
								<td align="center">&#x00A0;</td>
								<td align="center">&#x00A0;</td>
								<td align="center">0,67</td>
								<td align="center">&#x00A0;</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<fn id="TFN1">
							<p>Note: Remark 1:</p>
						</fn>
						<fn id="TFN2">
							<label>*</label>
							<p>Factor = 1 - Work Unit, 2 - Immediate Manager, 3 - Work Team, 4 -
								Inadequate Support. Remark 2: Extraction method: Main component
								analysis.</p>
						</fn>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t8">
					<label>Table 2</label>
					<caption>
						<title>PARTIAL FACTORIAL LOADS OF THE AMPLITUDE TRAINING BLOCK UNIFORMS
							SOLUTION</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t8.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="80%"/>
							<col width="20%"/>
						</colgroup>
						<thead>
							<tr>
								<th style="background-color:#bbc7d6">Item</th>
								<th style="background-color:#bbc7d6">Factor1 - Impact</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left">When I apply what I have learned in training, I
									carry out my work more safely</td>
								<td align="center">0,83</td>
							</tr>
							<tr>
								<td align="left">I remember well the contents taught in the
									training</td>
								<td align="center">0,77</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<fn id="TFN3">
							<p>Note. Remark 1: Extraction method: Main component analysis.</p>
						</fn>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t9">
					<label>Table 3</label>
					<caption>
						<title>PARTIAL LOADS OF THE IMPACT BLOCK SOLUTION IN DEPTH - STRATEGIC
							MANAGEMENT COURSE</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t9.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="60%"/>
							<col width="20%"/>
							<col width="20%"/>
						</colgroup>
						<thead>
							<tr>
								<th style="background-color:#bbc7d6">Strategic Management Course
									Item</th>
								<th style="background-color:#bbc7d6">Importance Scale Factor</th>
								<th style="background-color:#bbc7d6">Contribution Scale Factor</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left">Enable the application of strategic objectives in
									my unit of work</td>
								<td align="center">0,90</td>
								<td align="center">0,91</td>
							</tr>
							<tr>
								<td align="left">Promotes strategic management practices in my unit
									of work</td>
								<td align="center">0,87</td>
								<td align="center">0,85</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<fn id="TFN4">
							<p>Note. Remark 1: Extraction method: Main component analysis.</p>
						</fn>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t10">
					<label>Table 4</label>
					<caption>
						<title>PARTIAL LOADS OF THE IMPACT BLOCK SOLUTION IN DEPTH - TEAM MANAGEMENT
							COURSE</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t10.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="60%"/>
							<col width="20%"/>
							<col width="20%"/>
						</colgroup>
						<thead>
							<tr>
								<th style="background-color:#bbc7d6">Team Management Course
									Item</th>
								<th style="background-color:#bbc7d6">Importance Scale Factor</th>
								<th style="background-color:#bbc7d6">Contribution Scale Factor</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left">I discuss actions mobilizing performance with the
									work team</td>
								<td align="center">0,89</td>
								<td align="center">0,89</td>
							</tr>
							<tr>
								<td align="left">I stimulate in the work environment the formation
									of new leadership</td>
								<td align="center">0,82</td>
								<td align="center">0,90</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<fn id="TFN5">
							<p>Note. Remark 1: Extraction method: Main component analysis.</p>
						</fn>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			<p>
				<table-wrap id="t11">
					<label>Table 5</label>
					<caption>
						<title>PARTIAL LOADINGS OF AMPLITUDE TRAINING IMPACT BLOCK UNIFORMS SOLUTION
							ON SERVICE MANAGER SKILLS - SCALES IMPORTANCE AND CONTRIBUTION</title>
					</caption>
					<alternatives>
						<graphic xlink:href="t11.jpg"/>
					<table frame="hsides" rules="rows" style="border-color:#23507b">
						<colgroup>
							<col width="60%"/>
							<col width="20%"/>
							<col width="20%"/>
						</colgroup>
						<thead>
							<tr>
								<th style="background-color:#bbc7d6">Competency Item for the Service
									Manager</th>
								<th style="background-color:#bbc7d6">Importance Scale Factor</th>
								<th style="background-color:#bbc7d6">Contribution Scale Factor</th>
							</tr>
						</thead>
						<tbody>
							<tr>
								<td align="left">Get productivity at work</td>
								<td align="center">0,55</td>
								<td align="center">0,40</td>
							</tr>
							<tr>
								<td align="left">Find quality in decisions</td>
								<td align="center">0,51</td>
								<td align="center">0,54</td>
							</tr>
							<tr>
								<td align="left">Promote the personal and professional development
									of the team</td>
								<td align="center">0,54</td>
								<td align="center">0,46</td>
							</tr>
						</tbody>
					</table>
				</alternatives>
					<table-wrap-foot>
						<fn id="TFN6">
							<p>Note. Remark 1: Extraction method: Main component analysis.</p>
						</fn>
						<attrib><styled-content style="color:#23507b">Source:</styled-content>
							Elaborated by the author.</attrib>
					</table-wrap-foot>
				</table-wrap>
			</p>
			</app>
		</app-group>
		<ref-list>
			<title>REFERENCES</title>
			<ref id="B1">
				<mixed-citation>Abbad, G. (1999). <italic>Um modelo integrado de avaliação do
						impacto do treinamento no trabalho - IMPACT</italic> (Doctoral
					dissertation). Universidade de Brasília, Brasília, DF, Brazil. </mixed-citation>
				<element-citation publication-type="thesis">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
					</person-group>
					<year>1999</year>
					<source>Um modelo integrado de avaliação do impacto do treinamento no trabalho -
						IMPACT</source>
					<comment>Doctoral dissertation</comment>
					<publisher-name>Universidade de Brasília</publisher-name>
					<publisher-loc>Brasília, DF, Brazil</publisher-loc>
				</element-citation>
			</ref>
			<ref id="B2">
				<mixed-citation>Abbad, G. S. (2014). <italic>Necessidades e impactos de treinamento
						e programas educacionais no trabalho e nas organizações</italic> (Pedido de
					renovação de bolsa de produtividade CNPq). Universidade de Brasília, Brasília,
					DF, Brazil.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G. S.</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<source>Necessidades e impactos de treinamento e programas educacionais no
						trabalho e nas organizações</source>
					<comment>Pedido de renovação de bolsa de produtividade CNPq</comment>
					<publisher-name>Universidade de Brasília</publisher-name>
					<publisher-loc>Brasília, DF, Brazil</publisher-loc>
				</element-citation>
			</ref>
			<ref id="B3">
				<mixed-citation>Abbad, G. S. (2007). Educação à distância: O estado da arte e o
					futuro necessário. <italic>Revista do Serviço Público</italic>,
						<italic>58</italic>(3), 100-110.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G. S.</given-names>
						</name>
					</person-group>
					<year>2007</year>
					<article-title>Educação à distância: O estado da arte e o futuro
						necessário</article-title>
					<source>Revista do Serviço Público</source>
					<volume>58</volume>
					<issue>3</issue>
					<fpage>100</fpage>
					<lpage>110</lpage>
				</element-citation>
			</ref>
			<ref id="B4">
				<mixed-citation>Abbad, G. S., &amp; Borges-Andrade, J. E. (2014). Aprendizagem
					humana em organizações e trabalho. In J. C. Zanelli, J. E. Borges-Andrade, &amp;
					A. V. B. Bastos (Orgs.), <italic>Psicologia, Organizações e Trabalho no
						Brasil</italic> (pp. 244-284). Porto Alegre, RS: Artmed.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G. S.</given-names>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<chapter-title>Aprendizagem humana em organizações e trabalho</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Zanelli</surname>
							<given-names>J. C.</given-names>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
						<name>
							<surname>Bastos</surname>
							<given-names>A. V. B.</given-names>
						</name>
					</person-group>
					<source>Psicologia, Organizações e Trabalho no Brasil</source>
					<fpage>244</fpage>
					<lpage>284</lpage>
					<publisher-loc>Porto Alegre, RS</publisher-loc>
					<publisher-name>Artmed</publisher-name>
				</element-citation>
			</ref>
			<ref id="B5">
				<mixed-citation>Abbad, G. S., &amp; Carvalho, R. S. (2006). Avaliação de treinamento
					a distância: reação, suporte, transferências e impactos no trabalho.
						<italic>Revista de Administração Contemporânea</italic>,
					<italic>10</italic>(1), 95-116.
					doi:10.1590/S1415-65552006000100006</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G. S.</given-names>
						</name>
						<name>
							<surname>Carvalho</surname>
							<given-names>R. S.</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>Avaliação de treinamento a distância: reação, suporte,
						transferências e impactos no trabalho</article-title>
					<source>Revista de Administração Contemporânea</source>
					<volume>10</volume>
					<issue>1</issue>
					<fpage>95</fpage>
					<lpage>116</lpage>
					<pub-id pub-id-type="doi">10.1590/S1415-65552006000100006</pub-id>
				</element-citation>
			</ref>
			<ref id="B6">
				<mixed-citation>Abbad, G. S., Sallorenzo, L. H., Coelho Junior, F. A., Zerbini, T.,
					Vasconcelos, L., &amp; Todeschini, K. (2012). Suporte à transferência de
					treinamento e suporte à aprendizagem. In G. Abbad, L. Mourão, P. P. M. Meneses,
					T. Zerbini, J. E. Borges-Andrade, &amp; R. Vilas-Boas (Orgs.), <italic>Medidas
						de avaliação em treinamento, desenvolvimento e educação</italic> (pp.
					244-263). Porto Alegre, RS: Artmed.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Abbad</surname>
							<given-names>G. S.</given-names>
						</name>
						<name>
							<surname>Sallorenzo</surname>
							<given-names>L. H.</given-names>
						</name>
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Zerbini</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Vasconcelos</surname>
							<given-names>L.</given-names>
						</name>
						<name>
							<surname>Todeschini</surname>
							<given-names>K.</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<chapter-title>Suporte à transferência de treinamento e suporte à
						aprendizagem</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
						<name>
							<surname>Mourão</surname>
							<given-names>L.</given-names>
						</name>
						<name>
							<surname>Meneses</surname>
							<given-names>P. P. M.</given-names>
						</name>
						<name>
							<surname>Zerbini</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
						<name>
							<surname>Vilas-Boas</surname>
							<given-names>R.</given-names>
						</name>
					</person-group>
					<source>Medidas de avaliação em treinamento, desenvolvimento e educação</source>
					<fpage>244</fpage>
					<lpage>263</lpage>
					<publisher-loc>Porto Alegre, RS</publisher-loc>
					<publisher-name>Artmed</publisher-name>
				</element-citation>
			</ref>
			<ref id="B7">
				<mixed-citation>Aguinis, H, &amp; Kraiger, K. (2009). Benefits of training and
					development for individuals and teams, organizations, and society.
						<italic>Annual Review of Psychology, 60</italic>, 451-474.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Aguinis</surname>
							<given-names>H</given-names>
						</name>
						<name>
							<surname>Kraiger</surname>
							<given-names>K.</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<article-title>Benefits of training and development for individuals and teams,
						organizations, and society</article-title>
					<source>Annual Review of Psychology</source>
					<volume>60</volume>
					<fpage>451</fpage>
					<lpage>474</lpage>
				</element-citation>
			</ref>
			<ref id="B8">
				<mixed-citation>Alfandi, A. M. (2016). Training impact on the performance of
					employees "A case of jordanian travel and tourism institutions".
						<italic>International Business Management, 10</italic>(4),
					377-384.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Alfandi</surname>
							<given-names>A. M.</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>Training impact on the performance of employees "A case of
						jordanian travel and tourism institutions"</article-title>
					<source>International Business Management</source>
					<volume>10</volume>
					<issue>4</issue>
					<fpage>377</fpage>
					<lpage>384</lpage>
				</element-citation>
			</ref>
			<ref id="B9">
				<mixed-citation>Balarin, C. S., Zerbini, T., Martins, L. B. (2014). A relação entre
					suporte à aprendizagem e impacto de treinamento no trabalho. <italic>Revista
						Eletrônica de Administração, 20</italic>(2).
					doi:10.1590/1413-2311017201341925</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Balarin</surname>
							<given-names>C. S.</given-names>
						</name>
						<name>
							<surname>Zerbini</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Martins</surname>
							<given-names>L. B.</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>A relação entre suporte à aprendizagem e impacto de treinamento
						no trabalho</article-title>
					<source>Revista Eletrônica de Administração</source>
					<volume>20</volume>
					<issue>2</issue>
					<pub-id pub-id-type="doi">10.1590/1413-2311017201341925</pub-id>
				</element-citation>
			</ref>
			<ref id="B10">
				<mixed-citation>Bloom, B. S., Hastings, T., &amp; Madaus, G. (1983). <italic>Manual
						de avaliação formativa e somativa do aprendizado escolar</italic>. São
					Paulo, SP: Pioneira.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Bloom</surname>
							<given-names>B. S.</given-names>
						</name>
						<name>
							<surname>Hastings</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Madaus</surname>
							<given-names>G.</given-names>
						</name>
					</person-group>
					<year>1983</year>
					<source>Manual de avaliação formativa e somativa do aprendizado escolar</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Pioneira</publisher-name>
				</element-citation>
			</ref>
			<ref id="B11">
				<mixed-citation>Borges-Andrade, J. E. (1982). Avaliação somativa de sistemas
					instrucionais: Integração de três propostas. <italic>Tecnologia Educacional,
						11</italic>(46), 29-39.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
					</person-group>
					<year>1982</year>
					<article-title>Avaliação somativa de sistemas instrucionais: Integração de três
						propostas</article-title>
					<source>Tecnologia Educacional</source>
					<volume>11</volume>
					<issue>46</issue>
					<fpage>29</fpage>
					<lpage>39</lpage>
				</element-citation>
			</ref>
			<ref id="B12">
				<mixed-citation>Borges-Andrade, J. E. (2006). Avaliação integrada e somativa em
					TD&amp;E. In J. E., Borges-Andrade, G., Abbad, L., Mourão (Orgs.),
						<italic>Treinamento, desenvolvimento e educação em organizações e trabalho:
						Fundamentos para a gestão de pessoas</italic> (pp. 343-358). Porto Alegre,
					RS: Artmed.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<chapter-title>Avaliação integrada e somativa em TD&amp;E</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
						<name>
							<surname>Mourão</surname>
							<given-names>L.</given-names>
						</name>
					</person-group>
					<source>Treinamento, desenvolvimento e educação em organizações e trabalho:
						Fundamentos para a gestão de pessoas</source>
					<fpage>343</fpage>
					<lpage>358</lpage>
					<publisher-loc>Porto Alegre, RS</publisher-loc>
					<publisher-name>Artmed</publisher-name>
				</element-citation>
			</ref>
			<ref id="B13">
				<mixed-citation>Boyatzis, R. E. (1982). <italic>The competent management: A model
						for effective performance</italic>. New York, NY: John
					Wiley.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Boyatzis</surname>
							<given-names>R. E.</given-names>
						</name>
					</person-group>
					<year>1982</year>
					<source>The competent management: A model for effective performance</source>
					<publisher-loc>New York, NY</publisher-loc>
					<publisher-name>John Wiley</publisher-name>
				</element-citation>
			</ref>
			<ref id="B14">
				<mixed-citation>Brandão, H. P., Borges-Andrade, J. E., Freitas, I. A., &amp; Vieira,
					F. T. (2010). Desenvolvimento e estrutura interna de uma escala de competências
					gerenciais. <italic>Psicologia: Teoria e Pesquisa</italic>,
					<italic>26</italic>(1), 171-182.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Brandão</surname>
							<given-names>H. P.</given-names>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
						<name>
							<surname>Freitas</surname>
							<given-names>I. A.</given-names>
						</name>
						<name>
							<surname>Vieira</surname>
							<given-names>F. T.</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>Desenvolvimento e estrutura interna de uma escala de competências
						gerenciais</article-title>
					<source>Psicologia: Teoria e Pesquisa</source>
					<volume>26</volume>
					<issue>1</issue>
					<fpage>171</fpage>
					<lpage>182</lpage>
				</element-citation>
			</ref>
			<ref id="B15">
				<mixed-citation>Brandão, H. P., Borges-Andrade, J. E., &amp; Guimarães, T. A.
					(2012). Desempenho organizacional e suas relações com competências gerenciais,
					suporte organizacional e treinamento. <italic>Revista de Administração</italic>,
						<italic>47</italic>(4), 523-539.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Brandão</surname>
							<given-names>H. P.</given-names>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
						<name>
							<surname>Guimarães</surname>
							<given-names>T. A.</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<article-title>Desempenho organizacional e suas relações com competências
						gerenciais, suporte organizacional e treinamento</article-title>
					<source>Revista de Administração</source>
					<volume>47</volume>
					<issue>4</issue>
					<fpage>523</fpage>
					<lpage>539</lpage>
				</element-citation>
			</ref>
			<ref id="B16">
				<mixed-citation>Campos, E. B. D. (2015). <italic>Competências empreendedoras: Uma
						avaliação no contexto de empresas juniores brasileiras</italic> (Doctoral
					dissertation). Universidade de Brasília, Brasília, Brazil.</mixed-citation>
				<element-citation publication-type="thesis">
					<person-group person-group-type="author">
						<name>
							<surname>Campos</surname>
							<given-names>E. B. D.</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<source>Competências empreendedoras: Uma avaliação no contexto de empresas
						juniores brasileiras</source>
					<comment>Doctoral dissertation</comment>
					<publisher-name>Universidade de Brasília</publisher-name>
					<publisher-loc>Brasília, Brazil</publisher-loc>
				</element-citation>
			</ref>
			<ref id="B17">
				<mixed-citation>Carbone, P. P. (2009<italic>).</italic>
					<italic>Gestão por competências e gestão do conhecimento</italic> (3rd ed.). Rio
					de Janeiro, RJ: Editora FGV.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Carbone</surname>
							<given-names>P. P.</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<source>Gestão por competências e gestão do conhecimento</source>
					<edition>3rd ed.</edition>
					<publisher-loc>Rio de Janeiro, RJ</publisher-loc>
					<publisher-name>Editora FGV</publisher-name>
				</element-citation>
			</ref>
			<ref id="B18">
				<mixed-citation>Churchill Junior, G. A. (1999). <italic>Marketing research:
						Methodological foundations</italic> (7th ed.). Fort Worth: The Dryden
					Press.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Churchill</surname>
							<given-names>G. A.</given-names>
							<suffix>Junior</suffix>
						</name>
					</person-group>
					<year>1999</year>
					<source>Marketing research: Methodological foundations</source>
					<edition>7th ed.</edition>
					<publisher-loc>Fort Worth</publisher-loc>
					<publisher-name>The Dryden Press</publisher-name>
				</element-citation>
			</ref>
			<ref id="B19">
				<mixed-citation>Coelho Junior, F. A. (2004). <italic>Avaliação de treinamento a
						distância: Suporte à aprendizagem e impacto do treinamento no
						trabalho</italic> (Master's thesis). Universidade de Brasília, Brasília,
					Brazil.</mixed-citation>
				<element-citation publication-type="thesis">
					<person-group person-group-type="author">
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
					</person-group>
					<year>2004</year>
					<source>Avaliação de treinamento a distância: Suporte à aprendizagem e impacto
						do treinamento no trabalho</source>
					<comment>Master's thesis</comment>
					<publisher-name>Universidade de Brasília</publisher-name>
					<publisher-loc>Brasília, Brazil</publisher-loc>
				</element-citation>
			</ref>
			<ref id="B20">
				<mixed-citation>Coelho Junior, F. A., &amp; Abbad, G. (2010). Construção e validação
					de uma escala de avaliação de impacto em profundidade de um treinamento a
					distância em uma organização do setor bancário brasileiro. <italic>Revista
						Eletrônica de Administração, 16</italic>(1), 91-119.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>Construção e validação de uma escala de avaliação de impacto em
						profundidade de um treinamento a distância em uma organização do setor
						bancário brasileiro</article-title>
					<source>Revista Eletrônica de Administração</source>
					<volume>16</volume>
					<issue>1</issue>
					<fpage>91</fpage>
					<lpage>119</lpage>
				</element-citation>
			</ref>
			<ref id="B21">
				<mixed-citation>Coelho Junior, F. A., &amp; Borges-Andrade, J. E. (2011). Efeitos de
					variáveis individuais e contextuais sobre desempenho individual no trabalho.
						<italic>Estudos de Psicologia, 16</italic>(2), 111-120.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Borges-Andrade</surname>
							<given-names>J. E.</given-names>
						</name>
					</person-group>
					<year>2011</year>
					<article-title>Efeitos de variáveis individuais e contextuais sobre desempenho
						individual no trabalho</article-title>
					<source>Estudos de Psicologia</source>
					<volume>16</volume>
					<issue>2</issue>
					<fpage>111</fpage>
					<lpage>120</lpage>
				</element-citation>
			</ref>
			<ref id="B22">
				<mixed-citation>Coelho Junior, F. A., Abbad, G., &amp; Todeschini, K. C. (2005).
					Construção de validação de uma escala de suporte à aprendizagem no trabalho em
					uma instituição bancária brasileira. <italic>Revista Psicologia Organizações e
						Trabalho</italic> - rPOT, 5(2), 167-196.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
						<name>
							<surname>Todeschini</surname>
							<given-names>K. C.</given-names>
						</name>
					</person-group>
					<year>2005</year>
					<article-title>Construção de validação de uma escala de suporte à aprendizagem
						no trabalho em uma instituição bancária brasileira</article-title>
					<source>Revista Psicologia Organizações e Trabalho - rPOT</source>
					<volume>5</volume>
					<issue>2</issue>
					<fpage>167</fpage>
					<lpage>196</lpage>
				</element-citation>
			</ref>
			<ref id="B23">
				<mixed-citation>Creswell, J. W. (2010). <italic>Projeto de pesquisa: Métodos
						qualitativo, quantitativo e misto</italic> (3rd ed.). Porto Alegre, RS:
					Artmed.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Creswell</surname>
							<given-names>J. W.</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<source>Projeto de pesquisa: Métodos qualitativo, quantitativo e misto</source>
					<edition>3rd ed.</edition>
					<publisher-loc>Porto Alegre, RS</publisher-loc>
					<publisher-name>Artmed</publisher-name>
				</element-citation>
			</ref>
			<ref id="B24">
				<mixed-citation>Denhardt, R. B. (2012). <italic>Teorias da administração
						pública</italic>. São Paulo, SP: Cengage Learning.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Denhardt</surname>
							<given-names>R. B.</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<source>Teorias da administração pública</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Cengage Learning</publisher-name>
				</element-citation>
			</ref>
			<ref id="B25">
				<mixed-citation>D'Netto, B., Bakas, F., Bordia, P. (2008). Predictors of management
					development effectiveness: an Australian perspective. <italic>International
						Journal of Training and Development, 12</italic>(1), 2-23.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>D'Netto</surname>
							<given-names>B.</given-names>
						</name>
						<name>
							<surname>Bakas</surname>
							<given-names>F.</given-names>
						</name>
						<name>
							<surname>Bordia</surname>
							<given-names>P.</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Predictors of management development effectiveness: an Australian
						perspective</article-title>
					<source>International Journal of Training and Development</source>
					<volume>12</volume>
					<issue>1</issue>
					<fpage>2</fpage>
					<lpage>23</lpage>
				</element-citation>
			</ref>
			<ref id="B26">
				<mixed-citation>Elnaga, A., &amp; Imran, A. (2013). The effect of training on
					employee performance. <italic>European Journal of Business and
						Management</italic>, 5(4), 137-147.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Elnaga</surname>
							<given-names>A.</given-names>
						</name>
						<name>
							<surname>Imran</surname>
							<given-names>A.</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<article-title>The effect of training on employee performance</article-title>
					<source>European Journal of Business and Management</source>
					<volume>5</volume>
					<issue>4</issue>
					<fpage>137</fpage>
					<lpage>147</lpage>
				</element-citation>
			</ref>
			<ref id="B27">
				<mixed-citation>Freitas, H., Oliveira, M., Saccol, A. Z., &amp; Moscarola, J.
					(2000). O método de pesquisa <italic>survey. Revista de Administração,
						35</italic>(3), 105-112.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Freitas</surname>
							<given-names>H.</given-names>
						</name>
						<name>
							<surname>Oliveira</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Saccol</surname>
							<given-names>A. Z.</given-names>
						</name>
						<name>
							<surname>Moscarola</surname>
							<given-names>J.</given-names>
						</name>
					</person-group>
					<year>2000</year>
					<article-title>O método de pesquisa <italic>survey</italic></article-title>
					<source>Revista de Administração</source>
					<volume>35</volume>
					<issue>3</issue>
					<fpage>105</fpage>
					<lpage>112</lpage>
				</element-citation>
			</ref>
			<ref id="B28">
				<mixed-citation>Galanou, E., &amp; Priporas, C. V. (2009). A model for evaluating
					the effectiveness of middle managers' training courses: Evidence from a major
					banking organization in Greece. <italic>International Journal of Training and
						Development, 13</italic>(4), 221-246.
					doi:10.1111/j.1468-2419.2009.00329.x</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Galanou</surname>
							<given-names>E.</given-names>
						</name>
						<name>
							<surname>Priporas</surname>
							<given-names>C. V.</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<article-title>A model for evaluating the effectiveness of middle managers'
						training courses: Evidence from a major banking organization in
						Greece</article-title>
					<source>International Journal of Training and Development</source>
					<volume>13</volume>
					<issue>4</issue>
					<fpage>221</fpage>
					<lpage>246</lpage>
					<pub-id pub-id-type="doi">10.1111/j.1468-2419.2009.00329.x</pub-id>
				</element-citation>
			</ref>
			<ref id="B29">
				<mixed-citation>Hair Junior, J. F., Black, W. C., Babin, B. J., Anderson, R. E.,
					&amp; Tatham, R. L. (2006). <italic>Multivariate Data Analysis</italic> (6th
					ed.). Upper Saddle River, NJ: Pearson Prentice Hall.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Hair</surname>
							<given-names>J. F.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Black</surname>
							<given-names>W. C.</given-names>
						</name>
						<name>
							<surname>Babin</surname>
							<given-names>B. J.</given-names>
						</name>
						<name>
							<surname>Anderson</surname>
							<given-names>R. E.</given-names>
						</name>
						<name>
							<surname>Tatham</surname>
							<given-names>R. L.</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<source>Multivariate Data Analysis</source>
					<edition>6th ed.</edition>
					<publisher-loc>Upper Saddle River, NJ</publisher-loc>
					<publisher-name>Pearson Prentice Hall</publisher-name>
				</element-citation>
			</ref>
			<ref id="B30">
				<mixed-citation>Hamblin, A. C. (1978). <italic>Avaliação e controle do
						treinamento</italic>. São Paulo, SP: McGraw-Hill do Brasil.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Hamblin</surname>
							<given-names>A. C.</given-names>
						</name>
					</person-group>
					<year>1978</year>
					<source>Avaliação e controle do treinamento</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>McGraw-Hill do Brasil</publisher-name>
				</element-citation>
			</ref>
			<ref id="B31">
				<mixed-citation>Kirkpatrick, D. L. (1976). Evaluation of training. In R. L. Craig,
					&amp; L. R. Bittel (Eds.), <italic>Training and development handbook</italic>
					(pp. 87-112). New York, NY: McGraw Hill.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Kirkpatrick</surname>
							<given-names>D. L.</given-names>
						</name>
					</person-group>
					<year>1976</year>
					<chapter-title>Evaluation of training</chapter-title>
					<person-group person-group-type="editor">
						<name>
							<surname>Craig</surname>
							<given-names>R. L.</given-names>
						</name>
						<name>
							<surname>Bittel</surname>
							<given-names>L. R.</given-names>
						</name>
					</person-group>
					<source>Training and development handbook</source>
					<fpage>87</fpage>
					<lpage>112</lpage>
					<publisher-loc>New York, NY</publisher-loc>
					<publisher-name>McGraw Hill</publisher-name>
				</element-citation>
			</ref>
			<ref id="B32">
				<mixed-citation>Kraiger, K.; Cavanagh, T. M. (2015). Training and personal
					development. In K., Kraiger, J., Passmoore, N. R., Santos, &amp; S., Malvezzi
					(Eds.), <italic>The Wiley Blackwell handbook of the psychology of training,
						development, and performance improvement</italic> (pp. 227-246). West
					Sussex: John Wiley &amp; Sons.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Kraiger</surname>
							<given-names>K.</given-names>
						</name>
						<name>
							<surname>Cavanagh</surname>
							<given-names>T. M.</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<chapter-title>Training and personal development</chapter-title>
					<person-group person-group-type="editor">
						<name>
							<surname>Kraiger</surname>
							<given-names>K.</given-names>
						</name>
						<name>
							<surname>Passmoore</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>Santos</surname>
							<given-names>N. R.</given-names>
						</name>
						<name>
							<surname>Malvezzi</surname>
							<given-names>S.</given-names>
						</name>
					</person-group>
					<source>The Wiley Blackwell handbook of the psychology of training, development,
						and performance improvement</source>
					<fpage>227</fpage>
					<lpage>246</lpage>
					<publisher-loc>West Sussex</publisher-loc>
					<publisher-name>John Wiley &amp; Sons</publisher-name>
				</element-citation>
			</ref>
			<ref id="B33">
				<mixed-citation>Kimura, H. (2015). Editorial. RAC - <italic>Revista de Administração
						Contemporânea, 19</italic>(3), 1-5.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Kimura</surname>
							<given-names>H.</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>Editorial</article-title>
					<source>RAC - Revista de Administração Contemporânea</source>
					<volume>19</volume>
					<issue>3</issue>
					<fpage>1</fpage>
					<lpage>5</lpage>
				</element-citation>
			</ref>
			<ref id="B34">
				<mixed-citation>Malvezzi, S. (2015). The history of training. In K., Kraiger, J.,
					Passmore, N. R., Santos, &amp; S., Malvezzi (Eds.), <italic>The Wiley Blacwell
						handbook of the psychology of training, development, and performance
						improvement</italic> (pp. 13-31). West Sussex: John Wiley &amp; Sons. </mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Malvezzi</surname>
							<given-names>S.</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<chapter-title>The history of training</chapter-title>
					<person-group person-group-type="editor">
						<name>
							<surname>Kraiger</surname>
							<given-names>K.</given-names>
						</name>
						<name>
							<surname>Passmore</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>Santos</surname>
							<given-names>N. R.</given-names>
						</name>
						<name>
							<surname>Malvezzi</surname>
							<given-names>S.</given-names>
						</name>
					</person-group>
					<source>The Wiley Blacwell handbook of the psychology of training, development,
						and performance improvement</source>
					<fpage>13</fpage>
					<lpage>31</lpage>
					<publisher-loc>West Sussex</publisher-loc>
					<publisher-name>John Wiley &amp; Sons</publisher-name>
				</element-citation>
			</ref>
			<ref id="B35">
				<mixed-citation>Mcclelland, D. C. (1973). Testing for competencies rather than for
					intelligence. <italic>American Psychologist, 28</italic>(1), 1-14.
					doi:10.1037/h0034092</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Mcclelland</surname>
							<given-names>D. C.</given-names>
						</name>
					</person-group>
					<year>1973</year>
					<article-title>Testing for competencies rather than for
						intelligence</article-title>
					<source>American Psychologist</source>
					<volume>28</volume>
					<issue>1</issue>
					<fpage>1</fpage>
					<lpage>14</lpage>
					<pub-id pub-id-type="doi">10.1037/h0034092</pub-id>
				</element-citation>
			</ref>
			<ref id="B36">
				<mixed-citation>Meneses, P. P. M., Coelho Junior, F. A., Ferreira, R. R., Paschoal,
					T., Silva Filho, A. I. (2014). A produção científica brasileira sobre a gestão
					de recursos humanos entre 2001 e 2010. <italic>Revista de Administração
						Mackenzie, 15</italic>(4), 110-134.
					doi:10.1590/1678-69712014/administracao.v15n4p110-134</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Meneses</surname>
							<given-names>P. P. M.</given-names>
						</name>
						<name>
							<surname>Coelho</surname>
							<given-names>F. A.</given-names>
							<suffix>Junior</suffix>
						</name>
						<name>
							<surname>Ferreira</surname>
							<given-names>R. R.</given-names>
						</name>
						<name>
							<surname>Paschoal</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Silva</surname>
							<given-names>A. I.</given-names>
							<suffix>Filho</suffix>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>A produção científica brasileira sobre a gestão de recursos
						humanos entre 2001 e 2010</article-title>
					<source>Revista de Administração Mackenzie</source>
					<volume>15</volume>
					<issue>4</issue>
					<fpage>110</fpage>
					<lpage>134</lpage>
					<pub-id pub-id-type="doi"
						>10.1590/1678-69712014/administracao.v15n4p110-134</pub-id>
				</element-citation>
			</ref>
			<ref id="B37">
				<mixed-citation>Noe, R. A., Clarke, A. D. M., &amp; Klein, H. J. (2014). Learning in
					the twenty-first century workplace. <italic>Annual Review of Organizational
						Psychology and Organizational Behavior</italic>, 1, 245-275.
					doi:10.1146/annurev-orgpsych-031413-091321</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Noe</surname>
							<given-names>R. A.</given-names>
						</name>
						<name>
							<surname>Clarke</surname>
							<given-names>A. D. M.</given-names>
						</name>
						<name>
							<surname>Klein</surname>
							<given-names>H. J.</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>Learning in the twenty-first century workplace</article-title>
					<source>Annual Review of Organizational Psychology and Organizational
						Behavior</source>
					<volume>1</volume>
					<fpage>245</fpage>
					<lpage>275</lpage>
					<pub-id pub-id-type="doi">10.1146/annurev-orgpsych-031413-091321</pub-id>
				</element-citation>
			</ref>
			<ref id="B38">
				<mixed-citation>Pereira, L. M. R., Loiola, E., &amp; Gondim, S. M. G. (2016).
					Aprendizagem de competências, suporte à transferência de aprendizagem e
					desempenho docente: Evidências de validação de escala e teste de relações.
						<italic>Organizações &amp; Sociedade, 23</italic>(78),
					438-459.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Pereira</surname>
							<given-names>L. M. R.</given-names>
						</name>
						<name>
							<surname>Loiola</surname>
							<given-names>E.</given-names>
						</name>
						<name>
							<surname>Gondim</surname>
							<given-names>S. M. G.</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>Aprendizagem de competências, suporte à transferência de
						aprendizagem e desempenho docente: Evidências de validação de escala e teste
						de relações</article-title>
					<source>Organizações &amp; Sociedade</source>
					<volume>23</volume>
					<issue>78</issue>
					<fpage>438</fpage>
					<lpage>459</lpage>
				</element-citation>
			</ref>
			<ref id="B39">
				<mixed-citation>Pilati, R., &amp; Abbad, G. (2005). Análise fatorial confirmatória
					da escala de impacto do treinamento no trabalho. <italic>Psicologia: Teoria e
						Pesquisa, 21</italic>(1), 43-51.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Pilati</surname>
							<given-names>R.</given-names>
						</name>
						<name>
							<surname>Abbad</surname>
							<given-names>G.</given-names>
						</name>
					</person-group>
					<year>2005</year>
					<article-title>Análise fatorial confirmatória da escala de impacto do
						treinamento no trabalho</article-title>
					<source>Psicologia: Teoria e Pesquisa</source>
					<volume>21</volume>
					<issue>1</issue>
					<fpage>43</fpage>
					<lpage>51</lpage>
				</element-citation>
			</ref>
			<ref id="B40">
				<mixed-citation>Salas, E., Tannenbaum, S. I., Kraiger, K. Smith-Jentsch, K. A.
					(2012). The science of training and development in organizations: What matters
					in practice. <italic>Sage Journals, 13</italic>, 74-101.
					doi:10.1177/1529100612436661</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Salas</surname>
							<given-names>E.</given-names>
						</name>
						<name>
							<surname>Tannenbaum</surname>
							<given-names>S. I.</given-names>
						</name>
						<name>
							<surname>Kraiger</surname>
							<given-names>K.</given-names>
						</name>
						<name>
							<surname>Smith-Jentsch</surname>
							<given-names>K. A.</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<article-title>The science of training and development in organizations: What
						matters in practice</article-title>
					<source>Sage Journals</source>
					<volume>13</volume>
					<fpage>74</fpage>
					<lpage>101</lpage>
					<pub-id pub-id-type="doi">10.1177/1529100612436661</pub-id>
				</element-citation>
			</ref>
			<ref id="B41">
				<mixed-citation>Sandberg, J. (1996). <italic>Human competence at work</italic>.
					Göteborg: BAS.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Sandberg</surname>
							<given-names>J.</given-names>
						</name>
					</person-group>
					<year>1996</year>
					<source>Human competence at work</source>
					<publisher-loc>Göteborg</publisher-loc>
					<publisher-name>BAS</publisher-name>
				</element-citation>
			</ref>
			<ref id="B42">
				<mixed-citation>Tabachnick, B. G. &amp; Fidell, L. S. (2007). <italic>Using
						Multivariate Statistics</italic> (5 th ed.). Boston, MA: Allyn and
					Bacon.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Tabachnick</surname>
							<given-names>B. G.</given-names>
						</name>
						<name>
							<surname>Fidell</surname>
							<given-names>L. S.</given-names>
						</name>
					</person-group>
					<year>2007</year>
					<source>Using Multivariate Statistics</source>
					<edition>5 th ed.</edition>
					<publisher-loc>Boston, MA</publisher-loc>
					<publisher-name>Allyn and Bacon</publisher-name>
				</element-citation>
			</ref>
			<ref id="B43">
				<mixed-citation>Warr, P. B., Bird, M. W., &amp; Rackham, N. (1970).
						<italic>Evaluating of management training</italic>. Londres, UK: Gower
					Press. </mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Warr</surname>
							<given-names>P. B.</given-names>
						</name>
						<name>
							<surname>Bird</surname>
							<given-names>M. W.</given-names>
						</name>
						<name>
							<surname>Rackham</surname>
							<given-names>N.</given-names>
						</name>
					</person-group>
					<year>1970</year>
					<source>Evaluating of management training</source>
					<publisher-loc>Londres, UK</publisher-loc>
					<publisher-name>Gower Press</publisher-name>
				</element-citation>
			</ref>
			<ref id="B44">
				<mixed-citation>Yotamo, C. J. (2014). <italic>Avaliação de impacto de treinamento no
						desempenho de servidores públicos de Sofala em Moçambique</italic> (Master's
					thesis). Universidade de Brasília, Brasília, DF, Brazil.</mixed-citation>
				<element-citation publication-type="thesis">
					<person-group person-group-type="author">
						<name>
							<surname>Yotamo</surname>
							<given-names>C. J.</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<source>Avaliação de impacto de treinamento no desempenho de servidores públicos
						de Sofala em Moçambique</source>
					<comment>Master's thesis</comment>
					<publisher-name>Universidade de Brasília</publisher-name>
					<publisher-loc>Brasília, DF, Brazil</publisher-loc>
				</element-citation>
			</ref>
		</ref-list>
	</back>
</article>
