<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article
  PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.0/JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.0" specific-use="sps-1.8" xml:lang="pt" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
	<front>
		<journal-meta>
			<journal-id journal-id-type="publisher-id">cebape</journal-id>
			<journal-title-group>
				<journal-title>Cadernos EBAPE.BR</journal-title>
				<abbrev-journal-title abbrev-type="publisher">Cad. EBAPE.BR</abbrev-journal-title>
			</journal-title-group>
			<issn pub-type="epub">1679-3951</issn>
			<publisher>
				<publisher-name>Fundação Getulio Vargas, Escola Brasileira de Administração Pública e de Empresas</publisher-name>
			</publisher>
		</journal-meta>
		<article-meta>
      <article-id pub-id-type="publisher-id">00008</article-id>
			<article-id pub-id-type="doi">10.1590/1679-395120200089</article-id>
			<article-categories>
				<subj-group subj-group-type="heading">
					<subject>Artigo</subject>
				</subj-group>
			</article-categories>
			<title-group>
				<article-title>Avaliação do impacto das universidades em suas comunidades</article-title>
				<trans-title-group xml:lang="en">
					<trans-title>Evaluation of the impact of universities on their communities</trans-title>
				</trans-title-group>
				<trans-title-group xml:lang="es">
					<trans-title>Evaluación del impacto de las universidades en sus comunidades</trans-title>
				</trans-title-group>
			</title-group>
			<contrib-group>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">0000-0002-8420-5710</contrib-id>
					<name>
						<surname>CURI JUNIOR</surname>
						<given-names>WAGNER RAGI CURI</given-names>
					</name>
					<xref ref-type="aff" rid="aff1">1</xref>
				</contrib>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">0000-0002-5610-4699</contrib-id>
					<name>
						<surname>WOOD JUNIOR</surname>
						<given-names>THOMAZ</given-names>
					</name>
					<xref ref-type="aff" rid="aff2">2</xref>
				</contrib>
			</contrib-group>
			<aff id="aff1">
				<label>1</label>
				<institution content-type="original"> UNIVERSIDADE FEDERAL DE OURO PRETO(UFOP) / INSTITUTO DE CIÊNCIAS EXATAS E APLICADAS, JOÃO MONLEVADE - MG, BRASIL</institution>
				<institution content-type="orgname">UNIVERSIDADE FEDERAL DE OURO PRETO</institution>
				<institution content-type="orgdiv1">INSTITUTO DE CIÊNCIAS EXATAS E APLICADAS</institution>
				<addr-line>
					<named-content content-type="city">JOÃO MONLEVADE</named-content>
					<named-content content-type="state">MG</named-content>
				</addr-line>
				<country country="BR">Brazil</country>
				<email>wagner@ufop.edu.br</email>
			</aff>
			<aff id="aff2">
				<label>2</label>
				<institution content-type="original"> FUNDAÇÃO GETULIO VARGAS (FGV EAESP) / ESCOLA DE ADMINISTRAÇÃO DE EMPRESAS DE SÃO PAULO, SÃO PAULO - SP, BRASIL</institution>
				<institution content-type="orgname">FUNDAÇÃO GETULIO VARGAS</institution>
				<institution content-type="orgdiv1">ESCOLA DE ADMINISTRAÇÃO DE EMPRESAS DE SÃO PAULO</institution>
				<addr-line>
					<named-content content-type="city">SÃO PAULO</named-content>
					<named-content content-type="state">SP</named-content>
				</addr-line>
				<country country="BR">Brazil</country>
				<email>thomaz.wood@fgv.br</email>
			</aff>
			<author-notes>
				<fn fn-type="other" id="fn1">
					<p>Wagner Ragi Curi Filho - Doutor em Administração pela Fundação Getulio Vargas (FGV EAESP); Professor Adjunto do Departamento de Engenharia de Produção da Universidade Federal de Ouro Preto (UFOP). E-mail: wagner@ufop.edu.br</p>
				</fn>
				<fn fn-type="other" id="fn2">
					<p>Thomaz Wood Junior - Doutor em Administração pela Fundação Getulio Vargas (FGV EAESP); Professor Titular da Fundação Getulio Vargas (FGV EAESP). E-mail: thomaz.wood@fgv.br</p>
				</fn>
			</author-notes>
      <!--pub-date date-type="pub" publication-format="electronic">
        <day>04</day>
        <month>05</month>
        <year>2021</year>
      </pub-date>
      <pub-date date-type="collection" publication-format="electronic"-->
        <pub-date pub-type="epub">
				<season>Jul-Sep</season>
				<year>2021</year>
			</pub-date>
			<volume>19</volume>
			<issue>3</issue>
			<fpage>496</fpage>
			<lpage>509</lpage>
			<history>
				<date date-type="received">
					<day>22</day>
					<month>04</month>
					<year>2020</year>
				</date>
				<date date-type="accepted">
					<day>20</day>
					<month>10</month>
					<year>2020</year>
				</date>
			</history>
			<permissions>
				<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/" xml:lang="pt">
					<license-p>Este é um artigo publicado em acesso aberto sob uma licença Creative Commons</license-p>
				</license>
			</permissions>
			<abstract>
				<title>Resumo</title>
				<p>Este artigo explora a questão do impacto das universidades sobre as comunidades nas quais estão instaladas. A partir de uma pesquisa bibliográfica, foram identificados e sistematizados três tipos de impacto: socioeconômico; científico-tecnológico e na cultura e imagem da região. Esses três tipos de impacto foram integrados em um modelo conceitual que poderá ser utilizado como base para um modelo prático voltado para avaliar o impacto de uma universidade sobre a região na qual se encontra. Além deles, o artigo também sugere passos para a implantação do modelo de avaliação de impacto. O texto contribui para o avanço dos estudos sobre o papel das universidades e pode ser útil para os gestores universitários na organização de projetos de avaliação de impacto.</p>
			</abstract>
			<trans-abstract xml:lang="en">
				<title>Abstract</title>
				<p>This article investigates the impact of universities on the communities in which they are located. Based on bibliographical research, three types of impacts were identified and systematized: socioeconomic, scientific and technological, and on the culture and image of the region. These three types of impact have been integrated into a conceptual model that can be used as a basis for a practical model to be employed to assess the impact of a university on the region in which it is located. In addition to the three types of impact, the article also suggests steps for implementing the impact assessment model. This research contributes to the advancement of studies on the universities’ role and can help university managers evaluate its impact on the community.</p>
			</trans-abstract>
			<trans-abstract xml:lang="es">
				<title>Resumen</title>
				<p>Este artículo explora el tema del impacto de las universidades en las comunidades en las que se encuentran. A partir de una investigación bibliográfica, se identificaron y sistematizaron tres tipos de impacto: socioeconómico; científico-tecnológico y en la cultura y la imagen de la región. Estos tres tipos de impacto se han integrado en un modelo conceptual que se puede utilizar como base para un modelo práctico que se empleará para evaluar el impacto de una universidad en la región en la que se encuentra. Además de los tres tipos de impacto, el artículo también sugiere pasos para la implementación del modelo de evaluación de impacto. El texto contribuye al avance de los estudios sobre el papel de las universidades y puede ser útil para los administradores universitarios en la organización de proyectos prácticos de evaluación de impacto</p>
			</trans-abstract>
			<kwd-group xml:lang="pt">
				<title>Palavras-chave:</title>
				<kwd>Impacto de uma universidade na comunidade</kwd>
				<kwd>Impacto socioeconômico</kwd>
				<kwd>Impacto científico-tecnológico</kwd>
				<kwd>Impacto na cultura e imagem da região</kwd>
			</kwd-group>
			<kwd-group xml:lang="en">
				<title>Keywords:</title>
				<kwd>University’s impact on the community</kwd>
				<kwd>Socioeconomic impact</kwd>
				<kwd>Scientific and technological impact</kwd>
				<kwd>Culture and image of the region</kwd>
			</kwd-group>
			<kwd-group xml:lang="es">
				<title>Palabras clave:</title>
				<kwd>Impacto de una universidad en la comunidad</kwd>
				<kwd>Impacto socioeconómico</kwd>
				<kwd>Impacto científico-tecnológico</kwd>
				<kwd>Impacto en la cultura e imagen de la región</kwd>
			</kwd-group>
			<counts>
				<fig-count count="6"/>
				<table-count count="0"/>
				<equation-count count="0"/>
				<ref-count count="77"/>
				<page-count count="14"/>
			</counts>
		</article-meta>
	</front>
	<body>
		<sec sec-type="intro">
			<title>INTRODUÇÃO</title>
			<p>Friedrich von Humboldt (1767-1835) acreditava que a base e fim de qualquer sistema educacional era a formação de cidadãos, e defendia que somente a autonomia permitiria às universidades atingirem seus mais altos propósitos (<xref ref-type="bibr" rid="B63">Rohe, 2017</xref>). Vannevar Bush (1890-1974), no texto seminal ‘Science, The Endless Frontier’ (Bush, 1945) argumentou que o progresso científico é resultado da interação livre de intelectos livres: cientistas trabalhando em temas de sua escolha, definidos a partir de sua curiosidade para explorar o desconhecido e avançar as fronteiras da ciência.</p>
			<p>Esses dois princípios - autonomia universitária e liberdade criativa - fundamentaram a institucionalização de sistemas de educação superior em muitos países, e foram validados pelo gigantesco progresso científico experimentado no século XX. No final do século XX, a ciência era um campo institucionalizado, globalizado e superespecializado. E a evolução continuava (e continua) em novas áreas de conhecimento e em domínios transdisciplinares. Com o desenvolvimento da ciência, cresceram também as demandas por investimentos e os orçamentos de pesquisa.</p>
			<p>No entanto, a expansão começou a enfrentar limites orçamentários. A liberdade para criar começou a ser contraposta a necessidades sociais e econômicas, imperativos já antecipados por <xref ref-type="bibr" rid="B10">Bush (1945</xref>). Novas políticas de estado começaram a privilegiar uma visão de ciência estratégica, orientada para o fomento da competitividade (<xref ref-type="bibr" rid="B24">Gibbons, Limoges &amp; Scott, 2011</xref>). Com isso, o pêndulo entre a defesa da autonomia acadêmica e o imperativo de servir à sociedade está se movendo para a segunda base (<xref ref-type="bibr" rid="B63">Rohe, 2017</xref>). Este artigo se concentra em um aspecto relevante desse movimento: a questão do impacto das universidades sobre as comunidades nas quais se encontram.</p>
			<p>De fato, as universidades podem contribuir para as comunidades que as hospedam (<xref ref-type="bibr" rid="B68">Silva, 2006</xref>). Elas podem gerar empregos para profissionais da região e proporcionar oportunidades de estudo para jovens locais (por exemplo, <xref ref-type="bibr" rid="B16">Drucker &amp; Goldstein, 2007</xref>; <xref ref-type="bibr" rid="B34">Johansen &amp; Arano, 2016</xref>). Seus projetos de pesquisa podem promover o desenvolvimento local. As universidades podem também fomentar a cultura e promover a imagem da região na qual estão situadas (<xref ref-type="bibr" rid="B4">Arbo &amp; Benneworth, 2007</xref>; <xref ref-type="bibr" rid="B40">Leten, Landoni &amp; Looy, 2014</xref>).</p>
			<p>Por outro lado, vem crescendo o questionamento sobre o papel das universidades na sociedade (<xref ref-type="bibr" rid="B40">Leten, Landoni &amp; Looy, 2014</xref>; <xref ref-type="bibr" rid="B53">Musselin, 2013</xref>; <xref ref-type="bibr" rid="B75">Vieira, Bellen &amp; Fialho, 2006</xref>; <xref ref-type="bibr" rid="B77">Weber, 2010</xref>), levando algumas delas a buscar melhor comunicar os benefícios que geram para suas comunidades e para a sociedade em geral (<xref ref-type="bibr" rid="B39">Lendel, 2015</xref>; <xref ref-type="bibr" rid="B44">Marcovitch, 2019</xref>; <xref ref-type="bibr" rid="B45">Martin, 2012</xref>; <xref ref-type="bibr" rid="B47">May &amp; Perry, 2006</xref>).</p>
			<p>No Brasil, esse fenômeno ganha especial interesse no âmbito das instituições públicas de ensino superior. Essas instituições sofreram notável expansão nas últimas décadas, porém continuam sob pressão para aumento e melhoria dos serviços prestados, em ensino, pesquisa e extensão, ao mesmo tempo em que sofrem pressões orçamentárias (<xref ref-type="bibr" rid="B2">Alves et al., 2015</xref>; <xref ref-type="bibr" rid="B5">Audy, 2017</xref>; <xref ref-type="bibr" rid="B72">Tarocco, Sesso, Esteves &amp; Kureski, 2014</xref>; <xref ref-type="bibr" rid="B76">Wanzinack &amp; Signorelli, 2014</xref>).</p>
			<p>Deve-se destacar o papel dos <italic>rankings</italic> universitários que influenciam o comportamento das instituições. Eles são utilizados como instrumentos para uma análise sobre as variadas possibilidades de impacto de uma universidade na comunidade (<xref ref-type="bibr" rid="B44">Marcovitch, 2019</xref>).</p>
			<p>Tal contexto levou ao surgimento de modelos para avaliação do impacto de instituições de ensino e pesquisa sobre suas comunidades (European Foundation for Management Development [EFMD], <xref ref-type="bibr" rid="B19">2015</xref>). Entretanto, a maioria dos modelos criados parece se concentrar especialmente em dois aspectos: o impacto econômico e a capacidade de contribuição para o desenvolvimento tecnológico (<xref ref-type="bibr" rid="B36">Kantor &amp; Whalley, 2014</xref>; <xref ref-type="bibr" rid="B66">Scandura, 2016</xref>; <xref ref-type="bibr" rid="B67">Sen, 2011</xref>).</p>
			<p>Diante disso e da provável inexistência de modelos integrados para avaliação do impacto de universidades, este artigo tem como objetivo contribuir para o desenvolvimento de um modelo conceitual amplo que possa ser utilizado como base para a construção de um modelo prático a ser aplicado à avaliação do impacto de uma universidade em sua comunidade. Para isso, foi realizada uma revisão bibliográfica, a qual identificou três tipos de impacto: socioeconômico; científico-tecnológico; e cultura e atratividade da região na qual a universidade está inserida. Para cada tipo de impacto foram definidos meios de impacto e sugeridos indicadores.</p>
			<p>Este artigo traz contribuições para a ciência e para a prática. O estudo contribui para os estudos sobre o novo papel das universidades (<xref ref-type="bibr" rid="B31">Huggins, Johnston &amp; Steffenson, 2008</xref>; <xref ref-type="bibr" rid="B49">Mccowan, 2016</xref>; <xref ref-type="bibr" rid="B69">Sleutjes, 1999</xref>) e avança a modelagem do impacto social das universidades, ao integrar as três dimensões encontradas na literatura, as quais haviam sido exploradas individualmente em trabalhos anteriores (<xref ref-type="bibr" rid="B27">Guerrero, Cunningham &amp; Urbano, 2015</xref>; <xref ref-type="bibr" rid="B36">Kantor &amp; Whalley, 2014</xref>; <xref ref-type="bibr" rid="B60">Popescu &amp; Corbos, 2012</xref>). Além disso, modelos desenvolvidos a partir do modelo proposto poderão ser utilizados, com adaptações às características de cada universidade e de cada região, por gestores universitários interessados em avaliar o impacto de suas instituições sobre as comunidades nas quais estão instaladas. É relevante frisar que este trabalho propõe um modelo preliminar que deve ser aprimorado e testado, de forma a subsidiar a construção de um modelo prático para aplicação à avaliação do impacto de uma universidade em sua comunidade.</p>
			<p>Além dessa introdução, este trabalho conta com mais quatro seções. A segunda seção apresenta a pesquisa bibliográfica realizada para fundamentar o desenvolvimento do modelo. A terceira seção sistematiza os três tipos de impacto identificados na literatura e os integra no modelo de avaliação de impacto. A quarta seção propõe um processo de operacionalização do modelo de avaliação de impacto. A quinta seção apresenta comentários, indicando direções para futuros desenvolvimentos do modelo e futuras pesquisas.</p>
		</sec>
		<sec sec-type="methods">
			<title>MÉTODOS</title>
			<p>Diante do objetivo de desenvolver um modelo conceitual (<xref ref-type="bibr" rid="B13">Crossan, Lane &amp; White, 1999</xref>) para a avaliação do impacto de uma universidade na comunidade, foi realizada uma revisão bibliográfica (<xref ref-type="bibr" rid="B48">Mayring, 2004</xref>). Inicialmente, buscou-se no trabalho de <xref ref-type="bibr" rid="B42">Mainardes, Alves e Raposo (2010</xref>) uma resposta para a questão de quem seriam os <italic>stakeholders</italic> de uma universidade. O autor sugere uma lista de 21 diferentes tipos de <italic>stakeholders</italic>, sendo alguns específicos, tais como estudantes e professores, e outros mais genéricos, como a comunidade da região na qual a universidade está instalada. Considerando que as universidades podem impactar <italic>stakeholders</italic> tão distintos, buscaram-se artigos sobre os tipos de impactos que uma universidade pode gerar na comunidade local.</p>
			<p>A coleta foi realizada em bases de artigos, tais como EBSCO, Scielo e Google Acadêmico, a partir das seguintes palavras-chave (em português e inglês): universidade, impacto e ambiente. Foram localizados 676 artigos, com data de publicação entre 1998 e 2018.</p>
			<p>A partir dessa base, foi aplicado um filtro, de forma a selecionar textos que tratassem de impactos mais gerais, tais como: impacto nas indústrias, impacto na economia ou impacto na sustentabilidade da região. A seleção foi feita com base na leitura dos resumos e, quando isso não se mostrava suficiente, com base na leitura dos artigos completos. Resultaram desse processo 66 artigos.</p>
			<p>Os artigos foram, então, integralmente analisados. Avaliando os objetivos desses artigos, emergiram três tipos de impacto, a partir dos quais os textos foram organizados. A <xref ref-type="fig" rid="f1">Figura 1</xref> representa os tipos de impacto encontrados. Além dos objetivos, foram identificadas, para cada artigo analisado integralmente, as variáveis que foram tratadas para medir o impacto da universidade. A elaboração do modelo proposto considerou, em sua estrutura, as variáveis identificadas nos artigos de forma a desenvolver um modelo de caráter integrador.</p>
			<p>
				<fig id="f1">
					<label>Figura 1</label>
					<caption>
						<title>Tipos de impacto</title>
					</caption>
					<graphic xlink:href="1679-3951-cebape-19-03-496-gf1.jpg"/>
					<attrib>Fonte: Elaborada pelos autores.</attrib>
				</fig>
			</p>
			<p>O primeiro grupo de artigos analisados compreende 26 textos que tratam do impacto socioeconômico, seja por demandas da universidade (<italic>inputs)</italic> seja por efeitos da presença da universidade (<italic>outputs</italic>). O segundo grupo compreende 29 textos que tratam do impacto científico-tecnológico, com textos que tratam da relação entre universidade, empresa e governo; trabalhos que tratam do desenvolvimento de tecnologias comercializáveis; e estudos que abordam o papel das universidades na promoção de novos negócios. O terceiro grupo compreende 11 textos que tratam do impacto na cultura e imagem da região. Neste grupo estão os trabalhos que discutem a relação da universidade com os aspectos culturais do local ou que apresentam análises sobre como a universidade contribui para a formação da imagem da região.</p>
			<p>Cabe observar que os três tipos de impacto identificados possuem aspectos que se sobrepõem. Por exemplo, alguns projetos de pesquisa podem resultar simultaneamente em impacto científico-tecnológico, socioeconômico e sobre a imagem da região. Portanto, alguns indicadores podem ser analisados, ora como parte de um tipo de impacto, ora como parte de outro tipo de impacto. Entretanto, para facilitar a identificação e análise, os indicadores que podem resultar em mais de um tipo de impacto foram inseridos, no modelo conceitual, apenas no tipo de impacto considerado principal.</p>
			<p>A revisão bibliográfica permitiu também identificar, para cada tipo de impacto, os respectivos meios de impacto, ou seja, os diversos canais ou formas pelos quais a universidade gera aquele tipo de impacto.</p>
		</sec>
		<sec>
			<title>DESENVOLVIMENTO DO MODELO CONCEITUAL</title>
			<sec>
				<title>Impacto socioeconômico</title>
				<p>A análise do referencial teórico sobre impacto socioeconômico revelou dois subgrupos de artigos. O primeiro subgrupo de artigos foca os <italic>outputs</italic> de uma universidade (<xref ref-type="bibr" rid="B12">Cox &amp; Taylor, 2006</xref>; <xref ref-type="bibr" rid="B25">Goldstein &amp; Drucker, 2006</xref>; <xref ref-type="bibr" rid="B37">Kureski &amp; Rolim, 2009</xref>; <xref ref-type="bibr" rid="B39">Lendel, 2015</xref>; <xref ref-type="bibr" rid="B70">Steinaker, 2005</xref>). Os <italic>outputs</italic> incluem geração de empregos, dispêndio financeiro, projetos de extensão e outras atividades.</p>
				<p>Nesse subgrupo foram encontrados diversos artigos que utilizam a metodologia insumo-produto para comparar os gastos proporcionais da universidade em relação à economia da região estudada (<xref ref-type="bibr" rid="B55">Pastor, Pérez &amp; Guevara, 2012</xref>; <xref ref-type="bibr" rid="B72">Tarocco et al., 2014</xref>). O objetivo é identificar interdependências entre diferentes setores da economia (<xref ref-type="bibr" rid="B50">Miller &amp; Blair, 2009</xref>). Algumas universidades empregaram essa metodologia para avaliar seus respectivos impactos, como, por exemplo, a Universidade de Vancouver (<xref ref-type="bibr" rid="B64">Roslyn, 2013</xref>), a Universidade de Atenas (<xref ref-type="bibr" rid="B56">Payne, 2016</xref>) e a Universidade do Pacífico (<xref ref-type="bibr" rid="B59">Pogue, 2010</xref>).</p>
				<p>O segundo grupo de artigos foca os <italic>inputs</italic> de uma universidade (<xref ref-type="bibr" rid="B12">Cox &amp; Taylor, 2006</xref>; <xref ref-type="bibr" rid="B37">Kureski &amp; Rolim, 2009</xref>; <xref ref-type="bibr" rid="B39">Lendel, 2015</xref>). Os <italic>inputs</italic> incluem negócios diretos com a universidade, demandas por serviços públicos e demandas oriundas de políticas públicas (<xref ref-type="bibr" rid="B74">Verger, Curran &amp; Parcerisa, 2015</xref>).</p>
				<p>Cabe ressaltar que a avaliação do impacto socioeconômico de uma universidade deve considerar o contexto no qual a instituição está situada, pois a capacidade de influência da universidade depende das características da região na qual ela se localiza (<xref ref-type="bibr" rid="B30">Huggins &amp; Johnston, 2009</xref>; <xref ref-type="bibr" rid="B38">Lazzeroni &amp; Piccaluga, 2015</xref>; <xref ref-type="bibr" rid="B46">Martin, 1998</xref>; <xref ref-type="bibr" rid="B55">Pastor et al., 2012</xref>). Por exemplo, universidades inseridas em grandes centros urbanos podem ter seu impacto socioeconômico diluído, enquanto que as universidades inseridas em pequenas cidades podem ter seu impacto socioeconômico ressaltado.</p>
				<p>A <xref ref-type="fig" rid="f2">Figura 2</xref> sistematiza os meios possíveis de impacto socioeconômico de uma universidade, com respectivos indicadores, para a dimensão do impacto socioeconômico. Cada instituição interessada em avaliar seu impacto pode prover maior ou menor ênfase para cada meio de impacto, dependendo do objetivo da avaliação desejada.</p>
				<p>
					<fig id="f2">
						<label>Figura 2</label>
						<caption>
							<title>Impacto socioeconômico de uma universidade</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf2.jpg"/>
						<attrib>Fonte: Elaborada pelos autores.</attrib>
					</fig>
				</p>
			</sec>
			<sec>
				<title>Impacto científico-tecnológico</title>
				<p>A análise do referencial teórico sobre impacto científico-tecnológico revelou um corpo teórico que trata das relações entre universidade e indústria. Pode-se classificar tal corpo teórico em três subgrupos. O primeiro subgrupo contém trabalhos focando a relação entre universidade, empresa e governo (denominada tripla hélice). Seus autores argumentam que o impacto da universidade se dará a partir da promoção da inovação por meio das ações integradas desses três agentes (<xref ref-type="bibr" rid="B15">Doin &amp; Rosa, 2019</xref>; <xref ref-type="bibr" rid="B18">Etzkowitz &amp; Leydesdorff, 2000</xref>; <xref ref-type="bibr" rid="B26">Gomes &amp; Pereira, 2015</xref>; <xref ref-type="bibr" rid="B32">Ipiranga, Freitas &amp; Paiva, 2010</xref>; <xref ref-type="bibr" rid="B35">Johnson, 2008</xref>; <xref ref-type="bibr" rid="B41">Leydesdorff &amp; Meyer, 2003</xref>; <xref ref-type="bibr" rid="B71">Sutz, 2000</xref>;).</p>
				<p>O segundo subgrupo contém trabalhos que defendem uma agenda de pesquisa direcionada ao desenvolvimento de tecnologias comercializáveis, focando a relação direta entre universidade e indústria (<xref ref-type="bibr" rid="B8">Bramwell &amp; Wolfe, 2008</xref>; <xref ref-type="bibr" rid="B14">Curi, Daraio &amp; Llerena, 2012</xref>; <xref ref-type="bibr" rid="B20">Fernandes et al., 2010</xref>; <xref ref-type="bibr" rid="B21">Fisher, Atkinson-Grosjean &amp; House, 2001</xref>; <xref ref-type="bibr" rid="B66">Scandura, 2016</xref>) e aponta áreas de cooperação para tornar a relação entre universidade e indústria mais efetiva (<xref ref-type="bibr" rid="B3">Anderson, Daim &amp; Lavoie, 2007</xref>; <xref ref-type="bibr" rid="B17">Barnes &amp; Erkut, 2002</xref>).</p>
				<p>O terceiro subgrupo contém trabalhos que tratam do papel da universidade na promoção da inovação e no desenvolvimento de novos negócios. Esses trabalhos focam a capacidade de as universidades fomentarem a inovação em suas regiões (<xref ref-type="bibr" rid="B11">Cowan &amp; Zinovyeva, 2013</xref>); e o engajamento de acadêmicos no desenvolvimento de novos empreendimentos (<xref ref-type="bibr" rid="B52">Muscio, Quaglione &amp; Ramaciotti, 2016</xref>; <xref ref-type="bibr" rid="B62">Rasmussen &amp; Borch, 2010</xref>). Alguns autores focam especificamente na contribuição das universidades para a formação de <italic>clusters</italic> (<xref ref-type="bibr" rid="B22">Gerolamo et al., 2008</xref>; <xref ref-type="bibr" rid="B47">May &amp; Perry, 2006</xref>).</p>
				<p>A <xref ref-type="fig" rid="f3">Figura 3</xref> sistematiza os meios de impacto possíveis de uma universidade, com respectivos indicadores, para a dimensão do impacto científico-tecnológico. Como no caso anterior, cada instituição pode prover maior ou menor ênfase para cada meio de impacto<italic>,</italic> dependendo do objetivo da avaliação desejada.</p>
				<p>
					<fig id="f3">
						<label>Figura 3</label>
						<caption>
							<title>Impacto científico-tecnológico de uma universidade</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf3.jpg"/>
						<attrib>Fonte: Elaborada pelos autores.</attrib>
					</fig>
				</p>
			</sec>
			<sec>
				<title>Impacto na cultura e na imagem da região</title>
				<p>A análise do referencial teórico sobre impacto na cultura e na imagem da região revelou um corpo teórico que pode ser classificado em dois subgrupos. O primeiro subgrupo de artigos trata do impacto da universidade nas artes e sua participação em eventos culturais locais. Estes trabalhos analisam a possibilidade de os eventos artísticos e culturais promoverem desenvolvimento econômico (<xref ref-type="bibr" rid="B28">Guetzkow, 2002</xref>; <xref ref-type="bibr" rid="B73">Wyk, Saayman &amp; Rossouw, 2013</xref>). Para <xref ref-type="bibr" rid="B28">Guetzkow (2002)</xref>, por exemplo, destaca-se que, do ponto de vista individual, um evento artístico pode gerar empregos, além de estimular o autoconhecimento, enquanto, do ponto de vista de uma comunidade, pode contribuir para a economia e para a imagem da comunidade. <xref ref-type="bibr" rid="B60">Popescu e Corbos (2012</xref>), por sua vez, apresentam uma análise de como comunidades podem se estruturar a partir de eventos artísticos e culturais, apoiados por universidades.</p>
				<p>O segundo subgrupo de artigos pode ser caracterizado pelo debate sobre o papel da universidade no fomento de políticas e manifestações culturais. <xref ref-type="bibr" rid="B4">Arbo e Benneworth (2007</xref>), por exemplo, comentam o papel integrador que essas instituições podem ter sobre políticas locais. Complementarmente, <xref ref-type="bibr" rid="B1">Alshuwaikhat e Abubakar (2008</xref>), <xref ref-type="bibr" rid="B29">Hubbard (2008</xref>), <xref ref-type="bibr" rid="B33">Jain e Pant (2010</xref>) e <xref ref-type="bibr" rid="B65">Salmeron (2001</xref>) ressaltam a influência que uma universidade pode exercer sobre determinadas características culturais e da imagem de uma comunidade.</p>
				<p>A <xref ref-type="fig" rid="f4">Figura 4</xref> sistematiza os meios de impacto possíveis de uma universidade, com respectivos indicadores, para a dimensão do impacto na cultura e imagem. Como nos casos anteriores, cada instituição pode prover maior ou menor ênfase para cada meio de impacto, dependendo do objetivo da avaliação desejada.</p>
				<p>
					<fig id="f4">
						<label>Figura 4</label>
						<caption>
							<title>Impacto de uma universidade na cultura e na imagem da região</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf4.jpg"/>
						<attrib>Fonte: Elaborada pelos autores.</attrib>
					</fig>
				</p>
			</sec>
			<sec>
				<title>Modelo conceitual integrado de avaliação do impacto</title>
				<p>A integração dos três modelos anteriores resulta no modelo conceitual de avaliação de impacto da universidade na região na qual se localiza. A <xref ref-type="fig" rid="f5">Figura 5</xref> representa esse modelo. Cabe uma vez mais notar que o modelo deve ser visto como uma matriz geral, que poderá ser utilizada para o desenvolvimento de um modelo de aplicação prática, a ser adaptado para cada universidade e cada comunidade. Da mesma forma, poder-se-á trabalhar na adequação dos indicadores a serem utilizados em cada caso.</p>
				<p>
					<fig id="f5">
						<label>Figura 5</label>
						<caption>
							<title>Modelo conceitual de avaliação de impacto: tipos e meios de impacto</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf5.jpg"/>
						<attrib>Fonte: Elaborada pelos autores.</attrib>
					</fig>
				</p>
			</sec>
			<sec>
				<title>Contribuições brasileiras ao debate</title>
				<p>Neste ponto do texto, é conveniente destacar algumas contribuições brasileiras ao tema do impacto das universidades em suas comunidades. No Brasil, o tema do impacto social das universidades pode ser relacionado a discussões sobre: 1. indicadores de desempenho acadêmico; 2. os sistemas de avaliação; e 3. os <italic>rankings</italic> universitários. De forma mais ampla, pode ser igualmente relacionado a reflexões sobre autonomia universitária e à relação entre universidade e sociedade. Sem a pretensão de retratar ou sumarizar o rico debate sobre essas questões que acontecem no país, são destacados a seguir alguns autores e trabalhos mais diretamente relacionados ao presente estudo.</p>
				<p>Uma primeira questão, que caracteriza as reflexões brasileiras e apresenta direta relação com este artigo é a questão dos <italic>outputs,</italic> ou seja, os efeitos que a universidade gera sobre a comunidade. A identificação de <italic>outputs</italic> pode ser encontrada em trabalhos que se concentram no debate sobre indicadores utilizados na elaboração de <italic>rankings</italic> universitários e em trabalhos cujo alvo é a questão da avaliação de programas de pós-graduação. Por exemplo, <xref ref-type="bibr" rid="B44">Marcovitch e Axel-Berg (2019</xref>) observam a necessidade de utilizar indicadores quantitativos e qualitativos, e alertam que as instituições devem se preocupar com o eventual mau uso dos indicadores na “<italic>criação de políticas, avaliações, rankings e decisões de promoção e contratação de docentes”</italic> (<xref ref-type="bibr" rid="B43">Marcovitch &amp; Axel-Berg, 2019</xref>, p. 128).</p>
				<p>
					<xref ref-type="bibr" rid="B61">Ranieri (2019</xref>), por sua vez, indica especificamente os temas que devem ser considerados, ao se buscar os <italic>outputs</italic> de uma universidade: pesquisa e produção acadêmica; impacto social da produção acadêmica; impacto das atividades de extensão; e impacto profissional dos egressos. De forma similar, <xref ref-type="bibr" rid="B58">Planeta et al. (2019</xref>) indicam as seguintes dimensões para medição do impacto social: econômica/financeira; socioeducacional; inovação e empreendedorismo; intelectual, cultura e bem-estar; e reputação. De fato, o modelo proposto pelos autores aproxima-se daquele proposto no presente estudo. A tendência de valorização do impacto social pode também ser constatada por meio da observação da evolução do sistema da Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) do Brasil (<xref ref-type="bibr" rid="B7">Barata, 2019</xref>; <xref ref-type="bibr" rid="B23">Gheno et al., 2019</xref>; <xref ref-type="bibr" rid="B51">Ministério da Educação, 2018</xref>).</p>
				<p>Finalmente, vale ressaltar o debate sobre a transformação do conceito de autonomia universitária encontrado em <xref ref-type="bibr" rid="B54">Muzy e Drugowich (2018</xref>) e <xref ref-type="bibr" rid="B6">Balbachevsky e Kohtamäki (2019</xref>). Apesar de ter havido um aumento do controle externo, as universidades têm autonomia para tomar decisões sobre muitos aspectos da vida acadêmica. Por outro lado, o que se produz na universidade deve responder às demandas sociais. Por isso, mecanismos externos e internos de avaliação devem ser coerentes entre si. Dessa forma, as universidades devem utilizar os mecanismos externos e internos como instrumentos de gestão para que se amplie o impacto positivo na comunidade.</p>
			</sec>
		</sec>
		<sec>
			<title>PROCESSO PARA OPERACIONALIZAÇÃO DA AVALIAÇÃO DE IMPACTO</title>
			<p>Além do modelo de avaliação de impacto, propõe-se, de forma complementar, um processo para operacionalização da avaliação de impacto. O objetivo do processo é facilitar a implantação, visando maximizar os impactos positivos e minimizar eventuais impactos negativos da universidade em sua comunidade local. Esse modelo deve ser implantado em seis fases, conforme indicado na <xref ref-type="fig" rid="f6">Figura 6</xref>.</p>
			<p>
				<fig id="f6">
					<label>Figura 6</label>
					<caption>
						<title>Modelo de operacionalização da avaliação de impacto: fases e ações principais</title>
					</caption>
					<graphic xlink:href="1679-3951-cebape-19-03-496-gf6.jpg"/>
					<attrib>Fonte: Elaborada pelos autores.</attrib>
				</fig>
			</p>
			<p>A primeira fase destina-se principalmente à definição dos objetivos e do escopo do projeto. Os objetivos podem variar significativamente conforme o contexto e a universidade. Por exemplo, uma instituição tradicional e já estabelecida poderá estabelecer como objetivo principal aumentar seu impacto cultural sobre a comunidade na qual está localizada, contribuindo para o fortalecimento da imagem da região; outra instituição, jovem e em processo de expansão, poderá definir como meta aumentar seu impacto científico-tecnológico, contribuindo assim para consolidar o nascente parque industrial da região na qual foi instalada; e uma terceira instituição, enfrentando dificuldades de financiamento, poderá ter como foco demonstrar seu impacto em todas as dimensões diante de seus públicos de interesse, de forma a melhorar relacionamentos e facilitar a obtenção de recursos para pesquisas e outras atividades.</p>
			<p>A primeira fase destina-se também a definir o alcance interno da avaliação, a qual poderá restringir-se a uma única unidade (por exemplo, uma faculdade), um conjunto de faculdades ou toda a universidade.</p>
			<p>A primeira fase destina-se, finalmente, a definir a área que será objeto da avaliação. Algumas instituições podem restringir seu foco à cidade na qual estão instaladas; enquanto outras podem ampliar seu foco para conjuntos de cidades, um estado, ou ainda uma região inteira.</p>
			<p>A segunda fase destina-se a reconstruir o modelo de acordo com as definições da primeira fase. Recomenda-se que a reconstrução seja feita de “cima para baixo”, ou seja, primeiro, deve-se definir os tipos de impacto a serem avaliados: socioeconômico e/ou científico-tecnológico e/ou na cultura e na imagem da região; em seguida, deve-se definir os meios de impacto, eliminando eventualmente alguns daqueles listados na <xref ref-type="fig" rid="f5">Figura 5</xref> e acrescentando eventualmente outros; finalmente, deve-se rever os indicadores para os meios de impacto escolhidos, eliminando alguns daqueles listados nas <xref ref-type="fig" rid="f2">Figuras 2</xref>, <xref ref-type="fig" rid="f3">3</xref> e <xref ref-type="fig" rid="f4">4</xref>, e acrescentando outros. Recomenda-se também escolher, nessa fase, os meios de impacto e indicadores prioritários, sendo considerados como tal aqueles mais diretamente alinhados aos objetivos da avaliação.</p>
			<p>A terceira fase tem caráter técnico e operacional. Destina-se a definir como será feita a coleta, possivelmente combinando obtenção de dados primários e secundários, e executando-a. Deve-se observar que parte dos dados e informações a serem coletados pode ser de fácil acesso, constando de documentos já existentes, enquanto outra parte exigirá um esforço específico de obtenção. Além disso, pode-se supor que haverá coleta tanto de dados quantitativos quanto de informações qualitativas.</p>
			<p>A quarta fase compreende a compilação e análise dos dados e informações obtidos na fase anterior. Além de preparar quadros demonstrativos dos impactos, deve-se nessa fase comparar resultados (por exemplo, com referências externas, e/ou entre unidades, e/ou com resultados anteriores). Deve-se também identificar impactos positivos e negativos da universidade sobre a comunidade local.</p>
			<p>A quinta fase toma como base a fase anterior. A partir dos impactos positivos, devem-se identificar ações para sua conservação e, idealmente, maximizá-los. A partir dos impactos negativos encontrados, devem-se identificar ações para minimizá-los e, idealmente, suprimi-los.</p>
			<p>A sexta fase corresponde à implementação das ações definidas na quinta fase. Além da execução, devem-se monitorar continuamente os resultados, de forma a garantir que estejam de acordo com o planejado, realizando, quando necessário, ações de correção de rota.</p>
		</sec>
		<sec sec-type="conclusions">
			<title>CONCLUSÃO</title>
			<p>Este artigo apresentou um modelo conceitual de avaliação do impacto de uma universidade em sua comunidade local. Tal modelo foi construído com base na literatura existente, a qual indica três tipos de impacto: socioeconômico, científico-tecnológico, e na cultura e imagem da região. Além do modelo de avaliação de impacto, este trabalho apresentou um segundo modelo, visando a operacionalização do modelo de avaliação de impacto.</p>
			<p>Considerando o contexto brasileiro, o artigo chama a atenção para dimensões presentes na literatura científica, porém não consideradas nos sistemas nacionais de avaliação. Esses sistemas privilegiam três dimensões de atividades da universidade: ensino, pesquisa e extensão (<xref ref-type="bibr" rid="B77">Weber, 2010</xref>; <xref ref-type="bibr" rid="B57">Pinto, Mello &amp; Melo, 2016</xref>). Os sistemas locais utilizam listas amplas de critérios e parâmetros para avaliar instituições e programas. Eles diferem do sistema aqui discutido em pelo menos dois aspectos. O primeiro aspecto é a finalidade: os sistemas brasileiros destinam-se a garantir e fomentar a qualidade das instituições e dos programas de ensino e pesquisa do país, enquanto o sistema proposto nesse artigo objetiva avaliar e fomentar o impacto positivo das instituições em suas respectivas comunidades ou regiões. O segundo aspecto é a forma de aplicação: os sistemas locais empregam padrões únicos para avaliar instituições com características diferentes, enquanto o sistema proposto, embora possa utilizar dimensões e critérios comuns, pressupõe uma aplicação customizada à cada contexto específico. Assim, o modelo de avaliação de impacto aqui apresentado pode ser visto como um complemento, não substituto, dos sistemas existentes.</p>
			<p>Deve-se, finalmente, observar que este trabalho constitui um esforço inicial, cujo produto poderá ser enriquecido. O modelo conceitual proposto não constitui um sistema pronto para o uso. Ele deve ser validado empiricamente, de forma que possa ser utilizado como ferramenta administrativa por gestores de instituições de ensino e pesquisa. Além disso, futuros desenvolvimentos deverão focar a questão da operacionalização da avaliação, a qual encerra desafios metodológicos complexos.</p>
			<p>Em relação a futuras pesquisas, uma primeira possibilidade é realizar estudos de caso, aplicando o modelo a diferentes universidades, de forma a avaliar criticamente seu potencial e aperfeiçoá-lo. Uma segunda possibilidade é realizar estudos comparativos de casos, entre diferentes unidades e/ou diferentes universidades, de forma a avaliar como contextos distintos podem ser tratados. Uma terceira possibilidade é realizar estudos longitudinais, observando como uma universidade, ou uma unidade dentro de uma universidade, evolui ao longo do tempo.</p>
		</sec>
	</body>
	<back>
		<ack>
			<title>AGRADECIMENTOS</title>
			<p>Este artigo teve origem na tese de Wagner Curi. O autor agradece à CAPES, pelo apoio à realização de seu doutorado (Dinter). Os autores agradecem aos avaliadores anônimos por suas sugestões.</p>
		</ack>
		<ref-list>
			<title>REFERÊNCIAS</title>
			<ref id="B1">
				<mixed-citation>Alshuwaikhat, H. M., &amp; Abubakar, I. (2008). An integrated approach to achieving campus sustainability: assessment of the current campus environmental management practices.<italic>Journal of cleaner production</italic>,<italic>16</italic>(16), 1777-1785.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Alshuwaikhat</surname>
							<given-names>H. M.</given-names>
						</name>
						<name>
							<surname>Abubakar</surname>
							<given-names>I</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>An integrated approach to achieving campus sustainability: assessment of the current campus environmental management practices</article-title>
					<source>Journal of cleaner production</source>
					<volume>16</volume>
					<issue>16</issue>
					<fpage>1777</fpage>
					<lpage>1785</lpage>
				</element-citation>
			</ref>
			<ref id="B2">
				<mixed-citation>Alves, J., Carvalho, L., Carvalho, R., Correia, F., Cunha, J. ... Nicolau, A. (2015). The impact of polytechnic institutes on the local economy.<italic>Tertiary Education and Management</italic>,<italic>21</italic>(2), 81-98.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Alves</surname>
							<given-names>J</given-names>
						</name>
						<name>
							<surname>Carvalho</surname>
							<given-names>L</given-names>
						</name>
						<name>
							<surname>Carvalho</surname>
							<given-names>R</given-names>
						</name>
						<name>
							<surname>Correia</surname>
							<given-names>F</given-names>
						</name>
						<name>
							<surname>Cunha</surname>
							<given-names>J</given-names>
						</name>
						<name>
							<surname>Nicolau</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>The impact of polytechnic institutes on the local economy</article-title>
					<source>Tertiary Education and Management</source>
					<volume>21</volume>
					<issue>2</issue>
					<fpage>81</fpage>
					<lpage>98</lpage>
				</element-citation>
			</ref>
			<ref id="B3">
				<mixed-citation>Anderson, T. R., Daim, T. U., &amp; Lavoie, F. F. (2007). Measuring the efficiency of university technology transfer.<italic>Technovation</italic>,<italic>27</italic>(5), 306-318.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Anderson</surname>
							<given-names>T. R.</given-names>
						</name>
						<name>
							<surname>Daim</surname>
							<given-names>T. U.</given-names>
						</name>
						<name>
							<surname>Lavoie</surname>
							<given-names>F. F</given-names>
						</name>
					</person-group>
					<year>2007</year>
					<article-title>Measuring the efficiency of university technology transfer</article-title>
					<source>Technovation</source>
					<volume>27</volume>
					<issue>5</issue>
					<fpage>306</fpage>
					<lpage>318</lpage>
				</element-citation>
			</ref>
			<ref id="B4">
				<mixed-citation>Arbo, P., &amp; Benneworth, P. (2007). <italic>Understanding the regional contribution of higher education institutions: A literature review</italic>. Recuperado de http://dx.doi.org/10.1787/161208155312</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Arbo</surname>
							<given-names>P.</given-names>
						</name>
						<name>
							<surname>Benneworth</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2007</year>
					<source>Understanding the regional contribution of higher education institutions: A literature review</source>
					<comment>Recuperado de</comment>
					<pub-id pub-id-type="doi">10.1787/161208155312</pub-id>
				</element-citation>
			</ref>
			<ref id="B5">
				<mixed-citation>Audy, J. (2017). A inovação, o desenvolvimento e o papel da Universidade.<italic>Estudos avançados</italic>,<italic>31</italic>(90), 75-87.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Audy</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2017</year>
					<article-title>A inovação, o desenvolvimento e o papel da Universidade</article-title>
					<source>Estudos avançados</source>
					<volume>31</volume>
					<issue>90</issue>
					<fpage>75</fpage>
					<lpage>87</lpage>
				</element-citation>
			</ref>
			<ref id="B6">
				<mixed-citation>Balbachevsky, E., &amp; Kohtamäki, V. (2019). Autonomia e Governança Universitária: uma Abordagem Comparativa USP (Brasil) e UTA (Finlândia). In J. Marcovitch (Org.), <italic>Repensar a Universidade: Impactos para a Sociedade</italic>. São Paulo, SP: Com-Arte; Fapesp.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Balbachevsky</surname>
							<given-names>E.</given-names>
						</name>
						<name>
							<surname>Kohtamäki</surname>
							<given-names>V</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<chapter-title>Autonomia e Governança Universitária: uma Abordagem Comparativa USP (Brasil) e UTA (Finlândia)</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J.</given-names>
						</name>
					</person-group>
					<source>Repensar a Universidade: Impactos para a Sociedade</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Com-Arte; Fapesp</publisher-name>
				</element-citation>
			</ref>
			<ref id="B7">
				<mixed-citation>Barata, R. (2019). Mudanças necessárias na avaliação da pós-graduação brasileira. <italic>Interface - Comunicação, Saúde, Educação</italic>, <italic>23</italic>, e180635. Recuperado de ttps://doi.org/10.1590/interface.180635</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Barata</surname>
							<given-names>R</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<article-title>Mudanças necessárias na avaliação da pós-graduação brasileira</article-title>
					<source>Interface - Comunicação, Saúde, Educação</source>
					<volume>23</volume>
					<elocation-id>e180635</elocation-id>
					<comment>Recuperado de</comment>
					<pub-id pub-id-type="doi">10.1590/interface.180635</pub-id>
				</element-citation>
			</ref>
			<ref id="B8">
				<mixed-citation>Bramwell, A., &amp; Wolfe, D. A. (2008). Universities and regional economic development: The entrepreneurial University of Waterloo.<italic>Research policy</italic>,<italic>37</italic>(8), 1175-1187.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Bramwell</surname>
							<given-names>A.</given-names>
						</name>
						<name>
							<surname>Wolfe</surname>
							<given-names>D. A</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Universities and regional economic development: The entrepreneurial University of Waterloo</article-title>
					<source>Research policy</source>
					<volume>37</volume>
					<issue>8</issue>
					<fpage>1175</fpage>
					<lpage>1187</lpage>
				</element-citation>
			</ref>
			<ref id="B9">
				<mixed-citation>Barnes, T., Pashby, I., &amp; Gibbons, A. (2002). Effective university-industry interaction: A multi-case evaluation of collaborative R&amp;D projects.<italic>European Management Journal</italic>,<italic>20</italic>(3), 272-285.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Barnes</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Pashby</surname>
							<given-names>I.</given-names>
						</name>
						<name>
							<surname>Gibbons</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2002</year>
					<article-title>Effective university-industry interaction: A multi-case evaluation of collaborative R&amp;D projects</article-title>
					<source>European Management Journal</source>
					<volume>20</volume>
					<issue>3</issue>
					<fpage>272</fpage>
					<lpage>285</lpage>
				</element-citation>
			</ref>
			<ref id="B10">
				<mixed-citation>Bush, V. (1945). <italic>Science, the Endless Frontier: A Report to the President</italic>. Washington, DC: U.S. Recuperado de <ext-link ext-link-type="uri" xlink:href="https://archive.org/stream/scienceendlessfr00unit/scienceendlessfr00unit_djvu.txt">https://archive.org/stream/scienceendlessfr00unit/scienceendlessfr00unit_djvu.txt</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Bush</surname>
							<given-names>V</given-names>
						</name>
					</person-group>
					<year>1945</year>
					<source>Science, the Endless Frontier: A Report to the President</source>
					<publisher-loc>Washington, DC: U.S</publisher-loc>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="https://archive.org/stream/scienceendlessfr00unit/scienceendlessfr00unit_djvu.txt">https://archive.org/stream/scienceendlessfr00unit/scienceendlessfr00unit_djvu.txt</ext-link>
				</element-citation>
			</ref>
			<ref id="B11">
				<mixed-citation>Cowan, R., &amp; Zinovyeva, N. (2013). University effects on regional innovation.<italic>Research Policy</italic>,<italic>42</italic>(3), 788-800.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Cowan</surname>
							<given-names>R.</given-names>
						</name>
						<name>
							<surname>Zinovyeva</surname>
							<given-names>N</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<article-title>University effects on regional innovation</article-title>
					<source>Research Policy</source>
					<volume>42</volume>
					<issue>3</issue>
					<fpage>788</fpage>
					<lpage>800</lpage>
				</element-citation>
			</ref>
			<ref id="B12">
				<mixed-citation>Cox, S., &amp; Taylor, J. (2006). The impact of a business school on regional economic development: a case study.<italic>Local Economy</italic>,<italic>21</italic>(2), 117-135.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Cox</surname>
							<given-names>S.</given-names>
						</name>
						<name>
							<surname>Taylor</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>The impact of a business school on regional economic development: a case study</article-title>
					<source>Local Economy</source>
					<volume>21</volume>
					<issue>2</issue>
					<fpage>117</fpage>
					<lpage>135</lpage>
				</element-citation>
			</ref>
			<ref id="B13">
				<mixed-citation>Crossan, M. M., Lane, H. W., &amp; White, R. E. (1999). An organizational learning framework: From intuition to institution.<italic>Academy of management review</italic>,<italic>24</italic>(3), 522-537.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Crossan</surname>
							<given-names>M. M.</given-names>
						</name>
						<name>
							<surname>Lane</surname>
							<given-names>H. W.</given-names>
						</name>
						<name>
							<surname>White</surname>
							<given-names>R. E</given-names>
						</name>
					</person-group>
					<year>1999</year>
					<article-title>An organizational learning framework: From intuition to institution</article-title>
					<source>Academy of management review</source>
					<volume>24</volume>
					<issue>3</issue>
					<fpage>522</fpage>
					<lpage>537</lpage>
				</element-citation>
			</ref>
			<ref id="B14">
				<mixed-citation>Curi, C., Daraio, C., &amp; Llerena, P. (2012). University technology transfer: how (in) efficient are French universities?.<italic>Cambridge Journal of Economics</italic>,<italic>36</italic>(3), 629-654.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Curi</surname>
							<given-names>C.</given-names>
						</name>
						<name>
							<surname>Daraio</surname>
							<given-names>C.</given-names>
						</name>
						<name>
							<surname>Llerena</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<article-title>University technology transfer: how (in) efficient are French universities?</article-title>
					<source>Cambridge Journal of Economics</source>
					<volume>36</volume>
					<issue>3</issue>
					<fpage>629</fpage>
					<lpage>654</lpage>
				</element-citation>
			</ref>
			<ref id="B15">
				<mixed-citation>Doin, T., &amp; Rosa, A. R. (2019). Interação Universidade-Empresa-Governo: o caso do Programa de Cooperação Educacional para Transferência de Conhecimento Brasil-Cingapura.<italic>Cadernos EBAPE.BR</italic>, <italic>17</italic>(4), 940-958.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Doin</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Rosa</surname>
							<given-names>A. R</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<article-title>Interação Universidade-Empresa-Governo: o caso do Programa de Cooperação Educacional para Transferência de Conhecimento Brasil-Cingapura</article-title>
					<source>Cadernos EBAPE.BR</source>
					<volume>17</volume>
					<issue>4</issue>
					<fpage>940</fpage>
					<lpage>958</lpage>
				</element-citation>
			</ref>
			<ref id="B16">
				<mixed-citation>Drucker, J., &amp; Goldstein, H. (2007). Assessing the regional economic development impacts of universities: A review of current approaches.<italic>International regional science review</italic>,<italic>30</italic>(1), 20-46.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Drucker</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>Goldstein</surname>
							<given-names>H</given-names>
						</name>
					</person-group>
					<year>2007</year>
					<article-title>Assessing the regional economic development impacts of universities: A review of current approaches</article-title>
					<source>International regional science review</source>
					<volume>30</volume>
					<issue>1</issue>
					<fpage>20</fpage>
					<lpage>46</lpage>
				</element-citation>
			</ref>
			<ref id="B17">
				<mixed-citation>Erkut, E. (2002). Measuring Canadian business school research output and impact.<italic>Canadian Journal of Administrative Sciences/Revue Canadienne des Sciences de l’Administration</italic>,<italic>19</italic>(2), 97-123.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Erkut</surname>
							<given-names>E</given-names>
						</name>
					</person-group>
					<year>2002</year>
					<article-title>Measuring Canadian business school research output and impact</article-title>
					<source>Canadian Journal of Administrative Sciences/Revue Canadienne des Sciences de l’Administration</source>
					<volume>19</volume>
					<issue>2</issue>
					<fpage>97</fpage>
					<lpage>123</lpage>
				</element-citation>
			</ref>
			<ref id="B18">
				<mixed-citation>Etzkowitz, H., &amp; Leydesdorff, L. (2000). The dynamics of innovation: from National Systems and “Mode 2” to a Triple Helix of university-industry-government relations.<italic>Research policy</italic>,<italic>29</italic>(2), 109-123.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Etzkowitz</surname>
							<given-names>H.</given-names>
						</name>
						<name>
							<surname>Leydesdorff</surname>
							<given-names>L</given-names>
						</name>
					</person-group>
					<year>2000</year>
					<article-title>The dynamics of innovation: from National Systems and “Mode 2” to a Triple Helix of university-industry-government relations</article-title>
					<source>Research policy</source>
					<volume>29</volume>
					<issue>2</issue>
					<fpage>109</fpage>
					<lpage>123</lpage>
				</element-citation>
			</ref>
			<ref id="B19">
				<mixed-citation>European Foundation for Management Development. (2015). <italic>BSIS Process Guideline</italic>. Recuperado de <ext-link ext-link-type="uri" xlink:href="http://www.efmdglobal.org/images/download/BSIS/BSIS%20Process%20Guidelines-141204-PRINT.pdf">http://www.efmdglobal.org/images/download/BSIS/BSIS%20Process%20Guidelines-141204-PRINT.pdf</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<collab>European Foundation for Management Development</collab>
					</person-group>
					<year>2015</year>
					<source>BSIS Process Guideline</source>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="http://www.efmdglobal.org/images/download/BSIS/BSIS%20Process%20Guidelines-141204-PRINT.pdf">http://www.efmdglobal.org/images/download/BSIS/BSIS%20Process%20Guidelines-141204-PRINT.pdf</ext-link>
				</element-citation>
			</ref>
			<ref id="B20">
				<mixed-citation>Fernandes, A. C., Souza, B. C., Silva, A. S., Suzigan, W., Chaves, C. V. ... Albuquerque, E. (2010). Academy-industry links in Brazil: evidence about channels and benefits for firms and researchers.<italic>Science and Public Policy</italic>,<italic>37</italic>(7), 485-498.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Fernandes</surname>
							<given-names>A. C</given-names>
						</name>
						<name>
							<surname>Souza</surname>
							<given-names>B. C</given-names>
						</name>
						<name>
							<surname>Silva</surname>
							<given-names>A. S</given-names>
						</name>
						<name>
							<surname>Suzigan</surname>
							<given-names>W</given-names>
						</name>
						<name>
							<surname>Chaves</surname>
							<given-names>C. V</given-names>
						</name>
						<name>
							<surname>Albuquerque</surname>
							<given-names>E</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>Academy-industry links in Brazil: evidence about channels and benefits for firms and researchers</article-title>
					<source>Science and Public Policy</source>
					<volume>37</volume>
					<issue>7</issue>
					<fpage>485</fpage>
					<lpage>498</lpage>
				</element-citation>
			</ref>
			<ref id="B21">
				<mixed-citation>Fisher, D., Atkinson-Grosjean, J., &amp; House, D. (2001). Changes in academy/industry/state relations in Canada: The creation and development of the networks of centres of excellence.<italic>Minerva</italic>,<italic>39</italic>(3), 299-325.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Fisher</surname>
							<given-names>D.</given-names>
						</name>
						<name>
							<surname>Atkinson-Grosjean</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>House</surname>
							<given-names>D</given-names>
						</name>
					</person-group>
					<year>2001</year>
					<article-title>Changes in academy/industry/state relations in Canada: The creation and development of the networks of centres of excellence</article-title>
					<source>Minerva</source>
					<volume>39</volume>
					<issue>3</issue>
					<fpage>299</fpage>
					<lpage>325</lpage>
				</element-citation>
			</ref>
			<ref id="B22">
				<mixed-citation>Gerolamo, M. C., Carpinetti, L. C. R., Fleschutz, T., &amp; Seliger, G. (2008). Clusters e redes de cooperação de pequenas e médias empresas: observatório europeu, caso alemão e contribuições ao caso brasileiro.<italic>Gestão &amp; Produção</italic>,<italic>15</italic>(2), 351-365.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Gerolamo</surname>
							<given-names>M. C.</given-names>
						</name>
						<name>
							<surname>Carpinetti</surname>
							<given-names>L. C. R.</given-names>
						</name>
						<name>
							<surname>Fleschutz</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Seliger</surname>
							<given-names>G</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Clusters e redes de cooperação de pequenas e médias empresas: observatório europeu, caso alemão e contribuições ao caso brasileiro</article-title>
					<source>Gestão &amp; Produção</source>
					<volume>15</volume>
					<issue>2</issue>
					<fpage>351</fpage>
					<lpage>365</lpage>
				</element-citation>
			</ref>
			<ref id="B23">
				<mixed-citation>Gheno, E. M., Guaragna, R. M., Mata, L. F. S., Duarte, L. F., Souza, D. O. Calabró, L. (2019). Sistema de avaliação da CAPES: indicadores e procedimentos de monitoramento e avaliação de desempenho. <italic>Em Questão</italic>,<italic>25</italic>(3), 184-213.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Gheno</surname>
							<given-names>E. M</given-names>
						</name>
						<name>
							<surname>Guaragna</surname>
							<given-names>R. M</given-names>
						</name>
						<name>
							<surname>Mata</surname>
							<given-names>L. F. S</given-names>
						</name>
						<name>
							<surname>Duarte</surname>
							<given-names>L. F</given-names>
						</name>
						<name>
							<surname>Souza</surname>
							<given-names>D. O</given-names>
						</name>
						<name>
							<surname>Calabró</surname>
							<given-names>L</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<article-title>Sistema de avaliação da CAPES: indicadores e procedimentos de monitoramento e avaliação de desempenho</article-title>
					<source>Em Questão</source>
					<volume>25</volume>
					<issue>3</issue>
					<fpage>184</fpage>
					<lpage>213</lpage>
				</element-citation>
			</ref>
			<ref id="B24">
				<mixed-citation>Gibbons, M., Limoges, C., &amp; Scott, P. (2011). Revisiting Mode 2 at Noors Slott.<italic>Prometheus</italic>,<italic>29</italic>(4), 361-372.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Gibbons</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Limoges</surname>
							<given-names>C.</given-names>
						</name>
						<name>
							<surname>Scott</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2011</year>
					<article-title>Revisiting Mode 2 at Noors Slott</article-title>
					<source>Prometheus</source>
					<volume>29</volume>
					<issue>4</issue>
					<fpage>361</fpage>
					<lpage>372</lpage>
				</element-citation>
			</ref>
			<ref id="B25">
				<mixed-citation>Goldstein, H., &amp; Drucker, J. (2006). The economic development impacts of universities on regions: Do size and distance matter?.<italic>Economic development quarterly</italic>,<italic>20</italic>(1), 22-43.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Goldstein</surname>
							<given-names>H.</given-names>
						</name>
						<name>
							<surname>Drucker</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>The economic development impacts of universities on regions: Do size and distance matter?</article-title>
					<source>Economic development quarterly</source>
					<volume>20</volume>
					<issue>1</issue>
					<fpage>22</fpage>
					<lpage>43</lpage>
				</element-citation>
			</ref>
			<ref id="B26">
				<mixed-citation>Gomes, M. A. S., &amp; Pereira, F. E. C. (2015). Hélice Tríplice: Um ensaio teórico sobre a relação Universidade-Empresa-Governo em busca da inovação.<italic>International Journal of Knowledge Engineering and Management (IJKEM)</italic>, 4(8), 136-155.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Gomes</surname>
							<given-names>M. A. S.</given-names>
						</name>
						<name>
							<surname>Pereira</surname>
							<given-names>F. E. C</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>Hélice Tríplice: Um ensaio teórico sobre a relação Universidade-Empresa-Governo em busca da inovação</article-title>
					<source>International Journal of Knowledge Engineering and Management (IJKEM)</source>
					<volume>4</volume>
					<issue>8</issue>
					<fpage>136</fpage>
					<lpage>155</lpage>
				</element-citation>
			</ref>
			<ref id="B27">
				<mixed-citation>Guerrero, M., Cunningham, J. A., &amp; Urbano, D. (2015). Economic impact of entrepreneurial universities’ activities: An exploratory study of the United Kingdom.<italic>Research Policy</italic>,<italic>44</italic>(3), 748-764.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Guerrero</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Cunningham</surname>
							<given-names>J. A.</given-names>
						</name>
						<name>
							<surname>Urbano</surname>
							<given-names>D</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>Economic impact of entrepreneurial universities’ activities: An exploratory study of the United Kingdom</article-title>
					<source>Research Policy</source>
					<volume>44</volume>
					<issue>3</issue>
					<fpage>748</fpage>
					<lpage>764</lpage>
				</element-citation>
			</ref>
			<ref id="B28">
				<mixed-citation>Guetzkow, J. (2002). <italic>How the arts impact communities: an introduction to the literature on arts impact studies</italic>(Working Paper Series, 20). Princeton, NJ: Centre for Arts and Cultural Policy Studies.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Guetzkow</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2002</year>
					<source>How the arts impact communities: an introduction to the literature on arts impact studies</source>
					<comment>Working Paper Series, 20</comment>
					<publisher-loc>Princeton, NJ</publisher-loc>
					<publisher-name>Centre for Arts and Cultural Policy Studies</publisher-name>
				</element-citation>
			</ref>
			<ref id="B29">
				<mixed-citation>Hubbard, P. (2008). Regulating the social impacts of studentification: a Loughborough case study.<italic>Environment and Planning A</italic>,<italic>40</italic>(2), 323-341.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Hubbard</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Regulating the social impacts of studentification: a Loughborough case study</article-title>
					<source>Environment and Planning A</source>
					<volume>40</volume>
					<issue>2</issue>
					<fpage>323</fpage>
					<lpage>341</lpage>
				</element-citation>
			</ref>
			<ref id="B30">
				<mixed-citation>Huggins, R., &amp; Johnston, A. (2009). The economic and innovation contribution of universities: a regional perspective.<italic>Environment and Planning C: Government and Policy</italic>,<italic>27</italic>(6), 1088-1106.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Huggins</surname>
							<given-names>R.</given-names>
						</name>
						<name>
							<surname>Johnston</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<article-title>The economic and innovation contribution of universities: a regional perspective</article-title>
					<source>Environment and Planning C: Government and Policy</source>
					<volume>27</volume>
					<issue>6</issue>
					<fpage>1088</fpage>
					<lpage>1106</lpage>
				</element-citation>
			</ref>
			<ref id="B31">
				<mixed-citation>Huggins, R., Johnston, A., &amp; Steffenson, R. (2008). Universities, knowledge networks and regional policy.<italic>Cambridge Journal of Regions, Economy and Society</italic>, 1(2), 321-340.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Huggins</surname>
							<given-names>R.</given-names>
						</name>
						<name>
							<surname>Johnston</surname>
							<given-names>A.</given-names>
						</name>
						<name>
							<surname>Steffenson</surname>
							<given-names>R</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Universities, knowledge networks and regional policy</article-title>
					<source>Cambridge Journal of Regions, Economy and Society</source>
					<volume>1</volume>
					<issue>2</issue>
					<fpage>321</fpage>
					<lpage>340</lpage>
				</element-citation>
			</ref>
			<ref id="B32">
				<mixed-citation>Ipiranga, A. S. R., Freitas, A. A. F. D., &amp; Paiva, T. A. (2010). O empreendedorismo acadêmico no contexto da interação universidade-empresa-governo.<italic>Cadernos EBAPE.BR</italic>, 8(4), 676-693.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Ipiranga</surname>
							<given-names>A. S. R.</given-names>
						</name>
						<name>
							<surname>Freitas</surname>
							<given-names>A. A. F. D.</given-names>
						</name>
						<name>
							<surname>Paiva</surname>
							<given-names>T. A</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>O empreendedorismo acadêmico no contexto da interação universidade-empresa-governo</article-title>
					<source>Cadernos EBAPE.BR</source>
					<volume>8</volume>
					<issue>4</issue>
					<fpage>676</fpage>
					<lpage>693</lpage>
				</element-citation>
			</ref>
			<ref id="B33">
				<mixed-citation>Jain, S., &amp; Pant, P. (2010). Environmental management systems for educational institutions.<italic>International Journal of Sustainability in Higher Education</italic> 
 <italic>11</italic>(3<italic>),</italic> 
 <italic>236-249</italic>.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Jain</surname>
							<given-names>S.</given-names>
						</name>
						<name>
							<surname>Pant</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>Environmental management systems for educational institutions</article-title>
					<source>International Journal of Sustainability in Higher Education</source>
					<volume>11</volume>
					<issue>3</issue>
					<fpage>236</fpage>
					<lpage>249</lpage>
				</element-citation>
			</ref>
			<ref id="B34">
				<mixed-citation>Johansen, T., &amp; Arano, K. (2016). The long-run economic impact of an institution of higher education: Estimating the human capital contribution.<italic>Economic Development Quarterly</italic>,<italic>30</italic>(3), 203-214.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Johansen</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Arano</surname>
							<given-names>K</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>The long-run economic impact of an institution of higher education: Estimating the human capital contribution</article-title>
					<source>Economic Development Quarterly</source>
					<volume>30</volume>
					<issue>3</issue>
					<fpage>203</fpage>
					<lpage>214</lpage>
				</element-citation>
			</ref>
			<ref id="B35">
				<mixed-citation>Johnson, W. H. (2008). Roles, resources and benefits of intermediate organizations supporting triple helix collaborative R&amp;D: The case of Precarn.<italic>Technovation</italic>,<italic>28</italic>(8), 495-505.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Johnson</surname>
							<given-names>W. H</given-names>
						</name>
					</person-group>
					<year>2008</year>
					<article-title>Roles, resources and benefits of intermediate organizations supporting triple helix collaborative R&amp;D: The case of Precarn</article-title>
					<source>Technovation</source>
					<volume>28</volume>
					<issue>8</issue>
					<fpage>495</fpage>
					<lpage>505</lpage>
				</element-citation>
			</ref>
			<ref id="B36">
				<mixed-citation>Kantor, S., &amp; Whalley, A. (2014). Knowledge spillovers from research universities: evidence from endowment value shocks.<italic>Review of Economics and Statistics</italic>,<italic>96</italic>(1), 171-188.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Kantor</surname>
							<given-names>S.</given-names>
						</name>
						<name>
							<surname>Whalley</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>Knowledge spillovers from research universities: evidence from endowment value shocks</article-title>
					<source>Review of Economics and Statistics</source>
					<volume>96</volume>
					<issue>1</issue>
					<fpage>171</fpage>
					<lpage>188</lpage>
				</element-citation>
			</ref>
			<ref id="B37">
				<mixed-citation>Kureski, R., &amp; Rolim, C. (2009). Impacto econômico de curto prazo das universidades federais na economia brasileira.<italic>Revista Paranaense de Desenvolvimento</italic>, <italic>117</italic>, 29-51.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Kureski</surname>
							<given-names>R.</given-names>
						</name>
						<name>
							<surname>Rolim</surname>
							<given-names>C</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<article-title>Impacto econômico de curto prazo das universidades federais na economia brasileira</article-title>
					<source>Revista Paranaense de Desenvolvimento</source>
					<volume>117</volume>
					<fpage>29</fpage>
					<lpage>51</lpage>
				</element-citation>
			</ref>
			<ref id="B38">
				<mixed-citation>Lazzeroni, M., &amp; Piccaluga, A. (2015). Beyond ‘town and gown’: the role of the university in small and medium-sized cities.<italic>Industry and Higher Education</italic>,<italic>29</italic>(1), 11-23.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Lazzeroni</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Piccaluga</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>Beyond ‘town and gown’: the role of the university in small and medium-sized cities</article-title>
					<source>Industry and Higher Education,</source>
					<volume>29</volume>
					<issue>1</issue>
					<fpage>11</fpage>
					<lpage>23</lpage>
				</element-citation>
			</ref>
			<ref id="B39">
				<mixed-citation>Lendel, I. (2010). The impact of research universities on regional economies: The concept of university products.<italic>Economic Development Quarterly</italic>,<italic>24</italic>(3), 210-230.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Lendel</surname>
							<given-names>I</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>The impact of research universities on regional economies: The concept of university products</article-title>
					<source>Economic Development Quarterly</source>
					<volume>24</volume>
					<issue>3</issue>
					<fpage>210</fpage>
					<lpage>230</lpage>
				</element-citation>
			</ref>
			<ref id="B40">
				<mixed-citation>Leten, B., Landoni, P., &amp; Van Looy, B. (2014). Science or graduates: How do firms benefit from the proximity of universities?.<italic>Research Policy</italic>,<italic>43</italic>(8), 1398-1412.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Leten</surname>
							<given-names>B.</given-names>
						</name>
						<name>
							<surname>Landoni</surname>
							<given-names>P.</given-names>
						</name>
						<name>
							<surname>Van Looy</surname>
							<given-names>B</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>Science or graduates: How do firms benefit from the proximity of universities?</article-title>
					<source>Research Policy</source>
					<volume>43</volume>
					<issue>8</issue>
					<fpage>1398</fpage>
					<lpage>1412</lpage>
				</element-citation>
			</ref>
			<ref id="B41">
				<mixed-citation>Leydesdorff, L., &amp; Meyer, M. (2003). The Triple Helix of university-industry-government relations.<italic>Scientometrics</italic>,<italic>58</italic>(2), 191-203.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Leydesdorff</surname>
							<given-names>L.</given-names>
						</name>
						<name>
							<surname>Meyer</surname>
							<given-names>M</given-names>
						</name>
					</person-group>
					<year>2003</year>
					<article-title>The Triple Helix of university-industry-government relations</article-title>
					<source>Scientometrics</source>
					<volume>58</volume>
					<issue>2</issue>
					<fpage>191</fpage>
					<lpage>203</lpage>
				</element-citation>
			</ref>
			<ref id="B42">
				<mixed-citation>Mainardes, E. W., Alves, H., &amp; Raposo, M. (2010). An exploratory research on the stakeholders of a university.<italic>Journal of Management and Strategy</italic>, 1(1), 76.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Mainardes</surname>
							<given-names>E. W.</given-names>
						</name>
						<name>
							<surname>Alves</surname>
							<given-names>H.</given-names>
						</name>
						<name>
							<surname>Raposo</surname>
							<given-names>M</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>An exploratory research on the stakeholders of a university</article-title>
					<source>Journal of Management and Strategy</source>
					<volume>1</volume>
					<issue>1</issue>
					<fpage>76</fpage>
					<lpage>76</lpage>
				</element-citation>
			</ref>
			<ref id="B43">
				<mixed-citation>Marcovitch, J. (2019). A Universidade em 2022.<italic>Estudos Avançados</italic>,<italic>33</italic>(95), 7-18.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<article-title>A Universidade em 2022</article-title>
					<source>Estudos Avançados</source>
					<volume>33</volume>
					<issue>95</issue>
					<fpage>7</fpage>
					<lpage>18</lpage>
				</element-citation>
			</ref>
			<ref id="B44">
				<mixed-citation>Marcovitch, J., &amp; AXEL-BERG, J. (2019). Consenso para a Excelência Acadêmica. In: Marcovitch, J. (Org). <italic>Repensar a Universidade: Impactos para a Sociedade</italic>. São Paulo, SP: Com-Arte; Fapesp.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>AXEL-BERG</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<chapter-title>Consenso para a Excelência Acadêmica</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<source>Repensar a Universidade: Impactos para a Sociedade</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Com-Arte; Fapesp</publisher-name>
				</element-citation>
			</ref>
			<ref id="B45">
				<mixed-citation>Martin, B. R. (2012). Are universities and university research under threat? Towards an evolutionary model of university speciation.<italic>Cambridge journal of economics</italic>,<italic>36</italic>(3), 543-565.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Martin</surname>
							<given-names>B. R</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<article-title>Are universities and university research under threat? Towards an evolutionary model of university speciation</article-title>
					<source>Cambridge journal of economics</source>
					<volume>36</volume>
					<issue>3</issue>
					<fpage>543</fpage>
					<lpage>565</lpage>
				</element-citation>
			</ref>
			<ref id="B46">
				<mixed-citation>Martin, F. (1998). The economic impact of Canadian university R&amp;D. <italic>Research Policy</italic>, <italic>27</italic>(7), 677-687.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Martin</surname>
							<given-names>F</given-names>
						</name>
					</person-group>
					<year>1998</year>
					<article-title>The economic impact of Canadian university R&amp;D</article-title>
					<source>Research Policy</source>
					<volume>27</volume>
					<issue>7</issue>
					<fpage>677</fpage>
					<lpage>687</lpage>
				</element-citation>
			</ref>
			<ref id="B47">
				<mixed-citation>May, T., &amp; Perry 1, B. (2006). Cities, knowledge and universities: Transformations in the image of the intangible.<italic>Social Epistemology</italic>, <italic>20</italic>(3-4), 259-282.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>May</surname>
							<given-names>T.</given-names>
						</name>
						<name>
							<surname>Perry 1</surname>
							<given-names>B</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>Cities, knowledge and universities: Transformations in the image of the intangible</article-title>
					<source>Social Epistemology</source>
					<volume>20</volume>
					<issue>3-4</issue>
					<fpage>259</fpage>
					<lpage>282</lpage>
				</element-citation>
			</ref>
			<ref id="B48">
				<mixed-citation>Mayring, P. (2004). Qualitative content analysis.<italic>A companion to qualitative research</italic>, 4(1), 159-176.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Mayring</surname>
							<given-names>P</given-names>
						</name>
					</person-group>
					<year>2004</year>
					<article-title>Qualitative content analysis</article-title>
					<source>A companion to qualitative research</source>
					<volume>4</volume>
					<issue>1</issue>
					<fpage>159</fpage>
					<lpage>176</lpage>
				</element-citation>
			</ref>
			<ref id="B49">
				<mixed-citation>McCowan, T. (2016). Universities and the post-2015 development agenda: an analytical framework.<italic>Higher Education</italic>,<italic>72</italic>(4), 505-523.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>McCowan</surname>
							<given-names>T</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>Universities and the post-2015 development agenda: an analytical framework</article-title>
					<source>Higher Education</source>
					<volume>72</volume>
					<issue>4</issue>
					<fpage>505</fpage>
					<lpage>523</lpage>
				</element-citation>
			</ref>
			<ref id="B50">
				<mixed-citation>Miller, R. E., &amp; Blair, P. D. (2009).<italic>Input-output analysis: foundations and extensions</italic>. Cambridge, UK: Cambridge University.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Miller</surname>
							<given-names>R. E.</given-names>
						</name>
						<name>
							<surname>Blair</surname>
							<given-names>P. D</given-names>
						</name>
					</person-group>
					<year>2009</year>
					<source>Input-output analysis: foundations and extensions</source>
					<publisher-loc>Cambridge, UK</publisher-loc>
					<publisher-name>Cambridge University</publisher-name>
				</element-citation>
			</ref>
			<ref id="B51">
				<mixed-citation>Ministério da Educação. (2018). <italic>Proposta de Aprimoramento do Modelo de Avaliação da PG. Documento Final da Comissão Nacional de Acompanhamento do PNPG 2011-2020</italic>. Brasília, DF. Recuperado de <ext-link ext-link-type="uri" xlink:href="https://www.capes.gov.br/images/stories/download/conselho-superior/18102018 _PNPG_CS_Avaliacao_Final_CS_FINAL_17_55.pdf">https://www.capes.gov.br/images/stories/download/conselho-superior/18102018 _PNPG_CS_Avaliacao_Final_CS_FINAL_17_55.pdf</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<collab>Ministério da Educação</collab>
					</person-group>
					<year>2018</year>
					<source>Proposta de Aprimoramento do Modelo de Avaliação da PG. Documento Final da Comissão Nacional de Acompanhamento do PNPG 2011-2020</source>
					<publisher-loc>Brasília, DF</publisher-loc>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="https://www.capes.gov.br/images/stories/download/conselho-superior/18102018 _PNPG_CS_Avaliacao_Final_CS_FINAL_17_55.pdf">https://www.capes.gov.br/images/stories/download/conselho-superior/18102018 _PNPG_CS_Avaliacao_Final_CS_FINAL_17_55.pdf</ext-link>
				</element-citation>
			</ref>
			<ref id="B52">
				<mixed-citation>Muscio, A., Quaglione, D., &amp; Ramaciotti, L. (2016). The effects of university rules on spinoff creation: The case of academia in Italy.<italic>Research Policy</italic>,<italic>45</italic>(7), 1386-1396.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Muscio</surname>
							<given-names>A.</given-names>
						</name>
						<name>
							<surname>Quaglione</surname>
							<given-names>D.</given-names>
						</name>
						<name>
							<surname>Ramaciotti</surname>
							<given-names>L</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>The effects of university rules on spinoff creation: The case of academia in Italy</article-title>
					<source>Research Policy</source>
					<volume>45</volume>
					<issue>7</issue>
					<fpage>1386</fpage>
					<lpage>1396</lpage>
				</element-citation>
			</ref>
			<ref id="B53">
				<mixed-citation>Musselin, C. (2013). How peer review empowers the academic profession and university managers: Changes in relationships between the state, universities and the professoriate.<italic>Research Policy</italic>,<italic>42</italic>(5), 1165-1173.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Musselin</surname>
							<given-names>C</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<article-title>How peer review empowers the academic profession and university managers: Changes in relationships between the state, universities and the professoriate</article-title>
					<source>Research Policy</source>
					<volume>42</volume>
					<issue>5</issue>
					<fpage>1165</fpage>
					<lpage>1173</lpage>
				</element-citation>
			</ref>
			<ref id="B54">
				<mixed-citation>Muzy, J. R., &amp; Drugowich, P. A. (2018). <italic>Os Desafios da Autonomia Universitária: História Recente da USP</italic>. Jundiai, SP: Paco.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Muzy</surname>
							<given-names>J. R.</given-names>
						</name>
						<name>
							<surname>Drugowich</surname>
							<given-names>P. A</given-names>
						</name>
					</person-group>
					<year>2018</year>
					<source>Os Desafios da Autonomia Universitária: História Recente da USP</source>
					<publisher-loc>Jundiai, SP</publisher-loc>
					<publisher-name>Paco</publisher-name>
				</element-citation>
			</ref>
			<ref id="B55">
				<mixed-citation>Pastor, J. M., Pérez, F., &amp; De Guevara, J. F. (2013). Measuring the local economic impact of universities: An approach that considers uncertainty.<italic>Higher education</italic>,<italic>65</italic>(5), 539-564.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Pastor</surname>
							<given-names>J. M.</given-names>
						</name>
						<name>
							<surname>Pérez</surname>
							<given-names>F.</given-names>
						</name>
						<name>
							<surname>De Guevara</surname>
							<given-names>J. F</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<article-title>Measuring the local economic impact of universities: An approach that considers uncertainty</article-title>
					<source>Higher education</source>
					<volume>65</volume>
					<issue>5</issue>
					<fpage>539</fpage>
					<lpage>564</lpage>
				</element-citation>
			</ref>
			<ref id="B56">
				<mixed-citation>Payne Consulting. (2016). <italic>Athens State University: Economics Impacts</italic>. Recuperado de <ext-link ext-link-type="uri" xlink:href="http://www.athens.edu/pdfs/about/economic-impact.pdf?30255e">http://www.athens.edu/pdfs/about/economic-impact.pdf?30255e</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<collab>Payne Consulting</collab>
					</person-group>
					<year>2016</year>
					<source>Athens State University: Economics Impacts</source>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="http://www.athens.edu/pdfs/about/economic-impact.pdf?30255e">http://www.athens.edu/pdfs/about/economic-impact.pdf?30255e</ext-link>
				</element-citation>
			</ref>
			<ref id="B57">
				<mixed-citation>Pinto, R. S., Mello, S., &amp; Melo, P. A. (2016). Meta-avaliação: uma década do Processo de Avaliação Institucional do SINAES.<italic>Avaliação: Revista da Avaliação da Educação Superior</italic>,<italic>21</italic>(1), 89-108.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Pinto</surname>
							<given-names>R. S.</given-names>
						</name>
						<name>
							<surname>Mello</surname>
							<given-names>S.</given-names>
						</name>
						<name>
							<surname>Melo</surname>
							<given-names>P. A</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>Meta-avaliação: uma década do Processo de Avaliação Institucional do SINAES</article-title>
					<source>Avaliação: Revista da Avaliação da Educação Superior</source>
					<volume>21</volume>
					<issue>1</issue>
					<fpage>89</fpage>
					<lpage>108</lpage>
				</element-citation>
			</ref>
			<ref id="B58">
				<mixed-citation>Planeta, C. S., Marques, A.C., Bueno, G.W., Luque, C.A., Hashimoto, F., &amp; Gontijo, J. (2019). Impacto Social das Universidades. In: Marcovitch, J. (Org) <italic>Repensar a Universidade: Impactos para a Sociedade</italic>. São Paulo, SP: Com-Arte; Fapesp.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Planeta</surname>
							<given-names>C. S.</given-names>
						</name>
						<name>
							<surname>Marques</surname>
							<given-names>A.C.</given-names>
						</name>
						<name>
							<surname>Bueno</surname>
							<given-names>G.W.</given-names>
						</name>
						<name>
							<surname>Luque</surname>
							<given-names>C.A.</given-names>
						</name>
						<name>
							<surname>Hashimoto</surname>
							<given-names>F.</given-names>
						</name>
						<name>
							<surname>Gontijo</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<chapter-title>Impacto Social das Universidades</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<source>Repensar a Universidade: Impactos para a Sociedade</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Com-Arte; Fapesp</publisher-name>
				</element-citation>
			</ref>
			<ref id="B59">
				<mixed-citation>Pogue, T. E. (2010). <italic>University of the Pacific: community impact</italic>. Recuperado de <ext-link ext-link-type="uri" xlink:href="http://www.pacific.edu/Documents/marketing/community-impact-report.pdf">http://www.pacific.edu/Documents/marketing/community-impact-report.pdf</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Pogue</surname>
							<given-names>T. E</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<source>University of the Pacific: community impact</source>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="http://www.pacific.edu/Documents/marketing/community-impact-report.pdf">http://www.pacific.edu/Documents/marketing/community-impact-report.pdf</ext-link>
				</element-citation>
			</ref>
			<ref id="B60">
				<mixed-citation>Popescu, R. I., &amp; Corbos, R. A. (2012). The role of festivals and cultural events in the strategic development of cities. Recommendations for urban areas in Romania.<italic>Informatica Economica</italic>,<italic>16</italic>(4), 19.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Popescu</surname>
							<given-names>R. I.</given-names>
						</name>
						<name>
							<surname>Corbos</surname>
							<given-names>R. A</given-names>
						</name>
					</person-group>
					<year>2012</year>
					<article-title>The role of festivals and cultural events in the strategic development of cities. Recommendations for urban areas in Romania</article-title>
					<source>Informatica Economica</source>
					<volume>16</volume>
					<issue>4</issue>
					<fpage>19</fpage>
					<lpage>19</lpage>
				</element-citation>
			</ref>
			<ref id="B61">
				<mixed-citation>Ranieri, N. (2019). O Direito e suas Métricas. In: Marcovitch, J. (Org) <italic>Repensar a Universidade: Impactos para a Sociedade</italic>. São Paulo, SP: Com-Arte; Fapesp.</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Ranieri</surname>
							<given-names>N</given-names>
						</name>
					</person-group>
					<year>2019</year>
					<chapter-title>O Direito e suas Métricas</chapter-title>
					<person-group person-group-type="compiler">
						<name>
							<surname>Marcovitch</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<source>Repensar a Universidade: Impactos para a Sociedade</source>
					<publisher-loc>São Paulo, SP</publisher-loc>
					<publisher-name>Com-Arte; Fapesp</publisher-name>
				</element-citation>
			</ref>
			<ref id="B62">
				<mixed-citation>Rasmussen, E., &amp; Borch, O. J. (2010). University capabilities in facilitating entrepreneurship: A longitudinal study of spin-off ventures at mid-range universities.<italic>Research policy</italic>,<italic>39</italic>(5), 602-612.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Rasmussen</surname>
							<given-names>E.</given-names>
						</name>
						<name>
							<surname>Borch</surname>
							<given-names>O. J</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>University capabilities in facilitating entrepreneurship: A longitudinal study of spin-off ventures at mid-range universities</article-title>
					<source>Research policy</source>
					<volume>39</volume>
					<issue>5</issue>
					<fpage>602</fpage>
					<lpage>612</lpage>
				</element-citation>
			</ref>
			<ref id="B63">
				<mixed-citation>Rohe, W. (2017). The Contract between Society and Science: Changes and Challenges.<italic>Social Research: An International Quarterly</italic>,<italic>84</italic>(3), 739-757.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Rohe</surname>
							<given-names>W</given-names>
						</name>
					</person-group>
					<year>2017</year>
					<article-title>The Contract between Society and Science: Changes and Challenges</article-title>
					<source>Social Research: An International Quarterly</source>
					<volume>84</volume>
					<issue>3</issue>
					<fpage>739</fpage>
					<lpage>757</lpage>
				</element-citation>
			</ref>
			<ref id="B64">
				<mixed-citation>Roslyn, K. (2013). <italic>Vancouver Island University: Economic Impact Analyis &amp; Community Engagement</italic>. Recuperado de <ext-link ext-link-type="uri" xlink:href="https://www2.viu.ca/impact/documents/VIU-Impact-Report.pdf">https://www2.viu.ca/impact/documents/VIU-Impact-Report.pdf</ext-link>
				</mixed-citation>
				<element-citation publication-type="book">
					<person-group person-group-type="author">
						<name>
							<surname>Roslyn</surname>
							<given-names>K</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<source>Vancouver Island University: Economic Impact Analyis &amp; Community Engagement</source>
					<comment>Recuperado de</comment>
					<ext-link ext-link-type="uri" xlink:href="https://www2.viu.ca/impact/documents/VIU-Impact-Report.pdf">https://www2.viu.ca/impact/documents/VIU-Impact-Report.pdf</ext-link>
				</element-citation>
			</ref>
			<ref id="B65">
				<mixed-citation>Salmeron, R. A. (2001). Universidade pública e identidade cultural.<italic>Tempo social</italic>,<italic>13</italic>(1), 9-26.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Salmeron</surname>
							<given-names>R. A</given-names>
						</name>
					</person-group>
					<year>2001</year>
					<article-title>Universidade pública e identidade cultural</article-title>
					<source>Tempo social,</source>
					<volume>13</volume>
					<issue>1</issue>
					<fpage>9</fpage>
					<lpage>26</lpage>
				</element-citation>
			</ref>
			<ref id="B66">
				<mixed-citation>Scandura, A. (2016). University-industry collaboration and firms’ R&amp;D effort.<italic>Research Policy</italic>,<italic>45</italic>(9), 1907-1922.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Scandura</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2016</year>
					<article-title>University-industry collaboration and firms’ R&amp;D effort</article-title>
					<source>Research Policy</source>
					<volume>45</volume>
					<issue>9</issue>
					<fpage>1907</fpage>
					<lpage>1922</lpage>
				</element-citation>
			</ref>
			<ref id="B67">
				<mixed-citation>Sen, A. (2011). Local income and employment impact of universities: the case of Izmir University of Economics.<italic>Journal of Applied Economics and Business Research</italic>, 1(1), 25-42.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Sen</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2011</year>
					<article-title>Local income and employment impact of universities: the case of Izmir University of Economics</article-title>
					<source>Journal of Applied Economics and Business Research</source>
					<volume>1</volume>
					<issue>1</issue>
					<fpage>25</fpage>
					<lpage>42</lpage>
				</element-citation>
			</ref>
			<ref id="B68">
				<mixed-citation>Silva, F. L. (2006). Universidade: a idéia e a história.<italic>Estudos avançados</italic>,<italic>20</italic>(56), 191-202.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Silva</surname>
							<given-names>F. L</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>Universidade: a idéia e a história</article-title>
					<source>Estudos avançados</source>
					<volume>20</volume>
					<issue>56</issue>
					<fpage>191</fpage>
					<lpage>202</lpage>
				</element-citation>
			</ref>
			<ref id="B69">
				<mixed-citation>Sleutjes, M. H. S. C. (1999). Refletindo sobre os três pilares de sustentação das universidades: ensino-pesquisa-extensão.<italic>Revista de Administração Pública</italic>,<italic>33</italic>(3), 99-101.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Sleutjes</surname>
							<given-names>M. H. S. C</given-names>
						</name>
					</person-group>
					<year>1999</year>
					<article-title>Refletindo sobre os três pilares de sustentação das universidades: ensino-pesquisa-extensão</article-title>
					<source>Revista de Administração Pública</source>
					<volume>33</volume>
					<issue>3</issue>
					<fpage>99</fpage>
					<lpage>101</lpage>
				</element-citation>
			</ref>
			<ref id="B70">
				<mixed-citation>Steinacker, A. (2005). The economic effect of urban colleges on their surrounding communities.<italic>Urban Studies</italic>,<italic>42</italic>(7), 1161-1175.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Steinacker</surname>
							<given-names>A</given-names>
						</name>
					</person-group>
					<year>2005</year>
					<article-title>The economic effect of urban colleges on their surrounding communities</article-title>
					<source>Urban Studies</source>
					<volume>42</volume>
					<issue>7</issue>
					<fpage>1161</fpage>
					<lpage>1175</lpage>
				</element-citation>
			</ref>
			<ref id="B71">
				<mixed-citation>Sutz, J. (2000). The university-industry-government relations in Latin America.<italic>Research policy</italic>,<italic>29</italic>(2), 279-290.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Sutz</surname>
							<given-names>J</given-names>
						</name>
					</person-group>
					<year>2000</year>
					<article-title>The university-industry-government relations in Latin America</article-title>
					<source>Research policy</source>
					<volume>29</volume>
					<issue>2</issue>
					<fpage>279</fpage>
					<lpage>290</lpage>
				</element-citation>
			</ref>
			<ref id="B72">
				<mixed-citation>Tarocco, J., F Filho, Sesso, U. A., F Filho, Esteves, E. Z. G., &amp; Kureski, R. (2014). Impacto econômico de curto prazo da Universidade Estadual de Londrina.<italic>Economia &amp; Região</italic>, 2(1), 83-103.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Tarocco</surname>
							<given-names>J.</given-names>
						</name>
						<name>
							<surname>F</surname>
							<given-names>Sesso</given-names>
							<suffix>Filho</suffix>
						</name>
						<name>
							<surname>U. A.</surname>
							<given-names>F</given-names>
							<suffix>Filho</suffix>
						</name>
						<name>
							<surname>Esteves</surname>
							<given-names>E. Z. G.</given-names>
						</name>
						<name>
							<surname>Kureski</surname>
							<given-names>R</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>Impacto econômico de curto prazo da Universidade Estadual de Londrina</article-title>
					<source>Economia &amp; Região</source>
					<volume>2</volume>
					<issue>1</issue>
					<fpage>83</fpage>
					<lpage>103</lpage>
				</element-citation>
			</ref>
			<ref id="B73">
				<mixed-citation>Van Wyk, L., Saayman, M., &amp; Rossouw, R. (2013). Economic impact of the Klein Karoo National Arts Festival: investigating the application of different models.<italic>Journal of Economic and Financial Sciences</italic>, 6(1), 129-152.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Van Wyk</surname>
							<given-names>L.</given-names>
						</name>
						<name>
							<surname>Saayman</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Rossouw</surname>
							<given-names>R</given-names>
						</name>
					</person-group>
					<year>2013</year>
					<article-title>Economic impact of the Klein Karoo National Arts Festival: investigating the application of different models</article-title>
					<source>Journal of Economic and Financial Sciences</source>
					<volume>6</volume>
					<issue>1</issue>
					<fpage>129</fpage>
					<lpage>152</lpage>
				</element-citation>
			</ref>
			<ref id="B74">
				<mixed-citation>Verger, A., Curran, M., &amp; Parcerisa, L. (2015). La trayectoria de una reforma educativa global: el caso de la nueva gestión pública en el sistema educativo catalán.<italic>Educação &amp; Sociedade</italic>,<italic>36</italic>(132), 675-697.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Verger</surname>
							<given-names>A.</given-names>
						</name>
						<name>
							<surname>Curran</surname>
							<given-names>M.</given-names>
						</name>
						<name>
							<surname>Parcerisa</surname>
							<given-names>L</given-names>
						</name>
					</person-group>
					<year>2015</year>
					<article-title>La trayectoria de una reforma educativa global: el caso de la nueva gestión pública en el sistema educativo catalán</article-title>
					<source>Educação &amp; Sociedade</source>
					<volume>36</volume>
					<issue>132</issue>
					<fpage>675</fpage>
					<lpage>697</lpage>
				</element-citation>
			</ref>
			<ref id="B75">
				<mixed-citation>Vieira, E. M. F., Van Bellen, H. M., &amp; Fialho, F. A. P. (2006). Universidade em tempo de mudança.<italic>Cadernos EBAPE.BR</italic>, 4(3), 01-07.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Vieira</surname>
							<given-names>E. M. F.</given-names>
						</name>
						<name>
							<surname>Van Bellen</surname>
							<given-names>H. M.</given-names>
						</name>
						<name>
							<surname>Fialho</surname>
							<given-names>F. A. P</given-names>
						</name>
					</person-group>
					<year>2006</year>
					<article-title>Universidade em tempo de mudança</article-title>
					<source>Cadernos EBAPE.BR</source>
					<volume>4</volume>
					<issue>3</issue>
					<fpage>01</fpage>
					<lpage>07</lpage>
				</element-citation>
			</ref>
			<ref id="B76">
				<mixed-citation>Wanzinack, C., &amp; Signorelli, M. C. (2014). Expansão do ensino superior federal e desenvolvimento regional: o caso da Universidade Federal do Paraná no litoral paranaense.<italic>Revista Gestão Universitária na América Latina-GUAL</italic>, 7(2), 286-307.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Wanzinack</surname>
							<given-names>C.</given-names>
						</name>
						<name>
							<surname>Signorelli</surname>
							<given-names>M. C</given-names>
						</name>
					</person-group>
					<year>2014</year>
					<article-title>Expansão do ensino superior federal e desenvolvimento regional: o caso da Universidade Federal do Paraná no litoral paranaense</article-title>
					<source>Revista Gestão Universitária na América Latina-GUAL</source>
					<volume>7</volume>
					<issue>2</issue>
					<fpage>286</fpage>
					<lpage>307</lpage>
				</element-citation>
			</ref>
			<ref id="B77">
				<mixed-citation>Weber, S. (2010). Avaliação e regulação da educação superior: conquistas e impasses.<italic>Educação &amp; Sociedade</italic>,<italic>31</italic>(113), 1247-1269.</mixed-citation>
				<element-citation publication-type="journal">
					<person-group person-group-type="author">
						<name>
							<surname>Weber</surname>
							<given-names>S</given-names>
						</name>
					</person-group>
					<year>2010</year>
					<article-title>Avaliação e regulação da educação superior: conquistas e impasses</article-title>
					<source>Educação &amp; Sociedade</source>
					<volume>31</volume>
					<issue>113</issue>
					<fpage>1247</fpage>
					<lpage>1269</lpage>
				</element-citation>
			</ref>
		</ref-list>
	</back>
	<!--sub-article article-type="translation" id="s1" xml:lang="en">
		<front-stub>
			<article-categories>
				<subj-group subj-group-type="heading">
					<subject>Paper</subject>
				</subj-group>
			</article-categories>
			<title-group>
				<article-title>Evaluation of the impact of universities on their communities</article-title>
			</title-group>
			<contrib-group>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">0000-0002-8420-5710</contrib-id>
					<name>
						<surname>CURI</surname>
						<given-names>WAGNER RAGI CURI</given-names>
						<suffix>JUNIOR</suffix>
					</name>
					<xref ref-type="aff" rid="aff3">1</xref>
				</contrib>
				<contrib contrib-type="author">
					<contrib-id contrib-id-type="orcid">0000-0002-5610-4699</contrib-id>
					<name>
						<surname>WOOD</surname>
						<given-names>THOMAZ</given-names>
						<suffix>JUNIOR</suffix>
					</name>
					<xref ref-type="aff" rid="aff4">2</xref>
				</contrib>
			</contrib-group>
			<aff id="aff3">
				<label>1</label>
				<institution content-type="original">UNIVERSIDADE FEDERAL DE OURO PRETO (UFOP) / INSTITUTO DE CIÊNCIAS EXATAS E APLICADAS, JOÃO MONLEVADE - MG, BRAZIL</institution>
			</aff>
			<aff id="aff4">
				<label>2</label>
				<institution content-type="original">FUNDAÇÃO GETULIO VARGAS (FGV EAESP) / ESCOLA DE ADMINISTRAÇÃO DE EMPRESAS DE SÃO PAULO, SÃO PAULO - SP, BRAZIL</institution>
			</aff>
			<author-notes>
				<fn fn-type="other" id="fn3">
					<p>Wagner Ragi Curi Filho - Ph.D. in Administration at Fundação Getulio Vargas (FGV EAESP); Associate Professor in the Production Engineering Department of the Federal University of Ouro Preto (UFOP). E-mail: wagner@ufop.edu.br</p>
				</fn>
				<fn fn-type="other" id="fn4">
					<p>Thomaz Wood Junior - Ph.D. in Administration at Fundação Getulio Vargas (FGV EAESP); Professor of Fundação Getulio Vargas (FGV EAESP). E-mail: thomaz.wood@fgv.br</p>
				</fn>
			</author-notes>
			<abstract>
				<title>Abstract</title>
				<p>This article investigates the impact of universities on the communities in which they are located. Based on bibliographical research, three types of impacts were identified and systematized: socioeconomic, scientific and technological, and on the culture and image of the region. These three types of impact have been integrated into a conceptual model that can be used as a basis for a practical model to be employed to assess the impact of a university on the region in which it is located. In addition to the three types of impact, the article also suggests steps for implementing the impact assessment model. This research contributes to the advancement of studies on the universities’ role and can help university managers evaluate its impact on the community.</p>
			</abstract>
			<kwd-group xml:lang="en">
				<title>Keywords:</title>
				<kwd>University’s impact on the community</kwd>
				<kwd>Socioeconomic impact</kwd>
				<kwd>Scientific and technological impact</kwd>
				<kwd>Culture and image of the region</kwd>
			</kwd-group>
		</front-stub>
		<body>
			<sec sec-type="intro">
				<title>INTRODUCTION</title>
				<p>Friedrich von Humboldt (1767-1835) believed that the basis and purpose of any educational system was the development of a country’s citizens, and he argued that only autonomy would allow universities to achieve their principal objectives (<xref ref-type="bibr" rid="B63">Rohe, 2017</xref>). In his seminal text “Science, The Endless Frontier” (<xref ref-type="bibr" rid="B10">Bush, 1945</xref>), Vannevar Bush (1890-1974) argued that scientific progress results from the free play of free intellects: scientists working on subjects of their own choice, in the manner dictated by their own curiosity for exploring the unknown and for advancing the frontiers of science.</p>
				<p>These two principles - university autonomy and creative freedom - were the foundation for the institutionalization of higher education systems in many countries and were validated by the substantial scientific progress made during the 20<sup>th</sup> century. At the end of the 20<sup>th</sup> century, science was an institutionalized, globalized, and superspecialized field, and its evolution continued (and still continues) in new areas of knowledge and transdisciplinary domains. As science developed, demands for investments and research budgets also grew.</p>
				<p>However, expansion began to encounter budgetary limitations. Freedom to create started conflicting with social and economic needs, imperatives that <xref ref-type="bibr" rid="B10">Bush had already anticipated (1945</xref>). New state policies began to favor a strategic view of science to boost competitiveness (<xref ref-type="bibr" rid="B24">Gibbons, Limoges &amp; Scott, 2011</xref>). As a result, the pendulum between the defense of academic autonomy and the imperative to serve society has been moving to a second basis (<xref ref-type="bibr" rid="B63">Rohe, 2017</xref>). This article focuses on the impact universities have on the communities in which they are located, a relevant aspect of this movement.</p>
				<p>Universities do indeed contribute to the communities where they are based (<xref ref-type="bibr" rid="B68">Silva, 2006</xref>). They create jobs for professionals in the region and provide study opportunities for local young people (for example, <xref ref-type="bibr" rid="B16">Drucker &amp; Goldstein, 2007</xref>; <xref ref-type="bibr" rid="B34">Johansen &amp; Arano, 2016</xref>). University research projects can promote local development, and they can also foster culture and promote the image of the region where they are located (<xref ref-type="bibr" rid="B4">Arbo &amp; Benneworth, 2007</xref>; <xref ref-type="bibr" rid="B40">Leten, Landoni &amp; Looy, 2014</xref>).</p>
				<p>Questions about the role of universities in society, however, have been growing (<xref ref-type="bibr" rid="B40">Leten, Landoni &amp; Looy, 2014</xref>; <xref ref-type="bibr" rid="B53">Musselin, 2013</xref>; <xref ref-type="bibr" rid="B75">Vieira, Bellen &amp; Fialho, 2006</xref>; <xref ref-type="bibr" rid="B77">Weber, 2010</xref>), leading some of them to seek to better communicate the benefits they generate for their communities and for society in general (<xref ref-type="bibr" rid="B39">Lendel, 2015</xref>; <xref ref-type="bibr" rid="B44">Marcovitch, 2019</xref>; <xref ref-type="bibr" rid="B45">Martin, 2012</xref>; <xref ref-type="bibr" rid="B47">May &amp; Perry, 2006</xref>).</p>
				<p>In Brazil, this phenomenon is becoming especially interesting in the area of public higher education institutions. These institutions have undergone a notable expansion in recent decades; however, they are coming under pressure to increase and improve the services they provide in teaching, research, and extension courses while simultaneously suffering from budgetary pressures (<xref ref-type="bibr" rid="B2">Alves et al., 2015</xref>; <xref ref-type="bibr" rid="B5">Audy, 2017</xref>; <xref ref-type="bibr" rid="B72">Tarocco, Sesso, Esteves &amp; Kureski, 2014</xref>; <xref ref-type="bibr" rid="B76">Wanzinack &amp; Signorelli, 2014</xref>).</p>
				<p>The role of university rankings in influencing institutions’ behavior is worthy of special attention because they are used as instruments for analyzing the various possibilities a university has in terms of community impacts (<xref ref-type="bibr" rid="B44">Marcovitch, 2019</xref>).</p>
				<p>This context led to the emergence of models for assessing the impact that teaching and research institutions have on their communities (European Foundation for Management Development [EFMD], <xref ref-type="bibr" rid="B19">2015</xref>). However, most of these models seem to focus only on two aspects: economic impact and the ability to contribute to technological development (<xref ref-type="bibr" rid="B36">Kantor &amp; Whalley, 2014</xref>; <xref ref-type="bibr" rid="B66">Scandura, 2016</xref>; <xref ref-type="bibr" rid="B67">Sen, 2011</xref>).</p>
				<p>Given this and the probable nonexistence of integrated models for assessing the impact of universities, this article aims to contribute to developing a broad conceptual model, which can be used as the basis for building a practical model for assessing the impact a university has on its community. A bibliographic review was accordingly carried out that identified three types of impact: socioeconomic, scientific and technological, and cultural and attractiveness of the region. The means used for each type of impact were defined, and indicators were suggested.</p>
				<p>This article contributes to both science and practice. It contributes to studies on the new role of universities (<xref ref-type="bibr" rid="B31">Huggins, Johnston &amp; Steffenson, 2008</xref>; <xref ref-type="bibr" rid="B49">Mccowan, 2016</xref>; <xref ref-type="bibr" rid="B69">Sleutjes, 1999</xref>) and adds to the modeling employed in studying the social impact of universities. It does so by integrating the three dimensions found in the literature that have been individually explored in previous works (<xref ref-type="bibr" rid="B27">Guerrero, Cunningham &amp; Urbano, 2015</xref>; <xref ref-type="bibr" rid="B36">Kantor &amp; Whalley, 2014</xref>; <xref ref-type="bibr" rid="B60">Popescu &amp; Corbos, 2012</xref>). University managers can use any models developed from those proposed here to assess their institutions’ impact on the communities in which they are located by following adaptations to suit each university’s and region’s characteristics. It is important to stress that this work suggests a preliminary model that must be improved upon and tested before it is used to support the construction of a practical model for assessing a university’s impact on its community.</p>
				<p>In addition to this introduction, this work has four more sections. The second section presents the bibliographic research that was undertaken to support the development of the model. The third section systematized the three types of impacts identified in the literature and integrated them into the impact assessment model. The fourth section proposes a process for operationalizing the impact assessment model. The fifth section presents comments and indicates the direction of future developments of the model and further research.</p>
			</sec>
			<sec sec-type="methods">
				<title>METHODS</title>
				<p>Given the objective of developing a conceptual model (<xref ref-type="bibr" rid="B13">Crossan, Lane &amp; White, 1999</xref>) to assess a university’s impact on the community, a bibliographic review was carried out (<xref ref-type="bibr" rid="B48">Mayring, 2004</xref>). An answer to the question of who the stakeholders of a university might be was initially sought in the work of <xref ref-type="bibr" rid="B42">Mainardes, Alves and Raposo (2010</xref>). The authors suggest a list of 21 different types of stakeholders, some specific, such as students and teachers, and others more generic, such as the university’s region and community. Since universities can impact such a diversity of stakeholders, articles were sought about the impact that a university can generate in the local community.</p>
				<p>Data were collected from databases, such as EBSCO, Scielo, and Google Scholar, using the following keywords (in Portuguese and English): <italic>universidade</italic>, <italic>impacto</italic>, and <italic>ambiente,</italic> and university, impact, and environment. This resulted in 676 articles being located that were published between 1998 and 2018.</p>
				<p>A filter was then applied to these data to select those texts that dealt with more general impacts, such as the impact on industries, the economy, or the region’s sustainability. The selection was made following a reading of the abstracts, and when this proved insufficient, the full articles were read, resulting in 66 articles being chosen.</p>
				<p>These articles were then thoroughly analyzed. In assessing these articles’ objectives, three types of impacts emerged, on the basis of which the texts were then organized. <xref ref-type="fig" rid="f7">Figure 1</xref> shows the types of impact found. In addition to the objectives, the variables used for measuring the university’s impact were identified for each article that had been thoroughly analyzed. When preparing the proposed model structure, the variables identified in the articles were considered to develop a fully integrative model.</p>
				<p>
					<fig id="f7">
						<label>Figure 1</label>
						<caption>
							<title>Types of impact</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf7.jpg"/>
						<attrib>Source: Elaborated by the authors.</attrib>
					</fig>
				</p>
				<p>The first group of articles analyzed comprises 26 texts that deal with the socioeconomic impacts, whether as the result of university demands (inputs) or the effects of the university’s presence (outputs). The second group comprises 29 articles detailing the scientific and technological impacts, with texts that deal with: the relationship between university, company, and government; the development of marketable technologies; and studies that address the role of universities in promoting new business. The third group comprises 11 texts dealing with the impact on the region’s culture and image. The works in this group discuss the university’s relationship with the cultural aspects of the place or analyze how it helps shape the region’s image.</p>
				<p>The three types of impact that were identified contain aspects that overlap. For example, some research projects may have scientific and technological impacts, socioeconomic impacts, and, additionally, impact the region’s image. Therefore, some of the indicators can be analyzed as either part of one type of impact or another. However, to facilitate identification and analysis, those indicators that result in more than one type of impact were included in the conceptual model only regarding the type of impact considered to be its primary impact.</p>
				<p>The bibliographic review also made it possible to identify the respective means for each type of impact; in other words, the different channels or ways the university generates that particular type of impact.</p>
			</sec>
			<sec>
				<title>DEVELOPMENT OF THE CONCEPTUAL MODEL</title>
				<sec>
					<title>Socioeconomic impact</title>
					<p>Analysis of the theoretical framework relating to socioeconomic impact revealed two subgroups of articles. The first subgroup focuses on a university’s outputs (<xref ref-type="bibr" rid="B12">Cox &amp; Taylor, 2006</xref>; <xref ref-type="bibr" rid="B25">Goldstein &amp; Drucker, 2006</xref>; <xref ref-type="bibr" rid="B37">Kureski &amp; Rolim, 2009</xref>; <xref ref-type="bibr" rid="B39">Lendel, 2015</xref>; <xref ref-type="bibr" rid="B70">Steinaker, 2005</xref>), which include job creation, financial expenditure, and extension course projects, among other activities.</p>
					<p>Various articles were found in this subgroup that use the input-output methodology to compare the university’s proportional expenditure in relation to the economy of the region studied (<xref ref-type="bibr" rid="B55">Pastor, Pérez &amp; Guevara, 2012</xref>; <xref ref-type="bibr" rid="B72">Tarocco et al., 2014</xref>). The aim is to identify the interdependencies between different economic sectors (<xref ref-type="bibr" rid="B50">Miller &amp; Blair, 2009</xref>). Some universities, such as the University of Vancouver (<xref ref-type="bibr" rid="B64">Roslyn, 2013</xref>), the University of Athens (<xref ref-type="bibr" rid="B56">Payne, 2016</xref>), and the University of the Pacific (<xref ref-type="bibr" rid="B59">Pogue, 2010</xref>), have used this methodology to assess their respective impacts.</p>
					<p>The second group of articles focuses on university inputs (<xref ref-type="bibr" rid="B12">Cox &amp; Taylor, 2006</xref>; <xref ref-type="bibr" rid="B37">Kureski &amp; Rolim, 2009</xref>; <xref ref-type="bibr" rid="B39">Lendel, 2015</xref>), which include direct business with a university, demands for public services, and demands arising from public policies (<xref ref-type="bibr" rid="B74">Verger, Curran &amp; Parcerisa, 2015</xref>).</p>
					<p>The institutional context must be taken into consideration when assessing the socioeconomic impact of a university, since a university’s capacity for influence depends on the characteristics of the region in which it is located (<xref ref-type="bibr" rid="B30">Huggins &amp; Johnston, 2009</xref>; <xref ref-type="bibr" rid="B38">Lazzeroni &amp; Piccaluga, 2015</xref>; <xref ref-type="bibr" rid="B46">Martin, 1998</xref>; <xref ref-type="bibr" rid="B55">Pastor et al., 2012</xref>). For example, the socioeconomic impact of those universities located in large urban centers may be diluted, while that of universities located in small cities may be locally significant.</p>
					<p>
						<xref ref-type="fig" rid="f8">Figure 2</xref> systematizes the possible means of the socioeconomic impact of a university and any respective indicators. Each institution interested in assessing its impact can place greater or lesser emphasis on each means of impact, depending on the assessment’s desired outcome.</p>
					<p>
						<fig id="f8">
							<label>Figure 2</label>
							<caption>
								<title>The socioeconomic impact of a university</title>
							</caption>
							<graphic xlink:href="1679-3951-cebape-19-03-496-gf8.jpg"/>
							<attrib>Source: Elaborated by the authors.</attrib>
						</fig>
					</p>
				</sec>
				<sec>
					<title>Scientific and technological impact</title>
					<p>Analysis of the theoretical framework relating to the scientific and technological impact revealed a theoretical body of work that deals with relations between universities and industry. This theoretical body of work can be classified into three subgroups. The first subgroup contains works that focus on the relationship between university, company, and government (called the triple helix). The authors of these works argue that the impact of the university is based on promoting innovation through the integrated actions of these three agents (<xref ref-type="bibr" rid="B15">Doin &amp; Rosa, 2019</xref>; <xref ref-type="bibr" rid="B18">Etzkowitz &amp; Leydesdorff, 2000</xref>; <xref ref-type="bibr" rid="B26">Gomes &amp; Pereira, 2015</xref>; <xref ref-type="bibr" rid="B32">Ipiranga, Freitas &amp; Paiva, 2010</xref>; <xref ref-type="bibr" rid="B35">Johnson, 2008</xref>; Leydesdorff &amp; Meyer, 2003; <xref ref-type="bibr" rid="B71">Sutz, 2000</xref>).</p>
					<p>The second subgroup contains works that defend a research agenda aimed at developing marketable technologies. It focuses on the direct relationship between universities and industry (<xref ref-type="bibr" rid="B8">Bramwell &amp; Wolfe, 2008</xref>; <xref ref-type="bibr" rid="B14">Curi, Daraio &amp; Llerena, 2012</xref>; <xref ref-type="bibr" rid="B20">Fernandes et al., 2010</xref>; <xref ref-type="bibr" rid="B21">Fisher, Atkinson-Grosjean &amp; House, 2001</xref>; <xref ref-type="bibr" rid="B66">Scandura, 2016</xref>) and indicates areas of cooperation for making the relationship between universities and industry more effective (<xref ref-type="bibr" rid="B3">Anderson, Daim &amp; Lavoie, 2007</xref>; <xref ref-type="bibr" rid="B17">Barnes &amp; Erkut, 2002</xref>).</p>
					<p>The third subgroup contains works that deal with the role of universities in promoting innovation and developing new businesses. These works focus on the ability of universities to foster innovation in their regions (<xref ref-type="bibr" rid="B11">Cowan &amp; Zinovyeva, 2013</xref>) and to engage academics in developing new ventures (<xref ref-type="bibr" rid="B52">Muscio, Quaglione &amp; Ramaciotti, 2016</xref>; <xref ref-type="bibr" rid="B62">Rasmussen &amp; Borch, 2010</xref>). Some authors focus specifically on the contributions that universities make toward forming clusters (<xref ref-type="bibr" rid="B22">Gerolamo et al., 2008</xref>; <xref ref-type="bibr" rid="B47">May &amp; Perry, 2006</xref>).</p>
					<p>
						<xref ref-type="fig" rid="f9">Figure 3</xref> systematizes the possible means of impact of a university for the scientific and technological impact dimension, with regard to the respective indicators. As in the previous case, each institution can place a greater or lesser emphasis on each means of impact, depending on the assessment’s desired outcome.</p>
					<p>
						<fig id="f9">
							<label>Figure 3</label>
							<caption>
								<title>The scientific and technological impact of a university</title>
							</caption>
							<graphic xlink:href="1679-3951-cebape-19-03-496-gf9.jpg"/>
							<attrib>Source: Elaborated by the authors.</attrib>
						</fig>
					</p>
				</sec>
				<sec>
					<title>Impact on the region’s culture and image</title>
					<p>Analysis of the theoretical framework concerning the impact on the region’s culture and image revealed a theoretical body of work that can be classified into two subgroups. The first subgroup of articles addresses the university’s impact on the arts and its participation in local cultural events. These works analyze the possibility of arranging artistic and cultural events for promoting economic development (<xref ref-type="bibr" rid="B28">Guetzkow, 2002</xref>; <xref ref-type="bibr" rid="B73">Wyk, Saayman &amp; Rossouw, 2013</xref>). For example, from an individual point of view, an artistic event can generate jobs and encourage self-knowledge (<xref ref-type="bibr" rid="B28">Guetzkow, 2002</xref>), and from a community’s point of view, it can help the economy and contribute to the community’s image. <xref ref-type="bibr" rid="B60">Popescu and Corbos (2012</xref>) present an analysis of how communities can be structured on the basis of the artistic and cultural events that are supported by universities.</p>
					<p>The second subgroup of articles is characterized by the debate about the role of universities in promoting cultural policies and manifestations. <xref ref-type="bibr" rid="B4">Arbo and Benneworth (2007</xref>) comment on the integrating role these institutions can have concerning local policies. <xref ref-type="bibr" rid="B1">Alshuwaikhat and Abubakar (2008</xref>), <xref ref-type="bibr" rid="B29">Hubbard (2008</xref>), <xref ref-type="bibr" rid="B33">Jain and Pant (2010</xref>), and <xref ref-type="bibr" rid="B65">Salmeron (2001</xref>) also highlight the influence that a university can have on certain cultural and image characteristics of a community.</p>
					<p>Concerning the impact that a university can have on culture and image, <xref ref-type="fig" rid="f10">Figure 4</xref> systematizes the possible means employed and the respective indicators. As in the previous cases, each institution may place more or less emphasis on each means of impact, depending on the assessment’s desired outcome.</p>
					<p>
						<fig id="f10">
							<label>Figure 4</label>
							<caption>
								<title>Impact of a university on the culture and image of a region</title>
							</caption>
							<graphic xlink:href="1679-3951-cebape-19-03-496-gf10.jpg"/>
							<attrib>Source: Elaborated by the authors.</attrib>
						</fig>
					</p>
				</sec>
				<sec>
					<title>Integrated conceptual model for assessing impact</title>
					<p>Integration of the three previous models results in the university’s conceptual model for assessing its impact on the region where it is located. <xref ref-type="fig" rid="f11">Figure 5</xref> shows this model. The model must be seen as a general matrix, which can be used to develop a model for practical application and adapted to fit the peculiarities of each university and community. The indicators used in each case can also be adapted accordingly.</p>
					<p>
						<fig id="f11">
							<label>Figure 5</label>
							<caption>
								<title>Conceptual model for assessing impact: impact types and means</title>
							</caption>
							<graphic xlink:href="1679-3951-cebape-19-03-496-gf11.jpg"/>
							<attrib>Source: Elaborated by the authors.</attrib>
						</fig>
					</p>
				</sec>
				<sec>
					<title>Brazil’s contributions to the debate</title>
					<p>It is appropriate to highlight some of Brazil’s contributions to the topic of universities’ impact on their communities. The social impact of universities in Brazil can be related to discussions about 1) academic performance indicators, 2) evaluation systems, and 3) university rankings. More broadly speaking, it can also be related to reflections on university autonomy and the relationship between university and society. Without intending to summarize the rich debate on these issues in Brazil’s context, some of the authors and works that are more directly related to this study are highlighted below.</p>
					<p>A first issue, which characterizes Brazilian reflections and is directly related to this article, is that of outputs, in other words, the effects the university has on the community. Identifying outputs can be found in works that focus on the debate about the indicators used in preparing university rankings and those whose target is evaluating postgraduate programs. For example, <xref ref-type="bibr" rid="B44">Marcovitch and Axel-Berg (2019</xref>) observe the need to use quantitative and qualitative indicators and warn that institutions should be concerned with the possible misuse of indicators when “<italic>creating policies, evaluations, and rankings, and taking decisions about promoting and hiring teachers</italic>” (<xref ref-type="bibr" rid="B44">Marcovitch &amp; Axel-Berg, 2019</xref>, p. 128).</p>
					<p>
						<xref ref-type="bibr" rid="B61">Ranieri (2019</xref>) specifically indicates the subjects that should be considered when looking for the outputs of a university: research and academic production; the social impact of academic production; the impact of extension activities; and the professional impact of graduates. <xref ref-type="bibr" rid="B58">Planeta et al. (2019</xref>) similarly indicated the following dimensions for measuring social impact: economic/financial; socio-educational; innovation and entrepreneurship; intellectual, cultural, and well-being; and reputation. In fact, the model these authors propose is close to that proposed in this study. The trend toward valuing social impact can also be found by observing the evolution of Brazil’s Coordinating Office for Training Personnel with Higher Education (<italic>CAPES</italic>) system (<xref ref-type="bibr" rid="B7">Barata, 2019</xref>; <xref ref-type="bibr" rid="B23">Gheno et al., 2019</xref>; <xref ref-type="bibr" rid="B51">Ministério da Educação, 2018</xref>).</p>
					<p>Finally, it is worth highlighting the debate about transforming the concept of university autonomy found in <xref ref-type="bibr" rid="B54">Muzy and Drugowich (2018</xref>) and <xref ref-type="bibr" rid="B6">Balbachevsky and Kohtamäki (2019</xref>). Despite an increase in external controls, universities have the autonomy to make decisions about many aspects of academic life. What is produced at the university, however, must respond to social demands. Therefore, external and internal assessment mechanisms must be mutually coherent. Universities must use external and internal mechanisms as management tools to expand their positive impact on the community.</p>
				</sec>
			</sec>
			<sec>
				<title>PROCESS FOR MAKING IMPACT ASSESSMENT OPERATIONAL</title>
				<p>In addition to the impact assessment model, a process is also suggested for making impact assessment operational. The process’s objective is to facilitate implementation to maximize positive impacts and minimize any negative impacts of the university in its local community. This model should be implemented in six phases, as shown in <xref ref-type="fig" rid="f12">Figure 6</xref>.</p>
				<p>
					<fig id="f12">
						<label>Figure 6</label>
						<caption>
							<title>Operationalization model for impact assessment: phases and main actions</title>
						</caption>
						<graphic xlink:href="1679-3951-cebape-19-03-496-gf12.jpg"/>
						<attrib>Source: Elaborated by the authors.</attrib>
					</fig>
				</p>
				<p>The first phase is mainly aimed at defining the objectives and scope of the project. The objectives can vary significantly depending on the context and the university. For example, the main objective of a traditional and already established institution may be to increase its cultural impact on the community, thus strengthening the region’s image. Additionally, a young institution that is expanding may define its target as increasing its scientific and technological impact, thereby contributing to consolidating the nascent industrial park in the region. A third institution, facing funding difficulties, may focus on demonstrating its impact vis-à-vis its stakeholders in all dimensions to improve relationships and facilitate obtaining resources for research and other activities.</p>
				<p>The first phase is also intended to define the assessment’s internal scope, which may be restricted to a single unit (for example, a faculty), a group of faculties, or the entire university.</p>
				<p>Finally, the first phase is to define the area that will be the object of the assessment. Some institutions may restrict their focus to the city where they are located, while others may expand their focus to include groups of cities, a state, or an entire region.</p>
				<p>The second phase is intended for constructing the model according to the definitions of the first phase. It is recommended that the model be built “from top to bottom,” that is: first, the types of impact to be assessed must be defined (either socioeconomic, scientific and technological, or both); and second, whether they relate to the culture and image of the region. The means of impact must then be defined, eventually eliminating some of those listed in <xref ref-type="fig" rid="f10">Figure 5</xref> and possibly adding others. Finally, the indicators for the chosen means of impact should be reviewed, eliminating some of those listed in <xref ref-type="fig" rid="f8">Figures 2</xref>, <xref ref-type="bibr" rid="B9">3</xref>, and <xref ref-type="bibr" rid="B10">4</xref>, while others may be added. It is also recommended that the means of impact and the priority indicators should be chosen at this stage, which are those considered to be most directly aligned with the assessment’s objectives.</p>
				<p>The third phase is technical and operational. It is intended to define how data will be collected, a process that could combine primary and secondary data collection, and how it is carried out. It should be noted that part of the data and information to be collected may be easily accessible and found in existing documents. At the same time, a specific effort may be required to obtain other parts. It can also be assumed that both quantitative data and qualitative information will be collected.</p>
				<p>The fourth phase comprises the compilation and analysis of the data and information obtained in the previous phase. In addition to preparing tables that demonstrate the impacts, this is the stage at which the results should be compared (for example, with external references, between units, with previous results, or a combination of these). The positive and negative impacts of the university on the local community must also be identified.</p>
				<p>The fifth phase builds on the previous phase. Actions should be identified for conserving and, ideally, maximizing positive impacts and minimizing (and ideally suppressing) negative impacts.</p>
				<p>The sixth phase is the implementation of the actions defined in the fifth phase. In addition to their execution, the results must be continuously monitored to ensure they align with the plan, with corrective actions being carried out when necessary.</p>
			</sec>
			<sec sec-type="conclusions">
				<title>CONCLUSION</title>
				<p>This article presented a conceptual model for assessing the impact of a university on its local community. This model was based on existing literature, which indicated three types of impacts. These are socioeconomic impacts, scientific and technological impacts, and impacts on the region’s culture and image. In addition to the impact assessment model, this work presented a second model for making the impact assessment model operational.</p>
				<p>Considering the Brazilian context, the article draws attention to dimensions found in the scientific literature but are not considered in national assessment systems. These systems favor three dimensions of university activities (teaching, research, and extension courses) (<xref ref-type="bibr" rid="B77">Weber, 2010</xref>; <xref ref-type="bibr" rid="B57">Pinto, Mello &amp; Melo, 2016</xref>). Local systems use extensive lists of criteria and parameters for evaluating institutions and programs. They differ from the system discussed herein in at least two aspects. The first is their purpose. Brazilian systems are intended to guarantee and boost the quality of the country’s institutions and its teaching and research programs, while the aim of the system proposed in this article is to evaluate and boost the positive impact of institutions in their respective communities or regions. The second aspect is how these systems are applied. Local systems employ unique standards for evaluating institutions with different characteristics. In contrast, although it can use common dimensions and criteria, the proposed system presupposes an application customized to fit each specific context. Thus, the impact assessment model presented here can be seen as a complement to existing systems, not a substitute for them.</p>
				<p>Finally, it should be noted that this work is an initial effort, the product of which can be further enriched. The proposed conceptual model is not a ready-to-use system. It must be empirically validated to be used as an administrative tool by the managers of teaching and research institutions. Future developments should also focus on making the assessment operational, which poses complex methodological challenges.</p>
				<p>Regarding future research, a first possibility would be to carry out case studies, applying the model to different universities to critically assess its potential and improve upon it. A second possibility would be to carry out comparative case studies between different units or different universities to assess how different contexts can be dealt with. A third possibility would be to carry out longitudinal studies, observing how a university, or a unit within a university, evolves.</p>
			</sec>
		</body>
		<back>
			<ack>
				<title>AKNOWLEDGMENTS</title>
				<p>This article originated from Wagner Curi’s dissertation. The author thanks CAPES for supporting his doctorate (Dinter). The authors thank the anonymous referees for their useful suggestions.</p>
			</ack>
			<fn-group>
				<fn fn-type="other" id="fn5">
					<p>[Translated version] Note: All quotes in English translated by this article’s translator.</p>
				</fn>
			</fn-group>
		</back>
	</sub-article-->
</article>