Acessibilidade / Reportar erro

Impacts of the Brazilian innovation tax policy on the composition of private investments and on the type of innovation

Impactos da política fiscal de inovação brasileira na composição de investimentos privados e no tipo de inovação

Abstract

The objective of this paper is to investigate whether the tax incentives for innovation in Brazil established by Law 11,196/05 (BRASIL, 2005) have altered the composition of firms’ innovation investments and their results. Based on the concept of behavioral additionality and on the design of the policy, we derive three propositions on how these incentives affect the bundle of innovation expenditures, the educational level of researchers and the type of innovation pursued by firms. Using disaggregate data at firm level from the Brazilian Industrial Innovation Survey (PINTEC) of 2008 and 2011 and other sources, the average treatment effect on the treated (ATT) is estimated through propensity score matching with difference-in-differences. The main findings of the study are: (a) incentives had a positive impact on the research and development (R&D) intensity of innovation investments, increasing R&D spending by around 1,1 million Brazilian reais on average, while decreasing mean spending on acquisition of external knowledge and introduction of innovations in the market; (b) although the policy fostered additional hiring of researchers with undergraduate degree, no significant impact on personnel with master’s or Ph.D. degrees was found; and (c) there is no evidence of impact on the balance between product and process innovation.

Keywords:
Behavioral Additionality; Private Innovation; Investment Composition; Tax incentives

Resumo

O objetivo deste artigo é investigar se os incentivos fiscais para inovação da Lei 11.196/05 (BRASIL, 2005) alteraram a composição dos investimentos em inovação das empresas e seus resultados. Tomando por base o conceito de adicionalidade comportamental e o desenho da política fiscal, são apresentadas três proposições sobre como esses incentivos afetam a cesta de gastos com inovação, o nível educacional dos pesquisadores e o tipo de inovação desenvolvido pelas firmas. A partir de dados desagregados da Pesquisa de Inovação (PINTEC) de 2008 e 2011 e de outras fontes, o efeito médio do tratamento nas unidades tratadas (ATT) é estimado utilizando-se um pareamento por escore de propensão (PSM) com diferença-em-diferenças. As principais conclusões do estudo são: os incentivos impactaram positivamente a intensidade de pesquisa e desenvolvimento (P&D) dos investimentos em inovação das firmas, elevandoos gastos com P&D em cerca de R$ 1,1 milhão na média, assim como reduzindo os gastos médios com aquisição de outros conhecimentos externos e com introdução de inovações no mercado; embora a política tenha fomentado a contratação adicional de pesquisadores com diploma de graduação, não foi encontrado impacto significativo para pessoal de pesquisa com titulação de mestrado ou doutorado; e não há evidência de impacto no balanço entre inovações de produto e processo.

Palavras-chave:
Adicionalidade comportamental; Composição de Investimentos; Incentivos Fiscais; Inovação privada

1. Introduction

In 2005, the Brazilian government approved a new framework of tax incentives to promote business innovation in the country. Law 11,196/05 (BRASIL, 2005) established a horizontal policy that allowed for the enhanced deduction of innovation expenses from the taxable income of beneficiary firms, among other benefits. A group of studies found positive effects of these incentives on private innovation investment (KANNEBLEY JR. et al., 2013KANNEBLEY JR., S.; ARAÚJO, B. C.; MAFFIOLI, A.; STUCCHI, R. Productive development policies and innovation spillovers through labor force mobility: the case of the Brazilian innovation support system. Inter-American Development Bank, 2013 (IDB working paper series, 459).; KANNEBLEY JR.; SILVEIRA PORTO, 2012; SHIMADA, 2014SHIMADA, E. Efetividade da lei do bem no estímulo ao investimento em P&D: uma análise com dados em painel. São Paulo: Universidade de São Paulo, 2014.), but up to this point there is no evidence on whether firms’ innovation strategies were also affected. This paper addresses this issue by presenting a quantitative analysis of the impact of the tax incentives on the composition of the innovation investments and on the type of innovation pursued by beneficiary firms.

In the last decades, the economic literature on innovation policies has assessed and estimated the impact of government incentives in different countries, whether in the case of direct subsidies or tax incentives (CUNNINGHAM; GÖK; LARÉDO, 2012GÖK, A.; EDLER, J. (The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, v. 21, n. 4, p. 306-318, 2012.; KÖHLER; LAREDO; RAMMER, 2012KÖHLER, C.; LAREDO, P.; RAMMER, C. The impact and effectiveness of fiscal incentives for R&D. Compendium of Evidence on the effectiveness of Innovation Policy. University of Manchester, 2012 (Nesta Working Paper, 12/01)). However, until recently, majority of studies considered research and development (R&D) as a homogeneous activity (ZÚÑIGA-VICENTE et al., 2014) and did not investigate modifications in the composition of private spending caused by changes in firms’ strategies and behavior - the ‘behavioral additionality’ effect (GEORGHIOU; CLARYSSE, 2006GEORGHIOU, L.; CLARYSSE, B. Introduction and synthesis. In OECD. Government R&D funding and company behaviour - Measuring behavioural additionality. Paris: OECD Publishing, 2006.).

However, this is a relevant topic for innovation policy, as the composition of investments is likely to affect their efficiency and their results (AGGARWAL; HSU; WU, 2015AGGARWAL, V. A.; HSU, D. H.; WU, A. R&D production team organization and firm-level innovation. 2015 (working paper).; BARGE-GIL; LÓPEZ, 2014BARGE-GIL, A.; LÓPEZ, A. R versus D: Estimating the differentiated effect of research and development on innovation results. Industrial and Corporate Change, v. 24, n. 1, p. 93-129, 2014.). For this reason, recent empirical analyses (discussed in section 2) have advanced this debate by assessing how innovation policy impacts the structure of firms’ innovation bundles, although the existing evidence is still small (NEICU; TEIRLINCK; KELCHTERMANS, 2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.).

This paper aims to contribute to this literature by presenting evidence of the Brazilian case. The objective is to investigate whether the tax incentives provided by Law 11,196/05 (BRASIL, 2005) have had an impact on the bundle of innovation investments of beneficiary firms and on their results. We consider three different criteria: (a) spending on R&D and other categories of innovative activities;1 1 As defined in section 4. (b) the educational level of R&D personnel; and (c) the type of innovation (product or process). Based on the notion of behavioral additionality and on the policy design discussed in sections 2 and 3, we derive three propositions on how investments and results may have been affected by the policy. These propositions are tested through a quantitative investigation using disaggregate data at firm level of the Brazilian Industrial Innovation Survey (PINTEC). Our focus is not on the overall level of innovation inputs (or on their results), but rather on how the structure of the innovation bundle was affected by the incentives.

This paper presents the following contributions to the existing literature: first, it sheds new light on the impact of the tax incentives of Law 11,196/05 (BRASIL, 2005), whereas previous quantitative studies discussed in section 3 focused exclusively on input and output additionalities. Besides, to the best of our knowledge, it is the first quantitative assessment of the impact of a policy on the composition of private innovation investments in Brazil. Finally, as the empirical literature on this subject is still limited and refers almost exclusively to developed economies, this paper adds to the existing body of knowledge at the international level by presenting an analysis of the Brazilian case.

The following section reviews the literature on behavioral additionality of innovation policies and on the classifications used in the empirical analysis. Section 3 describes the innovation tax policy in place in Brazil, and section 4 presents the data and empirical strategy used for the analysis. The fifth part exhibits and debates the results, and the last section summarizes and concludes the paper.

2. Literature review

2.1. The behavioral additionality of innovation policies

The effect of public policies on innovation strategies of firms is known as the behavior additionality effect (BUISSERET; CAMERON; GEORGHIOU, 1995BUISSERET, T. J.; CAMERON, H. M.; GEORGHIOU, L. What difference does it make? Additionality in the public support of R&D in large firms. International Journal of Technology Management, v. 10, n. 4-6, p. 587-600, 1995.). Georghiou (1994GEORGHIOU, L. Impact of the framework programme on European industry. European Commission, Directorate General Telecommunications, Information Market and Exploitation of Research, 1994., 2002) suggested that policy impact had three different dimensions: input (usually interpreted as expenditure increase); behavioral (change in the firm’s strategy); and output (modification of results). The report of the Organization for Economic Co-operation and Development (OECD) on the subject stated that this approach aims to “measure explicitly changes in the ways firms conduct R&D as a result of government policy instruments” (OECD, 2006, p. 7) regardless of a significant impact on the bulk of total R&D. These analyses are supposed to complement (and not replace) the traditional approach of input additionality.

The importance of the behavioral approach lies in the fact that the traditional concepts of input and output additionality do not sufficiently describe the impact of public policies on the innovation process (FALK, 2007FALK, R. Measuring the effects of public support schemes on firms’ innovation activities: Survey evidence from Austria. Research Policy, v. 36, n. 5, p. 665-679, 2007.). The idea is to open the “R&D black box” (DAVID; HALL; TOOLE, 2000HALL, B. H.; VAN REENEN, J. How effective are fiscal incentives for R&D? A review of the evidence. Research Policy, v. 29, n. 4-5, p. 449-469, 2000.) to identify the channels through which government subsidies and incentives alter private innovation. For this reason, this approach connects to a rationale for government intervention that goes beyond the neoclassical concept of market failure (GÖK; EDLER, 2012GÖK, A.; EDLER, J. (The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, v. 21, n. 4, p. 306-318, 2012.; NEICU et al., 2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.). It comes closer to an evolutionary or neo-Schumpeterian perspective of innovation policy that emphasizes gains in the cognitive capacity and knowledge base of firms, to which their behavior and strategies are intrinsically linked (BACH; MATT, 2002).

An interesting feature of behavioral additionality is that it comprises multiple layers, or dimensions, of firms’ innovation strategies. For this reason it opens a wide range of subjects and methods that can be used for policy analysis and evaluation.2 2 For a review of the literature, see Gök and Edler (2012) and Cunningham et al. (2012). A growing number of empirical studies have assessed behavioral additionality effects in distinct policies and contexts. According to Cunningham et al. (2012CUNNINGHAM, P.; GÖK, A.; LARÉDO, P. The impact of direct support to R&D and innovation in firms. Manchester Institute of Innovation Research, 2012.), most of this literature focused on collaboration and partnerships (BUSOM; FERNÁNDEZ-RIBAS, 2008BUSOM, I.; FERNÁNDEZ-RIBAS, A. The impact of firm participation in R&D programmes on R&D partnerships. Research Policy, v. 37, n. 2, p. 240-257, 2008.) but there are also analyses on organizational learning (CLARYSSE; WRIGHT; MUSTAR, 2009CLARYSSE, B.; WRIGHT, M.; MUSTAR, P. Behavioural additionality of R&D subsidies: a learning perspective. Research Policy, v. 38, n. 10, p. 1517-1533, 2009.); project enlargement and commercialization behavior (HSU; HORNG; HSUEH, 2009HSU, F.-M.; HORNG, D.-J.; HSUEH, C.-C. The effect of government-sponsored R&D programmes on additionality in recipient firms in Taiwan. Technovation, v. 29, n. 3, p. 204-217, 2009.); duration of projects (FALK, 2007FALK, R. Measuring the effects of public support schemes on firms’ innovation activities: Survey evidence from Austria. Research Policy, v. 36, n. 5, p. 665-679, 2007.); risk of innovative activity (FELDMAN; KELLEY, 2003FELDMAN, M. P.; KELLEY, M. R. Leveraging research and development: assessing the impact of the US Advanced Technology Program. Small Business Economics, v. 20, n. 2, p. 153-165, 2003.); and probability of exiting the market (EBERSBERGER, 2011EBERSBERGER, B. Public funding for innovation and the exit of firms. Journal of Evolutionary Economics, v. 21, n. 3, p. 519-543, 2011.).

The composition of innovation investments and their results may be deemed to be one of the perspectives used to analyze behavioral additionality. The assumption is that a change in firms’ innovation strategies and activities also affects the allocation of their available resources. In this paper, the behavioral additionality of the Brazilian policy is assessed using three dimensions or groups of variables: the division of investment in different innovative activities; the educational background of R&D personnel; and the balance between product and process innovation.

The main point of investigating the first (composition of the bundle of innovative activities) is to acknowledge and consider that firms choose between distinct activities to obtain and apply new information in order to increase productivity or design new products. In this conceptual framework, R&D is but one strategy available to the firm. The Frascati Manual requires that, to fall under the category of R&D, the activity must be (a) novel, (b) creative, (c) uncertain, (d) systematic, and (e) either transferable or reproducible (OECD, 2015a). Innovative activity, on the other hand, is a broader concept that includes any procedure aimed at implementing innovation, whether of a scientific, technological, organizational, financial, or commercial nature (OECD, 2005).

The behavioral additionality in this case can be described as a change in the relative importance of each activity in the innovation strategy of the firm. It refers to the ‘knowledge acquisition’ dimension of the government support, or how firms organize their innovation activities (GEORGHIOU; CLARYSSE, 2006GEORGHIOU, L.; CLARYSSE, B. Introduction and synthesis. In OECD. Government R&D funding and company behaviour - Measuring behavioural additionality. Paris: OECD Publishing, 2006.). A reduction in the share of strict R&D indicate that firms favor lower risk projects with less technical complexity (PINGFANG; WEIMIN; LUNDIN, 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.) and greater short-run profit prospects (DAVID et al., 2000DAVID, P. A.; HALL, B. H.; TOOLE, A. A. Is public R&D a complement or substitute for private R&D? A review of the econometric evidence. Research Policy, v. 29, n. 4, p. 497-529, 2000.). We argue that such an effect can be assessed by investigating how the policy affects the spending on each category of innovative activity, or the composition of the investment bundle. The composition of investments was used by Neicu et al. (2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.) to measure and assess behavioral additionality (although the authors focus on the research versus development ratio); Hsu et al. (2009HSU, F.-M.; HORNG, D.-J.; HSUEH, C.-C. The effect of government-sponsored R&D programmes on additionality in recipient firms in Taiwan. Technovation, v. 29, n. 3, p. 204-217, 2009.) and Feldman and Kelley (2003FELDMAN, M. P.; KELLEY, M. R. Leveraging research and development: assessing the impact of the US Advanced Technology Program. Small Business Economics, v. 20, n. 2, p. 153-165, 2003.) also considered additional investment in risky projects as an indicator of policy-induced change in firms’ behavior.

Empirical studies found that firms commonly undertake more ‘strict R&D’ when they benefit from direct subsidies (CLAUSEN, 2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.; PINGFANG et al., 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.). Feldman and Kelley (2003FELDMAN, M. P.; KELLEY, M. R. Leveraging research and development: assessing the impact of the US Advanced Technology Program. Small Business Economics, v. 20, n. 2, p. 153-165, 2003.) and Neicu et al. (2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.) also found evidence that government support might favor high-risk research. Pingfang et al. (2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.), on the other hand, concluded that enterprises tend to switch from R&D to low-tech activities, which produce quicker results in the short run.

The second classification analyzed in this paper is the educational level of R&D personnel. The upgrade of human resources is another dimension of behavioral additionality described by Georghiou and Clarysse (2006GEORGHIOU, L.; CLARYSSE, B. Introduction and synthesis. In OECD. Government R&D funding and company behaviour - Measuring behavioural additionality. Paris: OECD Publishing, 2006.), Clarysse, Bilsen, Steurs, and Consult (2006), Hsu et al. (2009HSU, F.-M.; HORNG, D.-J.; HSUEH, C.-C. The effect of government-sponsored R&D programmes on additionality in recipient firms in Taiwan. Technovation, v. 29, n. 3, p. 204-217, 2009.) and Suzuki and Yumitori (2006SUZUKI, J.; YUMITORI, S. Behavioural additionality of public R&D funding in Japan. In: OECD. Government R&D funding and company behaviour: measuring behavioural additionality. Paris: OECD, 2006.). It is considered a key component of this approach (AFCHA; GARCÍA-QUEVEDO, 2016AFCHA, S.; GARCÍA-QUEVEDO, J. The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, v. 25, n. 6, p. 955-975, 2016.) as the proper qualification of personnel is deemed essential for the development of innovation-related projects (DUMONT; SPITHOVEN; TEIRLINCK, 2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.; SPITHOVEN; TEIRLINCK, 2010), particularly when considering the complexity of these activities and the fact that they rely heavily on the knowledge of available research personnel. Based on this argument, innovation policies should aim not only at increasing the number of researchers hired, but also at improving the qualifications or educational level of the R&D team, thus enabling the firm to acquire new skills and competitive advantages (AFCHA; GARCÍA-QUEVEDO, 2016).

A small number of empirical studies has investigated the impact of innovation policies on the educational level of R&D personnel. According to Clausen (2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.) and Dumont et al. (2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.), the effect is positive for distinct public incentives, and both studies found that beneficiary firms hired more highly qualified researchers, with either a master’s or a Ph.D. degree. Afcha and García-Quevedo (2016AFCHA, S.; GARCÍA-QUEVEDO, J. The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, v. 25, n. 6, p. 955-975, 2016.), on the contrary, did not obtain any significant result for the educational mix of research personnel.

The third classification considered herein distinguishes whether firms pursue product or process innovation (ARALICA; BOTRIĆ, 2013ARALICA, Z.; BOTRIĆ, V. Evaluation of research and development tax incentives scheme in Croatia. Ekonomska Istrazivanja-Economic Research, v. 26, n. 3, p. 63-80, 2013.; BELADI, MARJIT; YANG, 2012BELADI, H.;, MARJIT, S.; YANG, L. Outsourcing: volume and composition of R&D. Review of International Economics, v. 20, n. 4, p. 828-840, 2012.; SAHA, 1999SAHA, S. R&D composition over the product life cycle. Minneapolis, MN: Center for Economic Research, University of Minnesota, 1999 (Discussion Paper, n. 309).). Such a distinction was used by Hyvärinen (2006HYVÄRINEN, J. Behavioural additionality of public R&D funding in Finland. Government R&D funding and company behaviour: measuring behavioural additionality. Paris: OECD, 2006. p. 115-125.) to assess the behavioral additionality of public funding in Finland. Both types can positively impact a firm’s output, but process innovation is more related to productivity increase, while product innovation generates either new or better-quality goods (SAHA, 1999). However, it is not uncommon or these two types of innovation to be closely linked. The objective of considering these categories in a behavioral additionality analysis is to assess whether the innovation policy has had any role or influence on the type of R&D pursued by firms, or if this was the result of other factors, such as industrial sector, firm size, and market structure (COHEN; KLEPPER, 1996COHEN, W. M.; KLEPPER, S. Firm size and the nature of innovation within industries: the case of process and product R&D. The review of Economics and Statistics, v. 78, n. 2, 1996, p. 232-243.). Empirical evidence on the topic is ambiguous. Aralica and Botrić (2013ARALICA, Z.; BOTRIĆ, V. Evaluation of research and development tax incentives scheme in Croatia. Ekonomska Istrazivanja-Economic Research, v. 26, n. 3, p. 63-80, 2013.) found that only product innovation benefited from innovation policies in Croatia, while according to Jaffe and Le (2015JAFFE, A. B.; LE, T. The impact of R&D subsidy on innovation: a study of New Zealand firms. Cambridge, MA: National Bureau of Economic Research, 2015 (NBER Working Paper Series, 21479).), New Zealand firms increased their results in both types at similar rates.

2.2. Tax incentives and behavioral additionality

The choice of policy instrument can affect the type and magnitude of behavioral additionality, as distinct requirements, obligations, incentivized activities and funding schemes can trigger different responses and behaviors from firms. Understanding such differences is relevant for improving both the policy design and the innovation policy mix (GEORGHIOU; CLARYSSE, 2006GEORGHIOU, L.; CLARYSSE, B. Introduction and synthesis. In OECD. Government R&D funding and company behaviour - Measuring behavioural additionality. Paris: OECD Publishing, 2006.). In this study, we focus on the case of tax incentives, a policy tool to foster innovation that has been adopted by a growing number of countries since the 1980s (BLOOM et al., 2002BLOOM, N.; CHENNELLS, L.; GRIFFITH, R.; VAN REENEN, J. How has tax affected the changing cost of R&D? Evidence from eight countries. In: SMITH, H. L. (Ed.). The regulation of science and technology. New York: Palgrave, 2002. p. 136-160.).

There are two main arguments to maintain that tax incentives should present different behavioral additionality effects from those arising from direct subsidies. The first one is that fiscal benefits are considered more market-oriented, meaning that firms retain the decision on which projects and ideas are financed and implemented, instead of a previous choice by government bureaucracy (DAVID et al., 2000DAVID, P. A.; HALL, B. H.; TOOLE, A. A. Is public R&D a complement or substitute for private R&D? A review of the econometric evidence. Research Policy, v. 29, n. 4, p. 497-529, 2000.; HALL; VAN REENEN, 2000HALL, B. H.; VAN REENEN, J. How effective are fiscal incentives for R&D? A review of the evidence. Research Policy, v. 29, n. 4-5, p. 449-469, 2000.). By keeping the decision-making process within the firm, these incentives minimize inefficiencies and the allocative distortions arising from government intervention. On the other hand, tax incentives may pose a problem in terms of the social returns of funded projects. Pursuant to the market failure argument, innovation policies are mainly justified by the high levels of positive externalities or knowledge spillovers (CUNNINGHAM et al., 2012CUNNINGHAM, P.; GÖK, A.; LARÉDO, P. The impact of direct support to R&D and innovation in firms. Manchester Institute of Innovation Research, 2012.). However, as tax incentivized firms retain full control of their R&D portfolio, they would minimize such externalities by developing technologies that can be largely appropriated by means of internalized profits (HALL; VAN REENEN, 2000).

Both the market-oriented nature and bias towards projects with less knowledge spillovers should impact the nature of R&D performed by firms, thus providing a theoretical basis to investigate the behavioral additionality of tax incentives. However, the empirical literature provides limited information on this topic, as most studies on tax incentives focus on input additionality (ZÚÑIGA-VICENTE et al., 2014). The elasticity of fiscal benefits was the object of different analyses,3 3 For recent reviews of this literature, see IFS (2015) and Ladinska, Non and Straathof (2015). and the majority of them identified an elasticity inferior to one (IFS, 2015IFS, I. A study on R&D tax incentives. Final report. European Commission, 2015. Available at <https://ec.europa.eu/futurium/en/system/files/ged/28-taxud-study_on_rnd_tax_incentives_-_2014.pdf>.
https://ec.europa.eu/futurium/en/system/...
), although there is evidence that these effects tend to increase with time (KÖHLER et al., 2012KÖHLER, C.; LAREDO, P.; RAMMER, C. The impact and effectiveness of fiscal incentives for R&D. Compendium of Evidence on the effectiveness of Innovation Policy. University of Manchester, 2012 (Nesta Working Paper, 12/01)).

Most studies on behavioral additionality mentioned in the last section did not focus on fiscal incentives. As mentioned, in spite of recent developments, there is still little evidence on how tax breaks affect behavioral additionality and innovation investment composition. Four studies are noteworthy as they considered the impact of fiscal measures in at least one of the dimensions considered herein (ARALICA; BOTRIĆ, 2013ARALICA, Z.; BOTRIĆ, V. Evaluation of research and development tax incentives scheme in Croatia. Ekonomska Istrazivanja-Economic Research, v. 26, n. 3, p. 63-80, 2013.; DUMONT et al., 2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.; NEICU et al., 2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.; PINGFANG et al., 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.). In all cases, they found different policy effects for individual categories of investment or type of innovation, suggesting a change in firms’ innovation strategies or behavior induced by government support.

Clausen (2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.) argued that the impact of subsidies on investment composition is inherently linked to the level of uncertainty of subsidized projects and, for this reason, the policy design must be taken into account when analyzing the potential effect of a subsidy scheme. We follow this reasoning and examine the design of the tax incentives approved by the Brazilian government to develop the hypotheses of such impacts.

3. The Brazilian innovation tax policy

Since 2003, Brazil has experienced a substantial shift in the industrial policy paradigm at the federal level. Fostering economic development has become a primary policy target to be achieved by nurturing dynamic comparative advantages and competitiveness of national companies at the international level. Such was the message of the Industrial, Technology, and Foreign Trade Policy announced by the government in 2003 (BRAZIL, 2003).

A new regulatory framework for innovation tax incentives was approved by Brazilian Congress in 2005. Following the experience and framework of other countries (OECD, 2015c), the new Law 11,196/05 (BRASIL, 2005) expanded previous incentives and reduced the cost of innovation projects by allowing the deduction of expenditures from the base of income taxes. Along with other sectoral and regional policies, the incentives raised the volume of tax benefits to corporate R&D substantially. The Brazilian ‘b-index’ (an indicator used by the OECD to measure the tax cost of R&D and innovation activities)4 4 “The b-index is a measure of the level of pre-tax profit a ‘representative’ company needs to generate to break even on a marginal, unitary outlay on R&D” (OECD, 2013, p. 1). decreased around 8%, reaching a value of around 0.73 (ARAÚJO, 2010ARAÚJO, B. C. Incentivos fiscais à pesquisa e desenvolvimento e custos de inovação no Brasil. Radar, n. 9, p. 3-11, ago. 2010.). This represents a considerably lower cost than the one observed in most OECD countries, that averaged a ‘b-index’ of 0.88 in 2011, although it is still higher than the estimate for countries like France (0.66), Portugal (0.59) and Spain (0.65) (WARDA, 2013WARDA, J. B-index time series 1981-2011. 2013. (Discussion paper). Available at <http://www.oecd-ilibrary.org/science-and-technology/oecd-science-technology-and-industry-outlook-2014/tax-incentives-for-r-amp-d-and-innovation_sti_outlook-2014-18-en>.
http://www.oecd-ilibrary.org/science-and...
).

The law also represented an important change in the structure of the national innovation policy mix. The share of public support for R&D through tax incentives grew from less than a quarter in 2002 to more than 40% in 2008, later declining to around a third of total benefits (BRASIL, 2016b). The same trend has been observed in different countries since the last decade, as budgetary constraints led governments to favor policies that do not affect their expenditures, such as tax incentives (OECD, 2016).

Law 11,196/05 (BRASIL, 2005) initially provided for six tax incentives, but further amendments added others and modified existing ones. Considering the focus of this study on the composition of investments and results, Table 1 classifies these benefits according to the changes they introduce in the relative tax cost of different activities or categories, with potential impact on firms’ innovation strategies and investment composition, thus justifying our choice of the three criteria described in the previous section and providing the basis for the propositions to be tested in the empirical study.

TABLE 1
Summary of the tax incentives of Law 11,196/05

Deduction of R&D expenditures is the most important incentive and it represents almost the entire value of tax breaks provided by the law (BRASIL, 2016a). Firms can deduct up to 160% of their ‘technological research and technological innovation development’ spending from the taxable base of income tax and social contribution to the net profit. In principle, this benefit favors the development of strict R&D projects over other innovative activities. However, the conceptual framework of the policy blurs the distinction between R&D and other innovative activities, as incentivized expenditures encompass not only the standard cases of research and experimental development, but also other activities that are classified as ‘other types of innovative activities’ (OECD, 2005). These include: (a) testing, standardization, calibration of machinery and equipment, and certification (labeled as ‘industrial basic technology’); and (b) technical support services, including installation and maintenance of research equipment and facilities, and training of research personnel.

If, in addition to the R&D spending, the firm increases its research payroll, the ceiling of expense deductions rises by 20% of total spending. The law neither distinguishes nor sets any requirement for minimum academic degrees or experience of newly hired research personnel. Decree 5,798/05 defines researcher as any graduate, undergraduate, or technical high school level employee dedicated to R&D activities.

The law also makes no distinction between product and process innovation as both are included in the definition of technological innovation and are, therefore, eligible for the incentives. Nonetheless, there is an additional benefit for expenditures related to patented technologies, and firms are exempt from withholding income tax levied on payments for patent filing abroad. As there is evidence in the literature that patents are more suited to the protection of products than of process innovation (LÓPEZ, 2009LÓPEZ, A. Innovation and appropriability, empirical evidence and research agenda. The economics of intellectual property: suggestions for further research in developing countries and c.ountries with economies in transition. Geneva: World Intellectual Property Organization (WIPO), 2009.), one may argue that these provisions create a distinction in favor of the former type.

Thus far, only a few studies have tried to assess the impact of tax incentives for innovation in the country. Three quantitative analyses concluded that they had positive effects on firms’ R&D expenditures, technical personnel and export levels (KANNEBLEY JR. et al., 2013KANNEBLEY JR., S.; ARAÚJO, B. C.; MAFFIOLI, A.; STUCCHI, R. Productive development policies and innovation spillovers through labor force mobility: the case of the Brazilian innovation support system. Inter-American Development Bank, 2013 (IDB working paper series, 459).; KANNEBLEY JR.; SILVEIRA PORTO, 2012; SHIMADA, 2014SHIMADA, E. Efetividade da lei do bem no estímulo ao investimento em P&D: uma análise com dados em painel. São Paulo: Universidade de São Paulo, 2014.). None of these analyses have considered either the behavioral additionality effects of the policy or how it has affected either the mix of activities or input factors for innovation. This is the main novelty and purpose of the empirical analysis that follows.

4. Empirical analysis

This empirical study aims to investigate the impact of the tax incentives of Law 11,196/05 (BRASIL, 2005) on the composition of the innovation investments of beneficiary firms and their results, in order to assess the behavioral additionality of the policy. The main assumption, as mentioned, is that the bundle of investments and results reflects the choices and strategies of firms, and that a change in its composition indicates a behavioral additionality of the tax benefits. Such change is assessed herein by estimating the impact of the policy on the individual components of the three broad classifications discussed in the previous sections, and then comparing the individual results.

Following Clausen (2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.), we understand that such effect can only be properly explained by taking into account the policy design, along with the economic theory presented in section 2. Based on such discussions, three propositions for the impact of the tax incentives are presented and tested herein:

  • 1stProposition: the incentives caused beneficiary firms to increase the R&D intensity of their investment bundle, spending a larger portion of its innovation spending with strict R&D. As discussed in section 2, this proposition refers to the ‘knowledge acquisition’ dimension of the policy. It states that firms that benefited from the incentives are likely to invest a substantial part of the additional resources in R&D, thus developing riskier and more technologically complex projects. Such a hypothesis follows from the result of previous empirical analyses (CLAUSEN, 2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.; NEICU et al., 2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.; PINGFANG et al., 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.) and can also be explained by the fact that strict R&D is the main category of expenditure that can be deducted from a firm’s taxable base - the most important incentive provided by the law.

  • 2ndProposition: the policy had a positive effect on the educational level of the research team, but the impact on the hiring of highly qualified researchers is not significant. Again, previous studies suggested that government support should positively affect the composition of research personnel in terms of their educational background (AFCHA; GARCÍA-QUEVEDO, 2016AFCHA, S.; GARCÍA-QUEVEDO, J. The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, v. 25, n. 6, p. 955-975, 2016.; CLAUSEN, 2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.; DUMONT et al., 2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.). However, as the Brazilian law does not require beneficiary firms to hire researchers with high qualifications (graduate degrees), companies with no projects that require professionals with such advanced knowledge should find it more advantageous to employ less qualified - and less expensive - personnel to obtain the additional incentives described in Table 1. For this reason, we expect a non-significant effect on the number of researchers with masters and Ph.D. degrees, which implies a limited impact of the policy on the improvement of firms’ innovative capacity (AFCHA; GARCÍA-QUEVEDO, 2016).

  • 3rdProposition: the policy did not significantly impact the balance between product and process innovation in beneficiary firms. Although the policy provides for additional incentives that are more appropriate for product innovation, we do not expect a significant change in the type of innovation pursued by incentivized companies, mostly because of the relative small size of the additional deduction for valid patents, and also due to a complementarity effect between the two types of innovation (LIN; SAGGI, 2002LIN, P.; SAGGI, K. Product differentiation, process R&D, and the nature of market competition. European Economic Review, v. 46, n. 1, p. 201-211, 2002.).

4.1. Identification strategy

The research strategy implemented is the propensity score matching (PSM) (DEHEJIA; WAHBA, 1999DEHEJIA, R. H.; WAHBA, S. Causal effects in, nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, v. 94, n. 448, p. 1053-1062, 1999., 2002). The main rationale of this method is to estimate the causal effect of treatment (the innovation tax incentives) by comparing the value of outcome variables for treated units (beneficiary firms) with an estimated value of such variables had such units not been treated - the average treatment effect on the treated (ATT). The comparison between supported and unsupported firms is one of the main frameworks used to the assess behavioral additionality of innovation programs (FALK, 2007FALK, R. Measuring the effects of public support schemes on firms’ innovation activities: Survey evidence from Austria. Research Policy, v. 36, n. 5, p. 665-679, 2007.).

Firms in the control group (non-treated observations) are used as a basis for such estimation, but as the incentives are not randomly assigned, the expected value of outcome variables conditional on treatment for these firms is likely to be different from the value for firms in the treated group - the selection bias problem (DEHEJIA; WAHBA, 2002_________. Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics, v. 84, n. 1, p. 151-161, 2002.). To account for these differences, the PSM uses a preliminary step in which firms from both groups are matched based on their probability of obtaining the incentives.

Such probability for a firm (i) is represented by a propensity score calculated using a set of covariates and applying a logit functional distribution form. As the sample of firms and the year of participation in the policy considered for the analyses change for each broad classification (as explained in section 4.2), a specific propensity score is estimated for each case, so it more appropriately reflects the probability of treatment for that group.

The crucial assumption of the model is the ‘conditional independence’ or ‘selection on observables’, meaning that, once the propensity score is controlled for, participation in the policy (T i = 1 if firm ‘i’ benefited from the incentives, and T i = 0 if not) can be deemed to be random. If such assumption holds, the expected conditional values of outcome variables for treated (E[Yi0p(Xi),Ti=1]) and non-treated (E[Yi0p(Xi),Ti=0]) firms are independent of treatment, and therefore they can be considered equivalent. The selected control group can then be used as a suitable counterfactual for estimation of the ATT.

Y i 0 T i p ( X i ) E [ Y i 0 p ( X i ) , T i = 0 ] = E [ Y i 0 p ( X i ) , T i = 1 ] (1)

In practical terms, after excluding observations out of the common support,5 5 According to the common support assumption, observations with a propensity score above the maximum level common to both treatment and control groups or below the minimum common level should be excluded from the sample. treated units were matched with their control counterparts using the nearest neighbor with replacement algorithm. A means test is used to assess the quality of matching, checking if covariates are reasonably balanced between matched units.

The ATT for non-binary outcome variables (categories of innovative activities and educational level of R&D personnel) is calculated through linear regression with matched units using the difference between the values after (YiT1) and before (YiT0) treatment effect took place, as presented in equation 2. This difference-in-differences framework weakens the conditional independence assumption for it allows time-invariant non-observable factors to influence treatment assignment probability, since they are excluded from the estimation as fixed effects. To assess the significance of the estimated ATT, we use Abadie and Imbens’ (2006) heteroskedasticity-consistent analytical standard errors with two neighbors.

τ | T = 1 = E [ Y i 1 1 Y i 1 0 p ( X i ) , T i = 1 ] E [ Y i 0 1 Y i 0 0 p ( X i ) , T i = 0 ] (2)

In the case of binary outcome variables, the ATT represents the impact of the incentives on the chances of a firm having developed product-only, process-only or both types of innovation in the 2009-2011 period. For this reason, the parameter is estimated through a logistic regression with a maximum likelihood estimator, using exclusively the units selected in the propensity score and weighting the control observations in the case of repetition.

The Rosenbaum bounds approach (DIPRETE; GANGL, 2004DIPRETE, T. A.; GANGL, M. Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments. Sociological Methodology, n, 34, p. 271-310, 2004.; ROSENBAUM, 2012ROSENBAUM, P. R. Design of observational studies. New York: Springer, 2012.) is applied to assess the sensitivity of statistically significant results to hidden variable bias, with (Γ) intervals of (0.1) applied up to the value of two. As robustness checks, policy impact is estimated according to three different methods: (a) with log-linearized transformations of continuous outcome variables; (b) with two alternative matching algorithms (kernel and radius matching); and (c) through a Seemingly Unrelated Regression (SUR) framework for non-binary outcome variables (innovative activities and R&D personnel) and through linear regression for binary type of innovation outcomes.

4.2. Data and descriptive statistics

To generate the dataset used in this study, firm level data from the PINTEC surveys of 2008 and 20116 6 The latest editions available when estimates were calculated. (IBGE, 2010, 2013) were merged both with the list of beneficiary firms of Law 11,196/05 (BRASIL, 2005) disclosed annually by the Ministry of Science, Technology, Innovations and Communications (MCTIC) and with the list of exporting and importing firms disclosed by the Ministry of Development, Industry, and Foreign Trade (BRASIL, s.d.). The resulting dataset was organized in a panel format with two periods (t = 2008, 2011). Nominal 2008 values were adjusted for inflation to 2011 using the IGP-DI index.

To reduce the heterogeneity of firms, only those that innovated in the 2009-2011 period were considered. Additionally, samples used in each analysis were narrowed, considering the particularities of each group of outcome variables: in the analysis of distinct innovative activities, only firms with positive spending in at least one of the categories in 2011 were considered; for the study of the educational level of research personnel, firms were required to have had positive R&D spending in 2011 (as the salaries of these employees are classified as R&D).

To ensure the baseline and final values of the non-dummy outcome variables are not biased for the difference-in-differences estimation, it was further necessary to exclude from the dataset (a) all firms that benefited from the tax incentives before the baseline year (2008), and (b) all firms that did not benefit from the tax incentives at the specific year considered for analysis, but that did at any other point in time. In the case of different categories of innovation activities and educational level of personnel, as treatment impacts the outcome variables at the same period, it was also necessary to ignore all firms from the control group that accessed the benefits in 2008.

Participation in the policy is considered to be a treatment binary dummy variable. For the analysis of different categories of innovation activities and educational levels of personnel, tax incentives are assumed to affect innovation investments in the same year that companies benefited from them (2011). Observations in 2008 provide the baseline values to analyze the evolution of outcome variables in a difference-in-differences framework.

In the case of product and process innovation, however, the impact is estimated not for inputs but for results of these investments and, for this reason, it is necessary to consider a maturation period. In the PINTEC survey, firms state whether they have achieved any product or process innovation within the last three years. Such interval is used to assess the effect of incentives on the type of innovation pursued by firms. The year of participation in the policy considered for this analysis is 2008, and outcome is observed in 2009-2011, following the recommendation of the European Commission (2015) to access innovation output up to ‘t+3’.

TABLE 2
Descriptive statistics of outcome variables

The outcome variables used in this study are the categories or components of the three broad classifications mentioned previously. Their definitions are presented in Table A.1 of the Supplementary Material, and the descriptive statistics are displayed in Table 2. In addition, Figures 1 to 3 depict the average share of each innovative activity expenditure,7 7 The PINTEC survey and database follow closely the Oslo Manual (OECD, 2005) on the group of expenditures included in the category of innovative activities, as discussed in section 2 above. researcher’s degree and type of innovation in 2011. In the case of innovative activities and education levels of R&D personnel, variables represent the difference between the 2011 and 2008 values, as suggested by the difference-in-difference analysis.8 8 Workers with partial dedication are weighted according to the share of their time dedicated to the firm’s research activities. For the type of innovation, outcome variables are dummies that take the value of one if a firm succeeded in either product innovation, process innovation, or both types between 2009 and 2011.

FIGURE 1
Average share of spending on each innovative activity in 2011 for treatment and control groups

FIGURE 2
Average share of researchers by educational level in 2011 for treatment and control groups

FIGURE 3
Share of innovative firms by type of innovation achieved in 2009-2011 for treatment and control groups

In this analysis, covariates (X i ) are the factors determining the probability of a firm obtaining the tax incentives, as estimated by the propensity score. They include the size, age, location, revenue, origin of controlling capital, continuous R&D activity and other features of each firm. The list of all covariates, their definitions and descriptive statistics are presented in Tables A.2 to A.4 of the Supplementary Material. These variables are observed at the same period of treatment (2011 in the case of different innovative activities and educational level of research personnel, and 2008 for type of innovation).

5. Results

Table 3 presents the results of the estimated propensity score for each group of outcome variables under study. In most cases, coefficients of the covariates have the same sign, supporting the specification of the treatment probability model. Pseudo r-square ranges from 0.17 to 0.35, and log-likelihood ranges from -468 to -332.

Results of the means test9 9 See Tables A.5 to A.7 in the Supplementary Material. indicate that for nearly all covariates there are no significant differences (at a 95% confidence level) between matched treated and control groups. Most covariates present a substantial reduction of standardized bias in matched samples, and, in all cases, the log-likelihood test (p>chi2) does not reject joint insignificance hypothesis. Pseudo-R2, mean, and median bias also drop considerably for the matched groups. These results suggest that the covariates are sufficiently balanced, providing good grounds for accepting the propensity score specification.

TABLE 3
Estimated propensity score for each broad classification

The ATT estimated for each outcome variable is displayed in Table 4, along with the respective standard errors and confidence level indicators. In the analysis of innovative activities, the results confirm our first proposition: the average impact of the policy on R&D spending of beneficiary firms in 2011 was around 1.1 million Brazilian reais (or six hundred thousand dollars).10 10 Value converted to U.S. dollars according to the exchange rate applicable on the last day of 2011. This value represents 17% of the mean R&D spending of beneficiary firms that year.11 11 Mean R&D spending of beneficiary firms in 2011 in the sample: R$ 6,287.92. None of the other categories had an impact close to this magnitude, indicating an increase of the R&D intensity of the bundle of innovative activities.

TABLE 4
Estimated average treatment effect on the treated (ATT)

Part of such increase was counterbalanced by a reduction of investments in other innovative activities. Firms benefiting from tax incentives experienced an average reduction of expenditures on (a) acquisition of external knowledge (of around 200,000 Brazilian reais or 110,000 U.S. dollars), and (b) introduction of innovations in the market (of around 380,000 Brazilian reais or 200,000 U.S. dollars).12 12 Values converted to U.S. dollars according to the exchange rate applicable on the last day of 2011. The estimation does not yield evidence of impact on other innovative activities, as the statistical significance does not achieve a minimum confidence level.

In terms of the composition of the research staff, firms incentivized by the policy increased the number of researchers with undergraduate degrees only. On average, these enterprises hired 3.35 more researchers with such a background because of the policy. The effect is significant at a 95% confidence level, and it represents 21.4% of the average number of researchers with this educational level hired by beneficiary firms in 2011, and 12.8% of their average R&D staff.13 13 Mean number of undergraduate researchers hired by beneficiary firms in the sample in 2011 is 15.66; average size of their R&D staff is 26.9. On the other hand, no significant impact on research personnel with graduate degree was found. These results support our second proposition that the policy positively affected the educational level of the R&D team, but had no effect on highly-qualified researchers, confirming our second proposition.

The empirical study does not present evidence of policy impact on the type of innovation pursued by beneficiary firms, as suggested by our third proposition. Although Figure 3 shows that beneficiary firms did less ‘process innovation only’, the difference between treated and control groups does not stand after the matching. In this sense, it is not possible to maintain that the policy had any effect on the decision of firms for this classification.

In general, results for robustness checks14 14 See Table A.8 in the Supplementary Material. (coefficient signs and statistical significance) follow closely those of the main model, suggesting that they are not sensitive to the estimator applied. The Rosenbaum bounds analysis15 15 See Table A.9 in the Supplementary Material. of sensitiveness to hidden bias indicates that coefficients lose significance between 1.2 and 1.3 for the R&D and external knowledge acquisition variables. This means that a hidden variable not considered in the propensity score model should affect the odds of treatment ratio by a minimum of 20% to render the estimation results spurious. Considering the large group of covariates used to estimate the propensity score and that the difference-in-difference estimators excluded any chance of endogeneity arising from fixed effects, the results may be considered moderately insensitive to hidden bias. The impact on expenditures with the introduction of innovations in the market and hiring of researchers with undergraduate degrees, on the other hand, is less robust, as statistical significance is not found for values of (Γ) above 1.2.

5.1. Discussion of the results

The results presented herein are analyzed in light of the theoretical and empirical literature, and of the policy design discussed in the previous sections. The first point to stress refers to the notion of behavioral additionality of the policy. A positive impact was found for only one of the categories of innovative activities and groups of R&D personnel, with negative or no significant effect on the others. The uneven results for distinct variables within the same broad classification implies that the overall composition of firms’ innovation bundle has changed, which may be construed as a modification of their strategies, according to the behavioral additionality literature discussed in section 2. The study, in this sense, provides new evidence and elements to comprehend the effects and downsides of the Brazilian tax incentives that have not been considered in previous studies, confirming the importance of the behavioral additionality approach to better understand the impact and dynamics of innovation policies.

Our estimates for expenditures on innovative activities indicate that beneficiary firms changed how they obtain and apply new knowledge. According to our results, the policy led companies to adopt a higher ‘tech orientation’ (PINGFANG et al., 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.) by increasing the R&D intensity of their spending. This finding disputes the argument by David et al. (2000DAVID, P. A.; HALL, B. H.; TOOLE, A. A. Is public R&D a complement or substitute for private R&D? A review of the econometric evidence. Research Policy, v. 29, n. 4, p. 497-529, 2000.) that beneficiary firms are more likely to seek short-run profit. Our findings contrast with the conclusions of Pingfang et al. (2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.) for tax incentives, but it is in accordance with the results of Clausen (2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.) for direct subsidies.

The increase in the number of researchers with undergraduate degrees confirms our second proposition. Although the result may constitute a positive input additionality, it is problematic from a behavioral additionality perspective. The absence of impact on researchers with graduate degrees indicates that the policy had limited impact on firms’ innovative skills and knowledge, with reduced effects on their or ability to develop more technologically advanced projects. Comparing these results with previous studies, Clausen (2009CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.) and Dumont et al. (2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.) found evidence of impact on the number of qualified researchers with PhD or master’s degrees, while Afcha and García-Quevedo (2016AFCHA, S.; GARCÍA-QUEVEDO, J. The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, v. 25, n. 6, p. 955-975, 2016.) did not reach any significant results.

Finally, the absence of impact on the ‘type of innovation’ outcome variables is a sign that the tax incentives did not influence the choice of firms to pursue product or process innovation. The result differs from Aralica and Botrić (2013ARALICA, Z.; BOTRIĆ, V. Evaluation of research and development tax incentives scheme in Croatia. Ekonomska Istrazivanja-Economic Research, v. 26, n. 3, p. 63-80, 2013.), who found product-process innovation balance to be affected by the Croatian government policy, and from Hyvärinen (2006HYVÄRINEN, J. Behavioural additionality of public R&D funding in Finland. Government R&D funding and company behaviour: measuring behavioural additionality. Paris: OECD, 2006. p. 115-125.), who reported that Finish incentivized firms were more likely to engage in product innovation.

A group of policy implications can be drawn from this empirical study. First, the increase of R&D intensity in the bundle of innovative investments can be considered a positive result, as strict R&D is generally related to innovation projects with higher technological levels (PINGFANG et al., 2006PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.) and knowledge spillovers. The absence of impact on the number of researchers with graduate training is an important negative result that needs to be addressed. Establishing a system of incentives and cost reductions that stimulates demand for a more qualified research workforce seems particularly relevant to improve the policy design. The Belgian case described and tested by Neicu et al. (2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.) and Dumont et al. (2015DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.) presents a viable option and first basis for such improvement. At last, the design of incentives particularly suited to impact process innovation constitutes another challenge to be addressed. OECD (2015b) stressed that the weakness of Brazilian productivity rates is one of the main reasons explaining low GDP per capita levels compared to developed economies.

One last comment refers to the external validity of the results. The PINTEC sample is not random, and the presence of a firm in each edition of the survey is affected by its level of innovative activities, among other factors such as economic sector, location and size (IBGE, 2010, 2013). As our estimation strategy considers two editions of PINTEC, and as the mentioned features are likely to be correlated with the treatment and outcome variables, attrition issues may jeopardize external validity (MILLER; HOLLIST, 2007MILLER, R.; HOLLIST, C. Attrition bias. In: SALKIND, N. J. (Ed.). Encyclopedia of Measurement and Statistics. Thousand Oaks: Sage Reference, 2007. v. 1, p. 57-60.). For this reason, our findings should be considered with caution when generalized to the entire group of beneficiary firms of Law 11,196/05 (BRASIL, 2005), although they provide a first estimate of impact on the variables considered herein.

6. Conclusion

This paper presents an empirical study on the impact of innovation tax incentives established in Brazil by Law 11,196/05 (BRASIL, 2005) on the composition of private innovation investment and their results. The behavioral additionality analysis used herein is a recent dimension of the evaluation of innovation policies in the international economic literature, and it is virtually unexplored in Brazil.

The three main conclusions of the study are: (a) there is a positive effect on total R&D expenditures, raising the R&D intensity within the bulk of innovative activities; (b) the policy fostered additional hiring of researchers with an undergraduate degree, without a significant impact on personnel with higher educational levels; and (c) there is no evidence that the policy affected the balance between product and process innovation.

Besides presenting relevant information for improving the design and structure of the policy, this paper provides empirical support to maintain that the fiscal benefits of Law 11,196/05 (BRASIL, 2005) have contributed to the development of private innovation in Brazil. It also evidences that tax incentives can contribute to a broader innovation policy in an evolutionary and structuralist perspective (GÖK; EDLER, 2012GÖK, A.; EDLER, J. (The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, v. 21, n. 4, p. 306-318, 2012.; NEICU et al., 2016NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.). The change in the composition of investments and results indicates that firms’ behavior and strategies were affected by the policy, a result that is not limited to raising R&D levels to compensate for market failures (HALL; MAIRESSE; MOHNEN, 2010HALL, B. H.; MAIRESSE, J.; MOHNEN, P. Measuring the returns to R&D. Handbook of the economics of innovation. Elsevier, 2010. v. 2, p. 1033-1082.). This opens the possibility for such incentives to be designed to direct private innovation investments to achieve broader societal goals, such as either technological catch-up and raising environmental standards.

Acknowledgments

The authors acknowledge the financial support of the CAPES (Coordination for the Improvement of Higher Education Personnel) and FIPE (Institute of Economic Research). Access to PINTEC confidential microdata granted by permission of IBGE (03605.000637/2015-70).

References

  • AFCHA, S.; GARCÍA-QUEVEDO, J. The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, v. 25, n. 6, p. 955-975, 2016.
  • AGGARWAL, V. A.; HSU, D. H.; WU, A. R&D production team organization and firm-level innovation. 2015 (working paper).
  • ARALICA, Z.; BOTRIĆ, V. Evaluation of research and development tax incentives scheme in Croatia. Ekonomska Istrazivanja-Economic Research, v. 26, n. 3, p. 63-80, 2013.
  • ARAÚJO, B. C. Incentivos fiscais à pesquisa e desenvolvimento e custos de inovação no Brasil. Radar, n. 9, p. 3-11, ago. 2010.
  • BACH, L.; MATT, M. Rationale for science & technology policy. In: GEORGHIOU, L.; RIGBY, J.; CAMERON, H. (Ed.). Assessing the Socio-Economic Impacts of the Framework Programme (ASIF)’. Report to European Commission DG Research. European Commission DG Research, 2001. p. 93-145.
  • BARGE-GIL, A.; LÓPEZ, A. R versus D: Estimating the differentiated effect of research and development on innovation results. Industrial and Corporate Change, v. 24, n. 1, p. 93-129, 2014.
  • BELADI, H.;, MARJIT, S.; YANG, L. Outsourcing: volume and composition of R&D. Review of International Economics, v. 20, n. 4, p. 828-840, 2012.
  • BLOOM, N.; CHENNELLS, L.; GRIFFITH, R.; VAN REENEN, J. How has tax affected the changing cost of R&D? Evidence from eight countries. In: SMITH, H. L. (Ed.). The regulation of science and technology. New York: Palgrave, 2002. p. 136-160.
  • BRASIL. Diretrizes de política industrial, tecnológica e de comércio exterior. Available at <http://www.abdi.com.br/Estudo/Diretrizes_PITCE.pdf>. Brasilia, 2003.
    » http://www.abdi.com.br/Estudo/Diretrizes_PITCE.pdf
  • _________. Lei nº 11.196, de 21 de novembro de 2005. Available at <http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2005/lei/l11196.htm>.
    » http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2005/lei/l11196.htm
  • BRASIL. Ministério da Ciência, Tecnologia, Inovações e Comunicações. Lei do Bem - Utilização dos incentivos fiscais à inovação tecnológica - ano base 2014. Brasília, 2016a. Available at <http://www.mctic.gov.br/mctic/export/sites/institucional/arquivos/veja_tambem-lei_bem/Relatorio-Anual-Lei-11.196-05-Ano-Base-2014-Retificado.pdf>.
    » http://www.mctic.gov.br/mctic/export/sites/institucional/arquivos/veja_tambem-lei_bem/Relatorio-Anual-Lei-11.196-05-Ano-Base-2014-Retificado.pdf
  • _________. Recursos aplicados, governo federal. Brasília, 2016b. Available at <http://www.mctic.gov.br/mctic/opencms/indicadores/detalhe/recursos_aplicados/governo_federal/2_2_3.html>.
    » http://www.mctic.gov.br/mctic/opencms/indicadores/detalhe/recursos_aplicados/governo_federal/2_2_3.html
  • BRASIL. Ministério da Indústria, Comércio Exterior e Serviços. Empresas brasileiras importadoras e exportadoras. Brasília, s.d. Available at <http://mdic.gov.br/comercio-exterior/estatisticas-de-comercio-exterior/empresas-brasileiras-exportadoras-e-importadoras>.
    » http://mdic.gov.br/comercio-exterior/estatisticas-de-comercio-exterior/empresas-brasileiras-exportadoras-e-importadoras
  • BUISSERET, T. J.; CAMERON, H. M.; GEORGHIOU, L. What difference does it make? Additionality in the public support of R&D in large firms. International Journal of Technology Management, v. 10, n. 4-6, p. 587-600, 1995.
  • BUSOM, I.; FERNÁNDEZ-RIBAS, A. The impact of firm participation in R&D programmes on R&D partnerships. Research Policy, v. 37, n. 2, p. 240-257, 2008.
  • CLARYSSE, B.; BILSEN, V.; STEURS, G. Behavioural additionality of the R&D subsidies programme of IWT-Flanders (Belgium). Government R&D Funding and Company Behaviour: Measuring Behavioural Additionality. Paris: OECD, 2006. p. 91-114.
  • CLARYSSE, B.; WRIGHT, M.; MUSTAR, P. Behavioural additionality of R&D subsidies: a learning perspective. Research Policy, v. 38, n. 10, p. 1517-1533, 2009.
  • CLAUSEN, T. H. Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, v. 20, n. 4, p. 239-253, 2009.
  • COHEN, W. M.; KLEPPER, S. Firm size and the nature of innovation within industries: the case of process and product R&D. The review of Economics and Statistics, v. 78, n. 2, 1996, p. 232-243.
  • CUNNINGHAM, P.; GÖK, A.; LARÉDO, P. The impact of direct support to R&D and innovation in firms. Manchester Institute of Innovation Research, 2012.
  • DAVID, P. A.; HALL, B. H.; TOOLE, A. A. Is public R&D a complement or substitute for private R&D? A review of the econometric evidence. Research Policy, v. 29, n. 4, p. 497-529, 2000.
  • DEHEJIA, R. H.; WAHBA, S. Causal effects in, nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, v. 94, n. 448, p. 1053-1062, 1999.
  • _________. Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics, v. 84, n. 1, p. 151-161, 2002.
  • DIPRETE, T. A.; GANGL, M. Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments. Sociological Methodology, n, 34, p. 271-310, 2004.
  • DUMONT, M.; SPITHOVEN, A.; TEIRLINCK, P. Public support for R&D and the educational mix of R&D employees. CESifo Economic Studies, v. 62, n. 3, p. 426-452, 2015.
  • EBERSBERGER, B. Public funding for innovation and the exit of firms. Journal of Evolutionary Economics, v. 21, n. 3, p. 519-543, 2011.
  • EUROPEAN COMMISSION. Horizon 2020 indicators: assessing the results and impact of Horizon. Luxembourg, 2015.
  • FALK, R. Measuring the effects of public support schemes on firms’ innovation activities: Survey evidence from Austria. Research Policy, v. 36, n. 5, p. 665-679, 2007.
  • FELDMAN, M. P.; KELLEY, M. R. Leveraging research and development: assessing the impact of the US Advanced Technology Program. Small Business Economics, v. 20, n. 2, p. 153-165, 2003.
  • GEORGHIOU, L. Impact of the framework programme on European industry. European Commission, Directorate General Telecommunications, Information Market and Exploitation of Research, 1994.
  • _________. Impact and additionality of innovation policy. Innovation Science and Technology IWT Observatory, n. 40, p. 57-65, 2002.
  • GEORGHIOU, L.; CLARYSSE, B. Introduction and synthesis. In OECD. Government R&D funding and company behaviour - Measuring behavioural additionality. Paris: OECD Publishing, 2006.
  • GÖK, A.; EDLER, J. (The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, v. 21, n. 4, p. 306-318, 2012.
  • HALL, B. H.; MAIRESSE, J.; MOHNEN, P. Measuring the returns to R&D. Handbook of the economics of innovation. Elsevier, 2010. v. 2, p. 1033-1082.
  • HALL, B. H.; VAN REENEN, J. How effective are fiscal incentives for R&D? A review of the evidence. Research Policy, v. 29, n. 4-5, p. 449-469, 2000.
  • HSU, F.-M.; HORNG, D.-J.; HSUEH, C.-C. The effect of government-sponsored R&D programmes on additionality in recipient firms in Taiwan. Technovation, v. 29, n. 3, p. 204-217, 2009.
  • HYVÄRINEN, J. Behavioural additionality of public R&D funding in Finland. Government R&D funding and company behaviour: measuring behavioural additionality. Paris: OECD, 2006. p. 115-125.
  • IBGE. Pesquisa de Inovação Tecnológica 2008. Rio de Janeiro, 2010.
  • _________. Pesquisa de Inovação Tecnológica 2011. Rio de Janeiro, 2013.
  • IFS, I. A study on R&D tax incentives. Final report. European Commission, 2015. Available at <https://ec.europa.eu/futurium/en/system/files/ged/28-taxud-study_on_rnd_tax_incentives_-_2014.pdf>.
    » https://ec.europa.eu/futurium/en/system/files/ged/28-taxud-study_on_rnd_tax_incentives_-_2014.pdf
  • JAFFE, A. B.; LE, T. The impact of R&D subsidy on innovation: a study of New Zealand firms. Cambridge, MA: National Bureau of Economic Research, 2015 (NBER Working Paper Series, 21479).
  • KANNEBLEY JR., S.; ARAÚJO, B. C.; MAFFIOLI, A.; STUCCHI, R. Productive development policies and innovation spillovers through labor force mobility: the case of the Brazilian innovation support system. Inter-American Development Bank, 2013 (IDB working paper series, 459).
  • KANNEBLEY JR., S.; SILVEIRA PORTO, G. Incentivos fiscais à pesquisa, desenvolvimento e inovação no Brasil: uma avaliação das políticas recentes. Inter-American Development Bank, 2012 (Documento para discussão, 236).
  • KÖHLER, C.; LAREDO, P.; RAMMER, C. The impact and effectiveness of fiscal incentives for R&D. Compendium of Evidence on the effectiveness of Innovation Policy. University of Manchester, 2012 (Nesta Working Paper, 12/01)
  • LADINSKA, E.; NON, M.; STRAATHOF, B. More R&D with tax incentives? A meta-analysis. CPB Netherlands Bureau for Economic Policy Analysis, 2015 (Discussion Paper, 309).
  • LIN, P.; SAGGI, K. Product differentiation, process R&D, and the nature of market competition. European Economic Review, v. 46, n. 1, p. 201-211, 2002.
  • LÓPEZ, A. Innovation and appropriability, empirical evidence and research agenda. The economics of intellectual property: suggestions for further research in developing countries and c.ountries with economies in transition. Geneva: World Intellectual Property Organization (WIPO), 2009.
  • MILLER, R.; HOLLIST, C. Attrition bias. In: SALKIND, N. J. (Ed.). Encyclopedia of Measurement and Statistics. Thousand Oaks: Sage Reference, 2007. v. 1, p. 57-60.
  • NEICU, D.; TEIRLINCK, P.; KELCHTERMANS, S. Dipping in the policy mix: Do R&D subsidies foster behavioral additionality effects of R&D tax credits? Economics of Innovation and New Technology, v. 25, n. 3, p. 218-239, 2016.
  • OECD. Oslo Manual: Guidelines for collecting and interpreting innovation data. 3. ed. Paris: OECD Publishing, 2005.
  • _________. Government R & D funding and company behaviour: measuring behavioural additionality. Paris: OECD Publishing, 2006.
  • _________. Supporting investment in knowledge capital, growth and innovation. Paris: OECD Publishing, 2013
  • _________. Frascati Manual 2015: guidelines for collecting and reporting data on research and experimental development. Paris: OECD Publishing, 2015a.
  • _________. OECD economic surveys: Brazil. Paris: OECD Publishing, 2015b. Available at <http://www.oecd.org/eco/surveys/Brazil-2015-overview.pdf>.
    » http://www.oecd.org/eco/surveys/Brazil-2015-overview.pdf
  • _________. OECD science, technology and industry scoreboard 2015. Paris: OECD Publishing, 2015c.
  • _________. OECD science, technology and innovation outlook 2016. Paris: OECD Publishing, 2016.
  • PINGFANG, Z.; WEIMIN, X.; LUNDIN, N. The impact of government’s fundings and tax incentives on industrial R&D investments - Empirical evidences from industrial sectors in Shanghai. China Economic Review, v. 17, n. 1, p. 51-69, 2006.
  • ROSENBAUM, P. R. Design of observational studies. New York: Springer, 2012.
  • SAHA, S. R&D composition over the product life cycle. Minneapolis, MN: Center for Economic Research, University of Minnesota, 1999 (Discussion Paper, n. 309).
  • SHIMADA, E. Efetividade da lei do bem no estímulo ao investimento em P&D: uma análise com dados em painel. São Paulo: Universidade de São Paulo, 2014.
  • SPITHOVEN, A.; TEIRLINCK, P. External R&D: exploring the functions and qualifications of R&D personnel. International Journal of Innovation Management, v. 14, n. 6, p. 967-987, 2010.
  • SUZUKI, J.; YUMITORI, S. Behavioural additionality of public R&D funding in Japan. In: OECD. Government R&D funding and company behaviour: measuring behavioural additionality. Paris: OECD, 2006.
  • WARDA, J. B-index time series 1981-2011. 2013. (Discussion paper). Available at <http://www.oecd-ilibrary.org/science-and-technology/oecd-science-technology-and-industry-outlook-2014/tax-incentives-for-r-amp-d-and-innovation_sti_outlook-2014-18-en>.
    » http://www.oecd-ilibrary.org/science-and-technology/oecd-science-technology-and-industry-outlook-2014/tax-incentives-for-r-amp-d-and-innovation_sti_outlook-2014-18-en
  • ZÚÑIGA-VICENTE, J. Á.; ALONSO-BORREGO, C.; FORCADELL, F. J.; GALÁN, J. I. Assessing the effect of public subsidies on firm R&D investment: a survey. Journal of Economic Surveys, v. 28, n. 1, p. 36-67.
  • 1
    JEL Code | H25; H32; O38; O54
  • 2
    Códigos-Jel | H25; H32; O38; O54
  • 1
    As defined in section 4.
  • 2
    For a review of the literature, see Gök and Edler (2012GÖK, A.; EDLER, J. (The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, v. 21, n. 4, p. 306-318, 2012.) and Cunningham et al. (2012CUNNINGHAM, P.; GÖK, A.; LARÉDO, P. The impact of direct support to R&D and innovation in firms. Manchester Institute of Innovation Research, 2012.).
  • 3
    For recent reviews of this literature, see IFS (2015IFS, I. A study on R&D tax incentives. Final report. European Commission, 2015. Available at <https://ec.europa.eu/futurium/en/system/files/ged/28-taxud-study_on_rnd_tax_incentives_-_2014.pdf>.
    https://ec.europa.eu/futurium/en/system/...
    ) and Ladinska, Non and Straathof (2015LADINSKA, E.; NON, M.; STRAATHOF, B. More R&D with tax incentives? A meta-analysis. CPB Netherlands Bureau for Economic Policy Analysis, 2015 (Discussion Paper, 309).).
  • 4
    “The b-index is a measure of the level of pre-tax profit a ‘representative’ company needs to generate to break even on a marginal, unitary outlay on R&D” (OECD, 2013, p. 1).
  • 5
    According to the common support assumption, observations with a propensity score above the maximum level common to both treatment and control groups or below the minimum common level should be excluded from the sample.
  • 6
    The latest editions available when estimates were calculated.
  • 7
    The PINTEC survey and database follow closely the Oslo Manual (OECD, 2005) on the group of expenditures included in the category of innovative activities, as discussed in section 2 above.
  • 8
    Workers with partial dedication are weighted according to the share of their time dedicated to the firm’s research activities.
  • 9
    See Tables A.5 to A.7 in the Supplementary Material.
  • 10
    Value converted to U.S. dollars according to the exchange rate applicable on the last day of 2011.
  • 11
    Mean R&D spending of beneficiary firms in 2011 in the sample: R$ 6,287.92.
  • 12
    Values converted to U.S. dollars according to the exchange rate applicable on the last day of 2011.
  • 13
    Mean number of undergraduate researchers hired by beneficiary firms in the sample in 2011 is 15.66; average size of their R&D staff is 26.9.
  • 14
    See Table A.8 in the Supplementary Material.
  • 15
    See Table A.9 in the Supplementary Material.

Supplementary material

TABLE A.1
List and definition of outcome variables
TABLE A.2
List and definition of covariates used in the propensity score models
TABLE A.3
Descriptive statistics of covariates (values for 2011, not including economic sector dummies)
TABLE A.4
Descriptive statistics of covariates: economic sector dummies (values for 2011)
TABLE A.5
Results of the means test for the estimated propensity score. Broad classification: different innovative activities
TABLE A.6
Results of the means test for the estimated propensity score. Broad classification: educational level of R&D staff
TABLE A.7
Results of the means test for the estimated propensity score. Broad classification: type of innovation
TABLE A.8
Estimated policy impact: robustness checks results
TABLE A.9
Results of the sensitivity analysis of hidden bias due to omitted variables (Rosenbaum bounds)

Publication Dates

  • Publication in this collection
    04 Apr 2022
  • Date of issue
    Jul-Dec 2018

History

  • Received
    21 Jan 2018
  • Reviewed
    23 June 2018
  • Accepted
    29 June 2018
Universidade Estadual de Campinas Rua: Carlos Gomes, 250. Bairro Cidade Universitária, Cep: 13083-855 , Campinas - SP / Brasil , Tel: +55 (19) 3521-5176 - Campinas - SP - Brazil
E-mail: rbi@unicamp.br