इस ब्लॉग्स को सृजन करने में आप सभी से सादर सुझाव आमंत्रित हैं , कृपया अपने सुझाव और प्रविष्टियाँ प्रेषित करे , इसका संपूर्ण कार्य क्षेत्र विश्व ज्ञान समुदाय हैं , जो सभी प्रतियोगियों के कॅरिअर निर्माण महत्त्वपूर्ण योगदान देगा ,आप अपने सुझाव इस मेल पत्ते पर भेज सकते हैं - chandrashekhar.malav@yahoo.com
15. Scientometric Studies and Their Role in Science Policy
P- 07. Informetrics & Scientometrics *
By :I K Ravichandra Rao,Paper Coordinator
15. Scientometrics as a Policy and Strategic Tool
15. Scientometrics as a Policy and Strategic ToolP- 07. Informetrics & Scientometrics * |
Objectives
To understand
- Measurement activity and science policy
- Technology forecasting- basic understanding
- Scientometric and technology forecasting
- Application of scientometrics in science policy.
Introduction
Measurement of scientific activity evolved in the late 1960s as a practical need for a rational policy decision in scientific funding. There emerged a strong consensus among funding bodies that science policy cannot be made in isolation, it must center on S&T trends and their relation to current public policy developments. S&T policy must be based on evidence – authentic data collected and analyzed on a regular basis. This strong demand of an objective method of evaluation came from competitive funding pressure of different streams of research, advent of more organized scientific research activity/mission mode approach, science playing a much larger role in economy and society, scientific research increasingly requiring larger funding support from government.
Scientometrics and bibliometrics are primarily involved in constructing S&T indicators that can properly measure the various aspects of the latent variables of ‘scientific activity’ (for example productivity, quality). Indicators are constructed from the empirically directly measurable variables (for example publications, citations, patents) which are used to judge indirectly the state or dynamics of the corresponding latent variables. Scientometric research has led to the construction of varied types of indicators that can be address the following main types of scientific activity: (1) dynamic aspects – growth of scientific knowledge, signaling the new areas of research, etc (2) structural aspects – mapping the cognitive structure of scientific knowledge (3) evaluative aspects- assessment of scientific research and (4) prognostic- future studies. In spite of some major inherent limitations, the approach of analysing scientific activity through S&T indicators has come to stay; the debates has now shifted to how well one can construct better indicators and collect statistics.
The scientometrics method has become more popular and relevant because it can reveal the ‘hidden aspects’ of research activity and can signal policy actions. The evidence based studies provide important inputs for policy actions. One of the influential findings from analysis of research papers have been the role of research collaboration in advancement of scientific research. For example in the cutting edge area –nanotechnology, analysis of research papers highlight that papers from India in this field have high impact when the authors belong to different institutions. For example, 26 papers were identified from India in the top 1% cited papers globally in nanotechnology in 2009. Of the 26 cited papers, 16 papers (61%) were found to be collaborative papers. Again examining Indian publication in nanotechnology journals with high impact factor showed collaboration playing a major role. Looking at high reception of papers from China also brought out this fact. In a sense strong evidence emerges that collaboration has played an important role in pushing the quality of scientific research in nanotechnology for both India and China.
Similarly, examining patenting activity of India and China in nanotechnology in the US patent office reveals some interesting trends and insights. The joint patenting among Hon Hai Precsion Industry ltd and Tsinghua University is striking. Tsinghua University is a leading university of China, part of C9 league that comprises the top 9 universities in China and is among the top 100 universities in different global university rankings. Hon Hai Precision Industry is a Taiwan based entity, commonly known by its trade name, Foxconn and is the world's largest contract electronics manufacturer. The joint patent activity has led to filing of 118 patents during the period 2001-09 accounting for 72% of patents filed by China in nanotechnology. Similarly it has led to the grant of 22 joint patents which is 49% of the patents granted to China during the period 2001-09. The examination of their joint patents provides an indication of the inventive capability that is developing over the years in China. The patents in the early applications are in varied methods of growing carbon nanotubes. Later patents address specific applications of carbon nanotubes i.e. yarn (textile), microscopic electronics, nanoscale integrated circuits, nano based display panels (for computer, LCD, TV and mobile screen). Later patent applications also address Lithium battery, composite material for automotive, carbon based array sensors and electron emission device. Thus we observe the joint activity is not only strengthening over the years but are also directed to specific applications. Important indications like this can be revealed through bibliometric analysis.
An important contribution of scientometrics is in Technology Forecasting.
Introduction
Measurement of scientific activity evolved in the late 1960s as a practical need for a rational policy decision in scientific funding. There emerged a strong consensus among funding bodies that science policy cannot be made in isolation, it must center on S&T trends and their relation to current public policy developments. S&T policy must be based on evidence – authentic data collected and analyzed on a regular basis. This strong demand of an objective method of evaluation came from competitive funding pressure of different streams of research, advent of more organized scientific research activity/mission mode approach, science playing a much larger role in economy and society, scientific research increasingly requiring larger funding support from government.
Scientometrics and bibliometrics are primarily involved in constructing S&T indicators that can properly measure the various aspects of the latent variables of ‘scientific activity’ (for example productivity, quality). Indicators are constructed from the empirically directly measurable variables (for example publications, citations, patents) which are used to judge indirectly the state or dynamics of the corresponding latent variables. Scientometric research has led to the construction of varied types of indicators that can be address the following main types of scientific activity: (1) dynamic aspects – growth of scientific knowledge, signaling the new areas of research, etc (2) structural aspects – mapping the cognitive structure of scientific knowledge (3) evaluative aspects- assessment of scientific research and (4) prognostic- future studies. In spite of some major inherent limitations, the approach of analysing scientific activity through S&T indicators has come to stay; the debates has now shifted to how well one can construct better indicators and collect statistics.
The scientometrics method has become more popular and relevant because it can reveal the ‘hidden aspects’ of research activity and can signal policy actions. The evidence based studies provide important inputs for policy actions. One of the influential findings from analysis of research papers have been the role of research collaboration in advancement of scientific research. For example in the cutting edge area –nanotechnology, analysis of research papers highlight that papers from India in this field have high impact when the authors belong to different institutions. For example, 26 papers were identified from India in the top 1% cited papers globally in nanotechnology in 2009. Of the 26 cited papers, 16 papers (61%) were found to be collaborative papers. Again examining Indian publication in nanotechnology journals with high impact factor showed collaboration playing a major role. Looking at high reception of papers from China also brought out this fact. In a sense strong evidence emerges that collaboration has played an important role in pushing the quality of scientific research in nanotechnology for both India and China.
Similarly, examining patenting activity of India and China in nanotechnology in the US patent office reveals some interesting trends and insights. The joint patenting among Hon Hai Precsion Industry ltd and Tsinghua University is striking. Tsinghua University is a leading university of China, part of C9 league that comprises the top 9 universities in China and is among the top 100 universities in different global university rankings. Hon Hai Precision Industry is a Taiwan based entity, commonly known by its trade name, Foxconn and is the world's largest contract electronics manufacturer. The joint patent activity has led to filing of 118 patents during the period 2001-09 accounting for 72% of patents filed by China in nanotechnology. Similarly it has led to the grant of 22 joint patents which is 49% of the patents granted to China during the period 2001-09. The examination of their joint patents provides an indication of the inventive capability that is developing over the years in China. The patents in the early applications are in varied methods of growing carbon nanotubes. Later patents address specific applications of carbon nanotubes i.e. yarn (textile), microscopic electronics, nanoscale integrated circuits, nano based display panels (for computer, LCD, TV and mobile screen). Later patent applications also address Lithium battery, composite material for automotive, carbon based array sensors and electron emission device. Thus we observe the joint activity is not only strengthening over the years but are also directed to specific applications. Important indications like this can be revealed through bibliometric analysis.
An important contribution of scientometrics is in Technology Forecasting.
What is Technology Forecasting (TF)
Technology forecasting is primarily understood as all purposeful and systematic attempts to anticipate and understand the potential direction, rate, characteristics, and effects of technological change, especially invention, innovation, adoption, and use. Primarily it refers to a set of methods/techniques to identify future technology developments and their interactions with society and the environment for the purpose of guiding actions designed to produce a more desirable future. Technology forecasting (TF) usually focuses on specific technologies, but sometimes the scope is more encompassing. A firm might roadmap a set of related technologies and products; an industry association might roadmap the gamut of emerging technologies potentially affecting its sector; or a nation could roadmap technologies across its economic base. A new conceptual area/framework has evolved which is called Technology Future Analysis (TFA) which includes the Technology Forecasting as a sub-discipline. This framework articulated by Porter (2003) has found wide adoption.
Technology Future analysis primarily covers:
- Technology monitoring, technology watch, technology alerts (gathering and interpreting information)
- Technical intelligence and competitive intelligence (converting information into usable intelligence)
- Technology forecasting (anticipating the direction and pace of changes)
- Technology Road-mapping (relating anticipated advances in technologies and products to generate plans)
- Technology assessment, and forms of impact assessment, including strategic environmental assessment (anticipating the unintended, indirect, and delayed effects of technological changes)
- Technology foresight, also national and regional foresight (effecting development strategy, often involving participatory mechanisms)
Among its various applications are: prioritizing R&D, input to public policy, strategic decisions on technology, and so forth.
Some common methods of Technology Forecasting[1]
1) Expert Opinion: Delphi (iterative survey); Focus Groups [panels, workshops]; Interviews
2) Trend Analysis: Trend Extrapolation [Growth Curve Fitting]; Trend Impact Analysis; Long Wave Analysis
3) Monitoring and Intelligence Methods: Technology watch
4) Modeling and Simulation: life cycle analysis; Systems Simulation; Economic base modeling [input-output analysis]; Technology Assessment
5) Scenarios: Scenario-simulation [gaming; interactive scenarios]
[1] For the purpose of this research document, technology future analysis and technology forecasting are used inter-changeably.
Bibliometrics & Technology Forecasting
Bibliometrics plays an influential role/instrument in the application of these forecasting methods. For example, in many Delphi study choice of experts is based on identification done through mapping research profile. Authors who are highly cited or research groups/institutes are uncovered which provides an objective and more precise method for expert selection.
On the other hand the common forecasting techniques are applied to the bibliometrics data to reveal new insights. For example research publication activity and patenting activity over a period of time is a common approach in trend analysis and technology watch. It provides for the decision maker and or researchers/research groups to have a more informed understanding of the development in a field and allows for simulation and scenario building (extrapolation through forecasting methods of how the field is expected to develop). This is very useful for decision based analysis such as funding support, roadmap for technology development and impact, undertake strategic decisions, etc.
Bibliometric Analysis: one of the popular methods in Technology forecasting
Bibliometrics is the statistical analysis of text documents, typically publications and patents. Since publications in this case refer mainly to academic publications and patents, science and technology intensive industries would logically be a better fit for this type of analysis. As patents and publications often deal with ideas and techniques in the relatively early stages of development, this is the stage at which bibliometric methods are most useful. Also, in the early stages of development, technical merit is probably the key determinant of success. Later on many other factors would influence the success of a technology or product, so there is a lot more complexity and noise. In such situations, "higher-level" features and pattern recognition techniques become more appropriate.
A scientometric or knowledge map can identify the structure of a particular area of scientific research and measure its performance: How “hot” is this research area? How quickly are new discoveries being made? Is the field growing, or imploding upon itself? These insights provide inputs for science policy decisions/formulation of S&T roadmaps among others.
Usefulness in the Context of Foresight Study
- Help Identify emerging scientific specialties and research areas; research fronts where action is taking place.
- Bibliometric data can be adjusted using an S curve as a way to fit the technological growth process (applying models such as Fischer-Pry Model).
- Technology clustering based on: (a) Co-occurrence analysis of patent classification codes/keywords from titles or abstracts; (b) Patent citation network.
- Patent citation network can help identify in any area of technology: (a) The technology plane, Precursor and Successor technology; (b) Key patents, key companies, inventors; (c) Identify interactions between science and technology etc.
- Core competency of countries in an area of scientific research or technology.
- Expert selection within a field.
Example: Predicting the growth of scientific field
n The concept of exponential growth applies to science in terms of the number of units of scientific productivity: scientific papers (Price 1961, 1963).
n Science like any other growth phenomenon seems subject to a description in terms of logistic growth rather than pure exponential growth.
n Why this type of growth happens/ Mechanisms behind this Growth?
The totality of scientific literature doubles every fifteen years, it does not necessarily mean that this growth rate applies to every single discipline and sub discipline?
From an analysis of growth data it appears, on contrary that scientific disciplines and sub disciplines may vary widely with respect to growth rate.
Adopted from Science Since Babylon (Price 1961)
Example: Forecasting a Country/ Company’s Probability of Success
Patent based Indicators can address to some extent the technology part of the forecasting problem, by analysing: Which of the companies has the most valuable portfolio of patents? How concentrated is a company’s R&D across different technology categories? etc. Some of the Indicators that are used in this type of analysis: Number of Patents: Granted by a patent office (say US Patent Office); Cites Per Patent: A count of citations received by a company’s patents (for example year-wise or other-wise); Current Impact Index: Measure based on how often a company’s patents are cited by other patents. The number of times a company’s most recent five years of patents are cited in the current year, relative to the entire patent database; Technology Strength: The number of patents times the current impact index (will indicate the technology strength of a company’s newly issued patents).
Proposed framework for Tech-mining
Source: Stuart Madnick et al., Technology Forecasting Using Data Mining and Semantics: Second Annual Report, Working paper (December 2009).
Application of Scientometrics in Technology Forecasting: Some illustrative cases
- GlaxoSmithKline (2000): Just after the merger of SmithKline & with Beecham (1990), the question of focus was to guide the company in refocusing its R&D resources. The application of scientometrics or science mapping was used as one element in the redirection of its R&D resources. Scientometric maps of the seven therapeutic areas in which the merged company was active was generated. From this, they concluded that the field of gastrointestinal disease (GI) research in particular was not generating a significant amount of high-performance research. The company decided to close its research activities in this area, and to focus on research in the remaining six. Scientometric technology gave the company an important intelligence perspective that enabled it to reshape its research portfolio for greater productivity, and to define a number of promising technology opportunities.
- CHI Research Study in 2004 demonstrated the importance of public science in generating key input for subsequent patents in technology areas. This study showed the substantial citations to research papers in patents. It also highlighted the role of public funded institutions as almost 73% of research papers cited in patents emerged from public funded institutes (44% from public funded research institutions in America and rest 29% from foreign public funded research institutions). This work contributed significantly to the increase in research grant for public science in the USA. It also got noticed in other countries and had high spin-off effect i.e. may countries increased outlay for public science.
- The study by Cheng and Chen (2008), on technology forecasting of new materials (eg. Nano sized ceramic powders) adopted the bibliometric analysis through EI database and trademark office (USPTO) database to gain useful data for this work. This study applied the growth curve method to investigate the technology performances of nanosized ceramic powders. The study found that nanosized ceramic powders were all in the initial growth periods of technological life cycles. The technology performances of nanosized ceramic powders through the EI and USPTO databases were similar. The bibliometric analysis was proposed as the simple and efficient tools to link the science and technology activities, and to obtain quantitative and historical data for helping researchers in technology forecasting, especially in rare historical data available fields, such as the new materials fields.
- The study by Chen and Cheng Wang (2009) extracted the patent amount information of the biped robot walking technique in Japan from the patent database of the Japan Patent Office. The study then analyzed the extracted information using the S-curve Loglet Lab, Pearl and Gompertz models in order to predict the development trend of the walking technique in Japan. According to the results of the analysis, the biped robot walking technique in Japan will continue to grow and reach saturation in the period 2079–2082. This type of findings help business managers and technical developers to manage their strategies of developing the techniques. It is feasible to predict the development trend of a technology using the approach presented in this study.
Scientometric approach however requires deeper introspection to make it more acceptable to the scientific community and science policy/decision making. Problems of scientometric based research that require attention can largely be categorized under –(a) methodological issues, (b) issues of databases that include data mining and visulisation tools, (c) lack of integration of scientometrics research with other disciplines and (d) need for adopting reflexive/self critical approach.
(a) One pressing issue that calls for attention is the problem of inter-relation between the S&T indicators and latent variables. Are the indicators chosen really measure the latent variable and what aspect of the latent variable it measures requires deeper introspection.
(b) Different databases have small overlap in records. For example it has been estimated that there is only 52% overlap between two popular bibliometric databases namely Scopus and web-of-Science. Non-article items are less covered by standard databases, making the bibliometric approach more difficult. The lack of unification of items in a database is another concern. Mapping and delineation of scientific fields are related issues which call for developing a proper search strategy for extraction of records.
Scientometric analysis reveals various aspects of scientific and technological communication process by exploiting publication, citation and patent data. For example it can show linkages among institutions, concepts, pattern of knowledge growth within sub-grain analysis, identify the key papers/patents, long term research and technology trends, identify scientific community among others. This rich scientometric data provides ‘object of investigation’ for studies within various disciplines such as sociology of science, science, technology and innovation studies, strategy studies etc. Inspite of this wide reach of scientometric tools and rich data, it has not entered in the mainstream research methods of other disciplines.
Key Points
Bibliometric is increasingly being applied in science policy studies. Indicators constructed from bibliometrics can reveal the dynamics of a research field, how it is developing, and the core competence of different research groups or nations at large. It can show gaps in a country’s research profile and can identify to what extent its research has the ability to inform technological development (for example examining how often research publications are cited by its patents, etc), or show a firm/country technology preparedness (say examining a firm/country patenting activity in emerging areas such as stem cell research, nanotechnology, etc). In technology forecasting, bibliometrics is playing a key role. For example, in many Delphi study choice of experts is based on identification done through mapping research profile. Authors who are highly cited or research groups/institutes are uncovered which provides an objective and more precise method for expert selection. Text mining helps to identify conceptual connections between apparently disjoint areas of research. For example it has been applied in medical research to identify connections between different health problems, etc. Trend analysis based on research publication activity and patenting activity over a period of time is frequently undertaken. It provides for the decision maker and or researchers/research groups to have a more informed understanding of the development in a field and allows for extrapolation through forecasting methods of how the field is expected to develop. This is very useful for decision based analysis such as funding support, create the roadmap, undertake strategic decisions, etc.
Testing Students Ability
Can Scientometric be an important input for science policy studies? (identify four applications to justify your answer if say yes)
Why technology forecasting is important?
Can scientometrics techniques be useful for technology forecasting?
Mark True/False
Technology forecasting techniques are not suitable for scientometric?
Research papers cited in patents show importance of scientific research in technology development?
Patent statistics is not relevant in bibliometric studies?
Text mining techniques help in identification of conceptual connections in a research field?
`
References
Derek J. de Solla Price (1961). "Science Since Babylon. Yale University Press, New Haven, Conn.
Ayse Kaya Firat, Wei Lee Woon, Stuart Madnick. (September 2008). Technological Forecasting – A Review. Working Paper CISL# 2008-15, Composite Information Systems Laboratory (CISL), Massachusetts Institute of Technology.
David Edge, "Reinventing the Wheel," in Jasanoff et al. (eds.) Handbook of Science and Technology Studies (Sage, 1995).
G. Steven McMillan, G.S., Narin, F., Deeds, D.L. (2000), An analysis of the critical role of public science in innovation: the case of biotechnology. Research Policy 29, pp. 1-8 (open access)
Broad, W.J. (1997). Study Finds Public Science is Pillar Of Industry. New York Times, May 13 (open access)
Acknowledgement: I thank Ms Shilpa, research fellow CSIR-NISTADS for her intellectual inputs.
No comments:
Post a Comment