Public Disclosure Authorized EAST ASIA AND PACIFIC Indonesia Education Global Practice IBRD/IDA Investment Project Financing FY 2013 Seq No: 11 ARCHIVED on 11-Dec-2018 ISR35076 Implementing Agencies: Ministry of Finance, Ministry of Research Technology and Higher Education Public Disclosure Authorized Key Dates Key Project Dates Bank Approval Date: 29-Mar-2013 Planned Mid Term Review Date: 13-Jun-2016 Original Closing Date: 31-Dec-2020 pdotable Project Development Objectives Effectiveness Date: 12-Jun-2013 Actual Mid-Term Review Date: 09-Feb-2016 Revised Closing Date: 31-Dec-2020 Public Disclosure Authorized Project Development Objective (from Project Appraisal Document) To create an enabling policy environment for research and development in science and technology, to improve thepublicresearchanddevelopment institutes performance, and to improve science, technology and innovation human resource capacity. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured) To support the government in: (1) improving STI human resource capacity; and (2) strengthening technology transfer, institutional functioning, and data management of public research agencies (LPNKs). Components Table Public Disclosure Authorized Name Strengthening the Innovation System and Technology Transfer at Public Research Agencies:(Cost $2.50 M) Strengthening Public Research Funding:(Cost $2.50 M) Developing Science and Technology Human Resources Capacity:(Cost $68.00 M) Project Management:(Cost $7.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions 12/11/2018 Page 1 of 7
The overall implementation progress of the RISET Project towards the achievement of its Project Development Objective (PDO) has witnessed substantial accomplishments during this reporting period and the results have positively impacted the achievement of the PDO. Significant progress has been seen in Component 1 with the completion of pilots on improved Science and Technology Parks (STPs) and on reformed Technology Transfer Offices (TTOs), as well as through the preparation of an academic paper on TTO regulations and on the development of a product commercialization model. Important progress also has been seen in Component 2 with the provision of technical inputs to improve the methodology of unit cost calculations for new energy and renewable energy research activities and the refinement of the existing unit cost calculations based on inputs from the field. In addition, work has been done on the refinement of specific Technology Readiness Levels (TRLs), validation of the TRL measurement method, development of an improved training module for the measurement of TRL, and the refinement of the TRL training system. The STI research monitoring and evaluation (M&E) information system ( which is called (Monevrisbang)) has also been completed with the inclusion of new features for evidence-based executive decision- making. This system will now be integrated with other data bases (such as that of Insinas, the ministry s research block grant program that is provided to researchers at public and private institutions to conduct research focusing on the government s priority areas). The most significant progress has been seen in Component 3 with the cumulative departure of 457 Master s and Ph.D. Degree scholars to date, (exceeding the project s overall target of 422 scholars), coming from both the public research institutions (LPNKs) and from MoRTHE. Of these, 78 (or about 17 percent) of all scholars have graduated and have returned to work in their respective LPNKs. The graduates have also established an alumni association called IASPro (RISET-Pro Alumni Association). There were 28 Non-Degree Program participants to date this year bringing the total to 1,657 NDP participants. Though not numerous, these 28 participants attended various tailor-made training activities linked to the flagships of the LPNKs which are supporting national priorities in STI. As regards project management, the PMO has intensively monitored the delivery of all project activities to achieve the set targets, including mobilizing the required human resources, providing sufficient budget, and submitting project-related documents in a timely manner to relevant stakeholders. It has also established an online application to monitor student study progress as well as graduates re-entry to their respective institutions, though this could be done more efficiently in the future. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Moderate Moderate Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and Sustainability -- Substantial Moderate Fiduciary -- Substantial Substantial Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results PDO Indicators by Objectives / Outcomes 12/11/2018 Page 2 of 7
IN00602212 IN00602213 IN00602205 To support the government in improving STI human resources capacity IN00602218 3. Increased % of Master's and Ph.D. degree holders in LPNK and MoRTHE supported by the RISET Project (Percentage, Custom) 0.00 14.00 17.00 100.00 4. Master s degree holders who participate in applied science research programs (Percentage, Custom) 0.00 80.00 100.00 90.00 5. Ph.D. degree holders who manage or coordinate applied science research programs (Percentage, Custom) 0.00 92.00 100.00 90.00 2. To support the government in strengthening technology transfer 1. LPNK research agency reforms are institutionalized (Text, Custom) NA In progress In progress Reforms are institutionalized 3. To support the government in strengthening institutional functioning and data management of LPNKs IN00602204 2. Improved regulation on the output-based cost standard for the STI research funding system issued on an annual basis (Text, Custom) NA In progress In progress Refined regulation is issued based on annual review covering research priorities Date 13-May-2011 16-May-2018 28-Nov-2018 31-Dec-2019 Overall Comments PDO The work that is being implemented in the different components of the project are helping to achieve the PDO. A pilot Science and Technology Park (STP) in agriculture is being implemented, as are pilot reforms in four 12/11/2018 Page 3 of 7
IN00602211 IN00602209 Transfer Technology Offices (TTO) that are being coordinated by the LPNKs. In addition, work was carried out to generate recommendations for an improved regulation relating to an output-based cost standard. The Degree (Fellowship) program is also on track with 17 percent scholars (78 out of 457 graduated), and with 100 percent of Master s and PhD degree holders that are currently conducting research and/or managing applied science research at their institutions. The Non-Degree Program has also seen some progress through participation of participants in tailor-made training activities linked to LPNK flagships that support national STI priorities. Intermediate Results Indicators by Components Strengthening the Innovation System and Technology Transfer at Public Research Agencies 1. National innovation strategy is developed (Component 1) (Text, Custom) Strategy action plans Strategy action plans The results of the of improved STP and are submitted for technical policy studies is reformed TTO are consideration to the NA used as an input to completed, a product new national research inform the development commercialization and innovation master of Indonesia s RPJMN model is developed plan Date 30-Sep-2013 16-May-2018 28-Nov-2018 31-Dec-2019 IN00602210 2. National Information System for STI is established and integrated into ministry s database system (Component 1) (Text, Custom) In progress: The database has been The database has integrated into the been integrated into Not started ministry s database and the ministry s database STI data is collected the research information (Pusdatin) and with the and reported system including the research information monitoring and system and is actively evaluation system is being used. being refined The Directorate General of the Ministry of Research and Development (MoRTHE) uses the Monevrisbang tool for monitoring the implementation and results of research programs funded by MoRTHE, including those in LPNKs and universities. The data in Monevrisbang is also used as the basis for the planning and budgeting of research programs supporting national priorities undertaken by LPNKs, universities and MoRTHE. The link is: http://monevris.azurewebsites.net 3. Existing regulations in the STI legal framework are reviewed and modifications proposed (Component 1) (Text, Custom) Reviews undertaken: Achieved: Reviews Final modifications are 3 regulations (PP) are have been undertaken. proposed and NA being disseminated Draft of regulations submitted for Draft of regulations concerning TTO and consideration to MoF concerning TTO and on blueprint for 12/11/2018 Page 4 of 7
IN00602217 IN00602214 imported technology blueprint have been submitted to relevant DG at MoRTHE imported technology have been submitted to relevant DG at MoRTHE Strengthening Public Research Funding IN00602208 1. Increased number of research programs in LPNKs and MoRTHE focused on higher ranks of the Technology Readiness Level (TRL) (Component 2) (Text, Custom) On-track. TRL baseline based on More research 2017 Insinas research activities will be programs has been independently Increased number of identified. NA reviewed and the research programs of TRL 1-4: 58% recommendations will higher TRL TRL 5-6: 33% be used to strengthen TRL 7-9: 9% TRL in 2019 Date 30-Sep-2013 16-May-2018 28-Nov-2018 31-Dec-2019 2. Strengthened R&D monitoring & evaluation capacity (Component 2) (Number, Custom) 0.00 6.00 6.00 20.00 Six independent evaluations of multi-year research activities -- selected from the health, medicine, food, and energy research fields -- were conducted and lessons were drawn. Four independent evaluations are planned for 2019. Developing Science and Technology Human Resources Capacity IN00602207 1. Number of LPNK, MoRTHE, Research Agency staff who have studied overseas as supported by RISET-Project (Component 3) (Number, Custom) 0.00 433.00 457.00 422.00 IN00602206 2. Number of participants in RISET-Project s Non-Degree professional courses and training (Component 3) (Number, Custom) 0.00 1,629.00 1,657.00 1,907.00 Date 30-Sep-2013 16-May-2018 28-Nov-2018 31-Dec-2018 12/11/2018 Page 5 of 7
IN00602216 IN00602219 Direct project beneficiaries (Number, Custom) 0.00 2,062.00 2,114.00 2,387.00 Date 30-Sep-2013 16-May-2018 28-Nov-2018 31-Dec-2019 The pool of participants includes more males than females. In 2018, the Degree Program students departing to study abroad are mostly males. They consist of 36 (60%) male students and 24 (40%) female students. The same as in the Non-Degree Program, participants are also mostly males. They consist of 23 (82%) males and 5 (18%) females. However, as a whole, the project is meeting its end target. Female beneficiaries (Percentage, Custom Supplement) 0.00 31.00 28.00 28.00 Project Management 1. Project implementation and monitoring reports (include financial reports) are completed (Component 4) (Yes/No, Custom) No Yes No Yes Date 30-Sep-2013 06-Jun-2018 28-Nov-2018 31-Dec-2020 For the project implementation in the current fiscal year, January to December 2018, the report will be issued in February 2019. Financial reports are received in a timely manner. IN00602215 2. Computerized project monitoring database is established, updated, and key information is placed on MoRTHE project website (Component 4) (Yes/No, Custom) No No Yes Yes The link of the website is: http://risetpro.ristekdikti.go.id Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P121842 IBRD-82450 Effective USD 95.00 80.00 15.00 56.95 23.05 71% Key Dates (by loan) 12/11/2018 Page 6 of 7
Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P121842 IBRD-82450 Effective 29-Mar-2013 12-Apr-2013 12-Jun-2013 31-Dec-2020 31-Dec-2020 Cumulative Disbursements Restructuring History Level 1 Approved on 30-Jan-2017 Related Project(s) There are no related projects. 12/11/2018 Page 7 of 7