From TRL to MRL: Assessing The Market Readiness of Open Source Projects

Transcription

1 From TRL to MRL: Assessing The Market Readiness of Open Source Projects A Progress Report Cedric Thomas OW MARCH 2017 EXCEL LONDON

2 OW2 Non-Profit Open Source Organization European and Global Code Base

3 OW2 Non-Profit Open Source Organization European and Global Community Code Base

4 OW2 Non-Profit Open Source Organization European and Global Community Activities Code Base

5 OW2 Non-Profit Open Source Organization European and Global Community Activities Governance Code Base

6 OW2 Non-Profit Open Source Organization European and Global Community Activities Members Governance Code Base

7 2016, Cedric Thomas Mar 16,

8 2016, Cedric Thomas Mar 16,

9 2016, Cedric Thomas Mar 16,

10 2016, Cedric Thomas Mar 16,

11 Free Software Commercial Open Source 11

12 Agenda OSS Projects and the Value Chain Evaluating Readiness and Maturity Evaluating Open Source Projects OW2 OSCAR Approach Mar 16,

13 OSS projects and the value chain Project categories Code to product Supporting market readiness Mar 16,

14 Community projects Mar 16,

15 Enterprise projects Mar 16,

16 Collaborative projects Mar 16,

17 Software is Code Mar 16,

18 What is a Software Product? Customer Developer Mar 16,

19 What makes a Software Product? Documentation Packaging Upgrades Training Etc. Customer Developer Testing Pricing Contracts Support Expertise Mar 16,

20 What creates value? Research & Development Delivery Challenge Predictability Quality Trust Documentation Testing Upgrades Bug-fixing Training Support Packaging Case studies Collateral Pricing Contracts Early adopters Etc. Code POCs Use-cases Demonstrators Market Value OSS Without the code, the rest does not exist,but it's the rest that gives market value to the code 20

21 Who creates value? The ecosystem Systems Integrators Contributors Research & Development Predictability Quality Trust Code POCs Use-cases Demonstrators Documentation Roadmap Upgrades Bug-fixing Training Support Packaging Case studies Collateral Pricing Contracts Early adopters Etc. Market Value Open Source Orgs. Distrib.Delivery Vendors Challenge Fiduciary Services Users 21

22 Supporting market readiness and value creation Predictability Quality Trust Code POCs Use-cases Demonstrators Documentation Roadmap Upgrades Bug-fixing Training Support Packaging Case studies Collateral Pricing Contracts Early adopters Etc. Market Value Communication, Outreach, Marketplace Governance, Projects, Initiatives, Quality Program Delivery ResearchCollaborative & Development Challenge Technical Resources Development OW2 is an ecosystem platform that helps create value in open source projects OSCAR 22

23 Evaluating Readiness and Maturity Technology Readiness Level Market readiness Open source readiness 23

24 Origin: Technology Readiness Level (TRL) Operational (useful) A type of measurement system used to estimate the maturity level of a particular technology In technology, there are usually nine readiness levels. TRL 1 is the lowest and TRL 9 is the highest. A TRL number is obtained once the description has been achieved. Idea (useless) For example, successfully achieving TRL 4 does not move the technology to TRL 5. Pioneered by NASA in the 80 s. Adopted by the DOE and DOD for procurement and management of complex systems. 24

25 NASA/DOD TRL 25

26 Investment Readiness Level 26

27 27

28 Evaluating Open Source Projects QualiPSo OW2 SQuAT CII Badge Program 28

29 CI / Testing Engineering metrics EU Collab. Projects Static analysis Standardization bodies Qualitative analysis IP analysis Industry OSS Analysis Landscape OW2 OMM forms Crowd testing 29

30 2007: QualiPSo European project 48 months ( ) 22 organisations from 9 countries (3 continents) It is all about TRUST Trust cannot be claimed without being proved!!! QualiPSo aimed at standardising the way OSS systems are built, offered and consumed. 30

31 31

32 2010: OW2 Software Quality Assurance and Trustworthiness (SQuAT) IP verification: FOSSology Applied on all OW2 mature projects Code verification: Antelink Provides traceability of external libraries Static analysis: Sonar Set of OW2 Sonar rules Maturity analysis: Qualipso OMM applied to OW2 projects 32

33 OW2 Implementation of the QualiPSo OMM OMM Basic level Trustworthy elements assessment Assessed value PDOC STD QTP LCS ENV DFCT MST CM PP REQM RDMP STK Trustworthy elements OMM Basic level Assessment value of practices Practices assessment value % 0% 11% 0% 22% 0% 17% 57% 0% 25% 0% 56% 75% 0% 14% 0% 43% 100% 83% 86% 0% 0% 25% 0% 100% 75% STD QTP LCS ENV DFCT MST 0% 100% 0% PDOC 100% 100% CM PP 0% 33% 33% 33% REQM RDMP Trustworthy elements 33 STK

34 2012: RISCOSS Open source as a public resource freely accessible But OSS come from very different backgrounds Exploring and mapping the open source landscape??? Antepedia Need to identify, measure, evaluate existing software Many tools and online services available Business Users Integrators Commercial Products/Services 34

35 2015: Linux Foundation CII Badge Program Core Infrastructure Initiative (CII) Launched after the Heartbleed failure Organized by The Linux Foundation David A. Wheeler at OW2con'16 Supported by Amazon Web Services, Adobe, Bloomberg, Cisco, Dell, Facebook, Fujitsu, Google, Hitachi, HP, Huawei, IBM, Intel, Microsoft, NetApp, NEC, Qualcomm, RackSpace, salesforce.com, and VMware 35

36 CII BADGE PROGRAM Basics Checklist: Project website Project website content FLOSS License Documentation Other Change control Public version-controlled source repository Version numbering Release notes (ChangeLog) Reporting Bug reporting process Vulnerability reporting process Quality Working build system Automated test suite New functionality testing Warning flags Security Secure development knowledge Good cryptographic practices Secured delivery mechanism Publicly-known vulnerabilities fixed Analysis Static code analysis Dynamic analysis 36

37 OW2 OSCAR Approach More than just TRL Market readiness Promotes best practices 37

38 OSCAR Open Source Capability Assessment Radar Risk analysis Visual Reporting Metrics Metrics / Scorecards Documentation Privacy / GDPR Standards Licenses and IP Fossology Governance OMM Form Requirements OMM Form More to come: - Accessibility - Deployability - Marketing - Funding Cloud Deployment Testing / CI / Release Static code analysis SonarQube Code / Commits / Bugs Engineering 38

39 OMM Assessment Web Form Mar 16,

40 OMM Assessment Mar 16,

41 FOSSology License analysis Mar 16,

42 SonarQube Static code analysis Mar 16,

43 Risk Analysis Mar 16,

44 Risk Models Mar 16,

45 OSCAR Market Readiness Scorecard Mar 16,

46 From Data to Market Readiness Levels A type of measurement system used to estimate the market maturity and readiness of a particular project Fully Supported Product (useful) Rough Code (useless) 46

47 A Market Readiness Template for Open Source Software flight proven flight qualified prototype in space proven demo relevant envt validation Lab validation proof of concept application formulation Basic principles Established product with properly financed and organized Business support Customer base, Repeat sales and Market recognition Early customer base, appropriate financing or active community support, recognized software Early customer base and fledgeling financing or active community support Proven product recent, market opening, untested governance Some customers recent, market opening, un-proven governance Several users, project leadership well established One declared user (can be internal) with declared project leader Basic R&D code developed with one demonstrated use case, some documentation Basic R&D code developed 47

48 Thank You And now let's talk Q&A Disagreements Complements Feedback etc. For more details please contact Cedric Thomas, OW2 CEO, 48