Building a common information architecture for the Commission. October 14, 2014

Size: px

Start display at page:

Download "Building a common information architecture for the Commission. October 14, 2014"

MargaretMargaret Carter
5 years ago
Views:

1 Building a common information architecture for the Commission October 14, 2014

2 Introduction: what we did last time Explained process of building a common architecture Explained card sorting scope and planning in depth Prepared draft questions/instructions for treejack testing

3 What we will do today Overview of card sort results Build first hypothesis for level 1 architecture - Break - Continue building - Lunch (12:30 14:00) - Explain how we will test the hypothesis (treejack) Sign-off on task questions/instructions - Break - Continue sign-off Explain collaboration around content - Next steps -

4 1 ST LEVEL ARCHITECTURE How we look at the raw data

5 30 cards for sorting

6 Card sorting methodology

7 Card sorting: overview Test period: September 400 test volunteers from our pool invited to participate Total valid responses: 110 profiles accurately reflecting our real audiences. For statistical accuracy, responses are required The results are evidence-based building blocks that help us create our classification hypothesis

8 Similarity matrix What it shows Percentage of people who paired any one card with any other card What to look for Dark blue areas (where groups of cards have been grouped together more frequently)

10 Dendrogram What it shows Top axis shows % of people who agree with the grouping Early grouping = strong relationship between the tasks Rarely grouped tasks = orphans 100% 0% What to look for Groups with high level of agreement at least 50% Orphans

11 Dendrogram results

12 Dendrogram results

13 Category names created by test participants What they are Names given by test participants to the groups of tasks they created What to look for Names which appear several times

14 Card sort results: examples of frequent namings category label CountOfcategory label About EU 1 About European Union 1 About the EU 6 About the European Union 3 About category Us label CountOfcategory label 2 ABOUT/ About GENERAL business and sustainability 1 category label 1 CountOfcategory label All about business the EU 4 Enviromental Issues 1 1 Core/about Business the & Career EU in link with EU 1 Environment 1 10 Business & industry Environment & Development 2 1 Business and Economics Environment & regional development 1 1 Business in the EU Environment, Food and agriculture 2 1 Business information Environment, Business, Education & Travel in EU Environmental 1 1 Business/industryClick to rename Environmental challenges, agriculture and 1 food production 1 Businesses Environmental issues 1 1 bussiness interesting Environmental policy 1 1 Doing business EU environment 1 1 EU environmental 1 Doing Business in or with the EU 1 Doing Business in the EU 1 Enterprise aids, rules law businnes, doing businnes 1 Eu Business 1 EU Business, Industrie, Finance, Food/Farming and Law 1 European businesses and opportunities 1 For EU businesses 1

15 1 ST LEVEL ARCHITECTURE Using the raw data to build a hypothetical 1st level architecture

16 What we have prepared The digital transformation team has: done an in-depth analysis of all the card sorting data applying the rules and top-task methodology arrived at a first draft hypothesis of 13 classes. In a classification process like this, the maximum is 15 classes. Today we will go through the steps again, together, to finalise the hypothesis

17 Rules for classification building Create the classification top task downwards No new classes below the 30th task Use words used in the top tasks Orphan top (yellow) task -> must have own classification. Orphan medium (green) task -> very strong case for own classification Orphan small (blue) or tiny (white) task -> fit under another classification Group tasks as they are grouped >50% of the time in the dendrogram All tasks in the entire tasklist must have a home in the classification Avoid major percentage disparities between groups (eg 20% vs 2%)

18 Going through the list

19 What we will do today Overview of card sort results Build first hypothesis for level 1 architecture - Break - Continue building - Lunch (12:30 14:00) - Explain how we will test the hypothesis (treejack) Sign-off on task questions/instructions - Break - Continue sign-off Explain collaboration around content - Next steps -

20 TESTING OUR HYPOTHESIS

21 Today s hypothesis Class Total % Business 15,4% Work, Live, Travel in EU 13,5% Law 12,9% About the EU 11,5% Strategy 6,7% Funding 6,0% News, Publications, Events 6,0% Environment 5,9% Research & Innovation 5,3% Education 5,2% Food, Farming, Regional development 3,4% Human Rights, Aid 3,3% Jobs 2,6% Statistics 2,1% Grand Total 100,0%

22 Ingredients to test our hypothesis Online tool (treejack) Questions/instructions Test participants Targets to measure against

23 The tool: Treejack Participants are presented with a task question/instruction and our hypothetical classification. They choose where to click to perform the task

24 Task questions/instructions and test participants Aim: 30 questions Max 15 questions per test participant Aim: responses/question 1000 people will be invited from our pool of test volunteers

25 Test participants: selection criteria (1) LANGUAGE Poll completed in EN and EN as 2 nd language AGE 18+ EU28 90% NON EU 10%

26 Test participants: selection criteria (2) EU28 Employed Self Employed 58% 16% Students 10% Un employed 7% Retired 3% WORK PLACE Private Public sector sector NGO 50% 40% 10%

27 Targets to measure against Aim: 80% overall first click success rate (average) 3 test iterations are typically needed to get there

28 Test results: example Get to the section for the Problem Resolution Approach for production quality improvement Class Percentage Products & Services 57% About Me 0% Find People, Collaboration 7% About Alfa XYZ Laval 16% News 2% IT Support 2% Training 16%

29 TASK QUESTIONS AND INSTRUCTIONS: FINAL REVIEW

30 EU law, rules, treaties, judgments Top task 1 Instruction 1: Find the VAT directive Instruction 2: Find the Commission's decision on the protection of personal data Hypothesis (level 1) Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

31 Research and innovation Top task 2 Hypothesis (level 1) Instruction 3: Find out which scientific and technological fields the EU is promoting. Instruction 4: Find a partner in the EU for a joint development of a new vaccine. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

32 Funding, grants, subsidies Top task 3 Hypothesis (level 1) Instruction 5: A researcher wants to start a new project. Find out if there is an EU grant available. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

33 Education and training in EU Top task 4 Hypothesis (level 1) Instruction 6: Find out if there is an EU programme supporting training for people over 30. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

34 EU strategy, political priorities Top task 5 Hypothesis (level 1) Instruction 7: What are the EU's top 3 priorities for the next 5 years? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

35 Environmental protection Top task 6 Hypothesis (level 1) Instruction 8: Which natural areas are protected in Europe under the Natura 2000 scheme? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

36 Jobs, traineeships at the EC Medium task 7 Hypothesis (level 1) Instruction 9: Find a traineeship/internship at the European Commission Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

37 Find a job in another EU country Medium task 8 Hypothesis (level 1) Instruction 10: Find a job in another EU country. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

38 EU news Medium task 9 Hypothesis (level 1) Instruction 11: Find the latest European Commission press release on Ukraine. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

39 Human rights, fundamental rights Medium task 10 Hypothesis (level 1) Instruction 12: Find the principles for gender equality and nondiscrimination in the EU. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

40 Working in an EU country (rights, permits, benefits) Hypothesis (level 1) Medium task 11 Instruction 13: Find out if someone who moves from one EU country to another needs a work permit. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

41 Order, download an EU publication Medium task 12 Hypothesis (level 1) Instruction 14: Download a copy of this year s General Report on the Activities of the EU Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

42 Track policy and law making process, updates Hypothesis (level 1) Medium task 13 Instruction 15: What is the status of the review of the copyright directive? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

43 Statistics Medium task 14 Hypothesis (level 1) Instruction 16: Find the unemployment rate for year-olds in the EU. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

44 About the European Union (role, structure, how it works, origin) Hypothesis (level 1) Medium task 15 Instruction 17: What is the difference between the Council of Europe and the European Council? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

45 Food and farming (production & safety) Hypothesis (level 1) Medium task 16 Instruction 18: What additives are banned in the production of wine in the EU? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

46 Climate change, global warming Medium task 17 Hypothesis (level 1) Instruction 19: How does the EU Emission Trading System address climate change? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

47 Regional, rural and urban development Hypothesis (level 1) Medium task 18 Instruction 20: Find out what projects the EU is supporting in a particular city. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

48 Product safety, conformity, certification Hypothesis (level 1) Small task 21 Instruction 21: Find the EU requirements for toy safety. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

49 Culture (heritage, arts, films, Capitals of Culture) Hypothesis (level 1) Small task 24 Instruction 22: Find out which EU cities are capitals of culture this year. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

50 Doing business in the EU Small task 25 Hypothesis (level 1) Instruction 23: Find out what steps a company needs to take to open a new branch in the EU. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

51 Economic growth, financial stability in EU (crisis, assistance to member states) Instruction 24: Hypothesis (level 1) Business Work, Live, Travel in EU Small task 26 Find out what the EU is doing to tackle the economic and financial crisis. Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

52 Doing business with the European Commission (calls for tenders, bids) Hypothesis (level 1) Small task 27 Instruction 25: How does a company become a contractor for the European Commission? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

53 Industry norms and standards Small task 29 Hypothesis (level 1) Instruction 26: Find the CEN industry standards for construction materials in the EU. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

54 Travel within, to and from EU (documents, visa, consular help, currencies) Hypothesis (level 1) Small task 33 Instruction 27: Find out what documents are needed to go on holiday to an EU country. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

55 Relations with non-eu countries, international organisations (diplomacy, cooperation agreements) Hypothesis (level 1) Small task 36 Instruction 28: Which agreement is being negociated between the EU and the US? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

56 Competition (state aid, cartels, mergers, antitrust) Hypothesis (level 1) Tiny task 38 Instruction 29: If 2 companies want to merge, what conditions are imposed by the EU? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

57 Development and humanitarian aid Tiny task 39 Hypothesis (level 1) Instruction 30: What sort of development support is the EU providing to West Africa? Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

58 Loans, access to finance, microfinance Tiny task 43 Hypothesis (level 1) Instruction 31: Find out how the EU helps small companies get loans. Business Work, Live, Travel in EU Law About the EU Strategy Funding News, Publications, Events Environment Research & Innovation Education Food, Farming, Regional development Human Rights, Aid Jobs Statistics

59 What we will do today Overview of card sort results Build first hypothesis for level 1 architecture - Break - Continue building - Lunch (12:30 14:00) - Explain how we will test the hypothesis (treejack) Sign-off on task questions/instructions - Break - Continue sign-off Explain collaboration around content - Next steps -

60 Collaboration around content In addition to working on the architecture, we need to start preparing some content for the new web presence Starting point: the digital transformation team has mapped current pages onto the 77 tasks ("task mapping")

61 Task mapping Why? To discover the relative weights of each task in each DG /between DGs To understand the complexity of each task: content-heavy or application-heavy An input for future task identification work What? Mapping all DG pages to the 77 tasks the tasks you have a stake in + any additional tasks When was it done? June-Sept 2014

62 Task mapping example

63 Task mapping: results for a TASK

64 Task mapping: results for a DG

65 Next steps Task mapping: we will send you an in the next few days with this data for review and comment. Identifying 1 or more committed coordinators per DG to keep track of the various ways in which their DG is working with our team. ( to follow)

66 Next steps: architecture building Treejack test launch: October Next collective decision points (½-days to review treejack results, discuss & agree the new hypothesis): 13 November 2 December 18 December Thank you!

IMI Revolutionising Europe s Pharmaceutical Industry. IMI Matters!

IMI Revolutionising Europe s Pharmaceutical Industry IMI Matters! Session in the Framework of the Event Joint Technology Initiatives Innovation in Action 4 6 October 2011 European Parliament Brussels Programme