Commit 068d221d28a72dd2f14a5138a75fa2e922ebd361
1 parent
20b8d984
Exists in
master
and in
3 other branches
Revisão do research design
Showing
1 changed file
with
108 additions
and
115 deletions
Show diff stats
oss2018/content/03-methods.tex
1 | \section{Research Design} | 1 | \section{Research Design} |
2 | \label{sec:researchdesign} | 2 | \label{sec:researchdesign} |
3 | 3 | ||
4 | -The focus of this paper is investigating practical ways to conciliate cultural | ||
5 | -differences in software development processes between government and academia, | ||
6 | -without modifying their internal processes. Our analysis was guided by the | ||
7 | -following research questions: | 4 | +% TODO: Tenho a impressão de que esse parágrafo cairia bem no último parágrafo |
5 | +% da introdução. Pelo menos a ideia dele uma vez que resume bem o trabalho | ||
6 | +In this paper, we studied practical alternatives to harmonize different | ||
7 | +software development processes. We are interested in the relationship between | ||
8 | +government and academia from the project management perspective, without the | ||
9 | +enforcement of changing the internal processes. We present two research | ||
10 | +question that guided our work: | ||
8 | 11 | ||
9 | \textbf{RQ1.}\textit{How to introduce open source and agile best practices into | 12 | \textbf{RQ1.}\textit{How to introduce open source and agile best practices into |
10 | government-academia collaboration project?} | 13 | government-academia collaboration project?} |
@@ -12,12 +15,12 @@ government-academia collaboration project?} | @@ -12,12 +15,12 @@ government-academia collaboration project?} | ||
12 | \textbf{RQ2.}\textit{What practices would favor effective team management in | 15 | \textbf{RQ2.}\textit{What practices would favor effective team management in |
13 | government-academia collaborative project?} | 16 | government-academia collaborative project?} |
14 | 17 | ||
15 | -To answer these questions, we use as a case study the evolution project of the | ||
16 | -SPB portal \cite{meirelles2017spb}, a government-academia collaborative | ||
17 | -development based on open source software integration. We designed two surveys | ||
18 | -and an interview to the different roles performed by the project | ||
19 | -participants and we collected public data from the project development | ||
20 | -environment. Our research approach is detailed in the following subsections. | 18 | +To answer these questions, we use as a case study research method. We selected |
19 | +as a case the evolution of the Brazilian Public Software portal (SPB) | ||
20 | +\cite{meirelles2017spb}, a government-academia collaborative project based on | ||
21 | +open source software. To validate our answers, we picked three different points | ||
22 | +of views: developers, government agent, and data collected from the project | ||
23 | +repository. | ||
21 | 24 | ||
22 | \subsection{The case study} | 25 | \subsection{The case study} |
23 | 26 | ||
@@ -25,62 +28,60 @@ environment. Our research approach is detailed in the following subsections. | @@ -25,62 +28,60 @@ environment. Our research approach is detailed in the following subsections. | ||
25 | %Apresentar melhor a SPB plataforma aqui para preparar a discussão dos resultados (usar modelo IEEE Software) | 28 | %Apresentar melhor a SPB plataforma aqui para preparar a discussão dos resultados (usar modelo IEEE Software) |
26 | 29 | ||
27 | %TODO por parágrafo | 30 | %TODO por parágrafo |
28 | -%five existing open source software (substitutir software por systems) | ||
29 | -%systems-of-sytems software (Colab) (substitutir software por framework) | ||
30 | - | ||
31 | -The project to evolve the Brazilian Public Software Portal was a partnership | ||
32 | -between government and academia held between 2014 and 2016 | ||
33 | -\cite{meirelles2017spb}. To solve maintenance problems and fill design-reality | ||
34 | -gaps in the portal, the Ministry of Planning (MPOG) joined the University of | ||
35 | -Brasília (UnB) and the University of São Paulo (USP) to develop a platform | ||
36 | -based on the integration and evolution of five existing open source | ||
37 | -software. This environment was a novelty in the context of the Brazilian | ||
38 | -government, due to the technologies employed and its diverse features, | ||
39 | -including social networking (Noosfero), mailing lists (MailMan), version | ||
40 | -control system (GitLab), and source code quality monitoring (Mezuro), all | ||
41 | -integrated using a system-of-systems software (Colab) \cite{meirelles2017spb}. | ||
42 | - | ||
43 | -%Não usar empirical practices => best practices | ||
44 | -%undergraduate students => undergraduate interns | ||
45 | -%Colocar no discurso direto: The project hired 6 IT profectionals, and 2 designers. | ||
46 | - | 31 | +%five existing open source software (substitutir software por systems) --> As minhas modificações removeram isso, contudo vale a pena verificar |
32 | +%systems-of-sytems software (Colab) (substitutir software por framework) --> Não alterei uma vez que me parece inconsistente com os trabalhos antigos. | ||
33 | + | ||
34 | +The project to evolve the SPB was a partnership between government and academia | ||
35 | +held between 2014 and 2016 \cite{meirelles2017spb}. The old version of SPB | ||
36 | +suffers from maintenance problems and design-reality gaps. In this sense, | ||
37 | +Ministry of Planning (MPOG) decided to join the University of Brasília (UnB) | ||
38 | +and the University of São Paulo (USP) to develop a new platform based existing | ||
39 | +open source software. However, it was required to integrate multiple software | ||
40 | +in the same system in the way that end user has a unified experience between | ||
41 | +the tools. | ||
42 | + | ||
43 | +The new SPB portal was a novelty in the context of the Brazilian government, | ||
44 | +due to the technologies employed and its diverse features. The project includes | ||
45 | +social networking (Noosfero), mailing lists (MailMan), version control system | ||
46 | +(GitLab), and source code quality monitoring (Mezuro). All of this software is | ||
47 | +integrated using a system-of-systems software (Colab) [1]. | ||
48 | + | ||
49 | +%Colocar no discurso direto: The project hired 6 IT profectionals, and 2 designers. -> Eu acho importante falar que eles tinham backgroun em FLOSS | ||
47 | The academic team carried out development activities in the Advanced Laboratory | 50 | The academic team carried out development activities in the Advanced Laboratory |
48 | of Production, Research and Innovation in Software Engineering (LAPPIS) at UnB. | 51 | of Production, Research and Innovation in Software Engineering (LAPPIS) at UnB. |
49 | -The project management and development process in this laboratory are usually | ||
50 | -executed adopting empirical practices from open source communities and agile | ||
51 | -methodologies. For this project, a total of 42 undergraduate students and two | ||
52 | -professors participated in the development team. Six IT professionals were also | ||
53 | -hired as senior developers due to their experiences in open source projects and | ||
54 | -two designers specialized in User eXperience. | ||
55 | - | ||
56 | -%(Melhorar a frase) Although they were responsible... Sugestão de sequência: theses government servants did not develop software. Their responsability was contracting... | 52 | +The laboratory born from members of Brazillian FLOSS community and from |
53 | +professors that worked with agile values, naturally, LAPPIS embrace the best | ||
54 | +practices of both ecosystems. For this project, the laboratory had a total of | ||
55 | +42 undergraduate interns, and two professors engaged in the development team. | ||
56 | +Finally, the project had 6 senior professionals with vast experience with | ||
57 | +FLOSS, and two designers specialized in User eXperience (UX). | ||
57 | 58 | ||
58 | The government team was composed of one director, one coordinator, and two IT | 59 | The government team was composed of one director, one coordinator, and two IT |
59 | -analysts from MPOG. Although they were responsible for the | ||
60 | -execution of this collaboration, their department generally does not execute | ||
61 | -development of ministry's software projects, since its responsibility is | ||
62 | -contracting and homologating software development services, following | ||
63 | -traditional management approaches, such as the RUP, CMMI, and PMBOK. | ||
64 | - | ||
65 | -%Met in person to manage... | ||
66 | -%To improve the project management process we have adopted and evolute a set of empirical practices based on open source ecosystems and agile methodologies, establishing an empirical management model. | ||
67 | -%Melhorar frase como um todo tirando o 'we' (diferenciar autor (we) do coordenador do projeto): To improve the project management process we have adopted and evolved a set of empirical practices based on open source ecosystems and agile methodologies, establishing an empirical management model. | ||
68 | -%Sugestão de conteúdo para finalizar a última frase | ||
69 | -%"Ao longo do projeto, os seus responsáveis foram experimentando e testando práticas coletadas do OSS de forma intuitiva e não-sistemática. Neste paper tentamos analisar e sistematizar essas melhores práticas." | ||
70 | -The leaders of these two aforementioned teams periodically met in person for | ||
71 | -the purpose of managing the project progress, discussing strategic and | ||
72 | -technical goals. Initially, these meetings took place at the ministry's | ||
73 | -headquarters and, usually, only directors and professors participated. The | ||
74 | -management of the development team was concentrated in the academic side and | ||
75 | -was organized in biweekly sprints and 4-month releases. With the progress of | ||
76 | -the project, this workflow proved to be inefficient. Conflicts between the | ||
77 | -internal management processes and differences in pace and goals of each | ||
78 | -institution were compromising the platform development. To improve the project | ||
79 | -management process we have adopted and evolute a set of empirical practices | ||
80 | -based on open source ecosystems and agile methodologies, establishing an empirical | ||
81 | -management model. | ||
82 | - | ||
83 | -\subsection{Survey and data collection} | 60 | +analysts from MPOG. They were responsible for contracts and managed the |
61 | +collaboration, which means they do not produce software. Analysts following | ||
62 | +traditional management approaches (e.g., RUP, CMMI, and PMBOK) for a new | ||
63 | +contract and homologating software services. | ||
64 | + | ||
65 | +The leaders of LAPPIS and MPOG periodically met in person to manage the project | ||
66 | +progress, discussing strategic issues and technical goals. Initially, these | ||
67 | +meetings took place at the Ministry's headquarters and, usually, only directors | ||
68 | +and professors participated. On the academic side, the management of the | ||
69 | +development teams often spends two weeks per sprint and release a new version | ||
70 | +each 4-month. During the project progress, this workflow proved to be | ||
71 | +inefficient. Conflicts between the internal management processes and | ||
72 | +differences in pace and goals of each institution were compromising the | ||
73 | +platform development. | ||
74 | + | ||
75 | +% TODO: Eu alterei de acordo com os comentário. Contudo, da minha experiência no projeto eu não sei se isso é verdade. Eu acho que não foi bonito como descrito aqui. | ||
76 | +We decided to adopt and assess a set of empirical practices based on FLOSS | ||
77 | +ecosystems and agile values. We tried this strategy as an attempt to improve | ||
78 | +the project management process by reducing the conflict between the government | ||
79 | +and academia. We built an experimental management model to harmonize the | ||
80 | +different cultures. During the project, the members were encouraged to try | ||
81 | +FLOSS practices in intuitive a non-systematic way. In this paper, we try to | ||
82 | +analyze and codify these practices. | ||
83 | + | ||
84 | +\subsection{Survey, Interview and Data Collection} | ||
84 | 85 | ||
85 | %UnB undergraduate interns | 86 | %UnB undergraduate interns |
86 | %Online questionnaire (Não usar survey, usar sempre questionnaire) | 87 | %Online questionnaire (Não usar survey, usar sempre questionnaire) |
@@ -88,69 +89,61 @@ management model. | @@ -88,69 +89,61 @@ management model. | ||
88 | %The questions are classified into categories | 89 | %The questions are classified into categories |
89 | %tirar "in the context of government and project;" | 90 | %tirar "in the context of government and project;" |
90 | 91 | ||
91 | -We divided the UnB development team into two groups of target participants | ||
92 | -according to their roles during the project: \textit{UnB Interns} and | ||
93 | -\textit{Senior Developers}. For each group, we designed an online survey with | 92 | +We divided the development team into two groups of participants according to |
93 | +their roles during the project: UnB undergraduate interns and Senior | ||
94 | +developers. For each set of members, we designed an online questionnaire with | ||
94 | topics related to project organization, development process, communication and | 95 | topics related to project organization, development process, communication and |
95 | relationship between members, acquired knowledge, and experience with open | 96 | relationship between members, acquired knowledge, and experience with open |
96 | -source projects. We interviewed also two \textit{MPOG analysts} who directly | ||
97 | -interacted with the development team and project development process. The | ||
98 | -interview questions could be classified into four parts: Professional profile; | ||
99 | -Organization, communication and development methodologies in the context of | ||
100 | -government and project; Satisfaction with the developed platform; Lessons | ||
101 | -learned. | ||
102 | - | ||
103 | -%UnB interns (undergraduate students) => interns | ||
104 | -%their average age [in september 2017] are... | ||
105 | -%arredondar as casas das porcentagem, nada depois da virgula 43,2% => 43% | 97 | +source projects. We also interviewed two MPOG analysts who directly interacted |
98 | +with the development team and project development process. The interview | ||
99 | +questions had four parts: (1) Professional profile; (2) Organization, | ||
100 | +communication and development methodologies in the context of government; (3) | ||
101 | +Satisfaction with the developed platform; (3) Lessons learned. | ||
102 | + | ||
103 | + | ||
106 | %falar as porcentagens sobre a profissão de todos inclusive teacher and public servants | 104 | %falar as porcentagens sobre a profissão de todos inclusive teacher and public servants |
107 | %link to online questionnaire throught e-mail | 105 | %link to online questionnaire throught e-mail |
108 | - | ||
109 | -We sent the link to the online survey through emails to 42 UnB interns | ||
110 | -(undergraduate students), who participated in any time of the project as | ||
111 | -developer receiving a scholarship. We received a total of 37 responses. Their | ||
112 | -average age is 25 years old and 91.9\% of them are male. Currently, 35.1\% | ||
113 | -continue at the university as undergraduate or graduate students, 18.9\% work as | ||
114 | -a developer in a small company and 18.9\% in medium or large companies, 10.8\% | ||
115 | -are entrepreneurs, 8.1\% are unemployed and the others work as teachers or | ||
116 | -civil servants. 43.2\% said the SPB project was their first experience with | ||
117 | -open source software. | 106 | +We sent the online questionnaire link via email to 42 interns, all of them |
107 | +worked at any period of the project as a developer and received a scholarship. | ||
108 | +We received a total of 37 responses. Their average age in September 2017 is 25 | ||
109 | +years old, and 92\% of them are male. Currently, 35\% continue at the university | ||
110 | +as undergraduate or graduate students, 19\% work as a developer in a small | ||
111 | +company and 19\% in medium or large enterprises, 11\% are entrepreneurs, 8% are | ||
112 | +unemployed, and the others work as teachers or civil servants. About of the | ||
113 | +interns 43\% said the SPB project was their first experience with open source | ||
114 | +software. | ||
118 | 115 | ||
119 | %We also invited the 8 seniors developers to filling the oline questionnaire and all of them did. | 116 | %We also invited the 8 seniors developers to filling the oline questionnaire and all of them did. |
120 | %They average age are | 117 | %They average age are |
121 | 118 | ||
122 | -We also sent the link to the online survey through emails to eight senior | ||
123 | -developers (IT professionals). All of them answered the questionnaire. | ||
124 | -Their average age is 32 years old and 87.5\% are male. They have an average of | ||
125 | -11 years of experience in the IT market, and currently, 62.5\% of respondents | ||
126 | -are company employees, 37.5\% are freelance developers, 25\% are master's | ||
127 | -degree students and 25\% entrepreneurs. They have worked on average in 5 | ||
128 | -companies and participated in 4 to 80 projects. They participated in this | ||
129 | -collaborative project between 7 to 24 months. 85.7\% of them had some | ||
130 | -experience with free software before the SPB project. | ||
131 | - | ||
132 | - | ||
133 | -Two MPOG IT analysts were interviewed separately. Each interview took an | ||
134 | -average of 2 hours with 28 open questions. They are more than 30 years old and | ||
135 | -have been government employees for more than 7 years. Only one of them | ||
136 | -continues working in the same ministry. For both, this collaborative project | ||
137 | -was their first experience of government-academia development collaboration. | ||
138 | - | 119 | +We also sent the online questionnaire through emails to 8 senior developers (IT |
120 | +professionals), and all of them participated. Their average age is 32 years | ||
121 | +old, and 87\% are male. On average they have 11 years of experience in the IT | ||
122 | +market. Currently, 62\% of the interviewed have a formal job, 37\% are freelance | ||
123 | +developers, 25\% are master's degree students, and 25\% are entrepreneurs. On | ||
124 | +average they worked in 5 different companies and participated in 4 to 80 | ||
125 | +projects. They joined in this collaborative project between 7 to 24 months, and | ||
126 | +86\% of them had some experience with FLOSS before the SPB project. | ||
127 | + | ||
128 | +We interviewed two MPOG analysts separately. Each interview took an average of | ||
129 | +2 hours with 28 open questions. They are over 30 years old, and they have more | ||
130 | +than 7 years of experience working in the government. Only one of them | ||
131 | +continues working in the same ministry. Both of the analysts said this | ||
132 | +collaborative project was their first experience of government-academia | ||
133 | +development collaboration. | ||
134 | + | ||
139 | %We collected from the repository manager all open issues and commits. | 135 | %We collected from the repository manager all open issues and commits. |
140 | %We collected from the main project repository all the issues and commits. | 136 | %We collected from the main project repository all the issues and commits. |
141 | %The number of comment authors | 137 | %The number of comment authors |
142 | %In the main project repository | 138 | %In the main project repository |
143 | - | ||
144 | Finally, we quantitatively analyze data about the development of the project, | 139 | Finally, we quantitatively analyze data about the development of the project, |
145 | -publicly available on the SPB platform. We collected from the repository | ||
146 | -manager tool of the platform all open issues and commits related to the main | ||
147 | -repository of the platform, that is, the development repositories of the | ||
148 | -integrated software were not considered. For issues, we collected project | ||
149 | -name, author of the issue, opening date, issue title, and the number of comments. | ||
150 | -We also collected information about total open issues, the total commits, | ||
151 | -different authors of issues, the number of different authors of issues, the number of | ||
152 | -comments, authors of comments, the number of authors other than comments. During | ||
153 | -the period from April 2015 to June 2016, 879 issues were opened by 59 distinct | ||
154 | -authors with a total of 4,658 comments and 64 distinct commentators. The | ||
155 | -development team made 3,256 commits in the repository provided by SPB platform. | ||
156 | - | 140 | +publicly available on the SPB platform. We collected data from the repository |
141 | +manager all open issues and commits. We not considered the development | ||
142 | +repositories of the integrated software (e.g., Noosfero and Gitlab). Regarding | ||
143 | +the issues, we collected the total of them, project name, authors, opening | ||
144 | +date, title, and the number of comments. We also get information about the | ||
145 | +total commits, different authors per issues, the number of comments, authors of | ||
146 | +comments, the number of authors other than comments. During the period from | ||
147 | +April 2015 to June 2016, 879 issues were opened by 59 distinct authors with a | ||
148 | +total of 4,658 comments and 64 different commentators. The development team | ||
149 | +made 3,256 commits in the repository provided by SPB platform. |