Download as
Browse Code »

Commit 068d221d28a72dd2f14a5138a75fa2e922ebd361

Authored by Rodrigo Siqueira de Melo
1 parent 20b8d984
Exists in master and in 3 other branches oss_2018, oss_2018_siqueira, rework_case_study

Revisão do research design

Showing 1 changed file with 108 additions and 115 deletions   Show diff stats
oss2018/content/03-methods.tex
  Diff comments   View file @068d221
1 1 \section{Research Design}
2 2 \label{sec:researchdesign}
3 3  
4   -The focus of this paper is investigating practical ways to conciliate cultural
5   -differences in software development processes between government and academia,
6   -without modifying their internal processes. Our analysis was guided by the
7   -following research questions:
  4 +% TODO: Tenho a impressão de que esse parágrafo cairia bem no último parágrafo
  5 +% da introdução. Pelo menos a ideia dele uma vez que resume bem o trabalho
  6 +In this paper, we studied practical alternatives to harmonize different
  7 +software development processes. We are interested in the relationship between
  8 +government and academia from the project management perspective, without the
  9 +enforcement of changing the internal processes. We present two research
  10 +question that guided our work:
8 11  
9 12 \textbf{RQ1.}\textit{How to introduce open source and agile best practices into
10 13 government-academia collaboration project?}
... ... @@ -12,12 +15,12 @@ government-academia collaboration project?}
12 15 \textbf{RQ2.}\textit{What practices would favor effective team management in
13 16 government-academia collaborative project?}
14 17  
15   -To answer these questions, we use as a case study the evolution project of the
16   -SPB portal \cite{meirelles2017spb}, a government-academia collaborative
17   -development based on open source software integration. We designed two surveys
18   -and an interview to the different roles performed by the project
19   -participants and we collected public data from the project development
20   -environment. Our research approach is detailed in the following subsections.
  18 +To answer these questions, we use as a case study research method. We selected
  19 +as a case the evolution of the Brazilian Public Software portal (SPB)
  20 +\cite{meirelles2017spb}, a government-academia collaborative project based on
  21 +open source software. To validate our answers, we picked three different points
  22 +of views: developers, government agent, and data collected from the project
  23 +repository.
21 24  
22 25 \subsection{The case study}
23 26  
... ... @@ -25,62 +28,60 @@ environment. Our research approach is detailed in the following subsections.
25 28 %Apresentar melhor a SPB plataforma aqui para preparar a discussão dos resultados (usar modelo IEEE Software)
26 29  
27 30 %TODO por parágrafo
28   -%five existing open source software (substitutir software por systems)
29   -%systems-of-sytems software (Colab) (substitutir software por framework)
30   -
31   -The project to evolve the Brazilian Public Software Portal was a partnership
32   -between government and academia held between 2014 and 2016
33   -\cite{meirelles2017spb}. To solve maintenance problems and fill design-reality
34   -gaps in the portal, the Ministry of Planning (MPOG) joined the University of
35   -Brasília (UnB) and the University of São Paulo (USP) to develop a platform
36   -based on the integration and evolution of five existing open source
37   -software. This environment was a novelty in the context of the Brazilian
38   -government, due to the technologies employed and its diverse features,
39   -including social networking (Noosfero), mailing lists (MailMan), version
40   -control system (GitLab), and source code quality monitoring (Mezuro), all
41   -integrated using a system-of-systems software (Colab) \cite{meirelles2017spb}.
42   -
43   -%Não usar empirical practices => best practices
44   -%undergraduate students => undergraduate interns
45   -%Colocar no discurso direto: The project hired 6 IT profectionals, and 2 designers.
46   -
  31 +%five existing open source software (substitutir software por systems) --> As minhas modificações removeram isso, contudo vale a pena verificar
  32 +%systems-of-sytems software (Colab) (substitutir software por framework) --> Não alterei uma vez que me parece inconsistente com os trabalhos antigos.
  33 +
  34 +The project to evolve the SPB was a partnership between government and academia
  35 +held between 2014 and 2016 \cite{meirelles2017spb}. The old version of SPB
  36 +suffers from maintenance problems and design-reality gaps. In this sense,
  37 +Ministry of Planning (MPOG) decided to join the University of Brasília (UnB)
  38 +and the University of São Paulo (USP) to develop a new platform based existing
  39 +open source software. However, it was required to integrate multiple software
  40 +in the same system in the way that end user has a unified experience between
  41 +the tools.
  42 +
  43 +The new SPB portal was a novelty in the context of the Brazilian government,
  44 +due to the technologies employed and its diverse features. The project includes
  45 +social networking (Noosfero), mailing lists (MailMan), version control system
  46 +(GitLab), and source code quality monitoring (Mezuro). All of this software is
  47 +integrated using a system-of-systems software (Colab) [1].
  48 +
  49 +%Colocar no discurso direto: The project hired 6 IT profectionals, and 2 designers. -> Eu acho importante falar que eles tinham backgroun em FLOSS
47 50 The academic team carried out development activities in the Advanced Laboratory
48 51 of Production, Research and Innovation in Software Engineering (LAPPIS) at UnB.
49   -The project management and development process in this laboratory are usually
50   -executed adopting empirical practices from open source communities and agile
51   -methodologies. For this project, a total of 42 undergraduate students and two
52   -professors participated in the development team. Six IT professionals were also
53   -hired as senior developers due to their experiences in open source projects and
54   -two designers specialized in User eXperience.
55   -
56   -%(Melhorar a frase) Although they were responsible... Sugestão de sequência: theses government servants did not develop software. Their responsability was contracting...
  52 +The laboratory born from members of Brazillian FLOSS community and from
  53 +professors that worked with agile values, naturally, LAPPIS embrace the best
  54 +practices of both ecosystems. For this project, the laboratory had a total of
  55 +42 undergraduate interns, and two professors engaged in the development team.
  56 +Finally, the project had 6 senior professionals with vast experience with
  57 +FLOSS, and two designers specialized in User eXperience (UX).
57 58  
58 59 The government team was composed of one director, one coordinator, and two IT
59   -analysts from MPOG. Although they were responsible for the
60   -execution of this collaboration, their department generally does not execute
61   -development of ministry's software projects, since its responsibility is
62   -contracting and homologating software development services, following
63   -traditional management approaches, such as the RUP, CMMI, and PMBOK.
64   -
65   -%Met in person to manage...
66   -%To improve the project management process we have adopted and evolute a set of empirical practices based on open source ecosystems and agile methodologies, establishing an empirical management model.
67   -%Melhorar frase como um todo tirando o 'we' (diferenciar autor (we) do coordenador do projeto): To improve the project management process we have adopted and evolved a set of empirical practices based on open source ecosystems and agile methodologies, establishing an empirical management model.
68   -%Sugestão de conteúdo para finalizar a última frase
69   -%"Ao longo do projeto, os seus responsáveis foram experimentando e testando práticas coletadas do OSS de forma intuitiva e não-sistemática. Neste paper tentamos analisar e sistematizar essas melhores práticas."
70   -The leaders of these two aforementioned teams periodically met in person for
71   -the purpose of managing the project progress, discussing strategic and
72   -technical goals. Initially, these meetings took place at the ministry's
73   -headquarters and, usually, only directors and professors participated. The
74   -management of the development team was concentrated in the academic side and
75   -was organized in biweekly sprints and 4-month releases. With the progress of
76   -the project, this workflow proved to be inefficient. Conflicts between the
77   -internal management processes and differences in pace and goals of each
78   -institution were compromising the platform development. To improve the project
79   -management process we have adopted and evolute a set of empirical practices
80   -based on open source ecosystems and agile methodologies, establishing an empirical
81   -management model.
82   -
83   -\subsection{Survey and data collection}
  60 +analysts from MPOG. They were responsible for contracts and managed the
  61 +collaboration, which means they do not produce software. Analysts following
  62 +traditional management approaches (e.g., RUP, CMMI, and PMBOK) for a new
  63 +contract and homologating software services.
  64 +
  65 +The leaders of LAPPIS and MPOG periodically met in person to manage the project
  66 +progress, discussing strategic issues and technical goals. Initially, these
  67 +meetings took place at the Ministry's headquarters and, usually, only directors
  68 +and professors participated. On the academic side, the management of the
  69 +development teams often spends two weeks per sprint and release a new version
  70 +each 4-month. During the project progress, this workflow proved to be
  71 +inefficient. Conflicts between the internal management processes and
  72 +differences in pace and goals of each institution were compromising the
  73 +platform development.
  74 +
  75 +% TODO: Eu alterei de acordo com os comentário. Contudo, da minha experiência no projeto eu não sei se isso é verdade. Eu acho que não foi bonito como descrito aqui.
  76 +We decided to adopt and assess a set of empirical practices based on FLOSS
  77 +ecosystems and agile values. We tried this strategy as an attempt to improve
  78 +the project management process by reducing the conflict between the government
  79 +and academia. We built an experimental management model to harmonize the
  80 +different cultures. During the project, the members were encouraged to try
  81 +FLOSS practices in intuitive a non-systematic way. In this paper, we try to
  82 +analyze and codify these practices.
  83 +
  84 +\subsection{Survey, Interview and Data Collection}
84 85  
85 86 %UnB undergraduate interns
86 87 %Online questionnaire (Não usar survey, usar sempre questionnaire)
... ... @@ -88,69 +89,61 @@ management model.
88 89 %The questions are classified into categories
89 90 %tirar "in the context of government and project;"
90 91  
91   -We divided the UnB development team into two groups of target participants
92   -according to their roles during the project: \textit{UnB Interns} and
93   -\textit{Senior Developers}. For each group, we designed an online survey with
  92 +We divided the development team into two groups of participants according to
  93 +their roles during the project: UnB undergraduate interns and Senior
  94 +developers. For each set of members, we designed an online questionnaire with
94 95 topics related to project organization, development process, communication and
95 96 relationship between members, acquired knowledge, and experience with open
96   -source projects. We interviewed also two \textit{MPOG analysts} who directly
97   -interacted with the development team and project development process. The
98   -interview questions could be classified into four parts: Professional profile;
99   -Organization, communication and development methodologies in the context of
100   -government and project; Satisfaction with the developed platform; Lessons
101   -learned.
102   -
103   -%UnB interns (undergraduate students) => interns
104   -%their average age [in september 2017] are...
105   -%arredondar as casas das porcentagem, nada depois da virgula 43,2% => 43%
  97 +source projects. We also interviewed two MPOG analysts who directly interacted
  98 +with the development team and project development process. The interview
  99 +questions had four parts: (1) Professional profile; (2) Organization,
  100 +communication and development methodologies in the context of government; (3)
  101 +Satisfaction with the developed platform; (3) Lessons learned.
  102 +
  103 +
106 104 %falar as porcentagens sobre a profissão de todos inclusive teacher and public servants
107 105 %link to online questionnaire throught e-mail
108   -
109   -We sent the link to the online survey through emails to 42 UnB interns
110   -(undergraduate students), who participated in any time of the project as
111   -developer receiving a scholarship. We received a total of 37 responses. Their
112   -average age is 25 years old and 91.9\% of them are male. Currently, 35.1\%
113   -continue at the university as undergraduate or graduate students, 18.9\% work as
114   -a developer in a small company and 18.9\% in medium or large companies, 10.8\%
115   -are entrepreneurs, 8.1\% are unemployed and the others work as teachers or
116   -civil servants. 43.2\% said the SPB project was their first experience with
117   -open source software.
  106 +We sent the online questionnaire link via email to 42 interns, all of them
  107 +worked at any period of the project as a developer and received a scholarship.
  108 +We received a total of 37 responses. Their average age in September 2017 is 25
  109 +years old, and 92\% of them are male. Currently, 35\% continue at the university
  110 +as undergraduate or graduate students, 19\% work as a developer in a small
  111 +company and 19\% in medium or large enterprises, 11\% are entrepreneurs, 8% are
  112 +unemployed, and the others work as teachers or civil servants. About of the
  113 +interns 43\% said the SPB project was their first experience with open source
  114 +software.
118 115  
119 116 %We also invited the 8 seniors developers to filling the oline questionnaire and all of them did.
120 117 %They average age are
121 118  
122   -We also sent the link to the online survey through emails to eight senior
123   -developers (IT professionals). All of them answered the questionnaire.
124   -Their average age is 32 years old and 87.5\% are male. They have an average of
125   -11 years of experience in the IT market, and currently, 62.5\% of respondents
126   -are company employees, 37.5\% are freelance developers, 25\% are master's
127   -degree students and 25\% entrepreneurs. They have worked on average in 5
128   -companies and participated in 4 to 80 projects. They participated in this
129   -collaborative project between 7 to 24 months. 85.7\% of them had some
130   -experience with free software before the SPB project.
131   -
132   -
133   -Two MPOG IT analysts were interviewed separately. Each interview took an
134   -average of 2 hours with 28 open questions. They are more than 30 years old and
135   -have been government employees for more than 7 years. Only one of them
136   -continues working in the same ministry. For both, this collaborative project
137   -was their first experience of government-academia development collaboration.
138   -
  119 +We also sent the online questionnaire through emails to 8 senior developers (IT
  120 +professionals), and all of them participated. Their average age is 32 years
  121 +old, and 87\% are male. On average they have 11 years of experience in the IT
  122 +market. Currently, 62\% of the interviewed have a formal job, 37\% are freelance
  123 +developers, 25\% are master's degree students, and 25\% are entrepreneurs. On
  124 +average they worked in 5 different companies and participated in 4 to 80
  125 +projects. They joined in this collaborative project between 7 to 24 months, and
  126 +86\% of them had some experience with FLOSS before the SPB project.
  127 +
  128 +We interviewed two MPOG analysts separately. Each interview took an average of
  129 +2 hours with 28 open questions. They are over 30 years old, and they have more
  130 +than 7 years of experience working in the government. Only one of them
  131 +continues working in the same ministry. Both of the analysts said this
  132 +collaborative project was their first experience of government-academia
  133 +development collaboration.
  134 +
139 135 %We collected from the repository manager all open issues and commits.
140 136 %We collected from the main project repository all the issues and commits.
141 137 %The number of comment authors
142 138 %In the main project repository
143   -
144 139 Finally, we quantitatively analyze data about the development of the project,
145   -publicly available on the SPB platform. We collected from the repository
146   -manager tool of the platform all open issues and commits related to the main
147   -repository of the platform, that is, the development repositories of the
148   -integrated software were not considered. For issues, we collected project
149   -name, author of the issue, opening date, issue title, and the number of comments.
150   -We also collected information about total open issues, the total commits,
151   -different authors of issues, the number of different authors of issues, the number of
152   -comments, authors of comments, the number of authors other than comments. During
153   -the period from April 2015 to June 2016, 879 issues were opened by 59 distinct
154   -authors with a total of 4,658 comments and 64 distinct commentators. The
155   -development team made 3,256 commits in the repository provided by SPB platform.
156   -
  140 +publicly available on the SPB platform. We collected data from the repository
  141 +manager all open issues and commits. We not considered the development
  142 +repositories of the integrated software (e.g., Noosfero and Gitlab). Regarding
  143 +the issues, we collected the total of them, project name, authors, opening
  144 +date, title, and the number of comments. We also get information about the
  145 +total commits, different authors per issues, the number of comments, authors of
  146 +comments, the number of authors other than comments. During the period from
  147 +April 2015 to June 2016, 879 issues were opened by 59 distinct authors with a
  148 +total of 4,658 comments and 64 different commentators. The development team
  149 +made 3,256 commits in the repository provided by SPB platform.
... ...