Commit b3ebea5e8a276e024f990de2313e8e4af659535f

Authored by Melissa Wen
1 parent e10d8141

[oss-2018] Review results of second practice

Showing 1 changed file with 50 additions and 166 deletions   Show diff stats
icse2018/content/06-results.tex
@@ -15,6 +15,8 @@ government. In this section, we present by context the practices adopted in this @@ -15,6 +15,8 @@ government. In this section, we present by context the practices adopted in this
15 second phase and show the benefits generated by its deployment, as summarized 15 second phase and show the benefits generated by its deployment, as summarized
16 in the Table \ref{practices-table}. 16 in the Table \ref{practices-table}.
17 17
  18 +%% TODO: explicar a estrutura e cada campo da tabela
  19 +
18 \begin{table}[] 20 \begin{table}[]
19 \centering 21 \centering
20 \resizebox{\textwidth}{!}{% 22 \resizebox{\textwidth}{!}{%
@@ -40,12 +42,10 @@ increase interactions between development team and public servants; @@ -40,12 +42,10 @@ increase interactions between development team and public servants;
40 \item Biweekly gov staff, senior developers and coaches met to planning and 42 \item Biweekly gov staff, senior developers and coaches met to planning and
41 review sprint at the UnB headquarters. \item Most of features under development 43 review sprint at the UnB headquarters. \item Most of features under development
42 were discussed on Gitlab Issue Tracker. \item Only strategic decisions or 44 were discussed on Gitlab Issue Tracker. \item Only strategic decisions or
43 -bureaucratic issues involve board directors. \item Deploying SPB intermediated  
44 -versions in production \end{itemize} & 45 +bureaucratic issues involve board directors. \item Continuous Delivery \end{itemize} &
45 \begin{itemize} 46 \begin{itemize}
46 -\item Reduce communication misunderstood and develop requirements closer to the expectations of both sides;  
47 -\item Improve understanding of collaborative development by MPOG staff  
48 -\item Increasing government confidence for collaborative projects with the university; 47 +\item Reduce communication misunderstood and better meet expectations of both sides;
  48 +\item Improve understanding of collaborative development by MPOG staff and increase their confidence for collaborative projects with the university;
49 \item Aligning both side pace to execute project-related activities (Empathy between gov and academia side) 49 \item Aligning both side pace to execute project-related activities (Empathy between gov and academia side)
50 \item Improving translation from one development process to the other; 50 \item Improving translation from one development process to the other;
51 \end{itemize} \\ \hline 51 \end{itemize} \\ \hline
@@ -68,7 +68,6 @@ versions in production \end{itemize} & @@ -68,7 +68,6 @@ versions in production \end{itemize} &
68 68
69 \subsection{Project management and communication on the developing platform 69 \subsection{Project management and communication on the developing platform
70 itself} 70 itself}
71 -\hfill  
72 71
73 After nine months of project activities, the first version of new SPB Portal was 72 After nine months of project activities, the first version of new SPB Portal was
74 released. From this point, we started to migrate the management and 73 released. From this point, we started to migrate the management and
@@ -117,167 +116,52 @@ and also there in the portal itself of what happened in the project. At any @@ -117,167 +116,52 @@ and also there in the portal itself of what happened in the project. At any
117 moment we can go there and see how it worked, how the person did, and manages 116 moment we can go there and see how it worked, how the person did, and manages
118 to salvage those good points." 117 to salvage those good points."
119 118
120 -%\subsubsection{Bringing the government staff directly responsible for the  
121 -%project together with development team}  
122 -%\begin{itemize}  
123 -%\item \textit{Biweekly meetings (planning and sprint review) in the  
124 -%development lab with the presence of government staff, team coaches and senior  
125 -%developers}  
126 -%\item \textit{Discuss features under development directly on Gitlab Issue  
127 -%Tracker}  
128 -%\item \textit{Only strategic decisions or bureaucratic issues involve the  
129 -%directors/secretaries}  
130 -%\end{itemize}  
131 -%  
132 -%\paragraph{Benefits}  
133 -%  
134 -%\begin{itemize}  
135 -% \setlength\itemsep{1em}  
136 -% \item \textit{Reduce communication misunderstood}  
137 -% \subitem MPOG: "That's when the project started, people [MPOG staff] did  
138 -%not participate in anything. The communication process was horrible."; "The  
139 -%[MPOG] coordinator did not help, he would say something and UnB would talk to  
140 -%another at the meeting and it was the biggest mess." About the direct dialogue  
141 -%between the academic team and MPOG staff (without the involvement of  
142 -%coordinators and / or directors) , she said "That's where things really started  
143 -%to move, that the communication of the project began to improve."  
144 -%%  
145 -% \item \textit{Empathy between members on both sides}  
146 -% \subitem {72.9\%} of students believe that interacting with MPOG staff was  
147 -%important during the project  
148 -% \subitem Only 27\% of the students interviewed said they did not feel like  
149 -%attending meetings with MPOG employees  
150 -% \subitem MPOG: "You know people in person and it makes such a big  
151 -%difference because it causes empathy. You know what the person is going through  
152 -%on their side and she knows what we're going through on our side. So the next  
153 -%time you have a non-personal interaction (by mail, by list ...) I think it even  
154 -%facilitates, improves communication. You already know who that person is, it's  
155 -%not just a name. "  
156 -%%  
157 -% \item \textit{Develop requirements closer to the expectations of both sides}  
158 -% \subitem {81.1 \%} of students believe that the participation of MPOG  
159 -%staff in planning and closing sprints was important for the development of the  
160 -%project  
161 -% \subitem {75.6 \%} of students believe that writing the requirements  
162 -%together with the MPOG staff was very important  
163 -% \subitem Undergrad student: "Joint planning and timely meetings were very  
164 -%important for understanding the needs of MPOG, and the interaction via SPB  
165 -%tools helped validate the tool as a development platform"  
166 -% \subitem Undergrad student: "Often they did not know what they really  
167 -%wanted, and they caused some delays in the development of sprints"  
168 -% \subitem Undergrad student: "A relationship of constant attempt to balance  
169 -%and negotiate. The client does not always know the impacts of their requests"  
170 -% \subitem MPOG: "I believe it was very positive, we also liked to go there,  
171 -%to interact with the team. I think it brought more unity, more integration into  
172 -%the project, because we went there, where people were working and they show  
173 -%what was done. I think they also liked to receive our feedback about what had  
174 -%been done by them.This interaction did not just made with the coordinator. I  
175 -%found it very important and very positive it. "  
176 -%%  
177 -% \item \textit{Improve understanding of collaborative development by MPOG  
178 -%staff}  
179 -% \subitem Undergrad student: "In the beginning the demands of MPOG were  
180 -%very 'orders from above', but according to the progress of the project, they  
181 -%understood better our work philosophy and became more open"  
182 -% \subitem MPOG: "During development we realized that the team that was  
183 -%developing also felt like the owner of the project felt involved not only a  
184 -%mere executor of an order. It was not a client relationship, it was a  
185 -%partnership relationship, so there was a lot of team suggestions to be put into  
186 -%the project. Sometimes these were put in for us to decide and sometimes not."  
187 -% \subitem MPOG: "I think it was easy, I think the team was aligned. In  
188 -%addition to being aligned, these items that, for example, were not priorities  
189 -%and became priorities, were, in a sense, brought with some arguments from the  
190 -%team. So the team was able to argue and succeed in showing that it was  
191 -%important, that it needed to be prioritized, and I think the team was able to  
192 -%present the arguments well for some of the priorities that happened during the  
193 -%process."  
194 -%%  
195 -% \item \textit{Align the pace of both sides to execute activities}  
196 -% \subitem MPOG: "When we went there, I knew people and made that  
197 -%interaction more frequent, we also felt encouraged to validate faster and give  
198 -%faster feedback to the teams so they would not wait there. I knew they were  
199 -%waiting for our feedback and we were struggling to do it fast, because we ended  
200 -%a sprint and start another and not stop. We gave that feedback fast and they  
201 -%also gave quick feedback for any questions when they encountered a problem.  
202 -%That gave the project agility, things flowed faster and better. "  
203 -%\end{itemize} 119 +\subsection{Bringing together government staff and development team}
  120 +
  121 +The MPOG analysts observed communication noise in the dialogue between them and
  122 +their superiors and in the dialogues with the development team that were
  123 +intermediated by the superiors. They said that direct dialogue with the
  124 +development team and biweekly visits to the university's lab \textbf{reduce
  125 +communication misunderstood}. "At this point, the communication started to
  126 +change.. started to improve." According to one of the interviewees this new
  127 +dynamic unified the two sides: "I believe it was very positive, we also liked to
  128 +go there, to interact with the team. I think it brought more unity, more
  129 +integration into the project". The participation of the MPOG staff was also
  130 +considered positive by {72.9\%} of the students of them and to {81.1 \%} of them
  131 +think the presence of MPOG staff in sprint ceremonies was important for the
  132 +development. In addition, to \textbf{better meet expectations of both sides}
  133 +regarding the requirements developed, {75.6 \%} of students believe that writing
  134 +the requirements together with the MPOG staff was very important. According to
  135 +one of them "Joint planning and timely meetings were very important for
  136 +understanding the needs of MPOG".
  137 +
  138 +One of the consequences of this direct government-academia interaction in
  139 +laboratory was empathy, as reported by one of the interviewees "You know people
  140 +in person and it makes such a big difference because it causes empathy. You
  141 +already know who that person is, it's not just a name". This subjectively helped
  142 +to \textbf{align both activities execution pace}. The teams' synchronization was
  143 +reinforced with the implementation of a Continuous Delivery pipeline. The
  144 +benefits of this approach were presented in our previous work \cite {?} and
  145 +corroborate these research results. To 81.1\% of students and 75\% of senior
  146 +developers, deploying new versions of the SPB portal in production was a
  147 +motivator during the project.
  148 +
  149 +One of the MPOG analyst interviewed also noted these releases also helped to
  150 +\textbf{overcome the government bias regarding low productivity of collaborative
  151 +projects with academia}: ”At first, the government staff had a bias that
  152 +universities do not deliver. We overcame that bias in the course of the project.
  153 +We deliver a lot and with quality. Today, I think if we had paid the same amount
  154 +for a company, it would not have done what was delivered and with the quality
  155 +that was delivered with the price that was paid.” Additionally, the deployment
  156 +in production of each new version also \textbf{improve the translation of the
  157 +process from one side to the other}, as mentioned by MPOG analyst ”We had an
  158 +overview at the strategic level. When we went down to the technical level, plan
  159 +the release every four months was difficult. But in the end, I think this has
  160 +not been a problem. A project you are delivering, the results are going to
  161 +production, the code is quality, the team is qualified/capable and the project
  162 +is doing well, it does not impact as much in practice”
  163 +
204 164
205 -%\subsubsection{Continuos Delivery}  
206 -%  
207 -%\begin{itemize}  
208 -% \item \textit{Creating DevOps Team}  
209 -% \item \textit{Defining continuous delivery pipeline}  
210 -% \item \textit{DevOps team periodically going to the ministry to help deploy  
211 -%each version}  
212 -%\end{itemize}  
213 -%  
214 -%\paragraph{Benefits}  
215 -%  
216 -%\begin{itemize}  
217 -% \setlength\itemsep{1em}  
218 -% \item \textit{Increase government confidence for collaborative projects with  
219 -%the  
220 -%university}  
221 -% \subitem MPOG: "At first the government staff had a bias that universities  
222 -%did  
223 -%not deliver and we overcame that bias in the course of the project. We deliver  
224 -%a  
225 -%lot and with quality. Today, I think that if we had paid the same amount for a  
226 -%company, it would not have done what was delivered and with the quality that  
227 -%was  
228 -%delivered with the price that was paid."  
229 -% \item \textit{Motivate teams}  
230 -% \subitem {81.1\%} of students think new versions released in production  
231 -%motivated  
232 -%them during the project  
233 -% \subitem {75\%} of senior developers think new versions released in  
234 -%production  
235 -%motivated them during the project  
236 -% \subitem {81\%} of students think the presence of a specific DevOps team  
237 -%was  
238 -%necessary for the project  
239 -% \item \textit{Transfer of knowledge about DevOps and Continuous Deliveries  
240 -%from  
241 -%the academic team to the government infrastructure team}  
242 -% \subitem MPOG: "I only noticed positive aspects in the delivery. I think  
243 -%in the  
244 -%interaction, we had a lot of support to be able to deploy. From the time that  
245 -%the version was mature, which had already been tested in the UnB test  
246 -%environment and was ready to be put into production, we had a great agility to  
247 -%release in production. Then in the course of the project we realized that the  
248 -%infrastructure team [of MPOG] started to trust the UnB team a lot. Because, for  
249 -%you to put software in production in government, there is a whole process  
250 -%behind. The government has much of this security issue."  
251 -% \subitem MPOG: "If there was anything stopping the business from working,  
252 -%the  
253 -%software working inside, we would ask the seniors for support so we could  
254 -%investigate that, and the infrastructure team was also instructed to prioritize  
255 -%it. So when it came to an impasse, the teams were all together, both from  
256 -%within  
257 -%MPOG as well as senior developers and other UnB developers to unlock, to find  
258 -%the problem."  
259 -% \item \textit{Align the university and government teams pace in the  
260 -%execution of  
261 -%the activities}  
262 -% \subitem MPOG: "In the beginning, infrastructure personnel were not  
263 -%accustomed  
264 -%to deliveries so fast. They had to adapt to this pace. The portal of the SPB  
265 -%before the project was not there [in the MPOG infrastructure], it was in  
266 -%another  
267 -%place, they did not have that dynamics there. But what they asked for UnB (some  
268 -%configuration, installation manual, how to install everything inside) was  
269 -%requested and delivered."  
270 -% \item \textit{Improve translation from one development process to the other}  
271 -% \subitem MPOG: "We had an overview at the strategic level, but when we  
272 -%went down  
273 -%to the level of functionality we had this difficulty to do the planning of the  
274 -%release every four months. But in the end, I think this has not been a problem,  
275 -%because a project you are delivering, the results are going to production, the  
276 -%code is quality, the team is qualified/capable and the project is doing well,  
277 -%it  
278 -%does not impact as much in practice, because the result is being delivered.  
279 -%\end{itemize}  
280 -%  
281 %\subsubsection{Organization of the project in teams for each front, with a 165 %\subsubsection{Organization of the project in teams for each front, with a
282 %undergraduate student as coach and at least one senior developer} 166 %undergraduate student as coach and at least one senior developer}
283 % 167 %