Commit b3ebea5e8a276e024f990de2313e8e4af659535f
1 parent
e10d8141
Exists in
master
and in
3 other branches
[oss-2018] Review results of second practice
Showing
1 changed file
with
50 additions
and
166 deletions
Show diff stats
icse2018/content/06-results.tex
@@ -15,6 +15,8 @@ government. In this section, we present by context the practices adopted in this | @@ -15,6 +15,8 @@ government. In this section, we present by context the practices adopted in this | ||
15 | second phase and show the benefits generated by its deployment, as summarized | 15 | second phase and show the benefits generated by its deployment, as summarized |
16 | in the Table \ref{practices-table}. | 16 | in the Table \ref{practices-table}. |
17 | 17 | ||
18 | +%% TODO: explicar a estrutura e cada campo da tabela | ||
19 | + | ||
18 | \begin{table}[] | 20 | \begin{table}[] |
19 | \centering | 21 | \centering |
20 | \resizebox{\textwidth}{!}{% | 22 | \resizebox{\textwidth}{!}{% |
@@ -40,12 +42,10 @@ increase interactions between development team and public servants; | @@ -40,12 +42,10 @@ increase interactions between development team and public servants; | ||
40 | \item Biweekly gov staff, senior developers and coaches met to planning and | 42 | \item Biweekly gov staff, senior developers and coaches met to planning and |
41 | review sprint at the UnB headquarters. \item Most of features under development | 43 | review sprint at the UnB headquarters. \item Most of features under development |
42 | were discussed on Gitlab Issue Tracker. \item Only strategic decisions or | 44 | were discussed on Gitlab Issue Tracker. \item Only strategic decisions or |
43 | -bureaucratic issues involve board directors. \item Deploying SPB intermediated | ||
44 | -versions in production \end{itemize} & | 45 | +bureaucratic issues involve board directors. \item Continuous Delivery \end{itemize} & |
45 | \begin{itemize} | 46 | \begin{itemize} |
46 | -\item Reduce communication misunderstood and develop requirements closer to the expectations of both sides; | ||
47 | -\item Improve understanding of collaborative development by MPOG staff | ||
48 | -\item Increasing government confidence for collaborative projects with the university; | 47 | +\item Reduce communication misunderstood and better meet expectations of both sides; |
48 | +\item Improve understanding of collaborative development by MPOG staff and increase their confidence for collaborative projects with the university; | ||
49 | \item Aligning both side pace to execute project-related activities (Empathy between gov and academia side) | 49 | \item Aligning both side pace to execute project-related activities (Empathy between gov and academia side) |
50 | \item Improving translation from one development process to the other; | 50 | \item Improving translation from one development process to the other; |
51 | \end{itemize} \\ \hline | 51 | \end{itemize} \\ \hline |
@@ -68,7 +68,6 @@ versions in production \end{itemize} & | @@ -68,7 +68,6 @@ versions in production \end{itemize} & | ||
68 | 68 | ||
69 | \subsection{Project management and communication on the developing platform | 69 | \subsection{Project management and communication on the developing platform |
70 | itself} | 70 | itself} |
71 | -\hfill | ||
72 | 71 | ||
73 | After nine months of project activities, the first version of new SPB Portal was | 72 | After nine months of project activities, the first version of new SPB Portal was |
74 | released. From this point, we started to migrate the management and | 73 | released. From this point, we started to migrate the management and |
@@ -117,167 +116,52 @@ and also there in the portal itself of what happened in the project. At any | @@ -117,167 +116,52 @@ and also there in the portal itself of what happened in the project. At any | ||
117 | moment we can go there and see how it worked, how the person did, and manages | 116 | moment we can go there and see how it worked, how the person did, and manages |
118 | to salvage those good points." | 117 | to salvage those good points." |
119 | 118 | ||
120 | -%\subsubsection{Bringing the government staff directly responsible for the | ||
121 | -%project together with development team} | ||
122 | -%\begin{itemize} | ||
123 | -%\item \textit{Biweekly meetings (planning and sprint review) in the | ||
124 | -%development lab with the presence of government staff, team coaches and senior | ||
125 | -%developers} | ||
126 | -%\item \textit{Discuss features under development directly on Gitlab Issue | ||
127 | -%Tracker} | ||
128 | -%\item \textit{Only strategic decisions or bureaucratic issues involve the | ||
129 | -%directors/secretaries} | ||
130 | -%\end{itemize} | ||
131 | -% | ||
132 | -%\paragraph{Benefits} | ||
133 | -% | ||
134 | -%\begin{itemize} | ||
135 | -% \setlength\itemsep{1em} | ||
136 | -% \item \textit{Reduce communication misunderstood} | ||
137 | -% \subitem MPOG: "That's when the project started, people [MPOG staff] did | ||
138 | -%not participate in anything. The communication process was horrible."; "The | ||
139 | -%[MPOG] coordinator did not help, he would say something and UnB would talk to | ||
140 | -%another at the meeting and it was the biggest mess." About the direct dialogue | ||
141 | -%between the academic team and MPOG staff (without the involvement of | ||
142 | -%coordinators and / or directors) , she said "That's where things really started | ||
143 | -%to move, that the communication of the project began to improve." | ||
144 | -%% | ||
145 | -% \item \textit{Empathy between members on both sides} | ||
146 | -% \subitem {72.9\%} of students believe that interacting with MPOG staff was | ||
147 | -%important during the project | ||
148 | -% \subitem Only 27\% of the students interviewed said they did not feel like | ||
149 | -%attending meetings with MPOG employees | ||
150 | -% \subitem MPOG: "You know people in person and it makes such a big | ||
151 | -%difference because it causes empathy. You know what the person is going through | ||
152 | -%on their side and she knows what we're going through on our side. So the next | ||
153 | -%time you have a non-personal interaction (by mail, by list ...) I think it even | ||
154 | -%facilitates, improves communication. You already know who that person is, it's | ||
155 | -%not just a name. " | ||
156 | -%% | ||
157 | -% \item \textit{Develop requirements closer to the expectations of both sides} | ||
158 | -% \subitem {81.1 \%} of students believe that the participation of MPOG | ||
159 | -%staff in planning and closing sprints was important for the development of the | ||
160 | -%project | ||
161 | -% \subitem {75.6 \%} of students believe that writing the requirements | ||
162 | -%together with the MPOG staff was very important | ||
163 | -% \subitem Undergrad student: "Joint planning and timely meetings were very | ||
164 | -%important for understanding the needs of MPOG, and the interaction via SPB | ||
165 | -%tools helped validate the tool as a development platform" | ||
166 | -% \subitem Undergrad student: "Often they did not know what they really | ||
167 | -%wanted, and they caused some delays in the development of sprints" | ||
168 | -% \subitem Undergrad student: "A relationship of constant attempt to balance | ||
169 | -%and negotiate. The client does not always know the impacts of their requests" | ||
170 | -% \subitem MPOG: "I believe it was very positive, we also liked to go there, | ||
171 | -%to interact with the team. I think it brought more unity, more integration into | ||
172 | -%the project, because we went there, where people were working and they show | ||
173 | -%what was done. I think they also liked to receive our feedback about what had | ||
174 | -%been done by them.This interaction did not just made with the coordinator. I | ||
175 | -%found it very important and very positive it. " | ||
176 | -%% | ||
177 | -% \item \textit{Improve understanding of collaborative development by MPOG | ||
178 | -%staff} | ||
179 | -% \subitem Undergrad student: "In the beginning the demands of MPOG were | ||
180 | -%very 'orders from above', but according to the progress of the project, they | ||
181 | -%understood better our work philosophy and became more open" | ||
182 | -% \subitem MPOG: "During development we realized that the team that was | ||
183 | -%developing also felt like the owner of the project felt involved not only a | ||
184 | -%mere executor of an order. It was not a client relationship, it was a | ||
185 | -%partnership relationship, so there was a lot of team suggestions to be put into | ||
186 | -%the project. Sometimes these were put in for us to decide and sometimes not." | ||
187 | -% \subitem MPOG: "I think it was easy, I think the team was aligned. In | ||
188 | -%addition to being aligned, these items that, for example, were not priorities | ||
189 | -%and became priorities, were, in a sense, brought with some arguments from the | ||
190 | -%team. So the team was able to argue and succeed in showing that it was | ||
191 | -%important, that it needed to be prioritized, and I think the team was able to | ||
192 | -%present the arguments well for some of the priorities that happened during the | ||
193 | -%process." | ||
194 | -%% | ||
195 | -% \item \textit{Align the pace of both sides to execute activities} | ||
196 | -% \subitem MPOG: "When we went there, I knew people and made that | ||
197 | -%interaction more frequent, we also felt encouraged to validate faster and give | ||
198 | -%faster feedback to the teams so they would not wait there. I knew they were | ||
199 | -%waiting for our feedback and we were struggling to do it fast, because we ended | ||
200 | -%a sprint and start another and not stop. We gave that feedback fast and they | ||
201 | -%also gave quick feedback for any questions when they encountered a problem. | ||
202 | -%That gave the project agility, things flowed faster and better. " | ||
203 | -%\end{itemize} | 119 | +\subsection{Bringing together government staff and development team} |
120 | + | ||
121 | +The MPOG analysts observed communication noise in the dialogue between them and | ||
122 | +their superiors and in the dialogues with the development team that were | ||
123 | +intermediated by the superiors. They said that direct dialogue with the | ||
124 | +development team and biweekly visits to the university's lab \textbf{reduce | ||
125 | +communication misunderstood}. "At this point, the communication started to | ||
126 | +change.. started to improve." According to one of the interviewees this new | ||
127 | +dynamic unified the two sides: "I believe it was very positive, we also liked to | ||
128 | +go there, to interact with the team. I think it brought more unity, more | ||
129 | +integration into the project". The participation of the MPOG staff was also | ||
130 | +considered positive by {72.9\%} of the students of them and to {81.1 \%} of them | ||
131 | +think the presence of MPOG staff in sprint ceremonies was important for the | ||
132 | +development. In addition, to \textbf{better meet expectations of both sides} | ||
133 | +regarding the requirements developed, {75.6 \%} of students believe that writing | ||
134 | +the requirements together with the MPOG staff was very important. According to | ||
135 | +one of them "Joint planning and timely meetings were very important for | ||
136 | +understanding the needs of MPOG". | ||
137 | + | ||
138 | +One of the consequences of this direct government-academia interaction in | ||
139 | +laboratory was empathy, as reported by one of the interviewees "You know people | ||
140 | +in person and it makes such a big difference because it causes empathy. You | ||
141 | +already know who that person is, it's not just a name". This subjectively helped | ||
142 | +to \textbf{align both activities execution pace}. The teams' synchronization was | ||
143 | +reinforced with the implementation of a Continuous Delivery pipeline. The | ||
144 | +benefits of this approach were presented in our previous work \cite {?} and | ||
145 | +corroborate these research results. To 81.1\% of students and 75\% of senior | ||
146 | +developers, deploying new versions of the SPB portal in production was a | ||
147 | +motivator during the project. | ||
148 | + | ||
149 | +One of the MPOG analyst interviewed also noted these releases also helped to | ||
150 | +\textbf{overcome the government bias regarding low productivity of collaborative | ||
151 | +projects with academia}: ”At first, the government staff had a bias that | ||
152 | +universities do not deliver. We overcame that bias in the course of the project. | ||
153 | +We deliver a lot and with quality. Today, I think if we had paid the same amount | ||
154 | +for a company, it would not have done what was delivered and with the quality | ||
155 | +that was delivered with the price that was paid.” Additionally, the deployment | ||
156 | +in production of each new version also \textbf{improve the translation of the | ||
157 | +process from one side to the other}, as mentioned by MPOG analyst ”We had an | ||
158 | +overview at the strategic level. When we went down to the technical level, plan | ||
159 | +the release every four months was difficult. But in the end, I think this has | ||
160 | +not been a problem. A project you are delivering, the results are going to | ||
161 | +production, the code is quality, the team is qualified/capable and the project | ||
162 | +is doing well, it does not impact as much in practice” | ||
163 | + | ||
204 | 164 | ||
205 | -%\subsubsection{Continuos Delivery} | ||
206 | -% | ||
207 | -%\begin{itemize} | ||
208 | -% \item \textit{Creating DevOps Team} | ||
209 | -% \item \textit{Defining continuous delivery pipeline} | ||
210 | -% \item \textit{DevOps team periodically going to the ministry to help deploy | ||
211 | -%each version} | ||
212 | -%\end{itemize} | ||
213 | -% | ||
214 | -%\paragraph{Benefits} | ||
215 | -% | ||
216 | -%\begin{itemize} | ||
217 | -% \setlength\itemsep{1em} | ||
218 | -% \item \textit{Increase government confidence for collaborative projects with | ||
219 | -%the | ||
220 | -%university} | ||
221 | -% \subitem MPOG: "At first the government staff had a bias that universities | ||
222 | -%did | ||
223 | -%not deliver and we overcame that bias in the course of the project. We deliver | ||
224 | -%a | ||
225 | -%lot and with quality. Today, I think that if we had paid the same amount for a | ||
226 | -%company, it would not have done what was delivered and with the quality that | ||
227 | -%was | ||
228 | -%delivered with the price that was paid." | ||
229 | -% \item \textit{Motivate teams} | ||
230 | -% \subitem {81.1\%} of students think new versions released in production | ||
231 | -%motivated | ||
232 | -%them during the project | ||
233 | -% \subitem {75\%} of senior developers think new versions released in | ||
234 | -%production | ||
235 | -%motivated them during the project | ||
236 | -% \subitem {81\%} of students think the presence of a specific DevOps team | ||
237 | -%was | ||
238 | -%necessary for the project | ||
239 | -% \item \textit{Transfer of knowledge about DevOps and Continuous Deliveries | ||
240 | -%from | ||
241 | -%the academic team to the government infrastructure team} | ||
242 | -% \subitem MPOG: "I only noticed positive aspects in the delivery. I think | ||
243 | -%in the | ||
244 | -%interaction, we had a lot of support to be able to deploy. From the time that | ||
245 | -%the version was mature, which had already been tested in the UnB test | ||
246 | -%environment and was ready to be put into production, we had a great agility to | ||
247 | -%release in production. Then in the course of the project we realized that the | ||
248 | -%infrastructure team [of MPOG] started to trust the UnB team a lot. Because, for | ||
249 | -%you to put software in production in government, there is a whole process | ||
250 | -%behind. The government has much of this security issue." | ||
251 | -% \subitem MPOG: "If there was anything stopping the business from working, | ||
252 | -%the | ||
253 | -%software working inside, we would ask the seniors for support so we could | ||
254 | -%investigate that, and the infrastructure team was also instructed to prioritize | ||
255 | -%it. So when it came to an impasse, the teams were all together, both from | ||
256 | -%within | ||
257 | -%MPOG as well as senior developers and other UnB developers to unlock, to find | ||
258 | -%the problem." | ||
259 | -% \item \textit{Align the university and government teams pace in the | ||
260 | -%execution of | ||
261 | -%the activities} | ||
262 | -% \subitem MPOG: "In the beginning, infrastructure personnel were not | ||
263 | -%accustomed | ||
264 | -%to deliveries so fast. They had to adapt to this pace. The portal of the SPB | ||
265 | -%before the project was not there [in the MPOG infrastructure], it was in | ||
266 | -%another | ||
267 | -%place, they did not have that dynamics there. But what they asked for UnB (some | ||
268 | -%configuration, installation manual, how to install everything inside) was | ||
269 | -%requested and delivered." | ||
270 | -% \item \textit{Improve translation from one development process to the other} | ||
271 | -% \subitem MPOG: "We had an overview at the strategic level, but when we | ||
272 | -%went down | ||
273 | -%to the level of functionality we had this difficulty to do the planning of the | ||
274 | -%release every four months. But in the end, I think this has not been a problem, | ||
275 | -%because a project you are delivering, the results are going to production, the | ||
276 | -%code is quality, the team is qualified/capable and the project is doing well, | ||
277 | -%it | ||
278 | -%does not impact as much in practice, because the result is being delivered. | ||
279 | -%\end{itemize} | ||
280 | -% | ||
281 | %\subsubsection{Organization of the project in teams for each front, with a | 165 | %\subsubsection{Organization of the project in teams for each front, with a |
282 | %undergraduate student as coach and at least one senior developer} | 166 | %undergraduate student as coach and at least one senior developer} |
283 | % | 167 | % |