Commit 17af6c9a27c7a84b106b4e8e7a166bd815b9fa6a

Authored by Melissa Wen
1 parent f2f175bd

[i3eSW] Abstract, Intro and Context after Grammarly

ieeeSW/releaseEng3/IEEE_ThemeIssue_ReleaseEng_CD.md
@@ -23,7 +23,7 @@ __Fabio Kon__ is Full Professor of the Department of Computer Science of the Uni @@ -23,7 +23,7 @@ __Fabio Kon__ is Full Professor of the Department of Computer Science of the Uni
23 23
24 ## Abstract 24 ## Abstract
25 25
26 -For many software development teams, the first aspects that come to mind regarding Continuous Delivery (CD) are the operational challenges and the competitive benefits. In our experience, CD was much more: it was a survival technique. This article presents how and why we applied CD in a Brazilian Government project for the development of a Collaborative Development Environment (CDE), sharing the unconventional challenges we faced and the strategies used to overcome them. 26 +For many software development teams, the first aspects that come to mind regarding Continuous Delivery (CD) are the operational challenges and the competitive benefits. In our experience, the CD was much more: it was a survival technique. This article presents how and why we applied CD in a Brazilian Government project for the development of a Collaborative Development Environment (CDE), sharing the unique challenges we faced and the strategies used to overcome them.
27 27
28 ## Introduction 28 ## Introduction
29 <!--- 29 <!---
@@ -32,11 +32,11 @@ Comment: &quot;Generally, the piece comes across as part advertisement for CI and par @@ -32,11 +32,11 @@ Comment: &quot;Generally, the piece comes across as part advertisement for CI and par
32 Siqueira/Paulo: Ao meu ver, a introdução deixa bem claro o nosso "punch" e o resto do texto a gente desenrola bem isso 32 Siqueira/Paulo: Ao meu ver, a introdução deixa bem claro o nosso "punch" e o resto do texto a gente desenrola bem isso
33 --> 33 -->
34 34
35 -We worked on a three-year-long Brazilian government project to evolve an existing platform that had technical issues and lacked political support. In 2014, the Ministry of Planning, Budget, and Management (MP) initiated a project to modernize the Brazilian Public Software (SPB) portal in partnership with two public universities: University of Brasilia (UnB) and University of São Paulo (USP). 35 +We worked on a three-year-long Brazilian government project to evolve an existing platform that had technical issues and lacked political support. This project, started in 2014, was a partnership between the Ministry of Planning, Budget, and Management (MP) and two public universities: University of Brasília (UnB) and University of São Paulo (USP), to modernize Brazilian Public Software (SPB) portal.
36 36
37 -The SPB Portal (www.softwarepublico.gov.br) evolved to a Collaborative Development Environment [1] and this evolution brought important benefits not just to the Brazilian government, but also to society as a whole. It aims to minimize bureaucracy and costs by encouraging the use of the same set of applications across different government agencies. The society also gained a mechanism of transparency and collaboration, since anyone can check the government expenses on software and contribute to project communities. 37 +With this partnership, the SPB Portal (www.softwarepublico.gov.br) evolved to a Collaborative Development Environment[1], and this evolution brought significant benefits not just to the Brazilian government, but also to society as a whole. The government could minimize bureaucracy and costs of software development, encouraging the use of the same set of applications across different government agencies. The society also gained a mechanism of transparency and collaboration, since anyone can check the government expenses on software and contribute to project communities.
38 38
39 -In this article, we discuss the use of Continuous Delivery (CD) during our experience as the academic partner in this project. We focus on how we managed to implement CD in a large institution with traditional values and how CD helped to build trust between the government and the development team. CD enabled us to clearly show our progress and earned us the government’s confidence that we could adequately fulfill their requests, becoming an essential aspect of our interaction with them. According to this experience, the use of CD as a tool to build such trust relationships is yet another of its benefits [2]. 39 +In this article, we discuss the use of Continuous Delivery (CD) during our experience as the academic partner in this project. We focus on how we managed to implement CD in a large institution with traditional values and how CD helped to build trust between the government and the university development team. CD enabled us to show our progress and earned the government’s confidence that we could adequately fulfill their requests, becoming an essential aspect of our interaction with them. According to this experience, the use of CD as a tool to build such trust relationships is yet another of its benefits[2].
40 40
41 ## Context 41 ## Context
42 <!--- 42 <!---
@@ -46,21 +46,20 @@ Paulo: O ponto não foi gov e não gov. Vamos esclarecer que o SPB foi algo part @@ -46,21 +46,20 @@ Paulo: O ponto não foi gov e não gov. Vamos esclarecer que o SPB foi algo part
46 46
47 --> 47 -->
48 48
49 -The SPB is a governmental program of the MP created to foster sharing and collaboration on Open Source Software (OSS) projects for the Brazilian public administration. The MP managed both software requirements and server infrastructure of their projects. However, its hierarchical and traditional processes made them unfamiliar with new software development techniques, such as CD. Any of our requests had to pass through layers of bureaucracy before being answered. Requesting access to their infrastructure to make the deploy was not different. 49 +The SPB is a governmental program of the MP created to foster sharing and collaboration on Open Source Software (OSS) development for the Brazilian public administration. For their projects, the MP managed both software requirements and server infrastructure. However, its hierarchical and traditional processes made them unfamiliar with new software development techniques, such as CD. Any of our requests had to pass through layers of bureaucracy before being answered. Requesting access to their infrastructure to make the deploy was not different.
50 50
51 During its lifetime, the project suffered significant interference from the board of directors because the portal represents an interface between government and society. In light of political interests, directors continually imposed changes to the platform while ignoring our technical advice. In 2015, the board of directors was changed and, with it, the vision of the project. New directors had different political agendas which affected the project's requirements previously approved. 51 During its lifetime, the project suffered significant interference from the board of directors because the portal represents an interface between government and society. In light of political interests, directors continually imposed changes to the platform while ignoring our technical advice. In 2015, the board of directors was changed and, with it, the vision of the project. New directors had different political agendas which affected the project's requirements previously approved.
52 52
53 -  
54 <!--- 53 <!---
55 Comment: 54 Comment:
56 "The authors present 3 challenges in the intro and then go on to expand them. However, the expansion (line 21-43 in page 2), is has pints about all three challenges mixed together. It would be better I think to split it into one para for each challenge. " 55 "The authors present 3 challenges in the intro and then go on to expand them. However, the expansion (line 21-43 in page 2), is has pints about all three challenges mixed together. It would be better I think to split it into one para for each challenge. "
57 56
58 Siqueira/Paulo: Note que esse ponto gerou muita discussão e confusão. Mudei um pouco a estratégia de forma a responder o revisor e ao mesmo tempo tornar o texto mais fluido 57 Siqueira/Paulo: Note que esse ponto gerou muita discussão e confusão. Mudei um pouco a estratégia de forma a responder o revisor e ao mesmo tempo tornar o texto mais fluido
59 58
60 -Melissa: Reformula o enunciado do primeiro problema (FEITO por Siqueira e Diego). 59 +Melissa: Reformular o enunciado do primeiro problema (FEITO por Siqueira e Diego).
61 --> 60 -->
62 61
63 -In this context, we overcame three distinct challenges: (1) find a system solution wherein government and development team agree, (2) widespread belief among the government agents that any project in partnership with a University is doomed to fail, and (3) the bureaucracies involved in the deployment process by the MP. 62 +In this context, we overcame three distinct challenges: (1) find a system solution wherein government and development team agree, (2) deconstruct the widespread belief among the government agents that any project in partnership with a University is doomed to fail, and (3) deal with bureaucracies involved in the deployment process by the MP.
64 <!--- 63 <!---
65 Comment: 64 Comment:
66 65
@@ -69,7 +68,7 @@ Comment: @@ -69,7 +68,7 @@ Comment:
69 Siqueira/Paulo: Contamos essa história sem ter que entrar em detalhes aqui. Contudo, será preciso fazer a seção de pipeline harmonizar com isso 68 Siqueira/Paulo: Contamos essa história sem ter que entrar em detalhes aqui. Contudo, será preciso fazer a seção de pipeline harmonizar com isso
70 --> 69 -->
71 70
72 -Firstly, to find a system solution wherein government and development team agree, we designed the SPB Portal as a CDE with additional social features. Due to the complexity of creating such a system from scratch, we decided to adapt and integrate existing open source tools to build a system-of-systems [REF]. We created a solution that orchestrates systems and allowed us to smoothly provide a unified interface for final users, including single sign-on and global searches [4]. On top of that the new SPB Portal was an unprecedented platform to Brazilian government, with a complex deployment process. 71 +Firstly, to find a system solution wherein government and development team agree, we designed the SPB Portal as a CDE with additional social features. Due to the complexity of creating such a system from scratch, we decided to adapt and integrate existing open source tools to build a system-of-systems [3]. We created a solution that orchestrates software and allowed us to smoothly provide a unified interface for final users, including single sign-on and global searches [4]. On top of that, the new SPB Portal was an unprecedented platform to the Brazilian government, with a complicated deployment process.
73 72
74 <!--- 73 <!---
75 Comment: "Can the authors provide some data as well? As I said this is a unique scenario and the community can greatly benefit. For example, how many devs at any given time, how many features/unit time (month/year), how frequently were releases made, how frequently did you meet with the client, how frequently did the requirements change are some example questions to which if we had data, it would place the study in greater context." 74 Comment: "Can the authors provide some data as well? As I said this is a unique scenario and the community can greatly benefit. For example, how many devs at any given time, how many features/unit time (month/year), how frequently were releases made, how frequently did you meet with the client, how frequently did the requirements change are some example questions to which if we had data, it would place the study in greater context."
@@ -96,13 +95,13 @@ Paulo: o segundo problema foi alterado em relação à primeira versão, mas a e @@ -96,13 +95,13 @@ Paulo: o segundo problema foi alterado em relação à primeira versão, mas a e
96 Siqueira: trocar conhecimento técnico por interesse, disponibilidade ou esforço ... 95 Siqueira: trocar conhecimento técnico por interesse, disponibilidade ou esforço ...
97 --> 96 -->
98 97
99 -Secondly, we had to face the widespread belief among government agents that any project in partnership with a University is doomed to fail. Our team was not from a typical company, consisting mainly of undergraduate students coordinated by 2 professors. At the first year, our team was composed by 24 undergraduate students, 1 designer and 2 senior developers. In 2015, our team grew to 36 students, 2 designers, 8 senior developers. At the end of in project, due to budget constraint, we had 20 students, 1 designer and 2 senior developers. Moreover, the SPB Portal evolution was the first software development collaboration between university and government experienced by the MP analysts involved in this project. 98 +Secondly, we had to face the widespread belief among government agents that any project in partnership with a University is doomed to fail. Our team was not from a typical company, consisting mainly of undergraduate students coordinated by two professors. At the first year, we had a group composed of 24 undergraduate students, one designer, and two senior developers. In 2015, our team grew to 36 students, two designers, eight senior developers. At the end of in project, due to budget constraint, we had 20 students, one designer, and two developers. Also, on the government side, the SPB Portal evolution was the first software development collaboration between university and government experienced by the MP analysts involved in the project.
100 99
101 <!--- 100 <!---
102 Paulo: o terceiro problema é novo em relação à primeira versão, mas na prática tínhamos tratado a questão 101 Paulo: o terceiro problema é novo em relação à primeira versão, mas na prática tínhamos tratado a questão
103 --> 102 -->
104 103
105 -Lastly, our team thought of software deployment differently than the MP. On our side, we believe that frequent deliveries are better for the project’s success. However, the MP works with the idea of a single deployment at the end of the project. In other words, the MP was neither technically prepared nor the bureaucratic structured foresaw this kind of work style. In additionally, there was very little effort to deploy new versions of the system in a timely manner. That ended up hampering the benefits of the tool and preventing us from showing off the fruits of the project to those responsible for evaluating it. 104 +Lastly, our team thought software deployment differently than the MP. On our side, we believe that frequent deliveries are better for the project’s success. However, the MP works with the idea of a single deployment at the end of the project. In other words, neither the bureaucratic structure of the MP nor its technical abilities were conducive to this style of work. Furthermore, there was little effort to deploy new versions of the system promptly. That ended up hampering the benefits of the tool and preventing us from showing off the fruits of the project to those responsible for evaluating it.
106 105
107 <!--- 106 <!---
108 "the article is missing the ah,ha moment. Was there something interesting that you learned (could be a small thing) that you use to adapt the CI process when applying it in a gov or large org context versus a smaller org? " 107 "the article is missing the ah,ha moment. Was there something interesting that you learned (could be a small thing) that you use to adapt the CI process when applying it in a gov or large org context versus a smaller org? "
@@ -110,7 +109,7 @@ Lastly, our team thought of software deployment differently than the MP. On our @@ -110,7 +109,7 @@ Lastly, our team thought of software deployment differently than the MP. On our
110 Siqueira/Paulo: eis o AH-HA moment! 109 Siqueira/Paulo: eis o AH-HA moment!
111 --> 110 -->
112 111
113 -These challenges made our relationship with the MP tense, in particular at the first year of the project, and alerted us for the fact that the project could be finished at any time. The deployment limitation was the main technical issue we could tackle in the short term. As a result, we worked to deploy one version of the project onto our own infrastructure and showed it to the government evaluators. This strategy proved them that we could efficiently deliver new features, fulfill their expectations regarding the delivery of the requirements, and mobilized them to demand these features working in the MP infrastructure. This, in turn, generated more pressure on the IT department responsible for the deployment routines. This was compounded with each CD cycle, allowing us to gradually built a new relationship among all parties and, by the end of the project, to become active participants in the deploy operations. 112 +These challenges made our relationship with the MP tense, in particular at the first year, and alerted us to the fact that they could finish the project at any time. The deployment limitation was the substantial technical issue we could tackle in the short term. As a result, we worked to deploy one version of the project onto our infrastructure and showed it to the government evaluators. This strategy proved them we could efficiently deliver new features, fulfill their expectations regarding the delivery of the requirements, and incited them to demand the last version working in the MP infrastructure. These results, in turn, generated more pressure on the IT department responsible for the deployment routines. With each CD cycle, we gradually built a new relationship among all parties and, by the end of the project, we became active participants in the deploy operations.
114 113
115 ## Our Continuous Delivery Pipeline 114 ## Our Continuous Delivery Pipeline
116 115