Pagina's

Thursday, 23 February 2012

(My) CALM Alpha


The faculty of CALM Alpha had said little beforehand about what to expect, there were no tracks programmed and there were no speakers announced. The stated goal of the (un)conference was:

...to grow a community of thinkers, practitioners and researchers who further the application of Complexity Science in software development as well as in the larger organisations. We want to use the experience of the real-world application of principles based on validated theory to help both theory and practice co-evolve.

As I blogged beforehand, I was excited! My (ill formulated) expectations turned out to be somewhat overblown.

Day 1

I arrived at Wokefield House just after 9 in the morning. I breezed into the conference space, still congratulating myself on how smoothly the journey had gone, and promptly shrivelled. I recognised a few faces, but (as I was aware beforehand) I didn't know anybody in the room except by reputation or as a virtual entity. I sat at the nearest table, took out my notepad and began to doodle. What to talk about with strangers?

I took in my surroundings. There was no obvious presentation space, no rollup screen, no projector. There were five or six breakout stations with flip charts and a makeshift information radiator had been taped to a wall. I doodled some more. As the conference opening approached (ten o'clock), my table filled up and some introductions were exchanged, contact was progressively easier thereafter.

Simon Bennet opened proceedings. We were welcomed and told how the two days had been envisaged; day 1 would be dedicated to justification and rationalisation (or otherwise) of agile and/or lean practices on the basis of (complexity) theory and on day 2 some of the techniques developed for dealing with (socially) complex environments and/or problems would be elucidated.

Joseph Pelrine said a little about the inter-connectedness of those attending. A questionnaire had been circulated beforehand to this end and what had been remarkable to the faculty was how loosely connected the nascent network was.

Dave Snowden took the floor to introduce some basic complexity concepts and generally kick things off. I scribbled down notes as he spoke, as is my wont, and continued to do so throughout the conference. Unfortunately, I departed on Friday afternoon without my notebook. This means that my impressions as related here will be scant, and even more subjective and (subconsciously) selective than usual. The chronology as stated might also be suspect. Luckily there was a lively twitter stream.

Snowden ran through the main points made in “The new dynamics of strategy: Sense-making in a complex and complicated world”, this had been recommended reading before the conference so the pace was merciless. The three basic assumptions prevalent in organizational decision support and strategy: assumptions of order, of rational choice, and of intent were explained and (contextually) debunked. Then the idea of contextual complexity was proposed whereby the basic claim is that complex systems composed of human beings are a breed apart. This claim is supported by three pillars as follows, humans – are 1) not restricted to one identity, 2) not limited to acting in accordance with predetermined rules and 3) not limited to acting on local patterns.

Although I am not a greedy reductionist, I have a fundamental problem with the philosophical implications hereof as I regard these observations as statements of degree. Humans may not be ants, but the interaction of several humans can better be compared to the interaction of multiple ant colonies, not the interaction of individual ants. At the same time, the stupidity of people acting locally in (very) large groups is well documented, whereby I would suggest that although 5 guys in a room may not be a flock of birds, tens of thousands of guys packed into a football stadium just might be.

I felt the same discomfort when later watching the overtly political 'All watched over by Machines of Loving Grace' as Snowden recommended in his first address to the assembled. It would turn out that this was a moot point, to a degree, a question of semantics. I came to realise that what was important was that a system of nodes should often more correctly be viewed as a system of systems.

In this first broadcast, the notions of ontology, epistemology & phenomenology were also touched on.

Further, three heuristics for dealing with complex situations were introduced; fine-grained objects, dis-intermediation & cognitive spread. This resonated immediately with me and I was surprised that it did not strike a chord with many others. We had come to a mashup and these heuristics were varieties of practices current in agile (short time-boxes & resultant strategies, transparency, team commitment) and lean (reducing batch size, gemba & kanban boards, swarming).

Then it was time for the first breakout. There was some dissatisfied mumbling at this point, some felt that our aim was unclear, and the faculty's response (actively avoiding premature convergence) did not succeed in addressing peoples' concerns. Acting in the present as opposed to aiming at a future state is difficult. Even when explicitly setting out to explore...

1st breakout

The room seemed to have been setup for open space but we were quickly disabused of that idea, we were told that open space might be harmful, and that the law of two feet did not apply; if you started a conversation for instance then it was up to you to keep it going. Everybody had one vote for this session. Individuals could propose topics and/or vote. If you proposed a topic however you had to vote for same. The top 6 topics would be discussed. I proposed a discussion labelled 'How to avoid emergent lock-in' and to my (not necessarily pleasant) surprise it got enough votes to claim a station.

When I wrote the word lock-in I was thinking specifically of Jaron Lanier's “You are not a Gadget” but when asked what lock-in was I had to face up to the fact that I couldn't actually name any of Lanier's examples. I instead used the weak example of the 'design' of the human breathing apparatus - no good engineer would knowingly (partially) combine the tubes for breathing and swallowing as observed in humans.
Having since had time to check my sources; Lanier states that lock-in “turns thoughts into facts, philosophy into reality”and cites examples such as MIDI representation, UNIX & even files (the first Macs were apparently file-less). According to Lanier, once an idea becomes reality it can be difficult to even see that there are (or were at one point) alternatives. It is difficult if not impossible to retrace the progression of a design space such that all the options that were available at one point become available again (co-evolution is irreversible). As design options diverge initially it might be simple to 'jump' from one evolutionary path to another but as time goes on many options will expire.

We covered some interesting ground. I wasn't accused of dressing up a case for big design up front with fancy terminology (which might have been fair comment). Chris Matts suggested Real Options as the remedy, as he would repeatedly throughout the two days in response to a variety of problem propositions. Matts' has seemingly turned Real Options into the proverbial hammer and that's possibly why he didn't learn anything at CALM Alpha.

The problem remained. What if Robert Frost hadn't taken the road less travelled in that yellow wood? It made all the difference after all. 

In the loosely organised feedback session afterwards neither myself nor anybody involved in our discussion felt the need to report – although the other topics covered varied, much of what came out of them was relevant to our own discussion. I decided definitively against sharing when Snowden, responding to conclusions from another group's conversation, spoke about 'the need to maintain resilient capability'.

It had emerged that some of us were actually quite uncomfortable with emergence.

Given that TDD (as called for in XP) clearly facilitates emergent design, and that the agile principles talk explicitly about emergence (The best architectures, requirements, and designs emerge from self-organizing teams) and the currently popular Kanban method is sub-titled “(Successful) Evolutionary Change for your Technology Organisation” - this was a surprise.

After lunch Joseph Pelrine talked about multi-ontolgical sense-making, Stacy's model, the Cynefin model and so on. What stuck with me was: High agreement in the face of high uncertainty is religion, disagreement in the face of certainty (that something has to change) is politics. Assuming uncertainty and that there is no universally applicable solution is science.

2nd breakout

The second breakout was organised differently. People who had ideas for discussions were given a few minutes to prepare a pitch. Then these individuals had to pair off and present their ideas to a given table. Every table could assign a total of 7 points to the ideas presented together (4/3, 0/7 etc). After every pitch the presenters paired off again and repeated the process at another table. The ideas that gained the most points were to be the discussion topics for the breakout.

I took part in a truly enlightening, even inspiring, discussion on the '(Ab)use of metaphors from the natural sciences in (change) management'. Besides talking about metaphors that might be useful for illustrating the idea of weak signals we also spoke about the need to test the metaphors themselves – how to set up a safe-fail probe for the use of given a metaphor? Dave Snowden had said earlier on that it was necessary to change language when trying to effect change in an organisation - when you started hearing your newly introduced language being bandied about, thrown back at you, you knew your ideas were gaining traction. We discussed the possibility of people parroting new language and how to discern what was actually being signalled by the use thereof. Somehow we ended up on stereotypes and archetypes.

Dinner that evening was in the luxurious setting of the old Mansion House. Talk was light-hearted and ranged from techniques for hiring quality personnel to male pattern baldness. Post-prandial we were joined by Simon Bennet and the conversation turned to emergence. In a slightly less constrained situation the talk was wild and in no time we had progressed to the noosphere and other outlandish possibilities. When we were asked to leave the dining room I headed back to my room, I had been up since four that morning.

Day 2

Dave Snowden opened the second day with some reflections on multi-ontological sense-making and the Cynefin model. It was important to remember that the model was not a categorisation tool, it was about sense-making and thus in fact subjective & contextual. Now obviously talk like this could alienate anybody you might want to help with it so it was important to avoid definitions initially. Having shown us quickly how this might work, Snowden handed over to Pelrine who talked about techniques for generating social cohesion.

How does one seed a social network? By creating shared context, designing shared containers and introducing randomness. One of the examples offered in illustration was of a team which was asked to give its sprint demo in its own team room (as opposed to sending a representative to a review in some meeting room) to the full gamut of stakeholders (shared context, container) whereafter they all walked to lunch along a narrow corridor (container) such that the group became mixed and conversations sprang up between unlikely partners (randomness). Pelrine used the analogy of trying to approach someone of the opposite sex but backing down because of the enormity of the question “What could we talk about?”

Then we ran an exercise comprising the Social Network Simulation and Ritual Dissent methods. These were great fun to do and it was immediately clear how they could be very powerful – even though our execution of them was a little stilted. Especially trying to think up of an experiment for the SNS was difficult given time restrictions and the lack of a concrete context.

There was a real buzz in the room after the Ritual Dissent.

And then things turned ugly.

Simon Bennet spoke briefly about signifying and a technique that Cognitive Edge used for same. Snowden intervened, saying that the technique was patented and it was therefore probably not a good idea to talk about it. This incident left everybody, each for their own reasons, feeling somewhat uncomfortable. The reaction of some attendees was a little exaggerated and factually incorrect (this incident was the only mention of patents throughout). Snowden's reaction on Twitter to some of this (porky pies, Cynefin has no patents) was however also disingenuous. Cynefin's methods may not be patented, but neither are they open source as claimed. See Liz Keogh's excellent blog post on the subject.

After lunch we continued with a fishbowl exercise. I thought the mashup angle was finally going to come into play. Instead an initially entertaining cooking metaphor degenerated into pretty tiresome jockeying for position, the whole agile (specifically scrum, the mention of which seems noxious to some) vs lean thing. @ThirstyBear: “barely concealed rifts in the community”, @lunivore “We're applying labels like complex and complicated to make our method look better than the other guy's!”.

I took my place in the fishbowl at one point and suggested that the 3 heuristics delineated the day before were an excellent starting point in the the search for common ground. This simply did not land. I left the circle, slightly dismayed, set-based design or Lean Startup as safe-fail probes unmentioned...

For the last session of the day we could choose form several options. I chose to take part in a Social Construction of Emergent Properties (archetype extraction) exercise run by Jospeh Pelrine. Towards the end, I was only passively involved and literally saw the properties emerging in real time as the rest were busy. I hesitate to use words like epiphany but this came close! 


My very personal conclusion is that there is much in lean and agile that is already geared towards dealing with complexity (e.g. small steps & fast feedback, visualisation & transparency, teamwork & swarming but also set-based design etc) and that the difficulty lies in identifying what aspects of our work may lie in which domain in any given context. This is what Cynefin (and/or similar frameworks) can offer us. To my mind the work being done at Cognitive Edge in the development of collaboration techniques that are tailored to the (scientifically demonstrated) cognitive peculiarities of being human are just as exciting. The lack of clarity surrounding the use and/or extension of these methods (in a commercial setting) is unfortunate...

...a fevered mind could see an elaborate marketing ploy in CALM Alpha. Otherwise the event might yet prove a successful first step towards growing a community as envisioned.


Tuesday, 14 February 2012

Fractals at the office


I have been struggling with the idea for this post since LKBE11 in October of last year. For most of that period, suffering as I was from a bulging disc in my lower back, I was on large doses of morphine and I attributed my lack of progress to my induced state of mind. The one post I did complete in the same period was meandering and maudlin, and I took that as proof that the problem was the author, not his subject matter.

Now, clear-headed for almost a fortnight, I have only succeeded, despite concerted effort and a sense of urgency (I wanted to post prior to CALM Alpha), in bloating my notes. I've had to accept that the basic problem is that I do not in fact know what it is that I want to say. That is, as long as I do not try to examine my thoughts directly, I 'know' intuitively what it is that I want to express but, as soon as I try to look my subject in the eye, examine it in detail so to speak, it seems to shimmer & fade and dissolve into a million tiny pieces. Each fragment may be open to investigation but it seems that I can only grasp the whole obliquely.

I have played with a number of titles such as “The magic of feedback; the roux to your secret sauce”, “The key to Emergence (Feedback)”, “On Fractals, Feedback and Emergence (Why IT is where it's at)”, “Connectedness; Complexity simplified” and so on. To no avail.

So I have decided to proceed as follows: I will revisit LKBE11 and the topics touched there that are close to my heart, propose some auxiliary reading - inspired by the reading list for Calm Alpha - and wrap up with a brief deliberation (and an outlandish extrapolation) on an emergent order that some feel is on its way, if it isn't in fact already nascent. In doing so I hope to give you, dear reader, some idea of why I think IT is such an exciting field to work in at the moment.

Probability

At LKBE11 Don Reinersten & Alan Shalloway separately made a case against Deming's 95% (as related in an earlier post) while John Seddon wound the conference up with a stinging attack on the idea that individuals could win against the system. In fact this is a (useful) false dichotomy.

Stating that the probability of a person failing to change a system approaches 1, when he or she is a constituent of that system, would seem to preclude any individual successfully effecting change in any system. But we now know that small changes in initial conditions (of any system incorporating recursive feedback) can lead to large scale differences in output over time; the (by now slightly infamous because so widely misunderstood/frequently overstated) butterfly effect.

We humans are not good at probability. The Buddha (karma) and Jesus (Do unto others..., Live by the sword, die by the sword...) knew that the system (society in their case) was a function of the individuals composing it and their interactions. I'm pretty sure that they themselves also understood that their preaching was fundamentally flawed. Doing good acts may well increase the probability of meeting good acts but it's not a direct relationship (certainly not in the asymmetrical power distributions of old). Living by the sword most definitely increases the chances of dying violently, and yet there's many a warrior has passed away peacefully in their sleep.

Both Christianity and Buddhism dealt with this problem by introducing a non-falsifiable reckoning. If a Christian lived a good life they would see paradise in the afterlife, if a Buddhist lived a less than exemplary life he or she would be punished by dint of reincarnation (as a lower form). Don't blame the ancients though, probability continues to trouble us - see for instance the Copenhagen interpretation of Quantum Mechanics (as parodied by Schrodinger's famous thought experiment).

I have found Popper's “Quantum Theory and the Schism in Physics” and, more recently, Nassim Nicholas Taleb's “Fooled by Randomness” to be very helpful in trying to avoid probability pitfalls in my thinking.

And back to LKBE11. Despite the rhetorical enmity, the three speakers mentioned proposed similar methods for improving systems – the way to create an effective and humane system is to give those governed by it the power to adjust same according to their (quantified) experiences working in it. What they might have agreed on was that it was in fact all about the feedback...

Feedback

I was first introduced to the power of feedback, self-similarity (fractals) and all that wonderful stuff by James Gleik's seminal “Chaos”. In the days and weeks after LKBE11 I realised that the principles of the various agile methodologies and lean, and the basic practices they imply, represent in fact a fractal! Delivering value from the start; expand incrementally, refine iteratively, create a trusting/trusted environment, seek out and incorporate feedback early and often – these edicts apply equally well at all levels whether you are writing software, coaching or setting up a new business venture. They are loosely worded, ambiguous even, such that they must be adapted to any given concrete context or scale; no two “instances” of a fractal pattern are the same

And it gets more exciting, for instance, TDD is in many ways a fractal instance of the agile principles; hypothesise, test, reflect, repeat (or OODA, PDCA, do+ inspect&adapt, whatever your flavour or context). Further, Kent Beck's 4 simple design rules are:

  1. Run all the tests (create a trusting/trusted environment)
  2. Contain no duplicate code (expand incrementally)
  3. Express all the ideas the author wants to express (seek out and incorporate feedback early and often)
  4. Minimize classes and methods (refine iteratively)

So, if, for instance, a team is working scrum + lean, with XP inside, guided by A-TDD, self-similar patterns can be observed throughout the system. Multiple levels of fast feedback are then built in, allowing magic to happen, through the emergence of strange loops. Strange Loops? I only began to truly understood the implications of chaos theory, fractals etc. through reading Douglas Hofstadter's “Godel, Escher, Bach; An eternal golden braid”. To do a whopping intellectual feat absolutely no justice I will summarize it by saying that Hofstadter makes the case in this book for emergence as a function of feedback.

Emergence, Evolutionary Change

At LKBE11 I was introduced to the Marshall Model. In his original paper, Marshall states that “The basic premise of Rightshifting is that organisations can improve their effectiveness incrementally (and with little turbulence / disruption), until such time as they approach a transition zone.” but also “At these transition zones, major upheaval – in the form of a shift of mindset – is required to proceed further to the right i.e. to continue to improve the effectiveness of the organisation.



Personally, I suspect that this major upheaval is a symptom of the phase transition as much as an agent thereof. Things proceed incrementally or they do not. Think of heating water through its various physical states, from liquid to solid to gas. The change applied is the addition of heat. Heat may be applied constantly but the behaviour of the system varies. It displays punctuated equilibrium, ice remains ice even as its temperature creeps upwards, as it approaches 0 C strange things start to happen, some liquid water is produced but the rise in temperature seems to stall even as the heat applied remains constant. This is called latency (heat supplied goes into loosening bonds, in this example freeing molecules from their crystal straitjacket instead of raising temperature) and it occurs at all phase transitions. Now, there is increased turbulence too, the newly freed water molecules in our example are sliding around banging into bonds, imparting energy and amplifying the instability of the remaining crystal. So, even though the system displays major disruption and or 'sudden' state changes (large shifts), and allowing for significant qualitative difference on either side of a transition zone (liquid/gas, synergistic/chaordic mindset), it remains so that the change process (heat supply, conscious adaptation of practice) evolves step by step.

For a truly enlightening discussion on (biological) evolution by increment, and much more, see Daniel Dennett's “Darwin's Dangerous Idea” and his “skyhooks & cranes” analogy. Further understanding may be gleaned form John D. Barrow's “Impossibility” which is a delightfully accessible book on limits, tipping points and so on.

Another concept that I was introduced to at LKBE11 which struck me as oddly familiar was Real Options. I was sure I had come across it before. And I had. The central argument of Dennett's (loftily titled) “Consciousness Explained”, is that mind is an emergent property of the brain. A model for consciousness is proposed which boils down to the self as “narrative centre of gravity”; consciousness as an assemblage of mechanistic tricks including a “multiple drafts” model for action. This has largely been borne out by neuroscience since with one important caveat – we do not apply “best fit” when choosing from multiple drafts but “first fit”. For a less speculative discussion on the mechanics of mind, see the excellent and more recent “We are our Brains” by Dick Swaab.

Complexity theory

Dave Snowden also spoke at LKBE11. Cynefin and the sense-making model were an exotic beast to me, angry socialist Celts with a sense of humour less so as it happens. I did not understand everything, and am still quite vague on practical detail even having done pretty much all my reading homework for CALM Alpha, but I was immediately sold on the general framework. I undertook to re-read “Frontiers of Complexity” by Peter Coveney & Roger Highfield but haven't gotten round to it yet. What stuck with me from that book was the idea that complexity at one scale often yields to simplicity at another and vice versa. It is possible to know something about attractors, to recognise patterns, but not necessarily when or where they will arise. On the other hand, setting simple boundaries on a system with a sufficiently high number of agents can gave rise to complex patterns, emergent properties. Snowden cites the example of a flock of birds (simple rules: fly to the centre of the flock, match speed, avoid collision) in this instance saying that you can be sure they will avoid an oncoming mountain peak, just not whether they will go past it on the left or the right. For a spectacular example of flocking in action see the following video of a starling murmuration.

Elsewhere Snowden talks informatively and entertainingly about order & chaos since antiquity, which got me thinking.

This idea of patterns which arise again and again also surfaces over and over throughout the history of human thought. From the Buddha (reincarnation) to French folklore (plus ça change, plus c’est la même chose) and beyond to Nietzsche’s “eternal recurrence” and Camus' search for meaning in the Myth of Sisyphus, humanity has seen this tendency to (almost)repetition as something negative, fateful, at the very least something to be faced down, overcome. Should we despair? According to Snowden there's no need; with the right tool set, the beast can be tamed! I look forward to learning more.

To conclude, at the risk of indulging my apophenia: if mind is an emergent property of the brain with its fifty to a hundred billion neurons and their trillion connections, constrained locally by a relatively small number of variables (potential barriers, neurotransmitters), has humanity not been building its superbrain(s) since the advent of language? Or at least since agriculture was first practised? Every advance in communications since, from domesticating the horse to the printing press to the telegraph, and on to the internet, has increased our interconnectedness. Our ability to share and exchange narrative. The internet may as yet have a relatively small number of physical nodes and display only loose connectedness but phenomena like Facebook and Twitter are adding another dimension.

If you were to view users as equivalent to neurons and the internet 'merely' as infrastructure, then that one facet of the human super brain alone already has 2 billion neurons... Supra-identities like nation, tribe or corporation (that may pre-date internet) could get stronger and display more cohesion with ever more internet capacity and connectedness. I wouldn't go as far as those who talk of Gaia, or The Technium, or The Singularity. I'm not suggesting a global consciousness. For one individual human mind the self is already a much trickier idea than might appear at first glance. I'm thinking more in terms of a fragmented and multidimensional space where initially rough-hewn, badly bound and shifting personalities (consciousness as an extremely loose narrative centre of gravity) interact. But even at that scale (decidely smaller than global) some problems already seem a lot less of an issue. Inter galactic travel for example; if a consciousness can expect to exist coherently for centuries what's a few light years' travel between friends?

Monday, 5 December 2011

The history of a failure (Where's the value in that?)


Yes, this post represents a quest (nay an odyssey!) for that silver lining, because even though as I hope to show; failure has value, it still hurts!

It all began on the 16th of June of this past year 2011 when an ex-colleague of mine contacted me regarding project management at her new place of work. Introductions ensued and the first contacts were so bright that by the 23rd I was led to tweet:

One hot afternoon another two weeks down the line, we “pitched” by delivering a Scrum Basics workshop, on the framework of a retrospective, to a collection of interested individuals. One month and a few meetings later, my colleague and I were given the opportunity to propose a model for helping the development organisation of some 7 teams move to scrum. It seemed logical to all concerned to grow scrum in the organisation, team by team. This naturally generated the possibility of a pilot to start.

We reasoned as follows:


We had 3 workshops (Basics, Backlog Management and Planning & Estimating) and reckoned we needed 2 to 4 sprints to get a team off to a solid start. Where possible we would graft our workshops onto actual scrum ceremonies(planning, grooming, review & retrospective), using 'live' input, so that on top of having imparted whatever theory was necessary for the activity in question, the workshops would produce actionable output, in the form of the familiar scrum artefacts (realease & sprint backlogs etc). In this way we hoped to do more showing, though doing, than telling and to be one step ahead of anyone inclined to feel that our learning was getting in the way of the 'real' work.

We also wanted to just hang out a bit, on the one hand to explain and discuss and help out where possible with new ideas like swarming, pairing, WIP etc, should the need arise, but also to get to know the team and experience the physical environment in which the work took place, attend stand-ups, help with setting up other ceremonies etc., etc but we did not know how much time this would represent (we had no data from previous efforts). Wouter and I were also keen to pair throughout the pilot transition; we knew we had an awful lot to learn too

So, to remain honest and open in the relationship, and further sweeten the deal – we offered all our consulting hours for the pilot at zero euro. In this way all parties would have at least some basis to predict costs/effort before committing to anything truly substantial and Wouter & I could both hang around as we saw fit during the pilot.

It was a good deal. Our return, besides 2 paid workshops (we agreed that we would only charge for workshops if they had been 'tested' at least once before), was the opportunity to learn, structured feedback and some word of mouth advertisement. Of course, with a bit of luck, the whole thing would be the start of a mutually fruitful, and profitable, collaboration.

We got the go-ahead, the only decision that remained to be taken then, in early August, was with which team we would cooperate on that pilot. We were invited back in early September to discuss particulars and possible start dates. Little had evolved in the holiday month in between but the establishing of certain communication patterns. I was champing at the bit at this meeting, and it was here, is my own analysis, that the seeds of future failure were sown - if it had been chess this would have been my fatal error:

The team we were to work with were busy with the UAT phase of the current release of their product and their next development cycle was to start sometime in November. For various reasons, it was difficult to say when we could get the whole team together in the meantime such that we could discover of them what it was they did and how approximately (we had decided this should always be our first step when getting involved with a new team).

In the face of all this uncertainty about dates and states and next moves, I boldly suggested that we “just start!”. Wouter and I would hang our Basics workshop on a planning meeting and we could get learning in this UAT period, which for everybody but Test, wasn't actually that busy a period. We could do this at the drop of a hat, so why not? The team was unstable they warned us! My riposte was that we could get to know the team in (informal, relaxed) bilateral meetings after the first session, as the opportunities presented themselves. If we acted now, I asserted, the basic scrum cadence could be well established by the time the next development cycle started! (Privately, I also congratulated myself on how easy it was going to be in the UAT period to get the whole team thinking about testing as a whole-team activity)

How unstable could the team configuration be? All agreed.

As in chess, as in life - in chess too my downfall is often impatience, or hubris, depending on your perspective.

When we met (most of) the team on the morning of the Scrum Basics workshop, some of them for the first time, it was immediately obvious that the decision described above had caused some damage. The team felt crept up upon, and in some cases, put upon, the PO-elect among them.

And yet everybody pitched in positively, we had made no secret of the fact that we were new to the coaching side of things and the team generously allowed us some early fumbling, the workshop was a success. A sized sprint backlog (comprising outstanding UAT work as the team knew it at that moment) was produced and the scrum board setup and prepared. At the same time we had delivered most of our Scrum Basics slides. The perfection game feedback for the session averaged 8...

Lengthy sessions with the PO, the testers and the developers respectively took place during that first sprint. From our point of view it was essential to gain a better understanding of the domain, and the general technical and organisational parameters. But we also used these sessions to follow up on any questions or other input the team might have regarding specifically the adoption of scrum. After the fact it transpired that we had in some cases achieved the exact opposite of our aims, coming across at best, as hard of hearing, and at worst, as cerebrally challenged.

We had agreed to try and keep the number of open stories to lower than half the number of team members. This forced the team to search for new ways to cooperate during this first sprint and things seemed to go quite well initially, but eventually a lot of worked piled up in test anyway. All the skills necessary to deliver a story were available within the team but historically roles had been clearly demarcated so the team needed time to get to know one another's work. The sprint was successful though, twice as many story points were eventually delivered than that the team had committed to in the planning meeting!

On day n-2 of the sprint however, there had in fact only been one single story point actually delivered, DONE. Essentially the team had 'flatlined' all the way through the sprint and on the last day or two managed to get everything done and dusted. Some points were basically delivered through negotiation.

I had introduced the scrum master to Derby & Larsen's “Agile Retrospectives” and we discussed setting up the review and especially the retro along the lines as laid out by the “retrospective goddesses”. The stated goal of the retrospective, having dwelt briefly on the successful delivery, would be the production of one “improvement story”. In our case, a story that would start the team on the road to finishing with starting and starting to finish and give us the opportunity to discuss WIP limits and all that good stuff.

Surprisingly (or not) there was some resistance from the developers when it came to the demo. There wasn't much GUI work involved and everybody had already worked so closely together the whole sprint, telling each other, every day, what they were doing, on a mature project, etc. We insisted anyway and were quietly delighted when almost every single story demonstrated resulted in lively discussion.

The planning meeting for the second sprint under our guidance was less of a success. There was confusion concerning who should have done what to be prepared for the meeting and some of the team were in London while the meeting was being held. It was a difficult session but it clearly surfaced the necessity of excellent communication infrastructure when not co-located and more importantly; latent problems in understanding the scrum roles, and so was very useful. Again we produced a sized sprint backlog, including the improvement story that the retro of the previous day had yielded. But it was also becoming apparent just how badly I had underestimated what people had meant when they talked of team instability in the project phase (UAT) the team found itself in - during that meeting one of the team was called away such that he could put his development skills to good use on another project. And then there was our impending absence...

The week this 2nd sprint was to end, Wouter and I would be away, firstly at LKBE11, and then CSD training with Ron Jeffries & Chet Hendrickson, so we tried to schedule dates with the PO and the Scrum Master for the two remaining workshops we wanted to give such that we wouldn't exceed the 4 sprint maximum we had agreed with management. We were also convinced of the value that they would deliver. That planning meeting would not have been so problematic if we had had the chance to cover backlog management.

It proved difficult to set a date for this (or any other) workshop over time. Not only was it tricky to get everyone together (as we had been warned it would be) there was also a difference of opinion as to what material could be used as input for these workshops, the team was suspicious of any information that had not been signed off and the PO was wary of re-work, it seemed our hands were tied. Wouter and I had long and involved, but ultimately unproductive, discussions about how to get which management to give what signal. The last day at the client's just prior to our planned absence, having failed again to set a date for either workshop, I looked back for the first time at my insistence that we start immediately with serious trepidation. The team clearly felt that there was no room for mistakes.

On the upside though, at that point in time there were three days to go in the second sprint (sprints ran from Thursday to Wednesday) and the scrum board had been looking okay. The following Wednesday evening I mailed the scrum master and asked how the sprint had run down, how she had got on with the review & retro and if she was ready for the planning meeting the next day, or if there were any problems, questions etc... I received an evasive answer explaining how the sprint had been completed successfully, and that the team had delivered many more stories than anticipated.

I surmised that the improvement story had not been done. That there had been neither a review nor a retrospective and that there would probably be no planning meeting the next day.

When I (Wouter was at the Scrum Gathering in London, the lucky lucky...) turned up at the office the following Monday my worst fears were confirmed. The scrum board was closed and abandoned. When I opened it I saw the remains of the previous sprint (with indeed many many post-its in DONE). The improvement story however had not been touched...

I asked the member of the team sitting closest by, “What's going on, how come we don't have a sprint backlog, weren't there any ceremonies run?” They had collectively decided that there was no point for the moment, the workload was too variable, more people had been moved off the team (that was also why the improvement story wasn't picked up in the end, the guy who was to pick it up had been moved...) and so on.

I sought and found our sponsor. She explained that there had been some delay in signing off the next release with their client and that they had therefore re-assigned as many people from the team as they could. (It was clearly not the right moment to re-open the discussion on the advantages of stable teams.) There was however no doubt that the release/project would go ahead. It was just going to start a little later, probably the end of November (it was the middle of October at that point). We decided to leave things for a while until there was more clarity. Then, we could come back and finish off our transition with the hopefully largely re-grouped team. Precisely how we would start up again at a later date, we would leave up to the circumstances and how much material we still needed to cover.

In the mean time, the next day, we (our sponsor and I) ran an impromptu retrospective of the pilot transition. We wanted to gather feedback both on scrum, and the coaching. I was beating myself up about how badly we must have done our job - the first chance that had presented itself, everything had been ditched, by everybody!

Upward and onward, the retrospective itself went very well. Using the timeline activity we gathered data and emotions. We then dot-voted to bring some structure to our reflections. Some difficult discussions ensued but we all stuck to the task and reviewed events and each other honestly. The upshot of it all was that we coaches needed to be much more aware of our customer's narrative, where they were coming from if you will, and that the team needed to be more open to change, and dare to challenge their managers to change. I left that day much happier than when I had arrived, as far as I could tell, despite the problems, the team were still onside:









I was all full of the value of failure, I tweeted as follows:


And then fate struck. It's not just bad decisions that are required for failure, you must also have some bad luck along the way. A herniated disc in my lower back laid me low as of late October.

Wouter returned to our client's on his own in early November and they agreed that we would get a call the week before the re-scheduled project was due to launch (as of that moment, the week of the 21st).

In so far as I was able (treatment for herniated disk is mind-bending painkillers & rest) I helped Wouter to turn our Backlog Management and Planning & Estimating workshops into a sort of project kick-off built on the framework of Rasmusson's Inception Deck so that we were ready for any eventuality.

Meanwhile, time ticked on, and on. And the promised phone call never came.

When contact eventually was established, we heard that “everything was a go. Somebody just needed to check back with somebody else...” Now I know my project manager's instinct would have had me knocking down the door at the our customer's long before their deadlines for calling us had passed, but would it have made any difference? Ultimately? I don't think so, as I said, I think a little patience on my behalf, way back in September, would have served us all well!

Anyway, another 4 days went by, and then we were told that our services were no longer required. The project was up and running, what was the point? The rest of the teams had also decided to transition under their own steam. We had missed the boat.

And so, the balance.

On the negative side:
  • We did not successfully sell agile and I am concerned for our customer's adoption
  • We did not complete the pilot transition
  • We ran only one billable workshop
  • We did not test our new workshops
  • Direct return on investment was negative

And on the positive side, the value:
  • We now have a thoroughly tested Scrum Basics workshops, which we can execute on various frameworks (retrospective, planning meeting)
  • We have working experience as (external) coaches and have sent an invoice
  • We completed our Planning & Estimating workshop
  • We added the bones of a Project Kick-off workshop (framework inception deck) to our portfolio
  • Directly or indirectly, our work there was the stuff of a number of  blog posts!
  • Learning, learning, learning...