Tag Archives: problem-driven

Renewing the public domain: Can a more socially embedded bureaucracy help?

April 25, 2025 By in Uncategorized Tags: , , , , , , , , , 2 Comments

Even as time becomes shorter and the mood darker, I find it helpful to look beyond the immediacy of crisis and probe the possibilities of renewal. In so doing, I continue to take inspiration from Albert Hirschman’s  ‘possibilism’  – the endeavor to  “….try to widen the limits of what is perceived to be possible…. and figure out avenues of escape…. in  which the inventiveness of history  and a ‘passion for the possible’ are admitted as vital actors”.  In recent years, I have sought to bring the spirit of possibilism to an exploration of  governance at the interface between citizens and the public sector.

A combination of rule-boundedness  and insulation of public bureaucracies from day-to-day pressures have long been central tenets of conventional efforts to improve public governance. But conventional efforts have not helped stem a dramatic collapse in recent decades of trust in government and of civic perceptions regarding the legitimacy of the public domains. , As I  explored in some earlier work, multiple drivers account for this collapse in trust. Even so, the question of whether the narrowness of mainstream approaches to public sector reform has contributed to the loss of civic trust has continued to nag at me.  

Complementing mainstream approaches to public sector reform, might there perhaps be another way forward – one that can both help improve public-sector performance and, of particular import in these times of polarization and demonization of government,  do so in a way that helps to renew the legitimacy of the public domain?   Might a more ‘socially-embedded’ bureaucracy (SEB) help achieve gains on both the effectiveness and legitimacy fronts?  This blog post provides (as a substantial update to an earlier piece)  an overview of some of my recently published and ongoing work that addresses these questions.

Exploration of SEB’s possibilities often is met with skepticism. In part, this is because SEB is radically at variance with  the mainstream logic of how public bureaucracies should be organized; indeed, as I explore further below, embrace of SEB is not without hazard. But another reason for this skepticism is that SEB is  one facet of a broader agenda of research and experimentation that aims to help ‘redemocratize’ the public sector – and  enthusiasm among champions of redemocratization has all-too-often outrun both conceptual clarity and empirical evidence.  In a generally sympathetic review,  Laura Cataldi concludes that much of the discourse proceeds as:

“….an umbrella concept under which a large variety of governance innovations are assigned that may have very little in common……Most of the proposed solutions are situated at the level of principles such as participation, deliberation and co-creation of public value, rather than being concrete tools……[Protagonists]  seem to propose models of management, governance and reform that are too abstract, and ultimately lacking in terms of concrete administrative tools…..”

In the work introduced below, I have sought to distil from both the academic literature and the experience of practitioners a set of insights that can help strengthen SEB’s analytical foundation.

I define a ‘socially embedded bureaucracy’ (SEB) as one that incorporates “problem-focused relationships of co-operation between staff within public bureaucracies and stakeholders outside of government, including governance arrangements that support such co-operation.”   Questions concerning the value of SEB arise at both the micro and more systemic levels:

  • At the micro level: what is the potential for improving public-sector effectiveness by fostering problem-focused relationships of cooperation between staff within public bureaucracies and stakeholders outside government?
  • At the systemic level: To what extent do gains in addressing micro-level problems – and associated gains in trust among the stakeholders involved – cascade beyond their immediate context and transform perceptions more broadly, thereby contributing to a broader renewal of the perceived legitimacy of the public domain?

The  research papers introduced in this post explore the above questions. Two of the papers are largely conceptual (see here and here), and two are more empirically-oriented –  a case study of the governance of affordable housing and homelessness in Los Angeles, and an interpretive exploration (co-authored with long-time civil society activist Mark Heywood and anchored in two sectoral case studies) of the evolving interface between civil society and the public sector in South Africa.

Figure 1  contrasts SEB with conventional notions of  how public bureaucracies should be governed.  In the conventional view, governance is organized hierarchically, with a focus on ‘getting the systems right’  Citizens engage upstream via their selection of political representatives who oversee both policymaking and implementation. The tasks of public officials are defined by legalistic, rule-bound processes, which also insulate public bureaucracy from political interference. Civil society’s  governance role is to bring pressure from the demand-side to help ‘hold government to account’.  By contrast, SEB is problem- rather than systems-oriented; it incorporates horizontal as well as hierarchical governance arrangements; interactions (both within the bureaucracy and at the interface with civil society) are less legalistic and more adaptive, oriented towards  deliberation and fostering initiative.

Figure 1: Autonomous and socially-embedded bureaucracies

SEB’s distinctive characteristics create opportunities for improving public sector performance via three channels that are unavailable to insulated bureaucratic hierarchies:

  • Fostering synergies  –  (problem-level) gains from co-operation between public bureaucracies and non-governmental actors;
  • Clarifying goals – alliance-building among reform-oriented public officials and civil society actors as a way of bringing greater clarity to the (problem-level) goals to be pursued by public agencies.
  • Streamlining monitoring – transforming the governance arrangements for (problem-level) monitoring and enforcement from a morass of red tape to trust-building interactions between public officials and service recipients.

Taken together, the above three channels have the potential to unleash human agency by  opening up (problem-level) space for public/civic entrepreneurs to champion change. (See my ‘microfoundations’ paper, published by the Thinking and Working Politically Community of Practice for detailed exploration of each of the channels. And see the Los Angeles case study for an exploration of how  these channels  are at the center of  efforts to more effectively address the  twin crises of affordable housing and homelessness.)

Alongside recognizing its potential,  a variety of  concerns vis-à-vis SEB also need to be taken seriously. The first two are evident at the micro-level:

  • The implications for public sector performance of a seeming inconsistency between SEB’s horizontal logic and the hierarchical logic of bureaucracies.
  • The hazards of capture or vetocracy that might follow from opening up the public bureaucracy to participation by non-governmental stakeholders.

The third is a systemic level concern, namely that:

  • Championing SEB as a way to renew the legitimacy of the public domain mis-specifies what are the underpinnings of social trust.

The paragraphs that follow consider each in turn.

To begin with the seeming tension between horizontal and hierarchical logics, the organizational literature on private organizations  suggests that there is perhaps less  inconsistency than it might seem on the surface. Viewed from the perspective of that literature,  the challenge is the familiar one  of reconciling innovation and mainstream organizational processes, and it has a clear answer:  ‘shelter’ innovation from an organization’s mainstream business processes. As Clayton Christensen put it in The Innovator’s Dilemma:

Disruptive projects can thrive only within organizationally distinct units…When autonomous team members can work together in a dedicated way, they are free from organizational rhythms, habits

Consistent with Christensen’s dictum, the problem-specific building blocks of SEB potentially provide space for protagonists to work together flexibly, at arms-length from broader organizational rigidities.

The second set of concerns  follows from SEB’s opening up of the public domain to participation by non-governmental stakeholders. At one extreme, an inadvertent consequence of opening up might be  a ‘vetocracy’,  with enhanced participation providing new mechanisms through which  status-quo-oriented stakeholders can stymie any efforts at public action. At the other extreme, openness might inadvertently facilitate capture by influential non-governmental insiders.  As the microfoundations paper explores, these hazards potentially can  be mitigated via a combination of  vigorous efforts to foster a commitment among stakeholders to clear, unambiguous and measurable shared goals – plus a complementary commitment to open and transparent processes. These commitments can build confidence in what is being done, while also reducing the pressure for control via heavy-handed, top-down systems of process compliance.

The third (systemic-level) concern interrogates the presumption that SEB can help to transform more broadly civic perceptions as to the legitimacy of the public domain. As my second TWP paper explores, a variety of eminent scholars (including Sam Bowles and Margaret Levi) have argued that initiatives that seek to renew the public domain by  building working-level relationships between civil society and public bureaucracy mis-specify what it takes to improve social trust. Social trust, they argue, rests more on the quality of institutional arrangements and commitment to universal norms than on the relational quality of the government-society interface. This argument is eminently plausible in contexts where background political institutions are strong and stable. But, as the TWP papers explore,  in contexts where disillusion and institutional decay have taken hold, renewal of the public domain – and thus confidence in the possibility of achieving collective gains through social cooperation –  requires more than yet another round of institutional engineering.

There are, to be sure,  many ways to foster ‘pro-sociality’  that are not linked to SEB-style initiatives at the interface between public officials and non-governmental actors. These include strengthening of trade unions  and other solidaristic organizations within civil society, and  intensified  efforts to foster economic inclusion in contexts characterized by high and rising economic inequality.  Even so, as examples from Los Angeles, South Africa and the USA illustrate, the systemic potential of SEB should not be dismissed out of hand.

Especially striking in Los Angeles has been the repeated willingness of voters to support ballot initiatives in which they tax themselves to finance homelessness services and the construction of affordable housing. However, as declining majorities for these initiatives signal, patience is wearing thin. The SEB-like governance reforms on which the LA case study focuses are intended to help renew civic commitment via transparent and participatory processes of goal-setting and accountability; how this is playing out in practice is my current research focus.

Turning to South Africa, my recent paper with long-time civil society activist Mark Heywood explored some interactions between  civil society strategies and state capacity over the quarter century since the country made its extraordinary transition to constitutional democracy. Civil society’s principal strategy of engagement has been adversarial. This adversarial approach yielded  major victories,  including the reversal of AIDS-denialism in government, and momentum for a successful push-back against state capture. Over time, however, a series of political drivers (explored here and here) resulted in a weakening of state capacity. In parallel, civil society’s wins through adversarialism became fewer, and the effect on citizen disillusion became correspondingly corrosive. The Heywood-Levy paper thus makes a case for civil society to complement confrontational strategies with approaches centered around building problem-level  coalitions with those public officials who remain committed to a vision of service. (The paper is slated to be part of a forthcoming edited volume by MISTRA; in the interim, interested readers can feel free to email me to request a PDF.)

Finally, opening the aperture even further, Robert Putnam’s 2020 book, The Upswing, raises the possibility that SEB might  usefully be part of a strategy for renewing civic perceptions of the legitimacy of the public domain, a way for forward-looking leaders to champion an electoral and governance platform centred around a vision of partnership between the public sector and non-governmental actors.   Political and social mobilization centered around deliberative problem-solving would be a radical departure from contemporary pressure-cooker discourses which thrive on raising rather than reducing the temperature. But, as Putnam explored,  it happened in the USA between the 1880s and the 1920s, and it might happen again:

A distinct feature of the Progressive Era was the translation of outrage and moral awakening into active citizenship… to reclaim individuals’ agency and reinvigorate democratic citizenship as the only reliable antidotes to overwhelming anxiety……[Similarly], our current problems are mutually reinforcing. Rather than siloed reform efforts, an upswing will require ‘immense collaboration’, [leveraging] the latent power of collective action not just to protest, but to rebuild.”

From crisis to renewal? Affordable housing and homelessness in Los Angeles

April 16, 2025 By in affordable housing, homelessness, Los Angeles, participation, public sector governance Tags: , , , , , , , , , , , , , 4 Comments

In dark times, I take inspiration from the great social scientist Albert Hirschman’s commitment to  the search for ‘a bias for hope’, for  “avenues of escape from exaggerated notions of absolute obstacles…. avenues in  which the inventiveness of history  and a ‘passion for the possible’ are admitted as vital actors”. Viewed from this perspective, the point of departure for effective action is not some idealized vision of how things should be, but  clarity  as to how things actually are – with this clarity providing the basis for a search for practical entry points capable of setting far-reaching cumulative change in motion.  This passion for the possible has inspired my research and practice for almost a half century; it is the guiding spirit of a new  cycle of research on the Los Angeles’ region’s twin crises of homelessness and scarcity of affordable housing (AHHLA)  that I introduce in this piece.

Los Angeles’ AHHLA crisis startles. LA County is among the world’s affluent locales, with a  2023 per capita income of over $78,000, well above the American average. Yet that same year about 55,000 people were living on LA’s streets, and over 30,000 of them had been there for more than one year.  Even more startling, every year about 60,000 people become newly homeless –  a cumulative total over five years of almost 3 percent of LA County’s population of 10 million.  For those who live in Los Angeles (among whom, having moved here in 2023, I now count myself) the AHHLA crisis is existential. But its significance goes beyond the local.

As recent books by Ezra Klein and Derek Thompson (2025) and Marc Dunkelman (2025) explore in depth, a broad national reckoning is underway to assess both how failures of progressive governance contributed to the rise of toxic populism, and what might be the contours of a renewed and effective progressivism.  AHHLA is ground zero of this broader crisis of contemporary American progressivism. In what ways did decades of progressive good intentions gone wrong fuel LA’s current crisis? Are there hopeful lessons to be learned from recent efforts to address AHHLA about how progressive approaches to governance can become part of the solution?

Here, to set the stage for addressing the above questions,  is AHHLA’s economic backdrop:

  • Over the past four decades, even as the affluent have thrived,  earnings have been stagnant for the poorer half of LA’s population. As of the early 2020s, 16.6 percent of LA residents lived below baseline (rent-adjusted) measures of absolute poverty – the highest percentage among California’s regions. (California is the state with the highest percentage in the USA.) In the absence of the public safety net, the LA percentage would be 26%.
  • Beginning in the 1990s, a combination of population growth, the end of the extensive margin and slow growth environmentalism/NIMBYism has resulted in an increasingly severe shortage of housing. Between 1960 and 1990, about  200,000 housing units were built each decade; between 1990 and 2020,  the decadal average was below 75,000 units. In 2023, 45 percent of the households that earn below LA County’s median income paid more than half their income in rent.
  • The unit costs of building publicly-subsidized affordable housing in Los Angeles are almost two and a half times the equivalent costs in Colorado and Texas; startlingly, within LA the total development costs per square foot are 50 percent higher for publicly-subsidized  than for unsubsidized, market rate housing built for private (self-pay) buyers.

Considered together, the combination of stagnant incomes, rising unit costs and a near cessation of new housing construction (except at the more affluent end of the market) was to make accommodation increasingly unaffordable for lower-income Angelenos. In important part, and as per the title of an influential book, Homelessness is a Housing Problem. More on all of this in coming weeks and months.

LA’s fragmented  governance arrangements have enabled the AHHLA crisis to fester. This fragmentation  is especially ill-suited to addressing homelessness – a multi-faceted ‘wicked’ problem  that calls for a multi-sectoral, multi-jurisdictional and multistakeholder  response. The roots of LA’s fragmented governance can be traced back (at least in part; racial ‘redlining’ also played a role….) to a century-long aspiration to avoid centralized, urban machine politics and cultivate instead more localized, small-town-like governance.  Some tasks are the responsibility of LA County government, and others are diffused among the County’s 88 municipalities, of which the City of LA (with a population of four million) is the largest. This fragmentation has been exacerbated by deepening commitment over the past half-century to open, often legally-mandated public deliberative processes in advance of any action, which further complicates local government’s decision-making.  

Moving towards more top-down governance (of varying degrees of draconianism) offers one possible response to fragmentation.  But widening the distance between citizens and local government risks worsening what already is a crisis of civic alienation from government in many countries (not least of which the USA) the world over. Might there be a third way, one that finesses the traps of top-down governance accompanied by citizen alienation, or civic participation plus ineffectual governance? 

In recent conceptual work (see here for an introductory overview), I have explored the potential and limits of this third way. The articles delineate three distinct channels through which ‘socially-embedded’ approaches to public governance might simultaneously  counter fragmentation, encourage participation  and enhance effectiveness:

  • A collective effort to enhance clarity as to goals;
  • Streamlined, transparent  and participatory approaches to performance monitoring; and
  • Collaborative, multistakeholder arrangements for service provision.

Recent initiatives in LA to reduce homelessness incorporate all three channels. Why these initiatives were adopted,, and whether they will continue to unfold in ways that contribute to reducing homelessness is the focus of an ongoing research project in collaboration with  the University of Southern California’s Professor Yan Tang (an eminent scholar in the tradition of Elinor Ostrom’s work on collective action). As our research will explore, one key to success is whether the protagonists in the LA efforts will be able to craft a credible way of sharing gains and burdens within a framework that can advance the collective interest. What follows will hopefully whet the reader’s appetite for the research project.  

Strikingly, at least since the early 2010s,  momentum for scaling-up and reshaping how LA responds to its homelessness crisis has come less from government than from civil society. The efforts have unfolded in two phases. In a first phase, political and civic leaders championed a series of ballot measures that successfully raised billions of dollars to address AHHLA. However, by the late 2010s, there was a dawning realization that the magnitude of the challenge went way beyond earlier perceptions. Not only was further financing required, effectively addressing the twin crises called for better  co-operation among multiple stakeholders – something that the region’s fragmented institutions were not well placed to achieve.  A 2021 report commissioned by civil society champions took stock of the governance challenges, and proposed a menu of reforms. Partly in response to this report, Los Angeles County’s Board of Supervisors  established a Blue Ribbon Commission on Homelessness Governance  and subsequently adopted its recommendations.

Since mid-2024, there has been an extraordinary burst of energy and  reform aimed at aligning LA’s multiple stakeholders  around a coherent governance platform for reducing homelessness. Major initiatives include:

  • The creation by LA County’s Board of Supervisors of a robust, formally-empowered multistakeholder platform, with a mandate to “help align the region’s approach to homelessness and provide critical accountability and oversight to ensure more meaningful results”.  
  • The  development and official adoption of specific, measurable targets for reducing  homelessness.  
  • The initiation of work by  the Los Angeles County Affordable Housing Solutions Agency (LACAHSA), established in a 2022 resolution of the California State Senate to increase the availability and affordability of housing in LA.
  • A radical restructuring (currently at an early stage, but on an accelerated timetable)  of the lead public  LA County and City agencies responsible for overseeing and implementing the LA region’s response.
  • A new effort to specify performance standards for each of the many elements that go into the homelessness response – as a necessary basis for both resource allocation and accountability.

The hope is that the above initiatives will together finally provide the coherence and momentum needed to make real inroads into  homelessness – and thereby  break a longstanding corrosive cycle of overpromising and then underdelivering.  Whether this will happen remains uncertain,  but if it does  LA could go from being seen as a notorious example of the failure of well-intentioned progressivism to effectively address urgent social challenges, to  becoming an exemplar of a renewed, legitimate and effective 21st century progressivism. What happens next thus matters well beyond LA itself.  Watch this space for further updates.