Organization Design: How COOs Build Better Businesses for CEOs

Organization Design: How COOs Build Better Businesses for CEOs

As a new CEO, you’ve probably experienced this: your business is growing, but for some reason things feel harder, not easier. Communication breaks down. Decisions take forever. The same problems keep happening. What worked when you had five employees isn’t working with twenty. Sound familiar?

Here’s what’s happening: your organization needs to be intentionally designed to support your organic growth. And while you might not have a COO yet, understanding how they think about designing organizations will help you build a business that scales smoothly and serves its people well. We are using the term organization and not company or business because the principles in this article are applicable to all organizations (non profit, for profit, religious), not just companies or businesses.

What Is Organization Design?

Let’s start with clarity. Organization Design isn’t about drawing fancy org charts or copying what works at Google. According to organization scholars Royston Greenwood and Danny Miller, it’s “a way of thinking about organizations and how people and resources are organized to collectively accomplish a specific purpose.”

Richard Daft, author of Organization Theory and Design, describes it as seeing and analyzing organizations based on patterns that have been identified through decades of comparative study. These aren’t abstract theories—they’re practical insights about how successful organizations actually function.

Think of it this way: if you’re building a house, you don’t just start hammering boards together. You consider the foundation, the load-bearing walls, the flow between rooms, the climate you live in to know what type of materials to use, the availability of the materials you need, etc… Basically, you consider a lot of variables before you begin building. Organization design applies this same intentional thinking to the operational structure of your business.

The Executive Summary: What You Really Need to Know

This article is going to be long but packed with information. We know you’re busy running a business, so here’s the core of what you need to know upfront. Then you can dive into whichever sections matter most to you right now.

The Big Picture: Organization design is about intentionally building an operational structure for your business that best fits your business. It’s not about copying other companies—it’s about building the right operations for YOUR business’s specific needs.

Four Key Dimensions or scales Think of these as sliding scales from low to high. These are things that the company (or you as the CEO) has 100% control over…theoretically. 

  1. Formalization: How much is written down vs. kept in people’s heads. Low formalization means all in people’s heads and high formalization means all processes and SOPs are written down. 
  2. Specialization: Whether people are specialists or generalists. Low specialization means everyone is a generalist and handles every part of the process in your business (think one man team), and high specialization means everyone handles only one specific thing in the business and passes it to someone else for the next step (think departments or process lines).
  3. Hierarchy: How many layers between CEO and frontline (tall vs. flat). Low hierarchy/flat means the CEO manages all the employees directly and high hierarchy/tall means the CEO manages a VP, who manages directors, who manages managers, etc.
  4. Centralization: Who makes decisions (top leadership vs. distributed). Low centralization means anyone in the company can decide to spend money on behalf of the company or sign legal documents on behalf of the company, and high centralization means that only senior executives can spend money on behalf of the company or sign legal documents on behalf of the company. 

Five Factors (or influences) That Shape Your Design .Think of these as external forces that are happening to your business….or in other words, your business’s design is contingent on these factors. You will need to assess your business against the following contingency factors/influences and be honest and objective about the state/position of your business. This is not the time to let the narrative or “your story” lead. This is the time to “face the facts.”

  1. Size & Stage: Where you are in your growth journey. Is the business a startup, growing, maturing or declining?
  2. How You Create Value: Your core business processes. Do you offer a service, a digital product, a physical product, and what are the steps to provide this to clients?
  3. Your Environment: How fast your industry changes. Are you in tech (which changes rapidly) or construction which changes slowly?
  4. Your Strategy: What you’re trying to achieve. Are you a cost leader (try to be the cheapest) or a value leader (try to provide the most value by being unique)?
  5. Your Culture: How things actually get done. What’s the one thing that’s most important in your business? Is it making money, is it taking care of your employees or is it taking care of your customers, is it having the best systems and processes? Choose the one thing that’s most important for your business and be clear about it. Also, be careful about choosing several things because you may find it difficult to have multiple things that are most important because in certain scenarios they will compete against each other for your attention. 

The Spectrum: All organizations fall somewhere between:

  • Machine-like (rigid, efficient, standardized) – good for stable environments
  • Living System (flexible, adaptive, innovative) – good for changing environments

Most successful businesses blend both approaches based on their needs.

Why This Matters: As your business grows, you will need to remember that the way you used to do things worked up until “this arbitrary point” however, it won’t get your business to its next stage. The business needs to mature and do things differently. Understanding these principles helps you:

  • Anticipate and prevent common growth problems
  • Build structures that support your strategy
  • Create an organization that serves people well while achieving goals

Where to Start:

  1. Document your core processes (even simple checklists help)
  2. Clarify who makes what decisions
  3. Assess whether your structure supports or fights your strategy

Now, let’s dive into the details. Feel free to jump to whatever section you need most:

  • Building blocks of organization structure
  • Factors that influence your design
  • Finding your place on the rigid-to-flexible spectrum
  • How to actually apply these concepts
  • Industry-specific patterns

The Building Blocks: Key Structural Dimensions (The Sliding Scales)

No business or organization is one dimensional. We couldn’t look at someone’s company and be able to see exactly how it’s been developed or what its complete makeup is. However, through studying thousands of organizations since the late nineteenth century, researchers have defined four fundamental dimensions that shape how organizations work. Understanding these helps you see your business more clearly and make better structural decisions.

This section is going to be more theoretical and use a few academic words that you’re more likely to read in a text book than hear while running your business, however, it’s important to know them and what they mean.

Formalization: Your Documentation Reality

Formalization refers to how much is written down in your organization. Do you have documented processes, clear policies, employee handbooks? Or does everything live in people’s heads?

High formalization means extensive documentation—think McDonald’s and Chic Fil-A with their detailed procedures for everything so that when you order a #1 it tastes pretty much the same, everywhere you order. Low formalization means few written rules—think of a creative agency where with the exception of probably accounting and billing, each project is unique and so the final deliverable is based on what custom method of delivery the client requests.

Here’s the key insight: When that star employee leaves, does their knowledge walk out the door with them? In our experience, new CEOs often underestimate how much critical information isn’t documented anywhere. Start simple: document your core processes, even if it’s just a one-page checklist.

Specialization: How You Divide the Work

Specialization is about how narrowly or broadly you define roles. In highly specialized organizations, each person does a specific, narrow set of tasks. Think assembly line workers who install one component repeatedly. In generalist organizations, people wear multiple hats and handle diverse responsibilities.

Here’s the key insight: Most startups begin as generalist organizations by necessity—everyone does everything. As you grow, the question becomes: when and how do you specialize? The answer affects everything from hiring to training to career development. Most organizations fall toward the middle where one person does a group of related tasks. 

Hierarchy of Authority: Your Information Flow Structure

This dimension captures how many layers exist in your organization and how the thresholds of authority and responsibility are layered vertically up the organization. This is the chain of communication (or command). Picture your org chart: is it tall with many levels, or flat with few layers between the CEO and front-line employees?

Here’s the key insight: Tall hierarchies create clear reporting relationships but information takes a long time to get from the bottom to the top–Think government or military with long chains of commands. Flat organization structures enable faster information flow and positive collaboration among everyone because everyone is on the same level,  but can create confusion about who’s actually being held accountable to get things done there’s essentially no clear person in charge. Neither is inherently better—it depends on your business needs.

Centralization: Where Decisions Get Made

Centralization focuses on where decision-making power actually lives. In highly centralized organizations, most decisions flow up to the most senior employees in the company like Vice Presidents, and C-Suite Executives. In decentralized organizations, front-line employees have significant decision-making authority.

Here’s the key insight: Think about your current reality: can your customer service team issue refunds without approval? Can project managers adjust timelines? Can department heads hire without your sign-off? Your answers reveal your current centralization level.

The Influences That Shape The Design: Contingency Factors

Here’s where organization design gets more practical. The key structural dimensions from above don’t exist in a vacuum—they’re shaped by context about your organization. We call these shaping forces “contingency factors” because the right structure depends on (is contingent upon) your unique situation.

Size and Lifecycle: Where You Are in Your Journey

Size refers to headcount not revenue or assets owned. Revenue and assets are better indicators of the magnitude of your business than the size of your business. For example, a five-person consulting firm might generate the same revenue as a 150-person manufacturing company, because the consulting firm solves very complex problems while the manufacturing firm creates one million simple widgets. Typically, not always, as the number of employees increases some new complexities naturally get introduced. One common complexity that gets introduced is communication. Who needs to know what and when. As you grow from 10 to 50 to 200 employees, the complexity increases exponentially.

The lifecycle stage matters too. Organizations evolve through predictable phases, each with distinct challenges:

  • Startup or Entrepreneurial phase: Everything is informal, everyone does everything
  • Growth or Collectivity phase: Need for specialization and systems emerges
  • Maturity or Formalization phase: Focus shifts to efficiency and optimization
  • Renewal or decline phase: Requires either transformation or managed transition

Understanding your current phase helps you anticipate what’s coming and prepare accordingly.

Technology and Value Chain: How You Create Value

Don’t think of technology as just Information Technology—it’s your entire value creation process. How do you transform raw materials or ideas into final products and deliverables that customers value? A software company’s “technology” is its development process. A consulting firm is its methodology for solving client problems. A bakery would be its recipes and its equipment.

Your value chain shapes your organizational needs. Complex, interdependent processes require different structures than simple, sequential ones. A company that delivers custom work needs to be organized differently than a company that delivers a standard and easily repeatable product or service.

External Environment: Your Competitive Landscape

Your industry, competitors, regulations, and market dynamics create your competitive landscape and influence your optimal structure. Stable environments—think utilities or established manufacturing or banking—can support more rigid structures. Dynamic or volatile environments—think tech startups or fashion—require more flexible/nimble structures.

Consider these environmental factors:

  • How fast does your industry change? Is it every 2-3years or every decade?
  • How intense is competition? How easy is it for new companies to enter the market?
  • How complex are regulatory requirements? Is this a highly regulated industry with a lot of penalties including imprisonment?
  • How diverse are customer needs? Do customers want the same type of products or services or do they want different products that require you deliver something essentially custom for each customer?

Goals and Strategy: Your Unique Direction

Your organization’s purpose and strategy should drive its design. A company focused on being the least expensive and making profits by driving a high volume of sales needs different structures than one pursuing innovation and making profit by delivering a unique value that cannot be replicated by competitors. A business serving local markets organizes differently than one with global ambitions.

This seems obvious, but we often see misalignment. Companies claim to value innovation but create rigid hierarchies that stifle creativity. They talk about customer focus but centralize all customer decisions to one department or group of people. Make sure your structure supports your strategy, not undermines it. A company’s goals and strategies define the scope of its operations, its relationship with its employees, customers and competitors. Essentially, it sets the tone of the company’s culture

Culture: The Invisible Force

Culture represents the unwritten rules, shared values, and collective behaviors in your organization–the intangible glue. It’s how things really get done, regardless of what the org chart says. Culture influences everything from communication patterns to decision-making styles to how conflicts get resolved.

Strong cultures can overcome structural weaknesses, but they can also resist needed changes. Understanding your culture—and being intentional about shaping it—is crucial for effective organization design.

From Mechanistic to Organic. Where Does Your Organization Fit on the Spectrum? 

So far we’ve discussed nine variables (four structural dimensions and five contingency factors) to consider when designing your organization. The almost uncountable combination of the variables ultimately determine whether your organization is going to be mechanistic (rigid) or organic (flexible/fluid). All organizations exist somewhere on this spectrum between the two extremes: mechanistic/rigid and organic/flexible/fluid designs.

Understanding Mechanistic, Rigid, Design

Mechanistic organizations run like well-oiled machines. At the extreme these organizations have:

  • Every rule, SoP and policy written
  • Clear, specialized roles with defined boundaries
  • Tall hierarchies with formal reporting relationships
  • Centralized decision-making at senior levels
  • Predictability and consistency in operations and external industry landscape

These are the companies that sometimes make employees feel as though they, the employees, are easily replaceable. Think traditional manufacturing plants, government agencies, or large banks. These organizations THEORETICALLY excel at efficiency, consistency, and control. We say theoretically because many of us have experienced inefficient government agencies and banking institutions. So theoretically they work well in stable environments with predictable demands. 

Understanding Organic Design

Organic organizations flow like living systems. At their extreme they feature:

  • Few formal rules, with guidelines applied flexibly
  • Broad roles that evolve based on needs
  • Flat structures with unclear hierarchies
  • Decentralized decision-making throughout the organization
  • Adaptability and innovation in operations due to shifting external industry landscape

These are the companies that make employees feel like invaluable family members. Think creative agencies, tech startups, or research labs. These organizations excel at innovation, adaptation, and employee engagement. They thrive in dynamic environments requiring constant adjustment.

Finding Your Place on the Spectrum

Here’s the crucial insight: neither extreme is inherently better. The right design depends on your context and the degree to which the contingency factors influence your company. Most successful organizations blend elements from both approaches, creating hybrid structures that balance efficiency with flexibility.

Consider these trade-offs:

Formal Systems vs. Informal Networks: Mechanistic organizations rely on documented procedures and formal communication channels. Organic ones depend on relationships and informal information flow. Ask yourself: what mix serves your business best?

Specialized Roles vs. Generalist Flexibility: Specialists bring deep expertise but limited flexibility. Generalists offer adaptability but may lack depth. Your optimal mix depends on your value chain complexity and change rate.

Vertical Control vs. Horizontal Collaboration: Hierarchical structures provide clear accountability but can create silos. Collaborative structures encourage innovation but can blur responsibilities. Balance based on your coordination needs.

Central Authority vs. Distributed Decisions: Centralized decisions ensure consistency about how things are done throughout the organization but slow response time. Distributed authority enables agility but risks inconsistency about how things are done throughout the organization. Your customer needs and risk tolerance guide this choice.

Approaching Organization Design Like a COO (Or CEO Thinking Like a COO)

We’ve shared a lot of information up to this point. We want to now explain why it matters from a COO’s perspective. So whether you have a COO or you’re wearing that hat yourself, understanding organization design principles serves many purposes, three of which we think are critical for existing organizations.

1. Navigating Organizational Transformation

Every growing business faces moments requiring structural change or reorganization such as the periods signifying transition between business lifecycle stages. Or maybe you’re expanding to new markets, integrating an acquisition, or pivoting your business model in response to changes in your market. Organization design provides a framework for thinking through these transitions systematically rather than reactively.

It helps you baseline where you are, envision where you need to be, and build a roadmap between them. Without this framework, organizational changes become expensive experiments rather than strategic evolutions.

2. Planning for Predictable Challenges

Growth brings predictable problems. As an example, around 25 employees, informal communication breaks down. Around 50, you need middle management. Around 100, silos emerge between departments. Around 200, bureaucracy creeps in.

Understanding these patterns helps you prepare proactively. You can build structures that will scale before you hit the wall, not after. This forward-thinking approach saves time, money, and organizational stress.

3. Defining and Measuring Effectiveness

How do you know if your organization design is working? Effectiveness isn’t just about profit. It’s about your overall success and organization design provides multiple lenses for measuring effectiveness:

  • Goal achievement: Are you hitting your targets?
  • Resource acquisition: Can you attract the talent, capital, and partnerships you need?
  • Internal process efficiency: Do your operations run smoothly?
  • Stakeholder satisfaction: Are employees, customers, and investors happy with your performance?

Applying Organization Design: A Practical Process

Understanding organization design principles is valuable, but applying them transforms businesses. Here’s how COOs (or CEOs thinking like COOs) can lead this process (note the following exercise could be extensive and a heavy lift for your company, depending on your size and available resources; therefore embark on this journey mindfully):

Step 1: Clarify Your Strategic Direction

Everything starts with strategy. Work with your leadership team to define, reaffirm, or update:

  • Your mission and purpose (why you exist)
  • Your vision for the future (where you’re going)
  • Your strategic goals (how you’ll get there)
  • Your competitive approach (how you’ll win)

Use tools like SWOT analysis to ground your strategy in reality. Be honest about strengths to leverage, weaknesses to address, opportunities to capture, and threats to navigate.

Step 2: Assess Your Current State

Before designing your future organization, understand your present reality:

  • Map your current structure against the four dimensions
  • Evaluate your contingency factors honestly
  • Identify what’s working and what’s not
  • Gather input from all levels of the organization

This assessment will help reveal gaps between your current structure and strategic needs. This is also referred to as a gap analysis. From this analysis you might realize that you’re pursuing innovation with a rigid hierarchy, or maybe you’re seeking efficiency with too little documentation. These misalignments help to highlight you design priorities.

Step 3: Design Your Target Organization

Based on strategy and assessment, design your ideal structure:

  • Determine optimal formalization level for your context
  • Define role specialization that balances expertise with flexibility
  • Create hierarchy that enables appropriate decision speed
  • Establish centralization that empowers while maintaining control

Remember: you’re designing for your specific situation, not copying best practices. What works for Amazon might be a disaster for your business. It’s okay to borrow ideas and principles from best practices but do not copy paste.

Step 4: Plan Your Transition

Moving from current to target state requires careful change management:

  • Sequence changes to minimize disruption to operations
  • Communicate the why behind structural changes to everyone in the organization
  • Involve affected employees early in the implementation planning process
  • Provide training and support for new ways of working before and after the transition
  • Build in feedback loops to adjust as you go

Organizational change is challenging. People resist even positive changes. Strong change management makes the difference between transformation and chaos.

Step 5: Measure, Learn, and Iterate

Organization design isn’t one-and-done. It’s an ongoing process of refinement:

  • Establish metrics aligned with your effectiveness definition
  • Regularly assess performance against these metrics
  • Gather feedback from employees and customers
  • Identify what’s working and what needs adjustment
  • Make incremental improvements continuously

This iterative approach builds a culture of continuous improvement while avoiding the disruption of massive reorganizations.

Industry Patterns: Learning from Others

While every organization is unique, industry patterns provide useful guidance. Understanding why certain industries lean mechanistic or organic helps you think about your own organization.

Industries That Typically Favor Rigid Mechanistic Structures

These industries often benefit from standardization, efficiency, and control:

Manufacturing: Consistency and efficiency drive success. Whether producing cars, electronics, or consumer goods, manufacturers need predictable processes and clear quality standards.

Banking and Financial Services: Regulatory requirements and risk management demand formal procedures, clear hierarchies, and centralized controls.

Retail Chains: Standardization across locations ensures consistent customer experience and operational efficiency.

Airlines: Safety requirements and operational complexity require extensive procedures and clear command structures.

Government Agencies: Public accountability and regulatory compliance necessitate formal processes and hierarchical approval chains.

Industries That Typically Favor Organic Structures

These industries often thrive with flexibility, innovation, and adaptation:

Technology: Rapid change and innovation demands require flexible structures that can pivot quickly and encourage experimentation.

Creative Agencies: Unique client needs and creative processes benefit from fluid teams and minimal hierarchy.

Professional Services: Consultants, architects, and designers need flexibility to adapt to diverse client requirements.

Research Organizations: Discovery and innovation flourish in environments with minimal constraints and maximum collaboration.

Startups: Resource constraints and market uncertainty demand adaptable structures that can evolve rapidly.

The Important Caveat

These are tendencies, not rules. We’ve seen innovative manufacturers with organic structures and disciplined tech companies with mechanistic approaches. Your specific situation—not your industry—should drive your design choices.

Building Your Legacy Through Design

As a new CEO focused on building a business that serves its people well and creates lasting impact, organization design isn’t just about efficiency—it’s about creating an organization that lasts for generations. 

The best organization designs balance multiple objectives:

  • Efficiency without dehumanization
  • Control without stifling creativity
  • Flexibility without chaos
  • Specialization without silos

They create environments where people can do their best work, customers receive consistent value, and the business builds sustainable competitive advantage.

Your Next Steps

Whether you’re designing your first formal structure or redesigning an existing organization, start here:

  1. Document your current reality: Map your existing structure against the four dimensions. Be honest about what’s actually happening, not what the org chart says.

  2. Assess your contingency factors: Evaluate your size, lifecycle stage, value chain, environment, strategy, and culture. Identify which factors most strongly influence your needs.

  3. Identify misalignments: Look for gaps between your structure and strategy. Where does your organization design help or hinder your goals?

  4. Start small: Pick one area where better organization design could make an immediate impact. Maybe it’s documenting key processes, clarifying decision rights and responsibilities, or adjusting role definitions.

  5. Learn and iterate: Treat organization design as an ongoing discipline, not a one-time project. Build learning loops that help you continuously improve.

Remember: great businesses aren’t built by accident. They’re designed intentionally to serve their purpose, support their people, and sustain their mission. Whether you’re preparing for a future COO or building these capabilities yourself, investing in thoughtful organization design creates the foundation for lasting success.

The companies that endure aren’t just those with great products or services. They’re the ones with structures that enable consistent execution, continuous adaptation, and aligned effort toward meaningful goals. That’s the legacy thoughtful organization design helps you build.

References:

  • Daft, Richard L. Organization Theory and Design
  • Greenwood, Royston and Miller, Danny. “Tackling Design Anew: Getting Back to the Heart of Organizational Theory”

Ready to design an organization that serves your mission and scales with purpose? Let’s explore how these principles apply to your unique situation. Reach out, and we’ll help you build structures that serve your people well and create lasting impact.

Share Post :

Maybe You Like

What Is Your Value Proposition? Answering By Understanding Your Value Chain

Servant Leadership: Leading By Serving Others First

Organization Design: How COOs Build Better Businesses for CEOs

What is a Chief Operating Officer? A Preparation Guide for New CEOs