Voices of Quality: Insights from Accredited K-12 Virtual Programs

Planning for Quality: How Virtual Programs Align Strategy, Resources, Evidence, and Continuous Improvement

By Dr. Christopher Harrington

Strong virtual programs require more than thoughtful plans, adequate resources, and regular evaluation. These elements create the greatest value when they function as parts of a connected system—one in which organizational priorities shape decisions about people and resources, evidence informs reflection, and what leaders learn becomes the basis for future planning and action. In this kind of system, planning is not simply an annual exercise, resource allocation is not merely a budget function, and evaluation is not reserved for the end of an initiative. Each becomes part of an ongoing process through which the organization learns and improves.

Voices of Quality Logo

That connection is especially important because virtual programs operate in environments characterized by continual change. Funding conditions shift, policies evolve, technologies advance, student needs change, and organizational priorities compete for attention. Programs therefore need enough structure to establish direction while retaining enough flexibility to respond intelligently when circumstances change. Effective planning is not about predicting every future condition; it is about creating sufficient clarity to navigate uncertainty without losing organizational purpose.

That tension between clarity and adaptability was evident throughout a conversation with Alyssa Martin, Ph.D. of the North Dakota Center for Distance Education (NDCDE) and Meghan Roe, Assistant Director of Operations at Launch Virtual Learning. NDCDE is a statewide virtual school supported through legislative funding and tuition, while Launch Virtual Learning operates statewide in Missouri from within Springfield Public Schools. Their organizational contexts differ considerably, yet both leaders describe planning, staffing, resources, data, and evaluation as interconnected components of continuous improvement rather than separate administrative responsibilities.

Their experiences point toward a central lesson for virtual program leaders: sustained quality requires planning that creates clarity without creating rigidity. Strong organizations connect mission and strategic priorities to staffing, professional learning, technology, curriculum, and other resources, then use evidence to determine what should remain, what should change, and where the organization should go next.

Planning for Clarity, Not Certainty

Planning is sometimes treated primarily as an exercise in forecasting. Leaders attempt to anticipate future needs, establish targets, and develop a sequence of actions intended to move the organization toward them. Long-range thinking is important, but the experiences shared in this conversation suggest that the deeper value of planning lies in creating shared clarity about direction. When people understand where the organization is going and why, they are better positioned to make sound decisions even when circumstances do not unfold as expected.

NDCDE provides a particularly strong example of long-range planning shaped by organizational context. Because the program operates on a biennial funding cycle and may prepare resource requests several years before those resources are needed, Martin describes the importance of maintaining a broad 10-year trajectory. That long-range perspective gives leadership a sense of direction while also helping staff understand the priorities they are being asked to support. The value of the plan therefore extends beyond budgeting; it creates organizational coherence by connecting present-day work to a larger destination.

Launch Virtual Learning operates within a context that can demand greater short-term responsiveness. Roe explains that the program plans as far ahead as possible, but its position within a public school district and the broader Missouri education environment sometimes requires rapid shifts in priorities. Rather than revealing a weakness in planning, this experience highlights a different dimension of effective planning: a plan must provide direction without becoming so restrictive that the organization cannot respond to changing conditions.

The contrast between the two programs is useful. One plans within a long legislative and budgeting horizon; the other must be prepared for more immediate changes in district and state context. Yet both demonstrate that clarity and flexibility are not opposing qualities. In fact, a clear strategic direction can make adaptation easier because leaders have a stronger basis for deciding which changes support organizational purpose and which risk creating drift.

The purpose of strategic planning is not to eliminate uncertainty. It is to help an organization navigate uncertainty without losing direction.

Strategy Must Drive People and Resources

A strategic plan has limited value if it remains disconnected from decisions about staffing, professional learning, curriculum, technology, time, and financial resources. Those decisions are where organizational priorities become operational. For virtual programs, thoughtful resource allocation therefore begins with a fundamental question: What capacity will the organization need to accomplish what it has said matters most?

Launch Virtual Learning provides a clear example of this connection. Roe explains that Launch works from both the larger strategic plan of Springfield Public Schools and its own program-level strategic plan, with priorities then informing decisions about staffing, professional learning, technology, curriculum, and other resources. In this model, resources are not treated as independent categories competing for attention. They are instruments for carrying out strategy.

NDCDE extends this alignment across multiple levels of the organization. Martin describes a system in which broad organizational goals inform departmental plans, benchmarks, and individual employee goals. Departments develop their own strategic plans in relation to the larger organizational plan, and their evidence contributes back to the organization’s broader understanding of progress. This creates a visible connection between high-level priorities and the work being carried out by teams and individuals.

These examples also broaden the meaning of resources. Financial capacity matters, but it represents only one part of organizational readiness. People, expertise, professional learning, curriculum, technology, data systems, and time are all resources that must be intentionally aligned with strategic priorities. An initiative may be well conceived and adequately funded yet still struggle if staff lack the knowledge, capacity, or time to implement it effectively.

Strategy identifies the destination; resource allocation determines whether the organization has the capacity to get there. Strong planning systems make that relationship explicit and help leaders distinguish between activities that consume resources and investments that directly advance organizational priorities.

Continuous Improvement Must Be a Living Cycle

Planning and evaluation are often separated by long periods of implementation. A plan is developed, the organization carries it out, and evaluation occurs later to determine whether intended outcomes were achieved. The conversation with Martin and Roe suggests a more dynamic model—one in which strategy, action, evidence, and adjustment continually inform one another.

Roe describes the process succinctly as “strategy, action, evaluation, strategy.” For Launch Virtual Learning, continuous improvement is a loop rather than an endpoint. Strategic priorities guide action, multiple forms of evidence help leaders understand what is happening, and that information becomes part of the next strategic decision. This approach allows evaluation to influence work while it is still underway rather than functioning only as a retrospective judgment.

   


“Continuous improvement…that cycle is strategy, action, evaluation, strategy. It’s a loop.”
— Meghan Roe


  

NDCDE illustrates why this ongoing orientation is particularly important in a year-round asynchronous environment. Martin describes an annual leadership retreat during which leaders dedicate multiple days to examining data, connecting findings to strategic themes, identifying gaps, and determining future initiatives. Yet she also emphasizes that a program serving students throughout the year cannot wait for a natural pause before making improvements. Continuous improvement, in her words, must be a “living thing.”

Formal evaluation points remain valuable because they create protected time for deeper organizational reflection, but mature improvement systems do not depend exclusively on those moments. Leaders also need mechanisms for identifying emerging problems, interpreting evidence, and adjusting practice during implementation. Continuous improvement therefore operates through multiple rhythms: ongoing attention to practice, periodic examination of evidence, structured checkpoints during the year, and deeper strategic reflection at designated intervals.

The result is an organization that can remain responsive without becoming reactive. Decisions do not change simply because new information appears; rather, leaders establish processes through which evidence can be interpreted, placed in context, and used appropriately.

Data Matters Only When It Changes Practice

Virtual programs have access to extraordinary amounts of information. Learning management systems, student information systems, assessments, surveys, course analytics, engagement measures, and operational platforms can generate far more data than any leadership team could reasonably examine. The central challenge is therefore not obtaining information. It is determining which information matters and creating conditions in which people can use it effectively.

NDCDE’s experience illustrates this distinction particularly well. Martin describes the organization as becoming increasingly data rich, but she also reflects on the realization that access to dashboards and metrics does not automatically make the information meaningful. Leadership began asking which measures genuinely mattered, what information teachers needed at different intervals, and how evidence could support continuous improvement. This shift moved the organization beyond data accumulation toward purposeful data use.

One example is NDCDE’s end-of-course survey dashboard. Survey information was combined with student variables, including course outcomes and demographic characteristics, so teachers and leaders could examine patterns, identify curriculum pain points, and consider opportunities for instructional improvement or professional learning. Martin describes hearing teachers discuss and use the dashboard themselves as evidence that the information had moved beyond leadership reporting and become useful at the level of practice.

    


“Data…has to be something that is meaningful and useful to the organization.”
— Alyssa Martin, Ph.D.


   

NDCDE also developed a data matrix that identifies whether individual metrics remain meaningful, which stakeholders are expected to use them, and who is responsible for them. Martin explains that the intention is to protect the integrity and usefulness of the organization’s evidence rather than gathering information simply because it is available. That practice suggests a valuable question for any data-rich program: If leaders cannot explain how a measure will inform understanding, decision-making, or improvement, what purpose is served by collecting it?

Launch Virtual Learning broadens this discussion through the range of evidence it uses. Roe describes state assessments, common formative assessments, periodic benchmarks, student surveys, assignments, and course-level information as sources that can influence improvement. Different forms of evidence answer different questions. Performance data may reveal what students are learning, while perception and experience data may help leaders understand how students experience the program and where deeper investigation may be warranted.

Meaningful data use also depends on trust. When NDCDE introduced its teacher-facing survey dashboard, Martin recalls concerns about how leadership might use individual-level information. Leaders therefore clarified that the dashboard was intended as a professional resource rather than a mechanism for evaluating teachers, while aggregate information could inform larger organizational improvement. This is an important reminder that data systems are ultimately human systems. People are more likely to engage productively with evidence when its purpose is clear and when they understand how the information will—and will not—be used.

The larger principle is straightforward: data collection is not continuous improvement. Data becomes valuable when it changes understanding, informs decisions, or improves practice.

Build Quality In Rather Than Retrofit It

Quality assurance becomes more difficult when it is treated as something to be applied after a system, process, or learning experience has already been created. Both leaders describe the importance of using standards and evidence earlier in the design process so that quality is intentionally built into the work rather than inspected into it later.

Roe describes an important realization within Launch Virtual Learning’s instructional-design work. As the team engaged more deeply with quality frameworks, its thinking shifted from retrofitting existing courses toward designing with quality expectations in mind from the beginning. Standards became what Roe calls “beacons,” giving the instructional-design team a common foundation while still leaving room for greater interactivity, new tools, and approaches suited to both asynchronous and live learning experiences.

That orientation also changes how leaders think about completion. Roe emphasizes that course improvement is never truly finished; once the instructional-design team completes work across the catalog, it can return to earlier courses and begin another cycle. The objective is not to create a permanently finished product, but to build a design system capable of responding to new evidence, new tools, and changing student needs.

NDCDE faces a different version of the same challenge because it purchases most of its curriculum from external vendors. Rather than assuming that vendor-provided content is automatically ready for use, the organization developed a structured review cycle. Staff trained in relevant quality frameworks examine vendor materials, teachers contribute subject-matter expertise, and content is reviewed and adapted against established standards. Student feedback and other evidence then provide another source of information for identifying where the experience can be strengthened.

The contrast is instructive. One program develops much of its learning experience internally, while the other relies heavily on externally developed content. Yet both arrive at the same principle: quality requires intentional design, professional judgment, evidence, and recurring review. Standards provide a common point of reference, but organizations must still decide how those expectations will become visible in actual student experiences.

Building in quality from the beginning does not eliminate the need for evaluation. It changes the role of evaluation—from determining only whether a finished product meets expectations to informing quality throughout the design and improvement process.

Flexibility Without Drift

A common misconception about strategic planning is that a good plan should specify exactly what an organization will do and then remain stable until those actions are complete. Virtual programs frequently operate in conditions that make this approach unrealistic. Legislative changes, funding decisions, district priorities, emerging technologies, and evolving student needs can alter the environment quickly. The challenge is therefore not simply to remain committed to the original plan; it is to know which elements must remain stable and which should remain adaptable.

NDCDE confronts this challenge directly through its relationship with state policy and legislative funding. Martin explains that strategic goals must be meaningful enough to drive improvement but not so narrowly defined that external changes leave the organization unable to respond. She identifies competency-based education as one example of a strategic direction that could remain relevant even as legislative priorities shifted toward different course areas. The implementation context could change while the larger improvement strategy remained intact.

Launch encounters similar uncertainty through public funding and district priorities. Roe notes that programs may plan responsibly while still receiving resources that differ from what was anticipated, requiring leaders to determine how available resources can be used creatively without abandoning essential priorities. Martin extends that observation by identifying creativity and innovation as necessary characteristics of virtual programs operating within dynamic environments.

This is the distinction between flexibility and drift. Flexibility allows tactics to change while purpose remains clear. Drift occurs when changing circumstances repeatedly redirect the organization because no stable framework exists for determining what should be preserved.

Mature planning systems therefore contain both fixed and adaptable elements. Mission and broad organizational purpose provide continuity. Strategic priorities establish direction. Timelines, resource decisions, implementation approaches, and specific tactics may change as evidence and circumstances evolve. The quality of the planning process is reflected not in how rigidly an organization follows an original plan, but in how thoughtfully it adapts while continuing to pursue meaningful outcomes.

Begin with Purpose, Build Ownership, Bring People Along

For leaders whose planning and evaluation systems are still developing, both Roe and Martin return to the same starting point: mission, vision, and desired outcomes. Before an organization determines what resources it needs or what measures it should collect, leaders need clarity about what they are trying to accomplish.

Roe recommends beginning with the outcome and building outward from there. Launch revisits its strategic improvement plan annually, but mission and vision remain foundational. Once goals are established, leaders can begin asking what staffing will be needed, which resources should be allocated, what professional learning must occur, and which processes may need to change. This sequence helps prevent planning from beginning with existing activities or available resources rather than with the intended result.

   


“Start with the outcomes, start with the goal, and build from there.”
— Meghan Roe


  

Martin’s experience at NDCDE reinforces the importance of that foundation. When she entered her role, the organization did not yet have a strong strategic-planning structure, and conversations with staff revealed that mission and vision were not uniformly understood. Leadership devoted time to clarifying organizational purpose and ultimately developed an organizational playbook containing mission, vision, values, role clarity, and an annual strategic commitment. The playbook became a mechanism for making strategic direction visible throughout the organization rather than allowing it to remain primarily within leadership conversations.

Planning becomes more sustainable, however, when people throughout the organization do more than receive the plan. NDCDE has established teacher-input structures through which leadership shares information, invites questions and feedback, and communicates strategic priorities. Launch similarly uses retreats, multidisciplinary teams, quarterly check-ins, and a guiding coalition that brings teachers, administrators, instructional designers, and other staff together to examine data and consider adjustments during the year. These practices move planning away from a closed leadership exercise and toward shared organizational ownership.

Ownership also requires attention to organizational capacity. Martin describes NDCDE’s competency-based education initiative as an example in which leadership understood the strategic direction and was ready to proceed but later recognized that additional professional development was necessary to bring others along. Identifying those knowledge gaps and allocating the necessary human capital and professional-learning resources became part of the implementation strategy itself.

This is a critical distinction. A sound strategic decision does not guarantee successful implementation. People need the knowledge, clarity, resources, and opportunities for participation necessary to carry the work forward. Strong leaders therefore plan not only for the initiative, but also for the organizational capacity required to make the initiative succeed.

What This Means for Virtual Program Leaders

The experiences of NDCDE and Launch Virtual Learning suggest that planning, resources, and evaluation should not be treated as separate management functions. They form a continuous organizational system. Strategy establishes direction; people and resources create capacity for action; evidence helps leaders understand what is occurring; reflection gives that evidence meaning; and adjustment shapes the next decision, investment, or strategic priority.

The strongest systems also balance qualities that may initially appear contradictory. They provide clarity without creating rigidity, use data extensively without confusing volume with usefulness, establish standards while still encouraging innovation, and make long-term commitments while retaining the capacity to adapt. They invite stakeholder participation without surrendering leadership responsibility. In each case, quality depends on knowing what should remain stable and what should be allowed to change.

The Adaptive Quality Cycle (Figure 1) illustrates the interconnected nature of this work. Strategy establishes direction and informs action. Evidence generated through implementation helps leaders understand both results and experience. Reflection creates an opportunity to interpret what that evidence means, while adjustment translates learning into the next strategic decision. Throughout the cycle, people, resources, professional learning, and technology provide the capacity necessary to move from intention to implementation.

Graphic representation of the Adaptive Quality Cycle

The model is intentionally cyclical. Continuous improvement is not something a program conducts after the work is complete; it is the way the work itself is managed. The return to strategy does not mean starting over. It means returning with greater knowledge than the organization had before.

Perhaps the most important conclusion is that mature planning does not make an organization less responsive. Done well, it makes thoughtful responsiveness possible. When mission and desired outcomes are clear, leaders can modify tactics, reallocate resources, develop new capacity, or respond to changing conditions without losing sight of the larger purpose.

Quality is sustained not because an organization perfectly executes an original plan, but because it continually learns how to plan more effectively, act more intentionally, use resources more strategically, and respond more intelligently to what the evidence reveals.

Questions for Reflection

Virtual program leadership teams may wish to consider the following questions as they examine their own systems for planning, resources, and evaluation:

  1. Do our strategic priorities clearly influence how we allocate people, time, professional learning, technology, curriculum, and financial resources?

  2. Which data and evidence genuinely influence decisions in our program? Are we collecting information because it is useful, or simply because it is available?

  3. Where does our planning system need stability, and where does it need flexibility? Can we adapt to changing conditions without losing strategic direction?

  4. How broadly is ownership of our improvement work shared? Do the people responsible for implementation understand the goals, have meaningful opportunities to contribute, and possess the knowledge and resources necessary to succeed?

Continue the Conversation

This whitepaper is part of the AccredVEd Voices of Quality Series: Insights from Accredited K-12 Virtual Programs, a four-part thought leadership initiative exploring what quality looks like in practice across the National Standards for Quality Online Programs (NSQOP). Readers are encouraged to watch the accompanying Voices of Quality: Planning, Resources, and Evaluation webinar featuring Alyssa Martin, Ph.D. of the North Dakota Center for Distance Education and Meghan Roe of Launch Virtual Learning, moderated by Christopher Harrington of AccredVEd.

The series also includes conversations and companion publications focused on the remaining NSQOP standards clusters: Mission, Governance, and Leadership; Curriculum, Instruction, and Assessment; and Access and Stakeholder Support. Together, the four publications are intended to illuminate how experienced virtual-learning leaders translate standards into organizational practice and how those practices contribute to stronger systems, informed decision-making, and continuous improvement.

About AccredVEd

AccredVEd is a program of the Virtual Learning Leadership Alliance (VLLA), a nonprofit organization dedicated to strengthening K–12 virtual learning through leadership, collaboration, advocacy, and the advancement of quality practices.

AccredVEd provides specialized accreditation, quality assurance, and support for K-12 virtual schools and programs. Grounded in the National Standards for Quality Online Programs, AccredVEd helps organizations examine their practices, demonstrate quality, strengthen systems, and pursue continuous improvement through a process designed specifically for virtual learning.

Discover How AccredVEd Can Support Your Program

Learn more about our accreditation and certification process or reach out today to see how AccredVEd can help elevate the quality of K-12 virtual learning at your institution.