Rapid Cycle Evaluation for EdTech: IMPACT Analysis 2.0
Continuous improvement. Two of our favorite words. It’s what our educators and organizations do every day, and the approach applies to LearnPlatform too; it’s most evident when it manifests as an upgrade based on the needs of schools, districts, institutions and states. We’ve been struggling to contain our excitement about the release of the latest version of our IMPACT™ Analysis technology, IMPACT 2.0. Yes, we think it’s a pretty great update but are most excited to see it used to equip administrators with better, deeper and more meaningful data to examine edtech efficacy in their organizations. The 2.0 update is a direct output of the insights, needs and collaboration with dozens of K12 and higher ed organizations, along with our data scientists and nationally recognized thought leaders, who have run over 100 IMPACT analyses on dozens of products and interventions in the last year.
For those who are unfamiliar, the LearnPlatform is, first and foremost, an edtech management system to organize, streamline and automate the tedious and often challenging realities of implementing modern technology in schools and systems -- it saves time, saves money and reduces headaches for teachers and leaders. The IMPACT (Integrated Metrics Producing Analytics on Classroom Technology) module of LearnPlatform is one-of-a-kind tool, that integrates data from multiple sources including educator feedback, pricing data, product usage and student achievement data to produce evidence-based reports and dashboards on product effectiveness. Conservatively, a single product IMPACT Analysis will result in 1.54 million calculations in 2.6 seconds — that’s the functional equivalent of 2 weeks of effort in a traditional third party evaluation. That is a lot of number-crunching magic, and this data helps answer key questions that educators and administrators have about their edtech such as:
- How much and in what way did we use edtech products in our classrooms?
What can we do now to improve implementation and practice immediately?
Did the product do what it was intended to do in our situation?
Is the effect of the product different for different student populations (grade levels, demographics, achievement levels) or situations?
How can we adjust our implementation, use or licensing of the product to drive outcomes?
What are the opportunities for cost savings ( adjusting resource allocations for implementation, right-sizing the number of licenses, etc.)?
Building on the original IMPACT Analysis Technology, IMPACT 2.0 was informed by more than 100 product evaluations across diverse education environments. This new release offers an enhanced user experience, a new edtech rapid cycle evaluation capability, faster analyses and five times the number of visualizations than in the previous version. As with previous versions and our mission, the release continues our commitment to intellectual honesty, supporting equity of access, and saving educators and their organizations time and money so they can focus on their students’ success.
New features in IMPACT 2.0:
1. Summary dashboard showing overall effect on intended outcomes, product use towards goal and costs.
Answers the questions: “How much and in what way did we use the top edtech products being used in classrooms? Did the product do what it was intended to do? What can we do now to make improvements in our classrooms now? Situational analysis and statistical methods used for the analysis.”
2. Overall results and insights into product usage and achievement metrics (slice and dice by gender, grade, locale, school size, etc.).
Answers the questions: “Who used it and how much? Did we use it as much as we wanted or expected to use it?”
3. Detailed breakdown of product’s effect on an intended student outcome(s), sliced by varying levels of use, achievement and population demographics.
Answers the questions: “Is the effect of the product different for different student populations (grade levels, demographics, achievement levels)? How can we adjust use of the product to drive outcomes?”
4. Calculations on the cost of product use and potential cost savings.
Answers the question: “What are the opportunities for cost savings (adjusting resource allocations for implementation, right-sizing the number of licenses etc.)?”
We are lucky enough to spend a lot of time with educators across the country who are working smarter and making better decisions based on timely analysis. Organizations can also share their evaluations in de-identified ways with others using LearnPlatform. As always, all of the system’s activities are compliant with all student data privacy standards and regulations. This collaboration equips, engages and empowers more administrators with better, deeper and more meaningful data to examine edtech efficacy in their organizations from a 50,000 foot view, as well as drill into details most important to selecting instructional tools, supporting teachers and making edtech work in their unique environment.
Want to learn more? Join our upcoming webinar "Sneak Peek of IMPACT 2.0” on 4/27 at 12:00pm EDT with Karl Rectanus, CEO and co-founder and Dr. Daniel Stanhope, Lea(R)n's senior research officer. We'd love to have you join us!