2013 Logo 3d gradient 
SEGway        FEBRUARY 2015
Research and Assessment News from SEG Measurement  
In This Issue


Follow us on Twitter


View our profile on LinkedIn


View our videos on YouTube


Like us on Facebook



Find us on Google+



31 Pheasant Run

New Hope Pennsylvania 18938 267.759.0617
segmeasurement


An oft-cited Chinese proverb says "May you live interesting times."  For those of us involved in Assessment and Efficacy Research, we are certainly "blessed" with "interesting times."

The education community and public at large continue to debate the merits of the Common Core and the PARCC/Smarter Balanced testing.  And, on the legislative scene, Congress is working on the reauthorization of the Elementary and Secondary Education Act (ESEA).  They are taking a hard look at the form high-stakes assessment should take in the future, as well as the frequency with which the tests should be administered.  Also on the legislative agenda is determining how strong the proof of efficacy requirements should be for federal funding of school products and services.

In this issue of SEGway, we offer some insights in what we see for assessment in the future.  Assessment moves in about 10-year cycles.  In the "Next Wave of Large-Scale Testing," we take a look forward to what's next.

Inspired by the recent movie "The Imagination Game," which looks at the critical role math, statistics and measurement played in breaking the Enigma code during World War II, we look at another interesting, less-familiar use of statistics an measurement in the war effort in the "Measurement Moment."

Our conference calendar is filling up.  Coming off the heels of FETC we are headed out to TCEA for another dose of the latest and  greatest in educational technology.  From there it's on to PETE, to see what our fellow Pennsylvanians are doing with technology in education. Then, we will  try our luck at the SITE higher education technology conference in Las Vegas in March.

Finally, we offer some comic relief sharing a recent press release on Heaven's long-awaited new standards.

We very much appreciate your interest and support over the past year.  We look forward to hearing from you about what you would like to read in SEGway in the coming year.  Until then, you can continue the dialog with us on LinkedIn (SEG Measurement), and Twitter (@segmeasure).

Take a look at our website at www.segmeasurement.com, as it is continually updated with developments in the field.  And, feel free to email me at [email protected]. I'd love to hear what's on your mind.

 

Sincerely,

 

Scott Signature  

 

 

Scott Elliot

 

SEG Measurement 
The Next Wave in Large Scale Testing
What's next for testing in the U.S.?
  • Assessment of Non-Cognitive Skills- There is a growing recognition
    chemistry-boy-sm.jpg
    that success in school and the workplace demands more than content knowledge and skills.  The next wave of testing will see a greater emphasis on critical thinking skills, gathering and analyzing information, collaboration and communication, and personal characteristics such as drive.

  • ELL Assessment- It is no surprise that there is a growing number of students for whom English is not their first language.  As the number of English Language Learners approach 25% (expected by the year 2025) this will take center stage in the assessment community.
     
  • Assessment and Competency-Based Education- Competency based education is not new.  But, there is increased interest due to several trends. First, the growth in online learning options (including MOOCs) has opened the door for students to demonstrate competency in different ways.  Second, the introduction of micro-credentialing through technology-enhanced "badging" has made it easier to conceptualize learning in a competency-based framework.  And, changes in the technology environment have made credentials more portable and have fostered wider scale acceptance of student competency-based credentials. We can expect to see assessment play a major role as competency-based education grows.

Measurement Moment
Winning World War II, by seeing what's not there
The recent movie, The Imagination Game, dramatizing the life of Alan Turing and his role in dramatically shortening World War II, has showcased the importance of statistics and measurement during the War.  But, there is another interesting, albeit less familiar, story about how statistics and measurement helped to win the war.

The American military was losing a lot of planes over Europe. Large numbers of planes were being shot down and lost during engagements.  The military knew they needed to better protect planes, by providing them with better armor.  But, they faced a dilemma.  Some increase in armor was desirable, but too much armor would create weight problems.

To solve this problem, the military called in the "big guns"--the measurement and stat folks--specifically, the Statistical Research Group (SRG). Abraham Wald, from the SRG, was asked to help figure out how to best to armor planes to reduce losses.

As good researchers, they studied all the returning planes to see what areas showed the most damage.  To determine where best to put the armor, they counted the number of bullet holes per square foot for several areas of the plane.   The data clearly showed that the greatest number of bullet holes were in the fuselage and other areas of the plane (e.g., wings), suggesting armor was best placed in these locations.

To the surprise of those on the project and the military sponsors, Abraham Wald examined the data and proclaimed that the best place for the armament was the engine, not the fuselage.  Why? He suggested that the sample was "biased"; it did not include those planes that did not return--those that had been shot down.  He explained that the reason their study had found the fewest bullet holes per square foot on the engine, was that those that took significant gunfire to the engines were shot down.  The key was to look at what was not there.

An incomplete, biased sample almost led to the wrong conclusion. This is a dramatic example of something we see far too often in educational measurement and research: relying on inaccurate and incomplete samples.
About SEG Measurement
Building Better Assessments and Evaluating Product Efficacy
medical-team-portrait.jpg
SEG Measurement conducts technically sound product efficacy research for educational publishers, technology providers, government agencies and other educational organizations, and helps organizations build better assessments. We have been meeting the research and assessment needs of organizations since 1979. SEG Measurement is located in New Hope, Pennsylvania and can be accessed on the web at

SEG At Upcoming Conferences
Let's Meet!

We are looking forward to a busy conference season after our much deserved holiday break.  February and March are stacking up to be "all technology" conference months!

Look for us at these upcoming conferences:

  • Texas Computer Education Association (TCEA) Conference, February 2-6, Austin, TX
  • Pennsylvania Educational Technology Expo & Conference, February 8-11, Hershey, PA
  • AACE's Society for Information Technology & Teacher Education (SITE) Conference, March 2-6, Las Vegas, NV
     

We would love to meet with you and discuss how we can help you build strong assessments and get the proof of effectiveness you need for success.  

 

 If you would like to meet with a representative from SEG Measurement to discuss how we    might help you with your assessment and research needs, please contact us    at [email protected].

Heaven Releases Revised Standards
Paradise releases long awaited update to the ten commandments
church_choir.jpg
Heaven February 2, 2015.  Heaven, known to many as Paradise, announced the release of the updated "Ten Commandments" today. The new Commandments, now named The Common Core Spiritual Standards (CCSS), come in response to the increased complexity of the modern world and a recognition of the greater challenges humans face.

The Vatican (official press agent for Heaven) released the document earlier this week.   "Much has changed since the first release of the Ten Commandments" said God, Creator and CEO of Heaven, Inc. "The modern world is a much more complex place and many humans are arriving to the Pearly Gates who are not Heaven-ready."

According to informed Angel sources "there has been increasing pressure on Heaven and the Creator to update the standards from both clergy and lay people."  "The Creator's level of dissatisfaction with today's humans has been widely cited in the Fundamentalist literature."

The first release of the Commandments put far too much emphasis on rote activities. The new commandments emphasize a more conceptual understanding of the world.  Abstract phrases such as "thou shall not" have been replaced with wording more consistent with the complexities of the modern world.

The release culminates a multi-year project involving committees of humans from many different environments.  There was wide consensus on what humans need to know and be able to do to be Heaven-ready. "These are not simply new standards imposed by Heaven, they reflect a multi-year process involving several thousand current residents of Paradise," the Creator added.

The CCSS includes both changes to existing standards and new standards. Some of the key changes appear in the following amendments (old and new text indicated):

Commandment:  Analyze the role of parents and caregivers and the value of maintaining those roles. (Honor thy Father and Mother)

Commandment: Identify appropriate models of human sexuality and the best ways to get involved.  (Thou shall not commit adultery)

There are several notable additions including the following three new commandments:

Commandment 11: Thou shall not wear plaid with stripes.

Commandment 12: Thou shall not text and drive.

Commandment 13: Thou shall stop complaining.

Those who are not yet dead will fall under the new standards.  However, there is a proposal to grandfather in those who are nearly dead. Conversations are under way with Hell to bring them in under the new standards.

Neither Obama nor Boehner could be reached for comment.

###