Showing posts with label testing. Show all posts
Showing posts with label testing. Show all posts

Tuesday, December 9, 2014

The Second Best Educational Cartoon Ever.



Sometimes a picture is worth a thousand words...and a good cartoon is worth a book.


So, if this is the second best educational cartoon ever you may wish to see the absolute best educational cartoon ever. (As voted exclusively by me.)

   ~~~~~~~~~~~~~~~~~~~~~

Credits:
Creator unknown. Sourced from Google Images.

Monday, August 1, 2011

The learning tour of PISA

The word of education is awash with data – particularly testing results. While I personally have significant reservations about both the use and usefulness of much of this data, due to a combination of   the harm it can do to students, teachers, parents and schools as well as the often unsound assumptions upon which it is based, it has to be acknowledged that not everyone shares my views.  However, I will  put my concerns aside  for the moment and share this video explaining the biggest number cruncher of them all – the PISA testing program.  It is done in the style of the poplar RSA Animates series  and surprisingly, despite being essentially an advertisement for PISA,  it is entertaining ... and also contains some thought producing insights – hence the posting here.


Most educators are familiar with the Programme for International Student Assessment – otherwise known as PISA.  Some may not be aware that PISA was actually conceived and is managed by the OECD – the Organisation for Economic Co-Operation and Development.  It often passes unnoticed that this body is not primarily concerned with education.   As well as providing a vehicle by which the school systems of  participating countries can be ranked,  PISA  has made some observations based upon educational practices and results from around the world.
Many of these are now entrenched in the educational psyche – for example,  girls tend to outperform boys all over the world in literacy while the reverse is true for mathematics.   An equally “obvious” fact, but one which  is significant to have confirmed at this level, is that home background is a major influence on student success.  It is nice to have this confirmed by PISA (given the economic slant of the OECD) – perhaps people will bear this in mind when evaluating school performance.   
There are other “obvious” findings that it is pleasing to see confirmed – that students with fewer books at home are less likely to read.  An associated fact presented in the video is that children from “advantaged” families hear 30 000 000 more words over the course of their school years than students from “less advantaged families” ; you read correctly - 30 million.  The impact of this upon literacy performance need not be expanded upon here.   The fact that a conservative organisation like the OECD confirms the impact of home background on student success is significant – and well worth remembering during the next phase of “teacher bashing”.
Some other areas mentioned in the video include;
·         Early tracking (aka “streaming”) of students is NOT associated with higher PISA scores.
·         Having students repeat grades is NOT associated with higher PISA scores.
·         The “best” teachers tend to gravitate towards the “better schools” – meaning those students who need educational support the least get the best educators (a serious omission here for me was the absence of a definition of what constituted the “best” teachers – but, definitions aside, this is a significant statement).
·         All students, regardless of socio-economic backgrounds CAN perform at high levels when given the opportunity.

Perhaps the most interesting observation mined from the PISA data set  was this observation – that students from “less advantaged areas” that attended schools situated in “more advantaged areas” tended to do as well as their classmates.   Let’s unpack this a little – in this video PISA confirm that home background impacts significantly on student learning...but then indicate that students from “less advantaged” areas  can outperform their neighbours and match their  more advantaged classmates by attending school in more “advantaged” areas.   If this is true, and given the statistical rigour of PISA I’d suggest that, numerically at least ,this is a valid finding, then schools need to examine how this is possible.  The implication is that schools may be doing things that counter unhelpful social issues.  

It is tempting to assume that the schools in “advantaged areas” are doing things that do not occur in “less advantaged areas”.  If this is true then the solution is obvious – mimic the practices of advantaged schools.  However, this is simplistic – there are high performing teachers and outstanding educational practices in “less advantaged” areas which do not produce the same test performance as their more wealthy equivalents.  

Perhaps we should consider some of the non-tangibles of teaching and education – things that PISA can’t measure. Why are these students attending schools “out of area”?  Does this display some perception and ambition on the part of the parents? Is this transmitted to their children? Is this reflected in the work habits of the young people concerned?  So... following this train of thought,  do  the statistical findings of PISA support the wide spread “truism”  that family values and attitudes towards education are key variables  determining success at school?  Is achievement more to do with attitudes than with ability?

The video runs for about 12 minutes – but the contemplation of the issues it raises will last much longer.

(Anyone interested in  pursuing the notion that achievement is more to do with attitude than ability might like to visit my July 4th post “The more I practice the luckier I get. Mindset – Carol Dweck”.  Either go to the July archive folder or click here.

Monday, July 25, 2011

How to win the "best schools" competition - don't play the game!

A week ago my knowledge of the education system of Finland was, to be honest,  almost non-existent.   I knew that they were consistently ranked number one of all “Western” countries in PISA testing but had no idea how they did it.  Then, last weekend, I attended a keynote address by Professor Teemu Leinonen, Professor of New Media Design and Learning at the Media Lab of Aalto University in Helsinki.   Teemu informed the audience that Finland is the source country of Nokia, of Linux, and perhaps even more importantly, the mobile app “Angry Birds”.  Almost as an aside he mentioned that Finland does not have any formal systemic educational testing until the final year of schooling.
My ears picked up – no formal testing?
Professor Leinonen indicated that there was evaluation – but this was left to the teachers for the purpose of assisting their teaching,  not for any evaluation or ranking of students or teachers or schools.  So here is a country with essentially no formal testing until the final year of schooling that is consistently outperforming every country in the Western world that is test driven.  This flies counter to one of the major pillars of conservative school reformists and system administrators in other parts of the world.   It should be said that educators such as Alfie Kohn have been lamenting the revered status of test scores for many years now – but sometimes it seems he is an almost lone voice against  a massed choir of test advocates.  Some further investigation was called for.
As it happened American  broadcaster and blogger David Sirota recently interviewed Harvard Professor Dr. Tony Wagner on his radio program – which, thanks to the wonders of the internet, is accessible to anyone in the world.  Wagner is the  the author of a book with the unwieldy title of “The Global Achievement Gap: Why Even Our Best Schools Don’t Teach the New Survival Skills our Children Need” .  He is also the narrator of the recently produced documentary “The Finland Phenomenon: Inside the world’s most surprising school system”.  In the interview Wagner confirms Leinonen’s comments and makes some further observations:
·         There is no “high stakes” testing in schools in Finland.
·         Teachers must have a Masters degree.
·         Teaching is highly esteemed – only 10% of initial applicants make it through to teach in a classroom.
·         Teachers work collaboratively  - Wagner states that “...isolation is the enemy of innovation and improvement.”
·         The curriculum is designed to promote thinking – not memorisation.
·         The performance difference between the top and bottom schools in Finland is only 4%.

Much of the interview is spent addressing (and effectively debunking) the usual claims of “you can’t compare us to Finland...”

It is dangerous to make interpretations based on another’s observations – but, whilst acknowledging this,  there seem to be a number of implications for other education systems in the Finnish experience.     Obviously, large credit for the success of the Finish education system must go to the selection, preparation and performance of the teachers – and the collaboration embedded in their system. 

However, the absence of formal testing must be considered as a factor in their success.  Not only would this approach “free up” time for genuine teaching, but it would also remove the mindset of scores and test performance as indicators of student learning.  Mastery of concepts when performing authentic tasks in meaningful contexts would become the basis for student development.  We know that summative testing does not lead to sustained improvement in student performance – rather than cite Alfie Kohn yet again I will cite Dr. Dylan William of the University of London who claims that 4000 studies have confirmed that informative feedback consistently produces better student learning than  summative assessment – 4000 studies.  (To investigate this further click here to access the  Apple Classrooms of Tomorrow Today background document.   This should be compulsory reading for anyone involved in education.  The figure used here can be found on page 25.) 

As has been said, rather colourfully, by others, “You don’t fatten a pig by weighing it.”  It would appear that, on the basis of Williams’s research and the Finnish experience,  if we want to improve our schools ... we need to concentrate on teaching well rather than to the test.


Sirota’s blog provides a summary of the interview here   and also link to the relevant audio archive.     (The interview is towards the end of the show – I recommend downloading the mp3 file rather than listening online, then use the slider to fast forward to the 24:03 mark and listen from there.  Don’t be put off by a section in the middle where Sirota advertises the next guest – he does return to the Wagner interview.)

Credits:
Flag graphic: