Showing posts sorted by relevance for query stochastic. Sort by date Show all posts
Showing posts sorted by relevance for query stochastic. Sort by date Show all posts

Wednesday 5 June 2013

Fear & Arrogance

Quote from Bull Durham
The industrial mindset around education tends to look away from this approach to learning, but there is something to be said for bravery in the face of overwhelming odds; it's a true commitment to what you're learning.  Of course, if you're going to learn something like it matters then failure should be an expectation if anything other than competence is demonstrated.  In a school system that prides itself on stats it generates about itself, this kind of without-a-net learning doesn't happen.

When I say true commitment I mean a willingness to put your learning to the test (and I don't mean a standardized test).  There is a reflective aspect to learning that we tend to ignore in education.    We like to say we're looking at meta-cognition and self-aware learning, but only without questioning the context we frame it with.  Unless a student is considering the school system in which they find themselves complete with all its financially forced lunacy, the metacognition they are asked to endure in class is little more than another attempt to pretend rows of desks and student numbers are the ideal.  In that environment the student who shrugs and walks out of class in order to truly test themselves in a trade or other real pursuit is the only one answering the metacognitive question correctly.

Learning without concrete, relevant feedback is empty, pointless.  The type of feedback students get in school tends to be abstract to the point of emptiness.  We then wonder why their poor grades don't motivate them to try harder to get better abstract numbers, and then teachers agonize over how to 'engage' them.

When I first started to teach in Japan I tried to understand why my classes were so different even though the lessons were the same.  In looking at my learners I realized that some were intrinsically motivated and some extrinsically motivated.  The doctor who came in to work on their presentation to have their work shared in an international conference?  Those classes were stellar.  The employees who were required by management to upgrade their English?  Tedious.  Intrinsically motivated learners are a joy to teach though also a great challenge because of how voracious they are.  When we create an education system we iron out intrinsic motivation in favour of standardized, extrinsic motivations (grades, standardized test scores, report cards).  Any fear or arrogance in daring to explore and expand beyond our comfort zone is stamped out in favour of standardized assessment.

I've been learning the art and science of motorbike riding over the last couple of months.  I can't think of an activity that requires a greater commitment (except perhaps tight rope walking).  The learning process for this activity is ruthless and demanding.  I don't get days off or time to relax when I'm working on my craft.  I don't have someone constantly correcting my behavior to keep me on task.  And it hurts doing it, let alone if I do it poorly.  What got me on a bike in the first place?  Fear and arrogance; the chance to do something difficult well.  Thinking that I could learn this thing with grace and skill was a dare I've always wanted to take.  That I want to be successful in something I've seen kill other people is perverse and satisfying.

We don't like students to learn things that are challenging to them, we like them to all do the same thing on a bell curve.  We process them as statistics that we can then manage.  If you've ever tried to submit a class of all failures or all perfects you know this to be true; they want a bell curve of grades with a median in the Bs.  Student centred learning tries to put an individualized face on this, but the assessment rubric will quickly bring it back in line again.  It's unreasonable to expect a teacher to individualize learning for thirty people, but if we're going to run this like an assembly line we can't bemoan the loss of individual learning.

The real trick with learning is to want to do it.  Once you're there and you have a deeply seated need to figure out what it is you want master, you can begin to develop those skills.  In addition to fear and arrogance (two methods of not being daunted by learning a challenging skill), you should also embrace patience and a willingness to laugh at your failures without ignoring them.  With a flexible, resilient approach to learning in place you are sure to succeed at your craft, though not always in ways you may have imagined.

Mastery takes longer, but this'll get you over the steep bit
at the beginning of the learning curve
I stumbled across the chart on the right a few weeks ago on Google+.  Whenever I hear someone say, "I wish I could draw", or, "I wish I could code", or any other longed for learning you care to name, I think back to this chart and wonder why they never spent the time if they wanted it that badly; they obviously never wanted it that badly.  Learning isn't magic and teaching isn't a dark art.  The learner has to recognize the value of the learning and have an emotional need to achieve it.  The teacher has already walked that path to expertise and cultivates that love of the material by challenging the student to achieve that which is barely within their reach.  Their expertise allows them to dare the student to appropriate challenges.  Learning is a visceral, thrilling self-driven, emotional experience, not a pedantic, systemic process to be forced on rows of victims.

These moments of learning greatness where students reach for more than they should and see success (and failure) happen in schools all the time, but they are usually the result of a good teacher trying to protect students from systemic processing.  They also tend to happen in stochastic learning or extracurriculars more than the ordered learning of the class room.  In the kinetic action of arts, technology or physical education students still have the freedom of unregimented, hands on learning toward less specific ends. That stochastic space allows them room to attempt greatness, to bypass the routine learning and realize a eureka moment.  Formal classroom education irons that out with curriculum, formalized assessment and systemic teaching practice.  The freedom still evident in stochastic learning tends to unnerve the professional student and educational administrator, both of whom have learned to play the game of Education rather than simply encourage people do what they are naturally predisposed to do.  For the true apprentice hands on learning is the last bastion of real learning in our education system.  It may be the unspoken reason that killing extracurriculars in Ontario this year cut so deeply.  Only in sport and other physical activity can we appreciate the immediacy of failure and the joy of real success.  You can't bell-curve reality.

All is not lost.  We could begin revising education towards learning rather than self serving statistics gathering.

Imagine an education system that didn't work to generate its own self-serving statistics.  A school system that was focused on developing an environment in which students were able to develop a deep, intrinsic love of learning, where no extrinsic motivation existed to force them into a mold of grades and average expectations.  Failure in this system could be brutal and obvious, but students would be encouraged to attack their learning with fear and arrogance (and patience and humor) knowing that they would never be demeaned for failing but only for ignoring their failures.


Wednesday 11 May 2016

Failing Forward

Failures, repeated failures, are finger posts on the
road to achievement. One fails forward toward success.
- C.S. Lewis
Four years ago I decided to show what we know in the information technology focused computer engineering course I teach at Centre Wellington DHS.  The Skills Canada I.T. and Networking Administration contest seemed custom tailored to do that for us.  That first year we took two competitors down to Guelph and finished second and third to an urban(e) high school in the regional competition.  We took what we learned from that first round and applied again the next year, this time winning our way through to the provincial competition for the first time.  Had we not known the competition by failing at it the first time, we never would never have been able to re-orientate ourselves and get out of the regional battle.

That first student we sent to provincials was a polymath, gifted at pretty much everything, but once again we were unprepared and we ended up finishing fourth overall.  Like mechanics and other stochastic skills, I.T. is experiential.  You can be the sharpest person in the room, but the more experienced technician will usually figure it out first because the problems aren't always obvious and linear; instinct based on experience plays a surprisingly large part in analyzing problems.  Still, fifth in the province wasn't bad for our second go at it.   Our competitor came back and debriefed on the provincial competition just as our previous students had with the regional competition.

Our third go at it had two competitors having to face off challengers regionally.  They finished 1-2 and we were off to provincials again.  Our second run at the big competition showed just how much the scope of the competition could change year to year.  We once again finished in the top ten, but didn't medal.  As before, our competitor came back and did a thorough debrief, helping the next candidate (the one who'd finished second regionally) get ready in more detail than ever before.  The old adage goes: I was able to reach so high because I stood on the backs of giants.  In our case this is completely true.  Had those previous students not leapt into the breach and shown us the way, we would never have seen the steady improvement that we did.

We just got back from provincial competition once again.  We gold medalled in I.T. and then finished top three in all technology competitions combined - meaning we didn't just beat other competitors, we also got a near perfect score in the process.  The first thing Zach, our gold medalist, did when he found out he won was shout out to the people who came before him, thanking them for the doing all that dangerous reconnaissance blind.

We're off to Moncton next month to compete in Skills Canada at the national level.  Ontario's is the biggest provincial skills program with the toughest competition, and we scored highly, but it's our first time nationally.  I didn't consider changing our approach.  Our goal is to go there and learn.  Zach has benefited from the failures of previous students, and now it's his turn to go first and pave the way.

Can a small town school compete against massive, urban
school boards?  Yes, yes we can.
At first glance it might look like those previous students failed, but they didn't, they were part of something bigger than themselves that has succeeded.  I know some people look at competitions like Skills Canada and wring their hands over how harsh it is on tender adolescent egos, but our failures made us better and our approach meant we were resilient in the face of those failures.  Even when we were sending different individuals year on year there was a team feeling as new competitors read over the notes, advice and encouragement of now long graduated students (all of whom are enjoying post-secondary computer focused success).  In many cases current competitors connected with grads through social media in order to further develop this mentorship.

The education system has focused relentlessly on student success.  A big part of that push is to mitigate failure wherever possible.  When failure is removed from learning you can't develop nonlinear, experiential skill-sets or take risks on new challenges because those things in particular demand failure in order to learn.  You also can't learn to fail forward or consider your learning to be a part of something larger than yourself.  No fail learning is remarkably selfish on a number of levels, damaging not only a student's ability to learn stochastic skills, but also weakening their resiliency, resolve and humility before a task.

The concept of no-fail learning is very academic in origin, no real-world learning process would consider such an approach viable.  It's unfortunately ironic that one of my best teaching experiences and a unique learning opportunity for many students has to happen outside of the classroom, where the many benefits of failure are still allowed to happen.

A couple of years ago I realized were were on a multi-year trajectory, so I started putting up posters in the classroom for each competitor so that new students would realize they are part of a dynasty!


Our school mascot is a falcon... geddit?



Tuesday 25 February 2014

The Learning Expert & The Skilled Master

The other day a tech-handy colleague said over coffee, "I should get my tech qualifications in computers, what did you have to do to take the course?"  I replied that I had to provide five or more years of industry experience and recognized qualifications in order to qualify for the training; he seemed put off.

I understand his response, I battled the same one when I was applying to get qualified.  It was a kind of knee jerk reaction, a 'how dare you ask for specific qualifications!  I'm an expert learner with years of educational experience!'  I dug up my references and certifications and went through the process after putting away that ego.

This has me thinking about the duality of my educational background.  From high school dropout I attended a year of college before dropping out.  I then apprenticed as a millwright and returned to high school to graduate.  This eventually led me to university.  After university I was once again working in the trades as a automotive technician before eventually finding my way into information technology and finally teaching.  In the trades I worked in mastery focused experiential learning situations that were intense and demanding.  Academics were also demanding, but in a different way which usually had more to do with figuring out how to feed myself.  I got paid to apprentice in a trade, you are a customer when you are working through post secondary academics.  I saw a number of people being passed through that process simply because they wouldn't quit.  You saw less of that in the trades because if you couldn't do it, you often got injured and/or fired.

I took English and history as my teachables because it was easier to simply toss my degree into the ring than it was to cobble together all those technology requirements.  Most teachers in a high school are academically produced, the minority get into teaching through experiential/trades learning.  Those academically produced teachers are expert students themselves, they had to be or they wouldn't have survived the educational process.  An expert student is as much a politician as they are a learner, they've figured out how to survive in what is really an arbitrary social construct.

Having worked on the experiential and the academic sides of learning, I'm now trying to define the differences in the two types of learning:

Experiential versus discovery learning.  When you're learning a stochastic (experiential, non-linear) skill, you
need an expert in that experience to guide your progress.  When you're learning academics you need an
expert learner to show you how to self direct your learning and survive the system.
I'll talk about fundamental learning skills in another post, but in this case I'm focusing on the secondary learner who has already developed fundamental learning skills.  That student is capable of self-directing their learning, and in an information rich world like the one appearing around us this is a vital portion of their engagement in the learning process.  Where once we expected students to sit in rows and be portioned out information, nowadays teachers should be facilitating self-directed learning.  A 21st Century teacher's greatest ability is their own expertise in information fluency, which they provide in order to produce similarly self-directed learners.

'That's academic' has long meant a course of action that has no practical purpose, but academics do generally produce self-directed learners who have had to survive the vicissitudes of many education systems over the years and have become self-taught in spite of the best efforts of many of their educators.


In management and education the goals are
abstract, fabricated and ultimately political
In comparison to my academic background my experiential learning has been uncertain and demanding with no guarantee of success.  The tension between success in a fabricated situation and success in a genuine situation that allows for failure became more apparent to me as I proceeded through university.  Matt Crawford brings this up in Shop Class As Soulcraft when he refers to the magical thinking conjured up by management to justify their decisions.  Education, like business management, is a social construct and produces what Crawford describes as 'psychedelic' justification for its own existence.  As his quote here suggests, when you're learning experientially in a realistic environment you don't get to say, 'hey! great job!' if you're looking at your dismembered finger laying on the floor; reality doesn't put up with that crap.

As someone who has bounced back and forth between both sides of the education spectrum I can see the value and challenges in both.  What surprises me is how unwilling academic educators are to appreciate the advantages found in the hard-knocks school of experiential learning compared to the complex political dance of the academic classroom.

I know a lot of teachers who get angry with Shaw's pithy little quote about a character who is upset with his writing teacher, but I know a lot of teachers who teach writing who don't do it themselves.  I know a lot of teachers in a number of subjects that don't practice what they teach; it's hard not to see some truth in that statement.

Watching some teachers struggle with the surging availability of information makes me wonder what they'll do when an algorithm is created that does everything they do (I give it ten years).  There will come a time when our learning management systems become sufficiently intuitive and make the learning expert teacher redundant (while simultaneously personalizing education in a dramatic way).

It's a tough thing to be made irrelevant, ask many factory workers.  The teachers who will avoid being replaced by software in this inevitable future are the experiential masters who are guiding learning through doing, yet another reason why I reopened my experiential past and got tech-qualified.  It's too bad that not everyone practices what they teach.



Sunday 21 September 2014

Scripted Lives

I've been mulling this over on the motorcycle side of things, but the idea runs throughout modern digital life, so I'm going to open it up further here.



Being a computer technology teacher I have a passing acquaintance with software.  I'd even say I'm pretty handy with it, but I don't really like where it's going since it has become an integrated part of modern life.

Since we started carrying networked computers around with us we have become scripted creatures.  Our devices wake us up, tell us what we're doing, and how to get where we're going.  They remove doubts and make memory redundant.  We no longer guess at unknown information, or watch media by accident.  We live in a walled garden of playlists and information at our fingertips, surprises seldom happen.  Technology gives us access to information and media, as well as allowing us to communicate, but it changes how we do it; the medium is indeed the message.

When we connect to The Network we are operating within a script, quite literally, all the time.  Software scripts dictate what we see, how we see it, and how we express ourselves. Complex human relationships are being reduced to scripted simplicity dictated by technological limitations rather than the full range of human ability.  This restriction has begun to redefine what people are capable of doing.

I struggle to find non-scripted moments when software isn't dictating my responses.  You'd think this only happens when you make a choice to connect on a device, but it happens constantly in the world of action.  I can't stop my car in heavy snow as quickly because a computer steps in to keep the wheels spinning, even when I'm making a conscious choice to lock them.  Scripts are written for the largest possible population.  We're all being held to the outcomes of average thinking.

As Kenneth Clark states in Civilisation:
35:36: The obvious: "...our increasing reliance on machines. They have really ceased to be tools and have begun to give us directions..."
... and that was his angle on things in 1969.  Things have come a long way since.  Our brave new world of technology is levelling everyone off.  Individual ability doesn't matter when we are all just variables in an equation.

Students experience education, entertainment and interpersonal relationships through a digital lens whose singular intent is that of continued engagement.  When your world is housed within a simplistic digital process designed to constantly get your attention you have a lot of trouble dealing with your irrelevance in the real world.


How can you do that? They say, it's so dangerous, they say.
Fear driven risk reduction is a big part of why the scripted
world exists.  It's thinking pushed by actuarial accountants.
It isn't real if it's designed to be unfailable, if there is no risk.. 
When prompted into unscripted situations where I am asking them to critically analyze a piece of media, students long for a Google search to tell them what to think.  When given a opportunity to express themselves many students will leap into the same template to organize other people's material they copy off the internet.  When given a stochastic engineering problem with no clear, linear resolution they freeze up and long to return to scripted experience.

Technology is such an enabler, but it's also limited by its capabilities.  If friendship is now understood through the lens of social media then it isn't what it once was, it's less with more people.  More isn't necessarily better even though we're told that it is more efficient.  If communication with a student is primarily through screens then teaching isn't what it once was, it's more information with less learning.  Both friendship and teaching pre-date digital communication and have deep, nuanced social histories, but we are happy to simplify them into oblivion for convenience and the illusion of efficiency.

If you ever find yourself struggling against invisible limitations, fighting to express yourself but finding it increasingly difficult, you're up against this reductive technology.  That freedom of choice you feel when you put aside the digital and reclaim your full range of sense and capability is intoxicating.  It supercharges your mind and allows you to retain your humanity.  That I see so few people having those moments is a real cause for concern.


My son and I searching the tidal pools at Pacific Rim National Park on the edge of the world.  Carefully selected technology (a motorbike - so no digital distractions and out in the world) got us there, and then we put it all down and got lost in the world with no scripts telling us how to interact with it.  When was the last time you were unplugged?

This was such a complicated idea it spawned a number of others, including these thoughts of gamification.  The wise Skillen of the internet also shared this article on distraction prevention by a new media professor, which led to thoughts on distraction.

Saturday 21 September 2013

Learning Goals & Success Criteria

Learning Goals & Success Criteria


This past week we had a department heads visioning day.  One of the focuses (from the Ministry through the Board) was a concerted focus on clearly articulating learning goals and success criteria.  This goal/criteria approach has a lot of traction in current educational thinking.  Clearly stating the point of a lesson allows for greater focus for the teacher and greater fairness in instruction for the student.  In the ideal classroom clearly articulated learning goals along with specific criteria that demonstrate success allow everyone to work to a commonly understood end.

Learning goals and success criteria offer a trendy sense of student centered equality and transparency with no chance of nasty teachers changing up goals to suit their own megalomania.  In the process of establishing these learning goals and success criteria, teaching becomes a linear, reductive process that anyone with the right flowchart could follow.

There has been an ongoing attempt to simplify teaching in order to more efficiently (read: cheaply) manage it.  This is often hidden in business terminology like data driven analysis or goal orientated production.  The urge to simplify teaching offers some real financial payoffs.  If teaching is something that can be reduced to piece work we can drastically reduce professional expectations (and what we pay for them).  This cynicism is what I approached this latest PD with.  Do the powers that be want me to do this for the good of my students or for the good of the system?  The two things are often not mutually compatible.

Like many other previous educational fads LG/SC seems to have come from elementary classrooms.  In a grade two class where you need to provide structure around early student learning in order to show them the way this might have a credible place.  With sixteen year olds on the verge of moving beyond the classroom, clearly articulated goals and criteria could as easily obstruct the purpose of the lesson as it does help students.  In complex learning environments the teacher can often use the process of self-directed discovery to empower student learning.  If we are working in a lab on an experiment, clearly articulating the goal and success criteria to get you there reduces the complex process of scientific experimentation to a series of if/then statements.  In a room where experienced students are working with advanced ideas, learning goals seem like a simplistic step backwards.

In the working world you don't often find yourself with clearly articulated goals and criteria.  Workplaces and even post secondary education are complex environments in which self directed learning, organization and initiative are valued more than your ability to follow clearly articulated goals, assuming you're given any goals at all.  Asking high school teachers to focus on this means of 'student success' is like asking capable bicycle riders to put training wheels on in order to not fall over so much.  The intent might be to offer them a greater sense of safety and focus, but the result is a capable rider not being able to test their limits on the bike.

Schools already do a great job of atrophying initiative, creativity, self-direction and differentiation of learning in students.  That a new system hopes to close that off even more is worrying.  Where is there space for initiative, self directed learning or differentiation in classroom focused on listed goals and criteria?  Clearly articulated goals might help those who have no idea why they are in school, but they limit everyone else, especially at a secondary level, and even more so in non-deterministic learning situations.

I teach computer engineering and like many technology classes the students are asked to work in a stochastic, non-deterministic learning process.  As we push learners into more advanced learning situations clear goals become a detriment to their learning, much like any other expectation.  Rather than being able to discover direction through research and experimentation, the goal orientated classroom is barren and linear.  Perhaps it works for academic subjects but it never has in my experience, and the academic teachers it does work for aren't teachers anyone brags about.  If education is about discovery and engagement then ideas like goals and success criteria need to be handled very lightly, not suggested as a school wide success strategy by class room reviewers.

Many of the heads at our meeting weren't interested in picking up another one year fad from the Board, though they didn't articulate why other than simply being tired of them.  For me this latest educational focus raises some fundamental questions about education.  Are we teaching students to learn or are we teaching them curriculum material?  Since those two things often conflict with teach other, it would be good to hear what our overall goal is.  I'm all for learning to learn, and to do that you can't be trying to reduce learning to a flowchart of actions.  Learning is a fantastic and fantastically complicated process, and teaching someone how to do it goes back to the old adage about teaching a person to fish as opposed to giving them a fish.

Learning goals and success criteria fit nicely into the data driven educational management paradigm.  I have a number of concerns about driving education by the numbers.  Data (statistics) might offer some insight, but to drive education policy based upon them seems a cart before the horse approach.  I'd much rather follow a vision than my own tail (the stats from last year).  Following the numbers smacks of the kind of self-justifying business think I and others have railed against.

Teacher Intent


Teacher intent: pure evil? If so,
learning goals can save you from
yourself!
Teacher intent is probably the most important piece of this puzzle.  A teacher who doesn't know what they are doing or is doing it maliciously is the kind of teacher that needs learning goals and success criteria in order to be fair to their students; goals and clearly stated criteria stop that kind of teacher from doing damage.  Anyone teaching from a place that needs learning goals and success criteria in order to be fair to their students shouldn't be teaching.  A powerful learning environment is safe enough that students can be humble without feeling inferior and a teacher can let compassion rather than megalomania direct their ego when they are trusted with that most fragile of vessels, an ignorant human being.

In Ontario we've done everything possible in the past year to damage teacher intent.  From governments to media to political parties to ministry to boards and unions; teacher intent has taken a beating from pretty much everyone.  Into this low place we're delivered the latest silver bullet in education that seems designed to replace teacher intent entirely with data driven, linear, flow chart orientated goal setting.

Is teaching an art or a flowchart?  Is it a complex human endeavor or a business process?  I know many education managers and their financial overlords would like to turn what we do into (data driven) piece work, but that will result in an Americanization of our education system that will cause a plunge in quality much like they have experienced south of the border.  Simplifying education hurts everyone.

Teacher intent is the elephant in every room whenever I hear anyone talk about teaching and learning. Politicians love to take it out and abuse it for their own shabby ends, the general public only remembers their worst experiences in school and belittle teachers for it, and unions refuse to even consider teacher intent because it would call into question the competence of their own members.  Meanwhile, many teachers question it in themselves and in their colleagues.

If your teachers are caring, careful, professionals who approach each lesson with the intention of maximizing their student's potential,  you're going to have a positive learning environment.  Making teachers write that intent on the board won't stop bad teachers from being unfair, and good teachers will find it limiting.  How often have you started a lesson only to have to make an abrupt change because student understanding or mood isn't where you need it?  If you've already written up what you're doing it makes what should be a graceful, responsive changes into an awkward situation in which you've emphasized student ignorance.

The mindset a teacher enters a classroom is pivotal to successful learning in that classroom.  A teacher who is resilient, mentally agile, even handed and humble before their own power is the most powerful thing a student could hope for in learning.  That teacher happily bounces out that door to do extracurriculars, works with colleagues beyond their own classroom and encourages personal growth rather than data collection in their students.  They aren't trapped in myopic data collection, they don't see people as data, they see them as people.  A happy, capable teacher is a wonder.



Rather than frankly examining, understanding and improving teacher intent we get professionally developed toward systematic, process orientated teaching practices that feed data into the education machine.

Students aren't the only bricks in the wall.

Monday 27 July 2015

A Thin & Fragile Pretense

I'm still mulling my way through The World Beyond Your Head, by Matt Crawford.  It's a slow go because I'm re-reading and thinking over what I'm looking at, often paragraph by paragraph.

On page 153-4 Crawford is talking about the way in which we depend on established values when transacting with each other.  He is talking about how he bills his motorcycle repairs, but I found a surprising correlation between this and my current views on grading:


P.153-54 The World Beyond Your Head by Matt Crawford



This could easily be re-written to describe my own battle with grading:

Consider the case of a teacher. In handing a final grade to a student, I make a claim for the value of what they know about what I have taught them, and put it to them in the most direct way possible (a grade). I have to steel myself for this moment; it feels like a confrontation.  (I hate grading, I feel it actively discourages learning by implying there is a definitive end)

 The point of having posted criteria, rubrics, due dates, class rules,  and the use of complex grading systems with byzantine weights and balances, is to create the impression of calculation, and to appeal to the authority of an institution with established rules. But this is a thin and fragile pretense observed by me and my student - in fact the grade I present is never a straightforward account of the skill of a student. It always involves a reflection in which I try to put myself in the shoes of the other and imagine what he might find reasonable.  (Freeing myself from the tyranny of grading programs is both professionally satisfying and existentially terrifying – what are we all doing here if not making numbers?!?)

This lack of straightforwardness in valuing learning is due to the fact that learning is subject to chance and mishap, as well as many diagnostic obscurities. Like medicine, teaching and learning are what Aristotle calls "stochastic" arts. Especially when working on complex skills at the high school level, in trying to teach one discipline (learning how to code), I may unearth problems in another (the student has little grasp of basic logic). How should I grade for work done to solve a problem beyond the realm of what I’m supposed to be teaching? Should I hand off this new problem to spec-ed, or simply blame previous grades and move on? (I do neither, I consider a student who is able to overcome previous failings to catch up to his peers to be superior to a student who is simply going through the motions because this is easy repetition for them)  This question has to be answered when I formulate a grade, and in doing so I find that I compose little justificatory narratives.


When a student receives a grade, I usually go over the reasons with them in detail, and I often find myself delaying the presentation of the grade, because I fear that my valuation isn't justified (I can never have all the facts needed to be completely accurate). But all my fretting about the grade has to get condensed into a simplistic number for the sake of systemic learning on an established schedule (our education system is predicated on the receiving of numbers that are so abstract as to be virtually meaningless). Whatever conversation may ensue, in the end the grade achieves a valuation that is determinate: a certain amount of educational value exchanges hands. As the student leaves the class for the last time, I want to feel that they feel they have gotten a square deal in terms of me not using grades as either a gift or a punishment; I want to come away feeling justified in the claim I made for what I think they know and can do.   (but many teachers don't - empathy and grading can be safely made mutually exclusive thanks to the absolute truth of mathematics, the more complex the calculation, the truer the grade it produces must be)

Tuesday 10 February 2015

Cookie Cutter 'Formal' Exams

We were recently told that our board is moving to a formal exam for every course model. We're told that this needs to happen because if we don't use formal exam days for formal exams, we'll lose the days.  Perhaps we should lose the days.  Formal exams are an echo from the past.  Desperately trying to 'keep' them by forcing them on everyone isn't the best approach to learning, it never was.  Clinging to status quo thinking seldom produces outstanding results in anything.

This conundrum once again has me feeling the friction between academic and technology classrooms.  To the majority of subjects in our school, an exam for every class simply means setting up more desks and running off more photocopies.

One of our auto-shop teachers tried running a 'formal' exam this semester.  He had tinkered with a car and then had students diagnose it.  Since he doesn't have a 24 bay garage, he has to have students approach the car one at a time in order to diagnose it.  Because he is expected to have all students in the room at the same time (exams are blocked into two hour scheduled time periods, one per day), he had students come up one at a time to diagnose and resolve the problems while the rest wrote written tests that  did not reflect how students had learned in his class during the semester.


Cookie cutter exam schedules for cookie cutter learners.

The formal exam structure didn't work at all in the shop.  The first kid up shouted out, "do you want me to change out this fuse?" and suddenly everyone in the room knew an answer.  It then kept happening.  When you've been teaching students to collaborate on diagnostics all semester, why would you suddenly have a summative that demands they don't?  Even if that's what a 'formal' exam is?

All that effort to create a genuine assessment within a standardized exam structure was wasted, but that doesn't stop us from being expected to bring meaningful assessment to all our technology students in this cookie cutter final exam format.  How meaningful can this two hour window be when our courses are tactile, stochastic and experiential?  In a class where there is a linear progression from question to answer, and were the skills are assessed on paper this works a treat, but not in tech.

Coop avoids the exam problem by creating individual summatives (each student has an interview).  Of course this means that each teacher is handling 25+ hours of assessment for each class they teach.  I'm surprised that they can stuff all that meaningful assessment into a single exam week.  While this resolves the problem of trying to fit individualized exams into cookie cutter academic schedules, it doesn't address the complexity of creating an entire class set of experiential problems of equal complexity (you couldn't have the same problem because the first student out would happily tell the rest what they are about to face).  Creating individualized, immersive simulation for each student might be the ultimate in summatives, but a factory styled school system isn't remotely designed to produce that kind of individualized learning opportunity.
Is this what an exam for every course looks like?  Kinda like
the floor of a very serious factory, or a university...

Would I like to create a 'formal' exam that offers my computer students real-world, immersive, experiential computer technology problem solving?  You bet, but expecting me to do that in a two hour window for dozens of students at a time suggests that the actual goal here isn't meaningful and genuine so much as generic and formulaic, like most 'formal' exams.

'Formal' exam is code for a university-styled, written, academic assessment.  It typically involves lots of photocopying and students sitting in rows writing answers to the same questions.  The teacher then spends a lot of time trying to assign value to this dimensionless form of assessment.  Like many other aspects of high school, formal exams are high school teachers imitating the university professors they wished they could be.


For hundreds of thousands of dollars with corporate sponsorship
 and post-secondary support, Skills Ontario championships
create meaningful, experiential tech-assessment.
If you're looking for an example of an immersive, complex, skills based assessment, we have a fantastic home-grown example.  Skills Canada does a great job of creating experiential assessment of technology knowledge and tactile abilities, but with million dollar budgets and support from all levels of government, private business and post secondary education, they exist in a different world from my classroom.  They're also catering to the top 1% of 1% of technology students.  I have to cater to the other 99.9% with nothing like that kind of budget.

I've been mulling over how I'm supposed to create meaningful assessment for my technology students in that two hour time slot and I'm stumped.  No budget is forthcoming to purchase equipment and tools so that I can have every student doing the same thing at the same time - I don't even have enough screwdrivers for all students to be building computers at the same time, let alone the computer parts needed to build them.  Those would be computer parts that some students would not ground themselves properly when installing.  Funding wouldn't just need to be there for tools, it would also have to be there to replace breakage due to incompetence.

Technology teachers already struggle trying to explain technology costs to academics with only a vague understanding and little experience in apprenticeship and the trades.  When students are heavy handed or absent minded it costs us money to replace what they break, yet we struggle to get funded on par with academic courses that do most of their work on paper.

Now we face the prospect of being forced to reduce our tactile, experiential, immersive learning into cookie cutter summatives that jive with the pre-existing academic scheduling.  Just when you think we might be evolving beyond the 20th Century factory model of education it rears its ugly head and demands reductionist assessment for all.  Wouldn't it be nice if we were looking to diversify summatives instead of cramming them all into the same schedule that existed fifty years ago?

Sunday 27 September 2020

Unmasking The Truth

I've been teaching the engineering design process for the past two weeks to grade 9s in very difficult circumstances.  The engineering process underlies all the work we do in our stochastic, tactile technology/engineering program.  We aren't rote learning to the same standardized answer, so blind obedience to processes won't get us working results. We need to be organized, agile and able to step back and gain perspective in our non-linear problem solving circumstances like any good technician or engineer would when solving a complex, arbitrary problem.

I'm struggling with the half-baked safety plan we seem determined to follow at all costs.  Rather than get more frustrated with the optics, politics and bureaucracy that drive it, I thought, "why not apply the engineering process to my intolerable situation?"  

 

ENGINEERING DESIGN: COVID MASKS

  •  ASK:how do we resolve physically untenable policies around masks?
  • IMAGINE: a Heath Unit/Canada COVID19 compliant masking system that is effective and comfortable (if it isn't comfortable it isn't effective)
  • PLAN: collect data, research how COVID actually works, find existing solutions to best mitigate its spread
  • CREATE: build a testing system, create a solution based process
  • EXPERIMENT:  try different mask types and materials
  • IMPROVE: deliver an improved masking policy that is constantly in review

 

PLANNING:  DATA COLLECTION

It was a 15°C day today, it's still tropical in the mask.
It got up to 30°C/70% humidity in our it-has-never-worked-properly incorrectly ventilated classroom on Friday, which equates to a humidex temperature feeling like 41°C (that's 106°F if you're old school). I was rotating grade 9s outside to demask and breathe. It's hard to learn when you're seeing spots and can't think straight... during a pandemic.

We were building circuits with Arduinos so I built a temperature/humidity sensor, which is how we captured data. Just for giggles I put the sensor on longer wires and put it up inside my mask while I was instructing. Curious about the results?

Inside the too small and tight, restrictive masks we're required to wear all day every day at school the temperature is 4-5 degrees warmer than the outside air. I was getting readings of 33-35°C inside the mask depending on whether I was breathing in or out. But what gets you is the humidity. Inside the mask it was ranging between 92-97% humidity. Run that through the Canadian Humidex calculator and I'm stewing in what feels like 54°C all day, every day.

If I were in a climate controlled environment like the medical people who wear masks are this would probably be much more manageable, but I'm not.

CONCLUSION:  the small, restrictive medical grade ASTM Level 1 masks we're required to wear might work in a well ventilated hospital, but they don't work in schools where climate control is a distant dream.  When temperatures rise medical grade masks quickly become a liability more than a protection.
 
 
PLANNING:  ASTM Level 1 Mask RESEARCH:
 
WHERE & WHY ASTM1 MASKS WORK:  If you're a medical professional working in a dentist, doctor's office or hospital you're working in a climate controlled environment that must follow strict guidelines.  In that context ASTM1 masks work effectively because the environment is supporting mask use rather than fighting it.
 
In an uncontrolled environment medical masks are restrictive and can cause discomfort which makes them a liability because people start fidgeting with them.
 
Staff struggling in uncontrolled climates (ie: most classrooms) resolve their breathing difficulties by breaking many of the rules for safe mask use:
 
I regularly see staff having to move restrictive medical grade masks around or wearing them with gaps or incorrectly just to get a breath.  Wearing a medical grade mask incorrectly is less safe than wearing a properly fitted non-medical grade mask correctly.  Discomfort from an improperly mandated masking policy drives this misuse.

PLANNING/RESEARCH: WHEN TO USE ASTM1 MEDICAL MASKS

ASTM1 surgical masks, such as are being provided to teachers, are medical usage masks that work in concert with a variety of other PPE options that teachers haven't been provided with.  This video gives you an example of how medically focused these masks are:


What do ASTM1 medical masks do that a more comfortable, properly fitted non-medical option doesn't?  Not much in the context of a classroom.  In a medical environment where a professional is working with COVID19 positive patients, a medical mask would be used in conjunction with a face shield to keep the medical worker safe in a known high risk situation.
 
"Medical masks are designed to protect against large droplets, splashes or sprays of bodily fluid or other type of fluid." (Health News Hub.org).  In a medical context these masks provide a valuable level of protection, but an ASTM1 mask by itself isn't a better barrier to COVID transmission, especially when worn incorrectly.
 
"It’s unlikely you’ll be infected in public by airborne viral particles. The real threat is touching an infected surface and then putting your hand to your face: Frequent hand-washing is a sure way to avoid COVID-19"  (Health News Hub.org)  A focus on cleaning surfaces and regular hand-washing would be far more effective than the false protection of a single layer of PPE/incorrectly applied medical mask.
 
Smaller class sizes, reduced bus loads and more frequent spot cleaning is a far more effective barrier to COVID19 transmission than stipulating a medical grade mask with no other PPE, but it does provide the appearance of greater diligence without the effectiveness and makes uneducated jumpy people think things are being handled diligently.
 
ASTM1 mask compliance in non-medical settings also puts Ontario's public education systems at odds with the public health unit and Health Canada masking stipulations: "Due to critical shortages during the COVID-19 response, we are implementing and/or proposing a range of strategies to respond to the increased demand for medical masks"  Bins full of them outside every public school in Ontario every day isn't helping to solve this world-wide shortage, especially when it's done for optics rather than efficacy.
 
There are numerous well researched sources of information on mask usage this far into the COVID19 pandemic.  Its modes of transmission are known and technology is on hand to mitigate them, yet myths persist, like the idea that a medical mask is somehow a cure-all and significantly 'safer' than a correctly fitted cloth mask.  Every health agency in the world wouldn't be advocating non-medical masks if they didn't work.
 
 
PLANNING: RESEARCH: THE LIMITATIONS OF MASK ONLY PPE

"The coronavirus can spread through eyes, just as it can through nose and mouth" (American Academy of Ophthalmology) so demanding medical grade nose and throat protection while requiring no eye protection is wildly inconsistent and dangerously disingenuous.  The droplets that a properly sized and fitted cloth mask would stop and that an ATSM1 medical mask is designed to specifically stop 95% of would happen in a situation when a COVID19 positive person coughed or sneezed in your face without wearing a mask themselves, but with no eye protection you're going to contract it anyway.  Rather than pretending to act from a sense of greater protection, more logical and consistent masking policies from the provincial government would not only make educational staff more comfortable but also less likely to contract the virus.
 
The appearance of medical safety, without the efficacy..
That educational staff are being required to wear poorly fitted and environmentally damaging ATSM1 medical masks at a time when they are vitally needed by people who would be wearing them with a complete set of PPE in an appropriately controlled environment is problematic.  The education system seems incapable of understanding or providing a masking solution that aligns with masking requirements everywhere else.  We need to stop acting like this is a marketing gimmick and start acting like it's a medical emergency.


PLANNING: RESEARCH:  LACK OF CLARITY AROUND EFFECTIVE MASK USE
 
All medical mask directions stress a smooth seal with your face to ensure effectiveness, but another wildly inconsistent piece of Ontario education's approach to mask adoption is demanding ATSM1 medically compliant masks with no direction around facial hair.  A beard or moustache that prevents a seal around the nose and mouth makes the mask all but useless, but there has been zero direction on the mandatory removal of facial hair.  The CDC as well as other health groups have made suggestions on facial hair that allows for a proper mask fit, which is a challenge.  CBC's piece on it suggests a larger cloth mask would actually be more effective than smaller medical grade mask that won't cover the beard. Another piece suggests COVID19 droplets spat onto your beard from a virus carrier can live for hours, but wear an ATSM1 mask incorrectly and the powers that be are happy.  The only conclusion that can be drawn is that ATSM1 mask usage by Ontario educators is a marketing move and not a medically viable choice.  That so many teachers seem to be buying into it is astonishing.
 
You'll find a lot of panicky accusations saying this is a conspiracy theory from early in COVID19, but it should be fairly obvious that a beard would prevent a 'tight seal' as required in any surgical mask directions.CDC has always recommended shaving for medical professionals wearing medical grade gear.

 
CONCLUSION:
 
It appears Ontario public education is using ASTM1 level masks to produce a sense of false protection in the education system.  By ignoring the more difficult and expensive medically proven ways of preventing COVID19 spread, such as resolving decades long HVAC issues in schools and not providing the full range of PPE required to provide medical levels of protection, Ontario's pick-and-choose safety approach with an emphasis on medical mask use without any other criteria is both ineffective and misleading.

CREATE/EXPERIMENT/IMPROVE: FINDING A MORE EFFECTIVE MASKING SOLUTION

For staff with breathing and size issues the Chinese manufactured disposable ATSM1 masks are all but ineffective.  A policy that allows for public health/Health Canada compliant masks would not only produce staff in less physical distress, but also provide greater safety for everyone at this difficult time.
 
SPECIFIC REQUIREMENTS FOR MASKS:
  1.  Must fit the wearer's face (current one size fits all masks do not fit all user faces)
  2. Masks must be comfortable enough for 150 minute continuous usage scenarios
  3. Masks must be breathable enough that users aren't constantly pulling them away to breathe
EXPERIMENT:

Purchase a variety of mask types and sizes and experiment with them to find effective fit and duration results.  In a  medical situation professionals choose a mask from a selection of sizes and types.  They aren't all handed the same sized and shaped mask as educators have been.  By experimenting with appropriate fit and breath-ability options a more effective masking solution would reveal itself.  None of this happened in preparing for the new school year.  This doesn't appear to be happening now either.


IMPROVE:  COVID19 IS STILL BEING UNDERSTOOD SO RESPONSIVE CHANGE SHOULD BE BUILT INTO ANY PLAN
 
With COVID19's transmission still under review by major players like the CDC, the safest route would have been to provide remote learning for the majority of families so that social isolation bubbles could persist.  Schools should have only been opened up to students in need or for specific classes that require face to face instruction.

A more cautious and medically researched approach to this school year would have prevented the current increases in cases, but the provincial government picked what it liked in terms of medical advice and ignored the rest, while using medical mask usage to whitewash any questions of efficacy.
 
The latest data suggests that droplet transmission happens when people are in close proximity to one another.  In this scenario it is much more important that staff and students have properly fitted, comfortable masks than it is to have a splash ready ATSM1 medical grade mask.

Beyond a metre the droplets tend to fall out of the air, though this is in question too.  If airborne transmission can happen from infected droplets that hang in the air for hours, the only logical choice would be to shut down face to face schooling again as a single infected person in any school would be spreading COVID19 indiscriminately anywhere they travel whenever they remove or incorrectly wear their mask.  Even a properly fitted mask is up to 95% efficient so COVID19 transmission would occur anyway with enough exposure.

Following WHO's current understanding that COVID19 is most easily spread in close quarters, it's vitally important that staff and students have comfortable, properly fitted masks that they aren't constantly touching and making ineffective.

IMPROVE: A FLEXIBLE, MEDICALLY DRIVEN MASK POLICY FOR ONTARIO SCHOOLS

By experimenting with a variety of sizes and types of masks Ontario education could create a more effective masking policy that better protects its staff and students.
 
By closely following medical research on transmission and management, Ontario education could provide timely updates to its masking and PPE policies that keep people safe.

Larger, systemic issues like poor classroom ventilation and class sizes will have far more efficacy than a simplistic and misleading one-size-doesn't-fit-all masking policy.  Some boards (mine included) have taken steps to reduce class sizes but in some cases the Ministry intervened and prevented boards from creating smaller class sizes.  In our case the cohorted solution to class sizes has downloaded all of the effort in making it work on classroom teachers which is creating marathon sessions of face to face classes while teachers are simultaneously expected to manage the other half of the class online.  This is twice the preparation and work along with the impossible expectations of being in two places at once - all day, every day.  Doing this while wearing an ill-fitting mask with breath-ability issues in a poorly ventilated classroom is a combination that will hurt many employees.  Rather than enforcing a misleading, half-finished medical masking policy, a focus on these other urgent matters would produce better outcomes for all involved.

NOTES & LINKS:

Advice on the use of masks in the context of COVID-19:  https://www.who.int/publications/i/item/advice-on-the-use-of-masks-in-the-community-during-home-care-and-in-healthcare-settings-in-the-context-of-the-novel-coronavirus-(2019-ncov)-outbreak

https://news.lvhn.org/fact-or-myth-facial-hair-and-covid-19/

https://nymag.com/strategist/article/face-masks-for-beards.html 
"Dr. Sten Vermund, infectious-disease epidemiologist and dean of the Yale School of Public Health, he told us he trimmed his own facial hair down “so that the mask could completely cover my beard.” The key, he added, is to make sure there are no gaps and that the mask is hugging your skin, not your facial hair." 
https://virologydownunder.com/flight-of-the-aerosol/

A well written article by a pile of doctors that explains how viral transmission happens.  An airborne virus is a terrible thing.  Whether or not COVID19 is airborne is still in contention, but the latest from CDC suggests it is

https://www.scientificamerican.com/article/how-coronavirus-spreads-through-the-air-what-we-know-so-far1/

"Currently, WHO guidance considers surgical masks to be adequately protective for healthcare staffers working with potential COVID-19 patients, and advises using N95 masks in limited situations, such as when intubating patients, which is known to generate small particles from deep in the lungs. Healthcare workers who follow these recommendations have been generally protected against the virus, WHO notes."

Medical masks for medical work...

 

https://healthnewshub.org/cloth-mask-vs-surgical-mask-vs-n95-how-effective-is-each/

"A dual-layered cloth mask is sufficient to protect people in public settings. It’s unlikely you’ll be infected in public by airborne viral particles. The real threat is touching an infected surface and then putting your hand to your face: Frequent hand-washing is a sure way to avoid COVID-19"

"medical masks protect people from the wearer’s respiratory emissions. But it’s designed to protect against large droplets, splashes or sprays of bodily fluid or other type of fluid."
 
"The challenge before many healthcare workers in combatting the disease would be a daunting task unless proper administrative, clinical, and physical measures are taken within the healthcare settings"
- wouldn't hurt if educational administration followed proper measures too...