{"id":3594,"date":"2013-08-31T01:12:00","date_gmt":"2013-08-31T00:12:00","guid":{"rendered":"https:\/\/www.diaryofanadi.co.uk\/?p=3594"},"modified":"2023-04-08T14:09:03","modified_gmt":"2023-04-08T13:09:03","slug":"driving-test-results-rigged","status":"publish","type":"post","link":"https:\/\/diaryofanadi.co.uk\/?p=3594","title":{"rendered":"Driving Test Results Rigged?"},"content":{"rendered":"\n<p><strong>UPDATED<\/strong><\/p>\n\n\n\n<p>I&#8217;ve updated this article, which was originally written 3 years ago (September 2010). The subject is going through one of its periodic revivals among the ignorati across various web forums.<img decoding=\"async\" style=\"--smush-placeholder-width: 700px; --smush-placeholder-aspect-ratio: 700\/358;background-image: none; float: left; padding-top: 0px; padding-left: 0px; margin: 5px 10px 5px 0px; display: inline; padding-right: 0px; border-width: 0px;\" title=\"The sack\" data-src=\"https:\/\/www.diaryofanadi.co.uk\/wp-content\/uploads\/2015\/01\/the_sack.jpg\" alt=\"The sack\" width=\"700\" height=\"358\" align=\"left\" border=\"0\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/p>\n\n\n\n<p>At the time I wrote the original, there was a story doing the rounds on these forums concerning someone who called himself Jim Kerr. He claimed he had been an examiner for 23 years, and he said:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>I HAVE JUST BEEN SACKED BY THE D.S.A.. WHY? I HEAR YOU ASK.<\/p>\n\n\n\n<p>BECAUSE, ACCORDING TO D.S.A.&#8217;S NEW &#8220;CHI&#8221; SYSTEM OF COLLECTING PASS RATES FOR EXAMINERS AT EACH TEST CENTRE, MY PASS RATE WAS HIGHER THAN THE OTHER EXAMINERS AT [named test centre] AND SO I MUST BE DOING IT WRONG.<\/p>\n<\/blockquote>\n\n\n\n<p>There was much more, but that was the essence of his letter. Apparently, he\u2019d put it into leaflet form and was handing it to people turning up for their tests outside the test centre he\u2019d been sacked from. This act alone said a lot about the kind of person he must have been, and about the kind of person his employer had to put up with.<\/p>\n\n\n\n<p>Anyway, when the story broke there was the deafening sound of several thousand colostomy bags all popping at the same time as ADIs logged on to the internet for their weekly surf and saw the story! You see, many in this industry sincerely believe that driving tests are rigged, and a story like this is guaranteed to get them hyperventilating. But let&#8217;s just do a reality check for a moment.<\/p>\n\n\n\n<p>No company the size of the DSA (now known as DVSA) sacks someone on the spot for the sort of thing Kerr was claiming. They know bloody well that people like Kerr are \u201cunion\u201d through and through, and they will only act if they\u2019ve jumped through all the right hoops \u2013 or if they are sure of gross misconduct having been committed. What usually happens in a situation like the one Kerr is claiming is that retraining is given first of all. If that fails there will be further retraining. If that also fails then you\u2019re into verbal warnings, written warnings, and final warnings. If there are still issues once all that has been done then dismissal is likely to follow. Companies who want to dismiss staff need a cast iron case and \u2013 except in the case of gross misconduct \u2013 a properly constructed paper trail.<\/p>\n\n\n\n<p>Judging from the geographic location of the test centre in question, I&#8217;d be very surprised if Kerr <strong>hadn\u2019t<\/strong> been in the union \u2013 and even if he wasn\u2019t, if his claims came even close to being true he\u2019d have been awarded a knighthood for wrongful dismissal at any tribunal! He certainly didn\u2019t need to behave like a complete arsehole and picket the test centre to get justice.<\/p>\n\n\n\n<p>In other words: there was probably something Kerr wasn\u2019t telling us about his dismissal (<a title=\"Driving Test Results Rigged? An Update\" href=\"https:\/\/www.diaryofanadi.co.uk\/?p=3642\" target=\"_blank\" rel=\"noopener\">see the original update to this story for confirmation<\/a>).<img decoding=\"async\" style=\"--smush-placeholder-width: 700px; --smush-placeholder-aspect-ratio: 700\/405;background-image: none; float: left; padding-top: 0px; padding-left: 0px; margin: 5px 10px 5px 0px; display: inline; padding-right: 0px; border-width: 0px;\" title=\"No cheating sign\" data-src=\"https:\/\/www.diaryofanadi.co.uk\/wp-content\/uploads\/2015\/01\/no_cheating.jpg\" alt=\"No cheating sign\" width=\"700\" height=\"405\" align=\"left\" border=\"0\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\"><\/p>\n\n\n\n<p>But what about his claims? Is there any truth in them? Well, when I qualified my supervising examiner (also a test centre manager) told me this:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>You&#8217;ll hear a lot of stories about quotas. They aren&#8217;t true.<\/p>\n\n\n\n<p>What I do is monitor all my examiners, and if one of them has a significantly higher or lower variance than the rest I look into it. If we identify a problem then this is dealt with.<\/p>\n<\/blockquote>\n\n\n\n<p>I am a scientist by training, and I understand maths and statistics. What my supervising examiner told me can therefore be summarised as follows (note that in this updated version I refer to a variance of 5% instead of the 10% that was being used at the time I wrote the original article):<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>over a period of time, with hundreds of tests conducted, you would expect every examiner to have <strong>roughly <\/strong>the same pass rate, give or take a few percent variance<\/li>\n\n\n\n<li>the national average pass rate is around 45%, so over time you would expect the average pass rate for each individual examiner to be around the same figure, plus or minus a variance<\/li>\n\n\n\n<li>if one examiner had a pass rate of say 40% and another had 45%, then it wouldn&#8217;t matter because they both fall within an acceptable band either side of the mean (i.e. \u00b15% variance)<\/li>\n\n\n\n<li>if one examiner had a pass rate of, say, 20% or 60%, or if their variance was always skewed high or low, then this would point to a possible problem with the way they were conducting tests<\/li>\n\n\n\n<li>if the anomalous pass rate continued across several monitoring periods of, say, 3 months each, then a genuine issue with the examiner\u2019s test performance would be confirmed<\/li>\n<\/ul>\n\n\n\n<p>Most people don&#8217;t understand maths and statistics, and they cannot accept that a single examiner consistently having a grossly different pass rate to everyone else proves that there is a problem with that examiner. Kerr appears to be one of these ignorant people, believing his distorted understanding to be some sort of epiphany. As I say, I\u2019ve known what happens since I qualified as an instructor and it is no big deal.<\/p>\n\n\n\n<p>Kerr obviously couldn\u2019t understand that his higher pass rate pointed to him doing his job differently to everyone else. <a title=\"Update to the rigged test story\" href=\"https:\/\/www.diaryofanadi.co.uk\/?p=3642\" target=\"_blank\" rel=\"noopener\">The update to this story<\/a> shows clearly that Kerr was being a little creative with the truth, and that he had been spoken to on several occasions. He simply refused to change, believing that he &#8211; as a minority of one &#8211; was right, and that all the other examiners out there were wrong.<\/p>\n\n\n\n<p>There is one aspect of the system the DSA uses which has always worried me, though &#8211; and it isn&#8217;t the DSA&#8217;s fault. Not directly, anyway. Imagine this perfect world scenario:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>over a typical monitoring period, an examiner has a pass rate of 60% &#8211; a variance of 15% above the average for his test centre<\/li>\n\n\n\n<li>this is flagged to the examiner by his line manager, but over the next monitoring period nothing changes<\/li>\n\n\n\n<li>the DSA uses its internal procedure to re-train the examiner, as he is clearly passing some candidates who ought to be failing (obviously, the situation would be the same if the examiner\u2019s pass rate was 15% below the average for the test centre, and he was failing people who ought to be passing)<\/li>\n\n\n\n<li>That last part is totally beyond the comprehension of many ADIs (and examiners like Kerr). However, it is absolutely correct and proper: if the pass rate for the test centre in question is 45%, and if everyone else is passing\/failing at around the same rate (\u00b15% variance), then <strong>someone who is consistently passing\/failing at a much higher\/lower rate must doing their job wrong<\/strong>. It\u2019s a simple fact.Now imagine a <strong>real<\/strong> world scenario to see where the trouble potentially starts:<\/li>\n\n\n\n<li>over a monitoring period, an examiner has a pass rate of 60% &#8211; a variance of 15% above the average<\/li>\n\n\n\n<li>this is flagged to the examiner by his line manager<\/li>\n\n\n\n<li>the examiner fears losing his job and decides to take matters into his own hands<\/li>\n\n\n\n<li>the examiner keeps a tally of his passes and fails, and randomly fails a few people for minor (driver) faults if he needs to bring his variance down to acceptable levels (i.e. within the \u00b15% acceptable variance)<\/li>\n<\/ul>\n\n\n\n<p>There is absolutely <strong>no way<\/strong> that this isn\u2019t happening somewhere out there. However, the issue is <strong>not<\/strong> that it is happening \u2013 but rather that there is <strong>no way to stop it.<\/strong> No matter what system the DSA used it would still happen in one form or another between unscrupulous examiners eager to conceal their own incompetence. Ironically, if they did their jobs properly in the first place there\u2019d be no problem for them to try and hide, and they\u2019d all be within the \u00b15% variance. In spite of all that, it is vital to understand that those examiners fiddling their results are in a tiny minority, and this in no way supports claims of \u201cquotas\u201d or fixed results from ADIs and disgruntled learners. Of all the many hundreds of tests my own pupils have sat, there are perhaps just two that sound a little fishy \u2013 and since I do not sit in on most tests I am only going on what the pupil has told me. There is no way that the examiners in Nottingham are unique in their overall consistency, and people like Kerr are the exception rather than the rule.<\/p>\n\n\n\n<p>But back to Kerr\u2019s claims. As you can imagine, this Revelation in The Gospel According To Jim Kerr is Manna From Heaven for some ADIs. One one forum alone someone opines:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>I guess the reason the DSA doesnt [sic] want the contents of the leaflet published is that, they dont [sic] want us to know about their &#8216;variances&#8217; or the new &#8220;chi&#8221; sytem [sic] of making sure the DE&#8217;s have to work within a certain amount of passes\/fails, and how the DE&#8217;s have to comply with them. Although many ADI&#8217;s have known about it for a long time.<\/p>\n<\/blockquote>\n\n\n\n<p>It&#8217;s hard to get this many contradictions and misunderstandings into two sentences&#8230; unless you&#8217;re so excited your fingers and brain are not in proper sync!<\/p>\n\n\n\n<p>A variance is <strong>something that happens<\/strong> &#8211; not something you apply. If the DSA has decided that a variance of greater than \u00b15% indicates a problem, then that is the system being used as a quality control check. As I have already explained, if the variance is consistently outside \u00b15% then <strong>there is a definite problem<\/strong>. They can call their system whatever they like: Harriet, Tarquin&#8230; or chi. The name doesn&#8217;t alter what it is.<\/p>\n\n\n\n<p><strong>Do driving examiners fail people deliberately?<\/strong><\/p>\n\n\n\n<p>The short answer is <strong>NO<\/strong>. They do not. They are not told to fail people as part of any quota, and this applies to the vast majority of examiners throughout the UK. However, there are corrupt people in all walks of life, and as I explained above, it is possible that some examiners \u2013 a tiny percentage \u2013 will attempt fiddle their pass rates in order to avoid being \u201ctold off\u201d by their managers.<\/p>\n\n\n\n<p><strong>What is the 5% variance that examiners have to keep to?<\/strong><\/p>\n\n\n\n<p>There isn\u2019t one. The \u00b15% variance is something that is measured \u2013 not applied. Examiners are not told to \u201ckeep\u201d to anything, though they are expected to perform within certain limits as a quality control measure. If any examiner is misinterpreting this and deliberately fixing their results, then they are simply being dishonest.<\/p>\n\n\n\n<p><strong>Are examiners told to keep their pass rates within \u00b15%?<\/strong><\/p>\n\n\n\n<p>No. That \u00b15% is a range within which each examiner\u2019s pass rate is expected to fall, and if they\u2019re doing their job properly in the first place then their pass rate <strong>will<\/strong> fall within that range. If an examiner\u2019s pass rate consistently falls outside of the \u00b15% range then the DSA has internal systems which it uses&nbsp; to apply retraining because that examiner is not performing to an acceptable standard. Retraining is a minor issue, but less informed examiners might see it as a threat to their job security and therefore they might attempt to force the pass rate. This would be entirely the decision of the individual examiner. It is not a DSA policy.<\/p>\n\n\n\n<p><strong>Do quotas exist?<\/strong><\/p>\n\n\n\n<p>No. The idea of quotas is promulgated mainly by poorly educated ADIs and learners anxious to defend their poor performances on test.<\/p>\n\n\n\n<p><strong>What is the best day of the week to take your driving test?<\/strong><\/p>\n\n\n\n<p>There isn\u2019t one as such. If you can drive, it doesn\u2019t matter if you take your test on Monday morning or Friday afternoon. The idea that by Friday all the quota has been \u201cused up\u201d is nonsense. I\u2019ve had lots of passes on Friday afternoons \u2013 just as I have on all other days.<\/p>\n\n\n\n <script data-jetpack-boost=\"ignore\" async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-4532794719633406\"\r\n     crossorigin=\"anonymous\"><\/script>\n","protected":false},"excerpt":{"rendered":"<p>UPDATED I&#8217;ve updated this article, which was originally written 3 years ago (September 2010). The subject is going through one of its periodic revivals among the ignorati across various web forums. At the time I wrote the original, there was a story doing the rounds on these forums concerning someone who called himself Jim Kerr. [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[80,81,85],"tags":[],"class_list":["post-3594","post","type-post","status-publish","format-standard","hentry","category-adi-related","category-driving-test-related","category-dsa-related"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3594","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3594"}],"version-history":[{"count":0,"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3594\/revisions"}],"wp:attachment":[{"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3594"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3594"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/diaryofanadi.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3594"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}