tag:blogger.com,1999:blog-30543007470933485422018-03-15T08:37:59.026-04:00Venting My CynicismEllis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.comBlogger25125tag:blogger.com,1999:blog-3054300747093348542.post-5698067550900874262017-07-17T23:05:00.002-04:002017-07-20T22:41:19.776-04:00Public Education's PR Problem (and more spurious "research")So I finally found an article linking to that old statement I made that teachers make very little impact on test scores (~10%).&nbsp; <a href="https://www.theatlantic.com/education/archive/2017/07/the-education-perception-gap/533898/">The Atlantic article itself</a> is great and highlights the PR/perception (and lack of leadership...) issues facing American public education.&nbsp; This has been long known; the late Dr. Gerald Bracey <a href="http://www.huffingtonpost.com/gerald-bracey/the-evolution-of-the-scho_b_48464.html">wrote about it in 2010</a> and touched on using the bad perception as a "scare tactic" <a href="http://www.washingtonpost.com/wp-dyn/content/article/2007/05/02/AR2007050202004.html">back in 2007</a>.<br /><br /><br />...<br /><br /><br /><br />But back to that 10% figure--why so much emphasis on time-consuming (thus expensive) teacher evaluation models for a small gain of a small percent?&nbsp; That gave rise for me to once again <a href="http://www.marzanocenter.com/MCTeacherEval_VAM%2020160328.pdf">look to my favorite evaluation system</a> and the evidence supporting it.&nbsp; I found this statement and things immediately went off the rails:<br /><br /><img alt="" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAbgAAAGxCAIAAACfpzQsAAAgAElEQVR4nOy93VMbx7oufv4ZX/kiF6dys9bNqlqVXaf23lW7Vi52rTlTqhmVpA2yMcb6YcwCG4wDC4wMGBTAYGwZO5JtsHEQHwISo9g4YgUrIcoRdhbxkXCWN4t9ospHcY4zGgH9u+jumZ7vGfHlZPVTurCFNNP99tvPdL9v633+G6CgoKCgMMV/O+wGUFBQULzpoERJQUFBYQFKlBQUFBQWoERJQUFBYQEDovw5v73xinztbIoH27CDwM4Pr5Td3Nj5FfZSjZ2fXzv4tOQJ3/1k+Bnxpx3Lz+hc+fWOg09LeL3zcylfe9NRojUcXN/6M+I/gPeXCgOiXDpbCB5RvzreLtzqKK45mWZvNoqjmj4GjxS6/0WcmN7+Fc7Gx2LfbwrBI4XRhw6+9NOU2AFHP1A0oMGdZACZLv6VnUtuxd4pdB0pBM8Wpbd+zm//YOVXX1wqhN4qBI+IS3bbboHNjTfh8a9jjf24y8R5o+HD+Eq8P7K9n234RcMJUaLXb8Xk3w62kfsFfaKEr1CguH7Y7dtjPBRh1xwRJRC3HrwNbSLOv9T7wMtiGBrNVfxPW1fEZsfUkIuIXUcKwbfEh381+xr2yT0hyp1Uc6HjSKHjd2Lqxz243C6gtsa+YL140+IxtrN0ttBxfl/J+hcNK6Kc+gzuvLa+fCBGfoeXlh6bU+INB/bRfxO/glvvzNZCv9h7FHXz5q/sAVsaUQLw135kkCv9WyZ/vT1lc/Oooobtj/+IrnB92Mzge0qUxft4lO9/sgeX201LDoIoPxE7zPYEAPxVvHqkEHxXzO1jI37RsCLKOfIhL27Nvove/zh7IM1zjr/eE8PvFEJv2ZlO2EeV/iE+E6/C9/9Y/Ha/mnkYKJUo5TXj22Ja9Sdpvfm2uGx3G6umhu+fiFffKnS9Ky7nzb5WKlFuPTop9r1T6FIy0YsRsfdoobei+OLAdt9fFaNsoe83KvsfBFG+GLKIjSz/Gdn2L4cfi3gz4YgoCYs7nmwHBSfTSZ8oAdia/bc9XLy8MSiZKIko5IMnij9IEUzdxaYBSqSGUonyQJZsdqBv/wNo3s6Tkzj+flZvUSk9CI8UJpf3rRW/bDgkyuc96P0PFzXfeQ1Tn5ZJyZ0fTHLo4s53Bkn2zY3tjVfbG3m8v4O3yxPbvdc7G6+2F6rRdFqwTmQbEuXk7w0WUFKG1/iy4k875tlz2BHzBDH8jJzfeL0j/VttBwA28zq3E3/aURgH6EzUzQ275xnEJ2K3Tkpn+xNPIXikEDwqPlEvBuGJAvni4k/Sv9XUIP60s/ppcb5PTOlEheXrmBAlGhS5vzs/5HcAStkX78DbVRfJ1PzP+e2VRHHuUhE5OHI82eYw3W+SYoIfkMdR3PnBcEx3fni1vfEA2f/OA/IkiY41bJ0xcHBCA/uz3owG8nLSLNxkZGH5T8TER2ONTarzyqujNA4cXjvxVbBLRI7giCjzxdHfoomRJELgYq444St0SZmQo4VrzcW/qYZR3P4qKoZ/Iw9J128Kt94r5uSLb83XFbqPyh/oPyVm5Om3Pfcu8idxY2vulHw7ecuGiUDxMgu76BPl9w/FkF6e9/unxdF/L3RIV36rcPv61vfEB/42K157m0gHseLcE9LtdjJRxQe6/kmce6oa7521acVnpBdmN9kO0GJdyvb//E1xwkeY8WihlxU/Wtwh7TP6UNnUo4XIyJbVrMP3JVM6eCXS/Wfi6+L2V9fF/rd0uoB9SZPMua7nbK+3F5vFEHGdjqM6RPnzN8UxclCk19kiMMhJXr2+DbTr07+ieMvoQ/DdZ+LtfyI+36EYZQDA3x4pPqC6sh7004Zzf1VYQ8wp+qINC1h6oD7WizeJmyoGCyiWk8EjOvkccwsTwycugZ1MVLz6Fu7aInq4al+zz6TLO3B4w4mPoSaitwrh5r06pWMzmfNiK3VbvIGTOVd6ZFuLz8TrR3X62fFHBQl++K96JpNmuETBqtdvpaQkthcn3tZ8EiWXSiZKnMx5+XlxvkNO5pDbEIk9Va8QPnUhLuIPvFXo+x1yLMLtdowOEtz/RH5KL53HHnm00PtOoZdwILXfHBNli+E+vhjRbyT6LrbP1T/q+L3OFkEJ7S5bSuPIkS9x62OX7KZ97xRIpnNAlPnifSlz+HahT2EKmSi/fygPVvfvZLNLFy+BKG8EdGxIrrNeDIvSVAy9o7jprojy3YJ2HoXa5Ilm6YGG+AQNXBcaC8XphXQb8rcueHdlXN7SwsTwiaNnFV2Tdp+qF8EeThzeZOJD1zMion8Vn+1B4NX58aDe80X5ISZufQhb/1tx7tPtnwEA4vZXPajzUleltGZvhfjl2o6Id1sTN6DJpB1c4f709qYIANhZe4DcAjuftKIpdPyr+Pjz7Y1X2y8/lUwjPvlR1XInMUrt62jh/kNirfeyePMouvXi1zsiAOD19mMctoPTO3Ue3fdxHgAAxJ+2FzvECE7j/ucIctbB88X/Dbd+3xTRwGOa+z6GPhMKyI/B70ZV+2XZDsGjhd53xGiTOHal+F8A/PSJzNRj01s/vAYA7PzwYmvxupiEBEQ8SD7oL66+2t54tSX1oq/HKsioyttI/yVOBUlz43rP1nfIO3e+uqQwlA2ilEOitx9IB1p3FnFQBY1svhg9inzv8Td4G7hR/EB5caMgoBFRwjFaebG98Wr7S+zJwZP4cbgsXoFO+Efxqw2guqkxUSrsrx+jPFIIlYtPM9sbr7ZXsfMHfy8+h5+y4YFGwHkF8ZNPUOPlRSW+7JX+IpqDZD7HnoWl4YNkGj4pjjWpoyiS3YK/FdP4+k4d3mziS0R0tDAJiei1PHzk86ZUOCLK/y4mvlZERqRVxihJKzgm0t22BYjwVveZov424StkRKWf4Qi0p/hfAJBbv8fEeluamZKv7J4oLx9DXCZBWjopPPLHYvRIIYiXG+jJfKRwc2jr7+rV/lb8nxWcCPFTTEQevE50UJU+Vs8u2Q4fk9cC2/N4KUfsa5TAl+rrIvwG98JOMoE8CSQNvXwqSCyOHlVTJ9DhQSuixJyl8m/VyErfUuaXtLTokCiPkV6Ko3t44KRvKY+Uolvsiih/L2bk3krpF9Q8Ox5oAHyp34vP5ScQaj+aPkfFT17KU0naSNm0sPSx8M1tfT4iTssQROHY4U0mPp5KhWiMJCLZjE92e1rWToyS2BerTrrJ7HBOHGsSR3yFvncKfe/gGNnZIvkZo83df43gLeEpcaxJHDspwougXRvyUWwvJddod20lZ73lrc3RwseKRzRe8P73wu0mcaxJjLKom13k9PhrUV75v1W41UGwLQ4SXX5XHGsSx5rE8DuFvncKfb8hGo+dHj5dZBj5zb+JL8iPSXEo9FzRw+6zrvLZcnHCpfHyZbFPb946JUrJ6VUOoxxZPAfUCbfdEqWS7FReh3lTbeS9IEqz5tnzQH3gNsNFMV6UhNq2RLxghAtMyex4+OxaWBo+oye0tJ3qOEk8hJw6vOnExySjJkQjX3IOe8kceeV8tDD3TOdjoXfQyMHXVZ841iROf7ytvZQWUp+7f6e4SB8rjjWJY3fR9ny/iRIQj6mOP4pEHB3f+mihV9lNuMtIfIE+9/M3xTFpX3ykEDxa+PDJDgDyJIThNuIlRpvEsabiM9Footr1G3lBZMJ3e3A8Rd4Uw5fiVJDB8SOnRKmf29Fwh74d9pcojWy170Rp0wN1gJ+gg0NwpDD9HRXvq1bHz8RBBXPZtbDReCFI+/ej4ifkMnx3Dq+6qeGsL/1InAq2s94vruN4DRFlkMMfxj/3k45eGv1yQ5y1w/oHQZRA3JrD4VRy3/eXM7qPVn1sfl2cq8OpNxTOK97VfXiS2N0DVrpF8J9Fw4DVXpzjkwIpijkGQVeU+0WUzjxQgU9EZcKAWPRAf5NPVuKWoHyO4xWlHlHuoJZrf3a1pytKiWRUbbBc7dqGg+NB8rHV0Fm8hMYreTIPDrH5dfGrrOIzwd+Kf9lQfObnb7ZymwD8WLwNA9Un1UHMn19tLX8F6fVAiBIQD0AiniLF45QREADAzt8/3frr/wUAgJ9y22RoMtNFNgwvxLTnDV9vf/lk6/8BIAcZ3xb/Qn7GJlESa73rQ1uKE2Ti9uqzbb1LKY1g98AzjrdqfxInpXfeJdfjpccoVUFt1cj+ZxR15+4sOSj7SpTykUPlxNt3orTjgbqQGIT4KZ08kYOK3+pISVeUz7FpYROilBOMSpeAt9uNw6tvuoRuJFMTIGKGvxX/l6GFbKK0c5Sy7eRTL728OB8vLsaLC9fFW/9Ejg1xMuatwq0/ifPx4uJtMfrvhQ4caJOWq13vinMPiovSB+Sf4tolSpx9tkgFAgAsz1HKQ0isNK/WiQvx4mK8ON8nXnu7EDwqpqSWHC1cOynOx4uLD8QP8IHTJREA8uzCW4XR68XFeHExXoyfLHQflY8QkWlr+Jn5PnQqzQZRKo5HdP+7GLteXIwX594T+98q3J0FAOzZL0Ok+aPdAeSG8bmo34kTt1EDpPMl9rPe0iBKTgVtpaC2H4v3f6sclNtiVAp9EESJftattFhpRClHoo8WIv3YUfFNLYgSL+6UH7PH4zY8UBe6S1HpKJvqUSelE1A+x56FDYlS3JrEz9TwJeTz8PXZl9tgdw6v9Rk1ERHHGZWp5tLg8Jc58u+gpWCluPVJufyAkl/k+InbT2p0zu51lEtbmJ3lNr1DrTLb2iVKKTWkXeRqYPTLHPk5LAcrjY6C4nNn5CEJ6UVuN75/Ig7qnfMiP0Oe0VO98H7WkCgBAN8/FcN6J70n4Gzbq5/QwR2Afq0g4mSc5oWJ1caShDyPqX7JewXxWVG3v8Ej5O4YZ0KUB2NLJErl0ULVy4IopYTbP4vPZde0R5TA2gP1YBQrQDZR/WBRmjvSutWOhY2IUppE2pfkgSU7vK7P6BLRB9Y/prADA6L84hLKNiQ0xS9eDKOs9JVqeap8ly7G/yRexQmK+U+3tL/9+vmbrfk+ceyk2PcHcaRJnP90W/XjuZ+/Kc5dQhnhW38S5+Jbr+Tn3XbiWKHvnULfMYVbfHtXVLdT3Ir/ayF4pND1G3FsYvv/mXV+K/aOzjXhRT7+DxQvv/NA8v6dtXkxBpPyfxBHLomLnxNdeL29EhdjyAiF8EnxcVpzWuL19tPrKGV51SfGrhdX1tQ/RCOMIEYviU+/3or/WyF4pDBwZcvEDkTLt7+Oi7Em8dYfCuGTYux6ceUVfpw+RgMXe6xnhEv2f6wNlv9sVitIdoY/iCN9xZW14t0jheDRwt3JHd076gwiANDaYz5kq/iDrb8/RB9TpC4Ik4ZPinPz2ytXCsEjha5/EVckk3yBHlGh/yl++lfUbMnD0dWyxQ/eKfS9U/jgroIoda0tbmw97hNv/aHQ907h1nvi4ufoV5IWRAnAs75Cx5FC8K3C9aZiFu2X9e2vbh5hE0MP1OL/FEegN15XD664KIa0j7qv0Oy7doX4vJWF9YdvrXjnn1WpSzmH+RciN12awxv5zN8/L8bRsRkx2kc4/25BpSDeeGxuvHk1vfPb3zl4TO/8cICl48WfdixrAO8xcF7CvEzcG4ad7zasP6SL/bbwm+jwlCgpKBxgfevzz9XV76U95q4P61G8saBESUFhH9ni9SOFjrcL0SaUZZKPgikijxS/MlCipKBwAP2fvXb8Tvxktyf1KN5kUKKkoHCCn19tLV6Xf60bPinOxbecRGwpfomgRElBQUFhAUqUFBQUFBagRElBQUFhAUqUFBQUFBbQEOV/JVDNRMvXIzM99T3F652NzNZivLh0YHeEWC/GjbsfT+zd6eLD6uChYH3r2UuLj4jPtnJ7d8Of89urnxYXbxetf/0vt2DnuxdbqXjxyeIv6Aw5xf5BQ5S6v1k2/8HmvmPPiso5BCEP4PiHvY5wGB0UN7bmL4nznxlUpd4/PBStfoa/kwzsvi6WjFJ0bo2qJVL8g4ISpQl+zUQpV0uLH+wy9sWQrrwtga/EKzr1xEoHJUqKXcM6RmlYYufgcOhEuY/i9ACA/e+guPPdq+2Vz7aImlqHRZSoGKLxohIV1rQWO7MNSpQUuwYlShP8SohSv1DVIW29tz6ExX2V0vAyJJubiP84BCVKil2DEqUJftVEeTjIFq/j2IVCbweBqPFsWo/WEShRUuwauyZK8aftL2+jRPB8QqvUCgD+1ddYkzjWJ1c5jt/TzJPXO6ufFhdvi2OXxIX41qpUm0vBIzt//7w4d0kcazL66Zj8gdj14pdKfd2/3hPHsBA2ELe/ThTn+4yToVZE+X8/K8KOQxk1CbkpcaxJHPtgSyrRb2EBTfn71BWinRjSgQS1aLI0BJdQ7evFeHHuRvG/8FeuIz3uwl2Ysr+3BU1x6w+F7qNq+lAMqLau6FdFog2WY6EBrvKtv6hUBoX18jmKwdVW80R4vbP6KTqxMPegGD+mT5RmrkuJkkKBXRHlTqZfU6D4LTH+lAjDi9ufdxT0ixgr2Gcnc12ncHSoYwsAgkcebMWVha+VcolAzBXv/k59kd6a4t/wZ9Di4l0xIxcDN15oSPP2fxicDcJqPwpJLywdg0rb2rFAaTohAACwsxo1KLj9rpgzSs2dLQL9dZbugBYmnhADips693Rr4l3FJ1VjoQtV1WsVDUmKNPCFFCwku+oObkVRddPvHslyAsqXZU8J16VESaHALohSErqBVafG/oRnrJzTlHdSSAzngTjGY6kAmSjJDVdhwCeONYm3/lDokiqh4snZAetUE4rGQVLzj5D06feJY02yvoeUOkA3ersQOqo7f5QwznpL80ea25JIPNKBQkW37FmgVKKUhwBr1MRPYsu8K+ZMV5RaolQPqCxTQyzucFO73jIdC31gWavf46F5W1ySFpVYNPzqSaTmqMjnaAYX6jIFlRpkst4RlmFZuC7xpnFPta5LiZJCgZKJErt195mitOeSFHXghJE0jBTSaBqREElhruOP4ldk1eXX23+HXosnJ6nj+P0s0k2VxLkkzor/L2kFtKMSVyJpaz5eXHmxvfHKuJyyDaKUNCY7zhZFAKRscjjqwAIlEuXL4s2j2qWc9rv6VzMSjSGvJguWSd+1NxYGwJmcM8XvH6KvqB85R8VkHkvvyvkc+XlDCEVp3pTUrH4rLhHHj9Q9teG6lCgplCiVKL8dVkxa8aedjVfbG6+2pv5NpgAs6qZUf1bThKT9pPoYATw5lQsW1XWQ2B4mrJ0fXm1vvNreeCCS7TQSTdOHrWQOVt08KiZ/xLLXOPpmzwIlEqUkBSUtZg2+a4sopQFVCU4970HvI5U3W2NhAJzJuXp9W24VlD7HpH+lZ0uU/iTnc7CS4kmlQC7WYEAEvYjI94MHijOYRj01cV1KlBRKlEqU8mZZ79VxvijLBGNNWvUFMcGh/6o/RsCOfKDp4XBpnjtLgNrLeksr4nB0C54BxDt9mxYokSixpitSYcYokSgNLaNq226kHHEmB0oQE3bbRk+Uo+InL8muqZW+NbSl6JrEgKoskEFPTVyXEiWFCqUSpTRLJ+MKxd7U59sbr7a/+wkYn0rRXwnulijxaqXvT4r2LMa3Vl/J++v9IEopexN8C0brpPWjTQuUSJQGfSmRKA1oF4izqG1IYH0XRIkzOeInKGuPD73jkHH3n1EoWVoso3wOHtzBIdVJia1ZuAz8Y/FbY91Uo54auy4lSgoVSiVKyZUnnup8RxQBIDzyieIUiNHWW73pk2FrcuL41zEyGig1CCiSOXtLlAD8tZ9YkhCi8vYsYEyUyoeHFISFRGCwWS6RKA028tJNMbuVTpQ4k4PjxYBYVAYVDxh5E43zOXhwVQqrUrSxbQsAecWq+vmjUU9NXJcSJYUSJSdz8MkYVQZm8+viXJ34EEZ/niB3DwWKa/iQ2s/fFG8oJ5U8W34rzn8pnYzb+fvnxQ+vb4nA7uSU2Or2A0In7/X2ygPxxmX0mRKJsrq4ASOexOs7MlqGZ6yKtmxaQEuU0sNjdHZbBACIO//7gXwMSErmwJuSQyBuFMd+b0CUStpVmyJfjB5FoyBlab6bRcmojpP48VM6UWKyU8QZ5V9Sdp8l3sfBRymfI4VKrw9tocF9vTX7R6XNfyyOvq3uAni9nVCdo7ThupQoKZTYxfEg+SgGPibS+7ZqAaU499P7TqHvN/LKS/940JFC8K1C3zuF0FuEm9qcnOLWHJ45HW8jSZMuxcKkVKLUe+mfAVSLytuzgKaD5BJVeg3+q5IoiWMuaAh+J/+XGC+8lFPmlLSmUA+o1FQyiVwyUa4Xb8JeKLfP38fQY1L5k3O8p5byOZrBlY4uXb8u/2xc65PEYUnjnmpdlxIlhQK7+2XOd4/EG6ozwG8VwnVF+ZPi9l+alcet3yoM/E57wZ1MVH1OuOufsLKd/cn5eutxnfp0d/e/iDOLaC+2f0QJzwmhQ+Yk7FhA20Fx62PyaP3RQuT61vfSYW/iwLn6oP7RwsA/qfv4nyOIjMhTSrqm+O6ReO1tpfX+XfycPLNVMlHifbHqGDk800PGKyDQuS4p2w4AeL01f0ptydvRLdXprr/NKh3paOHau/o9NXNdSpQUClgT5fYKjHY/3vpJ/wM7P7zYSqG0if6ZRPGnndVPi4vx4peZnU0RfHtXDJ8U47e31rWXerW9+mkx9fn2Rp5gnL9twXD7yt/0Gva52pWl26U+V26QAVj/HGV4NLfWw49bX8RVqSH59cVzFSduz581VHa2sIB+B3d+yGwtxouL0u8I88jOL1S//Hu98/Jz1N8fXgPwWLzqE2PXi/LHxO3Pr6Pf8z3Fh0yNTYHvG99azWt43+FYSPjpObqmuvEAfB8TJxaNPq+6ERB/2l5JoM5uGv0QSNx5RRoEtVmvp0aui4deM8oU/5igUhAUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBSpQUFBQUFqBESUFBQWEBDVFOBxmWN3jVhNOH0cZ/aMRbWZ5hg1MAAJCf7axwsf72ufxhtwr7SVvc4M9ks998pMOBvXNvC8vsN/bT8ogcyrsS6r+kwzUMyzPsxQlhP258+NAQ5eZGNpuDr9FmnmH590Zz+J1v879SK7zBUBJl0M9Qotx7UKK0B7yKcl9OKP/wdKDiV76WMtt6T7XxDMu3Th9YY94cLF2r8XN74G252MVTbm433vOmMg4lSgSNqxwoUWodbB8tnw7XMKzXxfGMJ5Qg/7A0dIzl3Z5ySpT/aNgrb9v9UuVNZRxKlAianh4oUWpbvt9EWdPYVKnafSf7Kxm2prWthmEr+5L7cOM3AI6IEo5KQzSH/p8fa1auwxf7/DzDBacEAADYzMR66k+5OZ5hve7yutbIk3XbzZpq4xk2OLF8t+m4D/vB+kKkPeDxMizPuE/WhSafE3EAYe1xpK2uDP3V7z9zMwUAAGB9IdpaXeZieYb1+et7J/B30uEahq18f+Zx+AJsoc9T043+qonS2npUCF9PdNZ53KizF2PPQHq4SnmdqnAavRkYlh1bNa+EtUeR9tM+H8PynK+uNdJ/lvB79YisP4m01bo5nmF57nhjz8TX2CTC84lueBGXp+L0xckVO0YXvp4YaD5djszlqekez2yqLOxxwz+1R94/77DZqtEUnk/01h33MSzPcGWBtuiC5BzrT+RBqWq89vgnNJLhluMeL8PynK+67vrCj9bdibcq1z7J/kqG5evu5ND/8w8a0VgguhkYv9daU+HmeMbtP92pdLDnkz31JzmWZ1ivu7o9Apur6yrwzZaR2YHGSp+PYb3uEy3hBcL3ha8nQo1+N8+wvMtTS8yLeCvLM22Ty3da/G6lk+hC18EQUV68M3e1rsrPsbzLc6opTE49Y8tbARJieGygTDHrE10engkMT4VrCOdcX4h0wQYgCzxaw3NvuIrlq8JPHoZq3RzPtMWhV6tezROCmUNOBxmWb7z72bg06dRGlh2ScfsriblfGpytKKGrNY7BGFn+fhPPsDzjH0gSJnC1xQUA1qc7yzie8Z0fmEllU7MD5/wMy3va4jYHZaqNZ1gf5+a5U83BjmszORSeOxtOZLIr8+HzHuJqwvJwgOMZLtAeTaSyuVTi9pUbiTwA+blOD8t7zg3PZ3KZ+eGzPp7xBafWAZBjz94TwXvJDLog4wslBBilvf8eyzNs62g2l83mNjbNmgqxNFjFsOV11xKZTDIW7o0mBSDkX2YX+qt4hq3uf5zLZnMv84IVUa5PtfkZlvecG4qncqnx7pNu6Dd6RJmfa/fxjO98eH4lm0mEz/kZ1t86vQ4A3grVh+czK8nYcM/tRXs+8vT6hfZwLJnJ5lIz7wc4nuFaPoRDvR5v9fEM6z87OJvKpsY7T3PQoR00mxxNkL5Z62K9J4KxVDaXGu88wfGu6uFlAQCQ//CCl2GrWsdT2VQiMjA4tQoAAPnxFhfLH2uLpbKpRPRq//Sqje5A/5TWOIt9fp5heabpAeyTMB10IXKBRMkzXKB9NJlBxuQ9lxN4bt8KcLyrsnM8lcumYu2VXoarDS8L+q6C2RNbo/MExzNcQxQ1OT1c7WW4QPt4KptNjQcDLtYbCC8LACCOc/s41neyqSt4dTZn3j9dB0NEKU29WHull2G9dXfw7Q0tb42pNrh6TXR5iCdQIuRm+apwOq0gyvzE5caeaCKVzWWSt5t8PMNWDSwhAxkAxUEAACAASURBVFSxvMvtc3EVZ/7cFby7tLkhZUFy2S/unHNL89TYIc2NLCwPn/FJszs5Cv9aG7bZTz043HonQm7pYZKPNXG8x+eXTJC708Cw3qbxPA7u1gxJLROWhwI8w/p7HttqFnrIYA+CM/9YvzTh4XSCaxPo5VV9SZUVng5U8EzFgPQ2nGxV6Ds1DMu7mh6sKy7obZ+D/3W6f4Ft0Kb8NDsjc6JcGjqm/KvwsNttQJRLg1WKXudjTRz6Luxd8+4SkORDcWmwCi9YcLs6y502Wx7NfKyJI40Pr+9tncbzvCq8rGzMVBvPsNVDqnetkLvTIC8hl4aOsV6Pr1yabInL5dh14TDJbIKMyXXOAoB8g2u+Lzd36BheEBhuveFDV+4dH7j5DCAn9DaOSdd6OlAhbcIQx1Vdsz+hjbbe/i759kPHWJ6pvrUCzC1vjak2uKGEo49235IZodfJC3YCcOtZ1r8IgLQQLm+e0KyahOVwtVfReAKKVRo0MjG7NUbm3S2T8i5l4qKb5V3nRnUaZw9OY5SJLg9aQgrTQRdb3nUHLqTT+AHefD8PwHK4kuWZ+rtks6DXVl6z5ezw1njpCpavVTPs8a4Z+cnzqL8ajQq0u/JeAKA2+C7PSl/JPh6UWgUHlZj5qnccB3rgOHnODcXT5NEAZ0S5fK1a42qKlhAjsjxUxTP/EZqReocWFw3RHJ4bvvMDM2lHBxWEfHp8oPn0sQq4nccGWR6SrryLZkujKUxcZFi+7oN0Vmr8aCuO4aAn1ongveQLeSUPXd9V2TlCvmuJ3N06vIRMh2sYtiFyJ+hCvLDY55c2Q1q6Id4RJptZnqmPpmVT33+PlZZUNmKU8jvCRAvPsI230rInjzbzmHTgpZrvOzjUYCdGKb9janlLPBuuxteZDroQ8SW6PDxTMbSEuynPqc0X85GuuqpKjxtvqKFN4BSQtqEy4K5RWl8DYOiQdoysOsOU6PLoLmXswilRClNtXvhUmWrzMp5QAjpc/d0cDAnBfY1uPNtJkFt1a90oBrKa0WWNDoQSa649JEogrD0Kt8DAE3eqdxYFZJwRpZ7BjYgS77DULxQBXHs03ATjUO7TPXNrdtxDWL5V4+YZ9+mO6Gwygx5FRNhLaY0Smw2NUqM/NHAQN1fGO2Hg1Vt2PvoU8eJmZrwbRqhd5e9FUjbZMh0OQEZLhwM8U383l3/QCHkhPVwlrXHMiVITCsQv2DtHRIn3+JoXMaaO8jDOiNLC8rbuFZwCOP4bGE4nB8qU5IX+vR5vL/cyXEXD4P1ECtGxgig1Edj16aCH5V3Vt+R9iaFD2jGyKjW327Sq46w3fLY3jsW7PLy7c15AS+KG6Icht7SsSA6U7cWKUrr1bNBruPPSuxcAAMx1uoxvt/dECSGsPeqvdbG8q/7uKryqE6JUhoCBtiWEWebaOZ0tqqY1AwFFgMwMs0Evw5Z3PCTzXdAgMLqnXOmU2GwAAFi5WWsdGdhcGbmgDBQCAMBmZrRFjibbwNJgFcNW9k3frWP5msgq2vd4Qg/uNBCLDlOiXLkVYHmmZdLgho6IEi7KjNY1+06UtixviMU+v7SOhgv/hq7LNfLdp4MMy7uCcwDfqCaC3Y60iS5Rrj9o5HjGc5Hcjhs7pLmR4db2kFeUKFfoDtSUSX1IhNwsX1lVTezOFnp8vF6MEgd0raC6NYrl9+slJYT5Dg+vE6OEYSYiikFiv4hS/V2tH8+1kzFpICT7q6Qhh6E9TLIAmMUoUdJDE5lVw/YZL9hU6WmUn2orxwaBMSkihKeMUTppNgAAx/iISJlBi3SXHg6XBnDJE6hh2Ho4bXN3Ghi2urKKTIibEiUKIxIxSgUcESWKCRIxStNLWcMZUdq1vD7ircRwwCnJsDxzRk5TVSk3GRIjo5WsEVHi0CRKRSq6puuQFkbOjZzXj1FeiJX8U40SzlHmovU8w/KMpxtzPWRrxbIOLqSVWW9vWafd35RoTyYNV3sZ1ney83YilctmV5Izt6/gZC66l/t0hzLrnb5Z62J57lR3JJHKZnOZ5Gxk4A4kFiuihH0sb7ybyqY+W7Zu9OpIG8zxrcz317pY3t0Wh19KXC5nWL7q/UQmk0x9A6Tx9ly4ncyk4oPnPYq9D+ymt6zldjJjlfVO3wpwcq+zmeRM9Go0KQAAVkfa60K3E6lcZn4gwPGMJzhlw+4ozHrhXgplY4mQELwXV9EcTWZ0st5Omg2AFI0qOz8US65ks7lU4n44HF8FAAiJ3nqY6EzBFSVk6kRfY2t4IpnJpeCK0vLojAzsnNJ8hoFLRWDOnCjR8QlX+XsDsWQmm8umEqPhG1P4cmpXMZ3D6KwCV9EwOJHM5LLZVGJ0+DpK4pfyeNY4mClRmljeGgqiRIeryGUjQZQoplw9MC8dKTEkSmE5XOti+eM9D1flKHDuZV4wc0hzIyPmVWa93fUf7OIwfCkHziGnwH037CpcX8gmAwAAsJ661wFPpbFe94nGnvEV+2F4nVsLX88NtlTCg1Gs111eXdc1kdG5F+/yVJxuvp8CAADh+UdDTegwF+/yVFTWd8cycheMiRIIy3ebTpS5WJ5xn4tan0JMP8CnOF2eU4oznuvzPTV+juUZrqzrYwAAAJupiHx4s33k0UgjOeTkecwTjT0TTyL1howjPP944EI1CpZzZWVVjZ2xFQBA+sN2dPqMKztu/wSZsHwPnsqE34pKAXt4r8kO3JHj9b0TC9G6UpuNRmy0Gx+R4zlf5emmyKPvAcgnButRjzifdPY2n7jaWInPxJ12cvQPR9VJ51yNnOHJPZ0lUQKlgzFuv7+m+dbjH7DZlK5iPocBAOupkU585pf1eY7VNX6w8AMAJe5j1A5mTpTA0PKWgCEIfLgK73DrZbsqGHD94QA8K+rz1LRHxgbk76qJUj/aXhVOmzmkpZFJunD7T7dFH9kK1BuCVg+ioKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLaIjSqN4tu6uyl3rYF7k43dKkVaW3e5807dIfnPExXK39Gjh2gMobq6REAZDrxRoWVbSCQbFVozaoC6mkozVuRU3Ww4CizkX6g3qO9QZuGrTogJQUjb2LUFgL3Phin5txoNDWozH8oEGRYzg0tq+zN9AQ5eZGVlGknn9vVKp99K0jXQEr7CNRVvYvZJUlm0q93n4R5XC1d7+IUl2yFCtDOKtOpsRuifJWgHvDiPJmrevNJUpYts7fFE1mMsnPdicf+KbBNsEJ+ZdKEZeqwUfSpN7YPGyiJLDPut77SJR7Z769aWQudum4x7vPg5oOB3iG87o0EihQIdLtOTyifCPgpOKvXaLMxS6ecnMl77QMvEtPcupXg1JmqJ77UaLcFd5MojyQQU2HAzwTaG70q3bfi31+ngkEWwO6ik42r02JctfX1IGBdx3QevZw8I9BlOtPIrCUJstzxxt7Jr7GuwJjvXMAANjMjPfKfy2vDk692o1S+1Qbz7DBieW7Tcd9Kjc1Mt9qpJ5h+WODT4mPDlehwtfC84mrjbgsK+er65BrDJtpv6jmyfpC9BIuOuvynGoKP14TgE6oJTCc1kwwYe1xpK0OF6ytJkv/psM1DFv5/szjsFzut1uvFi8kxOH7/ZWK3TeSXY7LylD4lmYK8Zsr46HG4x4vKsR7ratSWZXadGi0W2+Fo5M1gMtqLsWUdZGF55NXmnBdW7f/dGcsoyz4jJQnyLL+UOvK0/1QMBoF9WCp6zTL9vd5atoj758nqMrAtzWiY+hqwtcTIVizlnd5anHtYbXNOV9da6T/rIYo1UH2wHA6DYVOnzwM1bo5nmmLg/UnkQ5cyZgrO35h+NEaKbpQ3jH+Earm6/afDn20trn2KNyCRrO6/R6phqvfWmgrWXcT6s0SO5XFPr+ksgs2M7Ge+lOoRHd5Hdll7VRVWF4SgZgwLatrQpSDsRFUM1szLwzJqhQ4IUpYxd53Pjy/kkUi8ZLMhbHeOVifavMzLO85NxRLrmQzyVj46oM02I1S+1Qbz7A+zs1zp5qDHddmchrzaZ8zq9EaVrGkgoXmoRraUrgFKg1kU7Pd1V6sTg4cEWV+IgQFGLKZZOSCH/OykH+JBORQ5PRlXlB+EanNcYH20WQmkxwJBlys3Fk8c1Bde1RYX0ddC1fqJ7XXkVRATTidVhCluUK8spL+fPi9Mk4R4rQaGnOifDpQwTOehqH5lUxyItxzR636s3SjqW04llzJZlPxnlqXVuoEqSTJYmdIx/lywngU1IOl8JP1eKuPZ1j/2cHZlI7QhYFvC/mXSCK4uv+xFAqH0edA+3gqiwQMJP1VeSLEUzqCGahz+W+RZmHzfeQt6eEqlne5fS6u4syfu4J3l0B+squ+N5JIZbMryWiLh8WCsQpviaUyib5qL8PyHp/fVdk5nsIf9nXO5vHAGLRWKRgHi5kT0wc2qS0uALA+3VnGqURfeE9bfF2eMoqpSlgeGkShT6sPY6I0nBdmZFUKHBDl0mCVQs0KqnfpbcdIvfP8dNCtr2dUulI7ylroGVg3602ocVX2oaGGilGSyBcBKOuISt47IEqlCR40Eo6loW/yi7BhpB78+kRLOcN6z47kpO8SpkDK1+1zevasv5uDPIJ235LssmKNYK4Qj/6KZX8AXo+jsbYxNGZECf9tN/+uJwCJH3LSNIY6azq6dYpRMCRKeDVidBTSaepLEr6tdYD8eItLoR0G3Sw4JWD3JuaLSoJNhmrrjZaupIcoWnS/iZccW+0t6LuScRTOY9Za8nGbjzVxvMfnl66Tu9OAFxNPByp4PRlBf89jAPSmKrb88nK41mWHJYEZURKSdoqu2Scrm7BPlMtDVTzzH6EZOZsMH6d4fa6vdw4VSzR5WAB2o9QOG6bUR0XQzXpvbAKA5z9y8aWhY6Tsj5D/cvxqY00lVjKRbOqIKDdfzEcv1Vf7kbCP/EUzohQmm7VnehIhN2YTS3kfBChpItu8si+JrgOXVFNtUlPNFeL1/kp4qp2hsV5Rsv6zg7Nf6p9GEPLp2JWmOj/WddF5FEHSgQ8zOAck7TDDUTAiyuUh0o0hVFSl79vqa2LDNt5Ky7432oyMuXytWtrBYNiLUULrKePLmy8SkY7GymNID0qyucY31LcgPmDWWuQP/oEkAMJ00MWWd92BEYA0pubm+3n9vBMpTK2dqrABZdW1HuWj2gz2YpTqMTUhK+ewT5T6GkDISwz1zk2i3aUrtZtkDMxCvHCp5R9I4kQwkpdC+1Dfyc7bM8kVdBbBMVGuTwUrXKy37PzQaCKVzd5/zyZR6uZJiDftEiWhgSdMB10sXxVOJ/srJeMTRGmuEK/3V017nA2NKka59jh84STH8gzrOxn6SBmdEpZv1nNQO3MmmUH+rfUfKBDWfD+Pnn9YO8xkFIyIUo+tSKoy9G2tJQ2P/rVO61rGCVESHgJ3u67y9wZGEyl8jM85UZq1Fj9uG6I5YarNy3hCCbi6r7+bgxFh+JTSzTsRb2p7rfAfX3DKDlM6JkpTsioJ9olyrp3jmarwst4njfXOdcXIIUpXai+RKNGWqrIv+XSgQg7rgLlOF7m6VIyKbaKECzp5XaP4ohlRwu3h7leUyYEy5V6JqQ91BWT3mmrj8cbEXCFesZXDt5RtUsrQ6Dm6sPa4r1oRlQYAIDeTlZANH7QwGtA49s2HF7xyCMVsFIyIUm93T0x1Y9/WNu/ZcDW0oY5llFE/bfP0765nPXgXWf6QtLkTojRrLcA7sMaxeJcHzY5kfyXDNkQ/DLmlpTGMU1mtKLVEWdbx8cLNWpdNkXHHRGlGVqXBPlGiSFCfOvYuf1JX7xw6tHGMshSl9lKJEo1rWX3DMeIzaLd+DQutTwfdBkQJ54ycOl9/0MjheQKdWwq9odiQDaIEuZFz+jFKmFCyS5TTQeJNOFg8OcPht6DRzBXi4ZB5LsvpIkWMsoShMTpdpF2PwE9KLp6Pt3oMFgLwAXOmoY5DWQX5gvqjYESU8PFJ8rUiRmni21oeh+FaIuonAyXr5ZiawxilWt/14oTiWVICUZq1VrKwO1BTJu29EiE3y1dWVRN72IUeH68Xo0TRTCOihMmc+01eMpkj5NPJ5AsdUWvHRGlGVqXBSdY7fSvA8Yz7dEc0kcrmspnkTPRqNCkAc71znEJFmuvqrHcpSu2WRKmKUWbln+bAAJnigYwCXr6WkRTK4TIGRIkGjKvtnkllkvfaK73yeh4u4rjavvmVzPzwWR+8C/4iXCEG+uczK8nUN6oJJiwPBzh11ps7E00TPXJIlCjnQHaTJEoLhXiYMWR9Ne/PprLarLfzoSEdfXW0FWZsUU62vHWaXGShCGbTqHQQwmjHJD0MCIVus1EwznpDx+YqmqPJjCbrbebb6FABX/V+IpNJpr7BpuMqGgYnkplcNptKjA5fn15FVoAToeV2MmOY9ZaG0pgoUdYi0J/IoHxuiURp2loAQC5azzMsucCH2w7FEnJ9OuhhVVlvb1nnXN7AH/TOG0CehZyrCuPqWkC3p3pjqkdWpcHZOUrh+ccDF9AhNYYrK6tq7ESn4Iz1zoFSjJz1eaoa+z96ZUWUwESp3ZIo1S/CxChZpjhxIizfbw9IZwYnbrdyUuxc1SRhba4XnoNzeU7VDXwUf18OAq4/vAqPFnK+utbIg75qckO3/jAEj+l53ZcfalcipGE5X11rRDr9Z5co4WpX3tmhBVd01ehb5grxxG+NPTXtkYXJLsUPexwOjSLrPd6KjqxCa6tPtwnLY63VZS5o4dBkpM2rjgNIn5wOulgihALMR8H0HCVxtPN4fe/EQrROpipT316f78Ff7PoY2WakE58DZX2eY3WNHyz8gG0+0Ynd4ERjz8STSH0JRAnA+vyV+pMcHrj7/fLQOyNK89biD8tRKbzWlgMR6Br3OsgxlY8hWxGlzLPBqfXVkXM+hqvo0Rx8K4UozciqFNDqQRQUFBQWoERJQUFBYQFKlBQUFBQWoERJQUFBYQFKlBQUFBQWoERJQUFBYQFKlBQUFBQWoERJQUFBYQFKlBQUFBQWoERJQUFBYQFKlBQUFBQWoERJQfFLwebGrrSXKUqHIVFuZmLyD93L6y7Gnu1vQ9K3AhwsuPQs2kBUGnf7/TXNV4if2TtEfrazwsX62+f0S5a9WdArg4rVuvVeTkvblyjvV7IUpXYo28MzJQ/lPzbSow3lXqng2/rERTf2aqsvRmvchy6qDgBIf3DGt+da9gcGfaJEhb9g6aRMMhbu3U2FIhtYv9/kZSoGkrJsYWXPR7lsdiUZG2oo9zImWvUWgDXBfsFEubkh1YuD9bpbR3XKx5V+fRsomSj3dijfLAjPPw631fklGUtCChEAAIS12QFCxlJZJEnIp3ExN12rCmuf3bvSBC+OS0xtbrzMT7bKlTHJKWOK9K0A90YQ5XC191dGlEjoRi7zVwqcaMMvDR1j+bOjsICopqg1rBdZsiY1gV8iURJwSFi5yYsnylzkqvNwiJIYSqiFqSrn/otE/sMLXu5Ue3gmlc2m4oMqaUyoL+g/G05kkK4nIQH4uL+M4xm3T58oha/vt1S4WJ473ngpfD8W+3hZXjXGCaKEdX8ludA3DrnYpeMe797PNa1XHwh0iXKXsu6OL5LsryRKN2q/GG9leYbrnN1Nc9Cl/5GIUlvF79CJEr1TO1x6YcA3BUJ+g1jPw7UFYjFYulyWsYSV8H29j+B/c7M3IokXm7pWxQwbSekFKBREiUQspMqYbxj2a64ZVcvfZ2iJ0kiXhyyhXBNemO+pLnPBN8lypDCaaaQNr49nw9VYpRbeQVXUNjlwTC61KzyfuNqIgqc856vrIMKX6wvDTSfKXHArVH/j0Y8AmCuKmGjVg83MeG8dvBpXVlbTHlkwqJhvoUZf+f7MY6IIrkKjXVh7HGmDpvN5atoj7593SpTEFXjOV10XmnyuUAOXXqRexcjsAGyw132iJWzUL6P7TgcZlm+8+9m4XIPW6CJaoiQkD6eDDMu3TixHL5zk8KAYdQd19vlkTz1hyZmhSmk0da/2fLIHFrhlve5qcgTXF8Itxz1edJfrCz+id3X8xyZIbQmN8qieDJHeaMJq6sf6Fw22ciqiBLNBL1KXNWsZySzpcIBn/P3xR3JPT3dCI0O9NoXqL+wUKtO7/iTSVovm3XEymCA8n+jG1awrTl+cXNHKlgWG0zrFqo1H02BO6Xu184EuAVqi3NxQyrpndWTevJzb6yo/29LRdWcJKRrWXUtkpGimvja8EeKtLO8KSjLV0KDwiyvJ2NBZH+8qv3gfz5ilcEtreCKZyWXRpgbvPqAMQEVwPJVLJW5fuaIjTqAkSlOt+mCFS9Kqnxk66+MNBdRtqdHrabSjOvj+s4OzKY0CgZGhyKklLN+qcas1JFzVw8sCEPLfIjnJqsFH2Vw2+21ewEQp9QvqXnAN0VWDG+re18FF9J95yD7TQYblObePcZ9u7OganMmZdAcYCGYwSqIkr4Zic5Wd46kcUpXgauHwIj5qi6WyqUT0aj8UPzDwH5tIXC7H2m2w1wq1MqgsplRk0xIllF5o7LnZTlbRJyKfaqJcuVlrvWnTEiUrmREpSUB9JKiMhCXLAZblaIjmsGiE73x4fiWLvoWnA1R+rg/PZ1aSseGe24sCEPIvc4/6qxlJlOVlXrAhfyKPpsGc0vdqpwNdEmxtvbVcw3guYi0s+GGtlpvtrffKrYCO8Bbxcv9/7XdT+sseKAJHKGdKGmESjIjShlZ9mFBMClexxO7JEKZq9Doa7WTHFZpWelBNLXg1HVWysyM5AIy33nIoDbUhcNP8SIMeURJpBOOLkMmcVCIKVWLwBEOEK+lSmXdH+9fVaL1XRZTqq3HN96WPQ020triAXKJ6SOUpBv5jC2hzDQ2rs1TU24caSaHwrvL3wvMrWH+G9wSl3PbDnmOVPR+r26yriULcW0uUhNsjlaHOWenfUjIAWuxCLI+GmNDqgp8k5Iu1qpymgnpWo6mAcj2uqyDkaKBLQolESTx20DzxnBuKp8l1o22iTEvC6tovCvmXcK3He9riyBRC/svxq401xLkTaDU05IH2UYWSmwFROtWqh097faPbVqMn3yE2oRIcxSiFyWZtYoTQubUVo7QVtdQjSlsXUTzzXJ6K001XxzObim/Jwkqm3dH7q8K8ulerj6azyjMDnlBC0gur7BwhPcXAf2wABhalaV8qUSLpOmJtDpXoVU5CokSi1EaNSf5ClAR3ih0PBeSr/xGakY0J94sN0ZykzXd+YEY1/42J0nI0jeeU2qtLGOiSUCJRKoZcWHsUboGRPu5U7yzaKuwJUULA6Ak08fLwGR/D+k523p5JrqB1OLbaZibWUQ2jihUNOBxu0HinWvWGimZO1OjJd/Ri+Y6IUjeqrZDxekOI0sAHLCW0yDct5aV0r6bzgr3YzIx3BzxeuHyTEie6/mMFYTlcq3iQG2+9lc6jcQAoSq7so4mOntTrvSNKlIYq619EGyykv2iUt0CrmbVHw03H4TGp0z1z0vw3Jkqr0TSZU+rvljTQJWAviBJCWHvUX+uSlYvtZ711Y5SKL8oNmOt0kbJwehbfzNxr8vEM6+9KCMaNt9aqt7eidKRGT76z2OdXTydnRAl1Fn8BK0p7RGnendzdOlZ9RMyMKCHpSALf+tjMjLYoj/XAdxX+YwqJJSeJSKJRMkdlB+2Tcq6dU1kA7nvISymAMquOY5SGRInWsP6B5NLQMVnCfq6dI8TW9SGsPRoIENFqM6K0GE2zOaX26l0MtCPsHVECoBx7zZAIXz+KTcam/rKmezvjrDcQFvtwUBnJduNAUn466NYuQ5SNNGq8mfr7414PqxejVCqjEl22qUav2Ps/7CxnWG/dHXmj5TBGmRs5px/UQ9ktp0RpOEAHQpQW3YG7CpK84DsGRIkizkToSh/6LSSGaT01MxmLJb7SSZdilrzw4Lly+sEdn/w4h6dH1c6jJUroAMT5ZUhbsqy2GmTWW3i+EItN6k0vJ0SJVgmVdfVVxJtwS07EKA1gShTkjcxH02xOabx6VwNtH7snytWRtsaeaCKVXZnvr3URx8fU2vDJgTK1oDaC3jlKnPWeud1xysdIIW0UEGkZkfKt2GpCor+ubTiWXMmm4IoAtd+w8Wbq7zDqpMx6cxUdOr8Yc6RGr3wHarRzFc3RZKbErLdO6pA7E8X3g3L1Ne/Pr8ARsOA4wwE6GKK06E5+rtPD8oy7PjSTymYS4fMV2qw3eTX4eVf5ewOxZCaby6YSo+EbU6sAACHR1wgPTqTgQsPEf+A6V+cBufn0Wq2L5fmG6NKqHObGv5VKD1d78YHzWHull9H5uaFe7AUehIB9RMkc39kRo1yt4hxlsr+S0T1/7pAo0RRjFaLwyFfdpzuiiVQ2l80kZ6JX4a/1Vkfa60K3E6lcZn4gwPGMJziF5n/IzfJMoH8+s5JMfaO6keloms0prVc7HejSsHuiTD9oQwLqULFefroqteFzdxr0BxKPDVZVfxY9W+bCsQaXp0L5W29h+X57QP5l2O1WnKfLJ67VVcHQr89DHHs0a7yZ+vt6arT7dDk6R3m8vlfOQqjgQI1eq9E+2YFNdLy+d2IhWueEKIFS5Z3z1bVGHpO/o1t/2IsPmoQ+AhYcZzxAB0SU1t0hzjmebouOvG+89YafT93D9QpQ0YBbj38AIJ+4is/ouf2n26LQU/T9JxFyyztQsmcGoTFpKm6u4HOmPk9Ne0Tx80Y9q0oWWHscRhbQ+e2j4pOKX+bkovU8w7V8qB09p0SJM+MqTyCHhuHKyqoaO2MrAID0h+3kNCGOCa8/DOGTtpcfam9kNprGcwpovdrhQJeGA6seJEy0mGwibP9wlWK/YD5AbyL0MiR7jOVr06PB/AAAIABJREFU1WSw7E2CcsoIk83kZv8XiAMYzd3goIhSmO/w6D2ZJaRvBTi+6tryL3ekf9mwHKA3DUTket+wGjmjHyw6dMDqQVKMT3jY7Vb+qOYXhoMYzV2B1qOk+IVgNVpXfrYnmkhlc5nkPRS5vlxyGpPiUPFLG01KlBS/EHwTx5XHeIb1eaoae0qvUkpx2PiljSYlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsAAlSgoKCgoLUKKkoKCgsMCuiHIvhdYOSVyNhEWR1H1FifqIh4D8XHcZR+oTHDD2RCK0RBB1HGpvfHEIDbDAfk8ipLehUx8Ty0PpF3j9FYASpQxKlHYAq1r9IxIlLDXma4kkVzLJz56/gYxwQETJuy8nlH+AMmSH9gA7ABwWUeZiF0+5OcKsB06UWoF2SpQ6OCS9eWPYJsqlG6d9vj00qZ6S0uFi6VqNn9Oq7uzbYEEFVpe6DDsWYvSUU6LUxy6IUuPuB06U2sZTotTBG7DSV8I2Ue61SQ/TPfRhIE+2v0RZ09hUqdp9J/srGbamta1Go13+64GWKKEjyvWO8mPNysX2Yp8fyboirhmMjaDavT5PTfcEuSfRFU3XFD2tCqfxGA+Nj6I6oJyvrkNRtXR9IQJL9vKM+yRRITgdDvBMYHjhYW/A49VWQtWDrkA7mgnNdz+6Ul/tcSPldbLYp7HOuj1sroyHGo+jIscVikqicFa3jDyKyJrOTWG5bC1Z4res5lIM62asL0RboR4W6/OTZVOh7NTEcvTCSY7lq8JxM3l74euJgWZUfpX1eWq6YZVifb15FQEJa1KbGbe/UlG6Nd7K8kzTyGfj3USnnji1Wma8t+5EmQtVhg4Hq2SiFJ5PXmnCpZfd/tOdMVheGQ4l8QpOAbC+EL1Uj0rPqsxrBbXDVIXTSK9mYb6nusyFCXQzE+upP+XmeIb1usvrWiNyZ6faeIZtuDkXbcJ9aYqkNon6vv76qw/tmwbvgqVX6zTYxSSyBUiI4bGBMgUhJLo8PBMYngrXEA+S9YVIFy6E7HWfaAlLpYuRmOCTh6FaN8czbXHNYPEM1L81cEup+413P8PW87pPtIQVc9XELUuBzooSVtDE9YShLhKhBJQersKyuXgieU8E7yUzK/Ph8woFHyPRdCH/EsldQr2H3Mu8ILGnq7JzJLmSmR8+qxB4ys8G/ai2fhbdCOvepcMBnuF8HOct+9PFYMeIjaJ8ugLt0uzynx2cTWWRTC7WSgMmOuu2sB5vL/dKF48PQlsFp+DgYr9H3ZcKT6FQIJTEaxiaX8kkJ8I9d2C5VhQuPDc8n8khiykvyLl9jPt0Y0fX4EzOTN4ePL1+oT0cS2ayudTM+wEO1crW15tXyOxAUUzkAMnRzhMcT5gFq/f5zg/MpJDRFDJB1iMFdWkkr2go9ypiYUs3mqB+QzYV76l1YSmLzY1cdrSVYXmm+X42m8tmNzYByE+EoGhBNpOMXPAzuqXLDZqRf4m0AN8bRR4L96Gc2+sqP9vS0XVnCWkH4s5iVW6szih7VziRQWoT5R6f13NueD6DG199y+5icHMD6bKyraPZXDab29gEu5hEtjDVBi2f6PIQu+9EyC0/OSSizE9cbsRV1G43+YiHNCQQt8/FVZz5c1fw7tLmBqGl8cWdc27JjfXdEgB5viCxFqgKIyn9WrhlKdDbeidCbumJkY81cbzH55f6SQoGQNPIVILFLtrnADAVTTfcehOixkiTF6ozQk24/kVBcSP4dfS0d7dMOlqqGG29iaJ4kEpqh1fwHQ101u0Aqp8TlYmF5Ws1DMt7QgsA4IH3XJSVtZCmc31kFRtHLTX3dKCCJ8vCQ4sppBHYmqFlpf315O1VUDwpTRXKkIoWYfn1iYtulnedG80BgImS8AGoxyILyVkBtlmSYQFYqEt/660UtjTfekMxHKUQoDlUW2+0SpCHDHoLYXBheSjAM6y/57H8dcmHhemgiyXFG0hnswlrZXDbk8i+BRqiOSSCBnfficvlkBygQXRjuHBXih7SiM1JFTkMYTlc7TXSv1S4JRxcwvnh/ArcfAas3bIU6MYoE10e5EPCdNDFlnfdkaS34QIT+aKpJoypaLqdGCXxzvK1aoY93jUjP3ngerDuTg5fynFwxE6MUn7HVGfdBpaH5L5jQNFOqAKKtt4KKiQ8A84i/9nB2S8lkfnlcCXL+y7PSjZBq7/6uznpglh5CgBgLG8PAABCPj0+0Hz6GBYekRXQTIhSV0wVaj/BYyJaWRh9oRgjCBMXNTlWlecI+XTsSlOdv1zSWcJ/0iHKzRfz0Uv11bgMooOWAAOilFfoy2HZ+Bi5Ow0MFg1Ve5fGsM5joDZilHYnkR1AFdngFGb5sv5FNNxQfG06qJhQmy/mI111VZVIZkcaC9gknUcUXPB6CfFTY7c0E26ydMtSoEuUUJi4IZoTptq8jCeUgM/q+rs5Id7KydPPlCjNRdOdEaVuFAPfqMTzIs6I0kJn3RK6BEG8qbf8IVsorD0OX4DhUd/J0Edrgk6UCr2gDXWlu/Tl7YGwfKvGDTX2ZpMZNH9sEKWu5ck3d0uUetlC8vrC8s16juW5U92RmWQGPYmNiHJ9KljhYr1l54dGEym8b90tUcpt013AEm8eOlGaTiI7gJYPTgEAIA8EhtPJgTIleWF1sHh7uZfhKhoG7ydSOAxCEqUm47Q+HfQogw9mbmlGlJZuWQr0s95w7do4Fu/yIMWiZH8lwzZEPwy5iUeQKVGai6Y7I8rZoJdhq4f0r3UgRGlLZ90EcFdotaJUTjOo90u2R1h73FeNw3xznS5C4lwN3XmrL28PzSuvLpWauiZECbcX+7iiVGzZAG6dPNxz7RwpiKb0BJUF4AjKEqzOWgIsiTI5UPZmryhNJ5EdLPb5pS0U3J00dF2uURkcbvNXbtYysq6qcix0iXL9QSOnDD2Zu6UZUVq6ZSkwOB6Uf9DI8u5ATZnU0ETIzfKVVdXkbDclSnPRdGdECYmbCK+YXsoenBGlXZ11QzwK+Rm9GCViKxSjJEQQ8/FWD89w50dyygtJDgHjd0bSlQYROj15eySkjqdQfqqt3B5RgtzIef1gEAp97pYoUURSSg8CZYwStk16GEOLGRGlKriBtgh7R5RgocenG6NEwf1DJ0rTSWT7dvji8GoM+eyB9yKWz80TCo4zJEocmmydJmeXqVuaCy9buGUpMDpHmYvW88qpCylZ8cy00K02Fk0HeLlU9X4iA2XMTccYIEV538nO24lULptdSc7cvnIbDnmpi2q1QLs5UZrorNsD1LZXZr1d5d2zRObBxXmlrDdMEKN4zepoa31vJJHKZhJ91V6GLW+dzgMA0jdrXXDjmUhls7lMcjYygBLihqkMPXl7GAj3XLgn5fqJYVXrzauy3uFqrzq96K7/AI3FrokSxa147kxfPJXTZL1R6LZpVEqpE54AF+ye5jupXOqzL/PwucLV9s1L6eC9JUq0eVRmvb1lnegnTPtAlHCSljfeTWVTny3ndzOJ7EBBlCgbRi4bCaJESaTqgXnpMIwhUaKDDcd7Hq7KCYDcy7xg5pbm4vIWblkKDA+cQz8glIJhqouwiyVRGoumAwDA+nwPPhjY9bHlGAMgfD032ILkzFmvu7y6rmsiA+9ZYvRBJdBuQZTAUGfd/g1TI53o0J/Lc6ouFJOOhaFjj+Mr8rmw8roOSW4pPd6K7ut1n8DHUQEAQHj+0VATOq3GuzwVlfXdsYx8Qb2cr568vbB8Dx53hRr2USlUD82k1JtXn6MkxsXtP90WfSSfTtw9UQIA1hfCLfDwKeera408mbgs/wJEWB6Dx0hdnlN1oclIm5dI6wnLd/AX6+6sALD+8GrdcR++zoO+al5OkduAJVEChYd43ScUgln7QJRAWL6Lf3t+Lrqym0lkAzB2IacH4Q6XED1X3Gv94UCj380zrM9T0x4ZG5C/q26kfjKjKpw2c0tzogTmblkKaPUgCgoKCgtQoqSgoKCwACVKCgoKCgtQoqSgoKCwACVKCgoKCgtQoqSgoKCwACVKCgoKCgtQoqSgoKCwACVKCgoKCgtQoqSgoKCwACVKCgoKCgtQoqSgoKCwgIYojcrBsqUVnjBBCfURdgWNVJajqqVa7FP787OdFS7W335gutn7qGpv10R7KRC/n3jzhBhtIf1BPcd6AzeNzHvQM7EEHLqHaIhycyOLKx2RakpZSVtqz3A4RInUxIhqTqVeb9+IMuhnDoEo90PVnhLlG4H0zVoXJcrdwWzrvc9ucThEuXe23pv252KXjnu8h+gB+6lq/49KlLnJiyfKXG+QGDqJXOziKTdHjuleePLSjdM+3/4J0x+6h1CiLBl70/5D94D9VLX/RyVKA1mYNwPa+q174cnmmpe7xqF7iEOiXH8SgaU0WZ47TlaQNdY7BwBp2Et/La8OTr3Cw3PxztxV+CeX51RT+AmpYf58ohdWWmW4skBbVNI3n2rjGTY4sXy36bjP/nrHyNZQcktRJh5qJ3m6HwrC84mrjbhYL+cjiukq3UtjK4U7Cs8nrzShkr2M23+6E5bsRUK78osQgZIvtbkyHmo8jsr9Vpwm7GAtA28DTlTtARpKWCyWKyuraY8YqM5zvrrWSP9Z5QxcX4jCOrsM6/MTmvSlTYPNTKynHpWFdnkqKjum/4YaEW2FNaFZn6eK9FIdz9HzJXPHw9ZYfxLpaESlYbmy4xeGoctrQuHIB4z6DoSvJ4hqzRdjz+z1HjqPrMsC9YWIEVzs8/MMF5wSCPNqNPIIHUCTmWgBjWwZGnGjLhtMB2yPtceRNvmv/jM3U5KHDMZG0J98nppu2YbAmJrSUEH2ycNQrZsrncqdEGV+rt3HM77z4fmVbCYRPucnZC6M9c7B+lSbn2F5z7mhWHIlm0nGwlcfyBJ9Uul8WMrfW3cHK3DcrHWx3hPBWCqLBM5d1cNQj2SqjWdYH+fmuVPNwY5rMzlbXTWcjUhBWy52jXSBLycAAEvhltbwRDKTy6Zmu6u9RG1wB0QJlm40tQ3HkivZLJa6vxDLAyH/EmnLocjpy7ygno3x9nKvSkACy8NbycDbgxNVeyhkiG83M3TWxxM+IA90PJVLjXefdCumDdTS8Jwbns/kkBgD7kgJRCnrLsSSmexKMjZ85cO0pMuor6ih5znad6wcD1sjP9kF9TmyK8loi4dFqq1C/lukG1w1+AhH9k36DnWD664lMplkLNwb1ZdA0oFC5xrVGydkYNPDVVh3XjavkH+JtCqr+x9LMXqLmWiJzQ2ss9h8P5vNZbMbm6bDbTAdAABAWB4OcDzDBdqjiVQ2l0rcvnIjkZcfP0jdAclLSGJKJtQE7eD2ubiKM3/uCt5dstkpFRwQ5dJglUIsDIqQ6O0vSPG8/HTQzfKupgeaBxQcHkLsHMq5VN9awRcnv7U0WMWw3tZpQWoYQwoA24Bu1hv2DqpzSD4HZdEGtCaFSnuoGr4TolQAKjIaaqOTl4IN00qSeUILAFjIwNuEA1V7OECE2YXlcBXLM77eR/JfZX+AS3VsoqcDFYqmwqdRFRIvdkiUSHlNo/UGfZIU81ufbCY02rSeo37HhuPpbb0hT+EYhXrrbdJ36CclnStIhNzSEjIfa+J4j88v+W3uToP0UFea12jrbTATbUK99TYbbiXI6QDbpqNICLvgqr+LyRtOUm/7HADm1IQW0eXNE6XqAgIAnBDl8lAVz/xHaEZOGcNHE1786+udQ4lwnaMn5oIqUPm+7oN0VrrdaKu0s4ANw7xmF7pZ7w245oeeARkQWlnS3hLyX45fbaypRHsBeQI4Ikohn45daarzl5e5lDsyU6JcHiItDGEucus4VORA1X75WjVDiBXD1kTreSiVp/dXwkTL4UqW912elY0Pl131d3POiRI2VZOmR26jeh/K2EFFQK3nqN6x43jSKG++SEQ6GiuPIc0i+U8qojTtO5LQOjcUTzs9gZHo8qAlpDAddLHlXXfgNjONiVv3YWwnRuk8aqlyPNMuG04HaDel5C8A2i6o3jGlJnhNaaFdKuwTpb4GEOqhod65ycLKbHh0V3/SSJSWZTKdjauRM8ix4KMPaagJy8NnfFC4bia5ggbbMVGi/SB3qjsyk8ygUbRDlLr+Sry5B0TpQNVe1+zSm3p/1TRV+woMp50TpdHndd8n37TUj7PveOvTnWUc7yp/b2A0kcJn6fSJ0rTvQFh7FG7xu3mG5blTvbMONLDgKqQhmhOm2ryMJ5SAq7P6uzk4lFgI7BCI0qzLxtPB2HtNidKUmvYosWafKOfaOUJDWQljvXNdMXIIs+GBF2w22JDsA1GC1Ug9w/KNY998eMHLcC0fQheb63SRUpQKo9snyrl2jhT+VXiqKVHCXcm+rigdqNrDoJjRilIZMoMgTDTX6WL5ymu67uOYKDWJC7P3tStKE6K07XhwJS5rECquo5qcpn1HENYe9de6FLtLa8CHeuNYvMuDvDTZX8mwDdEPQ25ipA6BKM26bDwdYGjL8YrSjJoOnihR5E4bPpA+qat3DgnIOEZpMDxLQ8f0v6VtmF1YzEaoU3ymoY5DIXDpK9J4w3irLlHCCXZs8Cm62vqDRk75TJMGEsbXbBEleBTyM3oxSnSjPSBKB6r24HGvh9WLUcIkBjw8QMxzRYwSBjSIoBUJxzHK1WgNqxejzI2e1Y9RoiefJVHadjyUKZ5QzHYDojTtOwHn9JR/0Mjy7kBNGVveAYknEXKzfGVVNfl8PQSiNOmyyXRAaVXDGKUBUZpR08ETJQDpWwGOZ9ynO6KJVDaXzSRnoldhks5M7xyLkZed1816Gw0P/IEK/lY2l0rcD4fjq7oNswfdGGVW/mkONDfPSD4HcOzS1zIi5ZQNiBKNB1fbPZPCyVbJHeFPXPxNo1JKkfDURMjN8kygfz6zkkx9o+7derzVx6uy3q7y7lm4bttrojRXtVfntWHWm6voQD8iSg/DgW65nczoZL3TN2tdcMOVSGWzuUxyNjJwB/q286y3sByudbG8q/w9ddYbvq/IevtqPkBXtiZKu46HkgmB/kQGpVnJ6yS6PDzD1rw/v5JJpr4x6/vqSBs8LrIy31/rYnl3W9xJ6B2u6MkFGry1Yl2mMi9cYle9n8jAxu0JUcKNjqf5TiqX+uzLvFmXzaYDOsyASUaV9TYgSjNqOgyiBEB4/vHABXRyjeHKyqoaO2MwM2asdw5Usus+T1Vj/0evbAzPemq0+zQO93K+ytNNkUff6zfMDvTDT2SWdjrowusj6b3l++0Bjxfp2U/cbuWkwLCqtcLaXC88QujynKob+Cj+fqV8jnJ5DB4oc3lO1YUmI21e4hT3+sMQPkZ3+aFO79ZTI53oWJnLc6ouRBw62z1ROlO1B4pB4cqO1/eOK47AEUcCTzT2TDyJ1CtM9PyjoSZ0nJZ3eSoq67tjGXloHJ6jVFyN81XX9X/8N/X7Pk9Ne4Q40muDKIFdx1ufv1J/kmN5xu0/3Ra9319LRh7WH0rOEPrIrO/pB23k4E4+d5jQgaaTo0MAnl4gHnVa867P98BzplxZ18dgb4gSCMt3WuBpX67uzopZl82nA1hP3evAJ5ddnorTzfdTlkRpQk0HQJQUFBQUFIASJQUFBYUlKFFSUFBQWIASJQUFBYUFKFFSUFBQWIASJQUFBYUFKFFSUFBQWIASJQUFBYUFKFFSUFBQWIASJQUFBYUFKFFSUFBQWIASJQUFBYUF9owoD10mDbXCsE4w/HPJjfwFaB+/UUjfrHVxteFlAVUlUJQaAQDgSlxccAqVc4C1k/XKEaIqsDpVTXGhExMpBWH5Wg3D1b6Zioj7h1+oBPl+Yf1J+MIpN8czrC9w44sSLkCJ0iYoUTrB+oNGjj/WvygAgMtqqQcFlebDpT9RnS5WU6gYyOWyNZV64ZXNRhwAAITFvgrDEpO/VlCiJAALAPqboslMJvmZ0wJNAABKlLZBidIBlgarGPb8CGYmvdLoSExJKv0JxbDq6us1n4Sj5nVxhEgkus3QMZZ3e8otJYtXI/X6anG/GizdOO3zkeX1Dp4oc7FLxz1em5Nr6Xqdx31QzVsOV+ruVJyAEqVNUKK0j8U+P1njUq/Ev6ycDv8PC9A2RBPDVazyu2jUahqbKlW7b6hI3tpWQ1Yz1Ef+QSOWBf11QlOH9OCJ0tHkOtDmOa5mrQMtUcJQkeLxC01QE1k1En0H6oLDmmKZ6rauL0RgQVyecZ80r1e6vhC9JOvcn2oKPyb0lzYz4711J6QioOFglYIoNzOxnvpTbg5VmR3qqFaMpfD1RAjWG+ZdntrWCCH6Lqw9irTD2qucr6410n/WCVGmwzUMW94x/hGqkOr2nw59tLa59igMi5t63dXt90ixXcOWrC9EuupQ9VOv+0RLWC5DKzyf6MbVYStOX5yEdUpNC/2nwwGeCQwvPOwNeLz4TcOxEJ5PduAKr2U1l2I21UtXbgXUkrmw7LasnI5kFKVys3DffSa6qtTyhYCEGB4bKFPsvhNdHp4JDE8plMd1bQKQxI396q3Gfg4AAJsr4yH5r2VVXVN/Qx7eOrEcvXCSwz4mrD2OtMFKxjznq1b4OVnkuLzuYuyZafvNgBR35VdwSlJnufvRFTh3uLLjF4YXiOiD8HyyBxYeZr3u6vbIgoPIxPrCcNOJMhfLM25/Zf2NRz8iJQxVPWyDmavRAsP18+1zghZGplaX6y61gq/OihKq3BCPXxgJaojmDEXfgTOihNX2/WfDiUwWSUd42uJGA5WfCNWFbidSuWwmGbngZ2RpGmXd//nhhnJFWXlZTH00mckkwucrYM1qSTxkuNrLcIH28VQ2mxoPBlysF+vBKDUPNKoGliD02mOpTKKv2suwvMfnd1V2jqew6XydSNHBrCX5ictQKiCXSd5u8hHPMLjxrA/PZ1aSseGe24vIMSyJkvNxnLfsTxeDHSNLZmPxdKCCZzwNQ/MrmeREuOeOleQLOdZIcFlC4nK5pI6t3XdDUTA4LlqRsqk22KNEl4fYfSdCbpavCqfTJFHq2wQAAGaDXgcbAmM/J8Q5JpKZXCY5ER4YT6Ne85zbx7hPN3Z0Dc7khOVbNW7J/ZIjwYCL5V3Vw3BclwarGLa87loik0nGwr1It8C4/SbY3MC6p833s9lcNruxKbMnEhEZh3eXFI3StwIc76rsHE/lkB4DzLzZMg7UwwmOp3KpxO0rV+KrQMi/zD3qr2YkqZWXecFw5m5uYNHK90Zz2Wwuu7HplBNUMDG1kP9WYZyXTjWBEfS23tAQkhIulFu6ENNIeShE3x0Q5dLQMVaK9AMsP2IRZsKffdDI4rYhtfvglNQyqDmFLgUvW946Lf8Z5lVhI/PjLS7W2zgmjcXTgQqchIVSOaRKBKmTZQNIr11KICAVdmmdrpBvN2uJqvdjzdIzDN5CoxdogyhZ3t0yiW5mMhawzS2TTh1r5WatdjQVS0ioISXvu6EjKUWEiN33VBt8TkORA7T7Tlwuh/aEdoBhTQObAPwnez6mBunn+am2ckYxWBgo41QzhOgGuV8zoXM20VLOsN6zIzk8EOpkvUn7LWCw9fZcTuBrweVO7fAKbhspzQbnuJRYs3EvrcKiLfE+zCq6mm4lcoKFqfdr6y3dGDEgfPRJD38j0Xf7RLl8rZphj3fNyApf8FlUdycHhPxLUvlrYxPdcz56qb7aj1R30LTXU7snaEKYbGbV4X+ikcJEC8+wjbfS8u1Gm9EZlOVr1Yw6peAsRqlxGvXXbbYE9T7SVVdVifRAlM8bxnd+YCZNPCXtEKUc0TMbCywCdXZw9ksnj2F9SkJByVACICqU991wCskC9hMX3bJuIhaGDU5hti3rX0T7brjKI5THDWxi3Cpj6Ps52QsVoIfLOlE67oeeAS2TAppWvOfcUJxsqXH7LWAjRim/A9tWH03Lc+3+e9rWGgGd6wq0jyZfEIJJekSpP3O1zTP1QytYmXr/iBItoMr6F/H+Cz38TUTf7ROlJqSCXlXhNF55kYywPhWscLHesvNDo4kUGlE2OKU/MARN6IkKEV/RRFWI+aAXad4/ojRrCViPt5d7Ga6iYfB+IoV3WGjIhbVHw03HfQzLM+7TPXNrdrfexF/NxgIAYe1x+AIMY/lOhj5aszd1DShJfvom+ysV+25JI1fx8jaNI3HHcAC3H/JUYDidHCiTzEsSpb5NTFqlD0M/N1GqUs1G3U+Sbwprj8ItMCrNneqdRS01bL8FHBGlapbJL7vuvZmJdVRDgbmKhkgKsqXG5w1nrrZ55n5oAUtT7x9Ros2RfyAJl8QoJmgm+m6fKGeDXoatHjKVg5cBZQIlmWli2pP7UAyCCJRLffxnqZGwL/oHlbVhsv0kSrOWQLlwWVFPZ8iFtUcDAY5nuIboKnBKlHbGQlh73FftZVhv3Z1Vs89J0ItRAjxegZuxPj/5/Ef7JjKdjY5YomjPIvF5+OGGrssE600HGZZ3Bcn7qWwCAPJVm8Nn7OfQqUxWlLKwtd4nyWWO1NL+WkX00KD9FnBElHBOOQ+qqLCZudfk4xnW35UQgNbnjWeutnnOOEEFS1PvI1Eisqisq68i5pWZ6LvSTHPtHLl7EpL9VVJb4TQg4hGmgJ2UBhU9DINTAEckfSEpDKOMUcKIJBpF+GcyRrk0WKUfbMILatJ3S4tR2iNKs5ag3KVs8RrdISfdbvb/b+/dntrGtvXRv1OlckkuW8s4XEJ8jMO2EwwEfnZwAwECCYS0QxI7BHJZ2OGaDj5Al/uEqLbbZ9udPukum157lysPrrXWLr/oTedhTElT0tTFYOc6v8pDt22keRnz05xjDI0v5ce2Y7JUXL5kTZRu56ItUyuvDRqj3nCzl3GWZ0KRQdxhghzNeivXvbSjUx7Xtp/qCtQpj5PHpM2ot42dgwlZ+yi1ZtQ3rpMdZ+rU6G9nNK2YqNB1AAAgAElEQVT2EmjaIkrkBMd8lOcFbsZGm7dZuabmtccJRjgNdVeJErlLdM8EO9F3/TCBz5v3jT8pVsTdlVGfdpSWlUR54fLMk4JYr9Wqxb0nd60CfGjNDC8dViuHa9cE/IwAkTKeu7q0K9bNUe/mwYyP5RlvbGFPrJmj3s2DKYFnuL6RlXyxUq/VxMLm2o87H7AW+gOTT4qV80e9XRKlTUvQ3iq8fFhBoUB1GD9sTEFIsXK4HMKCWs2dlJflGWEyU6yKe6v6ETPvN63n4sNmAiK/KGqPh8XsYcqjRIBkSR7fPxrzhBCQpSV2JANRIrbFd9kYUVqNSZt5lHZ2rqRSoMkyRL3x1ahPukChWO5qtizLsvxhIwnJDNXDO8Melvcmd5s27XcE5Ff5JtbFuvj216aTgjksDU/PjeVcsVKr18TCZvrBtrvdq1S4E02u5YrVmgg7Sn0ULnTnsFItin/Yrlx4v4D3jm2INfFtqdkeJ5ibZDfU3SZKtKj0D0Br0XcjNbTEjPJypS8ytXG0EcfbKv1+sDKJMtFYv7cnHJ3NVyza0XhzL9qr5jO+XArzWJ5d4yStyK4L0UTm5/wt3XsaeMLXUDJ7kkc5JcrX4sYMkp9nWMF3KRp/fPIvpYVamlt/fD7/cybWNaK0a0njzTLkVwq+yFTmxXKIRRxU/vvUUA/4iQK9scW8lnXWepfBxmTzeH3Mhiit56K8lUA69DACv7t/2p+uDOJHVxWwPLD9ozFPSIX2giOc4DTahRg0dnHMz2M1Jm2/mWNt57IsS+9/Wh5H6YGMNzgQW3n93+TViP+SE6KJjJoCXH6ZRNPt8V3Rkv4s59QRUmldmfToetWJKGVZbojPptH88ow3GIxMPDr+l5s7NQv3lcRewRfBEzAbbxaUJXPrjWy/cqVSVuGH4Se/yXJ7nEDov+VQd50oKSjOC9273p8b3+W73hSdBSVKiq6g/HDYoyUVfkZA9SDXUREKChIoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQOIRGlS/1EKOlxIarF5MN3jx4RijOiUMJtRTsjQC5vaq98GOlECoE04iF92CvYWUn4c41h/6KF9I75MNU1cU2xm+9+fuzkuYD0Xzf2ZPg8bnDpwWfjoHCBPoqkuj14DLjLXTpERI2yIMrGJqzLUPrYuTJRTAv8JiFJq/qOG2nxyZ5Bn2PCdY6wXlCg7jy+DKB8Oe75OokRFz8K3d8W6WBS/iuIddkSZCjKfnSilUjrsV7TV6pViPp2MJrbOP7Q2REkwpq6Kd3dB6pe0gClRmnBhNfovgijd4QskShBN0tV4PwfquR96ff4urU0zPr1uOAZnorSoc3p+UKL85tA+UV545ClRXgSdGb2urk0zvnCihP82S0WeGxcjSunsKDMFvhXGGxzQlRrdTbA8k3xVWp8MeoGYDJeVzo6yiUhQLY96+zo29PYK9G5hQ5SrW5uoSConRKd1VWldCrFbadVL7/OLUK+U4QKhZFanOn92nFEqtjLeYPDqQxH73Czfroz5wO2947RWCFnnbcH+VvBFpjK3R62JEq9zHI7+ePJvshq9yQCMT5dWZWsx2h/woLqz6dQgGmcQhddJY0Kp/KsWdc5MuoYgWKTJ7yEBibWyKozx9PXdWNjnRYahDq+JKVqVrUWlxKzf2xNObf+PKvOwfnAPvvL4roylfybpgbTRsMZJ9ocYqhrr8V0ZS2tVY6X3r6bByLlAIPJDrmq4jXH8EzuyjQlZ3MikTxdaKzuoJyERoXzp6VivoPzMxnRtV6seOg7dSTEsH3/6dksrgz2ZPiEfgaX3r+6OaatjaCZXaRF/6OLofbzoY3lGSOXPwxsEXIAopdLaVYFh/f2pZ8VKtbg508/xmIz6boLlGa/AscLlsdnUvf26/rKNnZSPBWVOsSbmpq8IeMF9OwX6NmBNlCzvGZjZKKpF6lVpHddC7BZa9eAp60/lxFpd3Jrp5zTNe61gfbYg1upi4cndB4WmrXy7OubqOCNBCFUpqLGbEHhN535miNOpbuiAlEmSObEmFrL37ux8sFCjtydKqZQe9mADqFPgQEpPqmY30mWNmMudK43C1eGRjARW0hzOUGByilaf0lkYKEXaSE+Uje1kkGF53/XVXLFaqxRz6Xsvy7JGTIrhTQ1Y6aa10bBmfgEkHGqVYmY8yGh6fCBiOrJ6WK0U8+n59aJx2bY+6j3pH1t2JmRxI6n5F9J3HbhzUqvVa381JVdEKXBenrsykZq+v1e3u6/DatXDTJQwEbsiuqxledDTB2MgMlETd+eHMYE5A9wEc0ADkme4vqsLz95emC5dR72Tu4amwKrzTr7CFH1uelnec32zjl1k8L5auxXvHmhGY7MIuo8W7mG9ybqHNVFiU4VUB0DGz7UQO1mrvpkb43TFtEE4LLEjKY0ZXDKuFQf5drgRdk2k6AIyh0BD2DZKejPTY0WU20meqHVnOkbZEiWSA8PkXHSabqg7iroDTLQq3UEA6EOgndrp6iXW7xN6VGW6wq0eVcUB2um7pcrFwcWH16qybDDOnZSXJVY1h65hknOw4Q0/Mm712mmYDrj8J4ybg96h3krtTMj6RoQNtRui5JmQsrGxu29bq5VElH3LRf2Dk6A9ZwQ8mYiW4y7qLbcqW3MhRV7Fvd4yEa6j3h9b+qYQPdCFWR+vyNfBRfB+Yt0rpQdYnok9rWN/bFiuZAX69uDOR4l90oYQO0mrXsrfZFg++risjdtmAh1F4S76Lsuys3y72feEfVJaHeQZdiSLX9TaR4keCQMzGzrl+vaIEvqoO1zrxxlpWCZ3JeUPLfYFCkAYC4SA0hGGHcmspzxoif6yFNS4wF4HBjdOkOIhhUfMa8zaa+m6YbLc+vMw+0MsHESSL4YNQfDayv6vTatlqh89GxOyu9E5iVITArK5r4vVKlt9ZbZGOx+61Czn7o5FgyAcxJoWL6kj2DgSvbStP5VDD/aIbRvnPnoTPdD4h7YWSRosfHwtFejbQ9tE2Y4QO0Gr3jKFM7lraR9O8u22REmaKTtD1J6xnp4binJ9e0RJMkfDOBdmfUisuJyOkHdD+iFIh+BRUU6HeCb2tN58GceeLqp6omuitAmPtEOUbhsGpzx/YHR1syDWas9vYBeUzo7T45c5u02NrrV2JmR7o/MRpTqY7ZpuF4hSKj2McSzPXZnL7BUryCNBnMSDKc6SKFXq16HxMq4JIJ8H5yZKOA477igtLLK4HGCNiqbY+For0LeHtomyfSF2nVZ99eEw4TwOgC6bd5RO8u22REk6njhHvVuVzUnc0dkWUTZfTDBG6VfjOMOpbWzrl3RI56+0wunKIMMOLO08jSJvZvP5GM/4Fl6uj+A25pooicZp0TXbOLirhoFOpBatIlxQOjteCls5Q3WjZ2dCtje6IFE6m67lajXivER5MMXh1mLztAPdY8M6tZl0+6u5wvmDOfWNUbKPEp2zbC0SfBy4T1fn9bBRoJfl1p/FYtnyHGNob5tEeT4hds0yTlcvkV1jagfNPkoH+XZbogSPJL787HyU+CjgI2MyenhQaQ64xosJjzpo4JFUo0mywUepfeIJDw9ih/SGuJ/LvTr8r/8lNKe4HGD5wVBEfTrW10cYNjwwqHuEuCZKFHy39lG6JUpXDYOVrzoiUbTQdEFLgtBbqY0J2d7IbCf7KT8uNy0Vly9ZE6Wz6VquViPOSZTQncE0Yr/mbsJnSW0wv7qj9IenUc76qYxExj/DjlLNfddHvb2xx2Wri+gfgA+HPSzv6bmZKVZNcTQbBXqgFYOPzAptE6XsWojdQqsegub+wOhqrlit1epi4Xk6vQsGhkKH3qFpY9TbTr7dlihlufwoxPEM1zeRLVYcot5SYSmeSOeLlboIO0plEExq9EoEKXx7V1RmVvs99JHnri7tinVj1FsZnsxVOLupbAsPfCtxbTiLYNsl8A/qJ9o9UarGiSbCGPV2TZRuGoYW4fDSoZpEoVzww2YCkjcqhaWwn2F7Ejvmg6HBSq1NyOZGsnIKCd05rFSL4h+yEtFihMlMsSrurRp+bxpMO9O1Xa1GnHdHify5Y5tqNoL1HlAqzAo8wwqXZ54VK3Vxb3Wkx8+wwcROQxnTCHdlKr2JFhrkNji9tWWHC+ZRYprl3uBQMotlOzpaJJ6HeCW68OokM6KNr6UCvVRY6POwwrUNN/Kj5yBKt0Ls1lr1DXFzbkjxRnPCwNBY5uif6nea6rzH1zc08RzlUVrLtzsQpT5Trze2mD/JRsmG2Czci+OTpWWzEdToz/ZVMfv++N2D/dtBfNDwfMxoIvNz/laPYZzhhI79SWHWZ5PjBeEXPIsIqFaNnstyW0QpG+ZR8A3G77z+n/aJ0lXDGm/uQfohJ0QTmZdLYcUfUt5KoOn2e/vj87p0XRVmK7U0IcsbwZfqlN16I8uyLLfeZbBp2jxeH7MhSrv7OqxWPc4dzJFKLxJhNTn3VSbpt8t1aYgbM0rSJRcIROY2sJc//3iz9kMsjH07lX5NHHy3oNWDKLoCCOOo5z6InFpnU1JQfNGgREnReSBnApY99yETUzMQKSi+OlCipOgsWn8erka8vC6pm4LiKwclSoqOAl6R9g7Nv/kqqoVRULgCJUqKzqJZeit+JNcyoKD4WkGJkoKCgsIBlCgpKCgoHECJkoKCgsIBlCgpKCgoHECJkoKCgsIBlCgpKCgoHECJkoKCgsIBRKJ8M39pAL1PjgpDDAyN3TOUxaawBVY2IvzwP9GHJhEom/oon0raUEXzYC7A8b5UF/WYvxQ0D6Z7/DYS818T9LWvHl8VGG64yxKjX6CSpQMuLlFpUz0olhbrtVq9JhY201OXvTzD8r7rT0v0tTQXgLJUvvEnxUq1+PZ3rRJQiFdlpJR//7CorfnpiXLGx34vRDkl8G0TZUPcWIgPKCWjApG5LZ1IYOvdJlIkhYpKujeTpOavW3OwiAwVd8ylxdtbz+YigZQoTegqUeoHoiWuhv1M+0VtL45PrOyO4fR+JMidxyBIUjay3Cb3dZko669u9gc837C+uSyf/hj1eTumPX26MujpuTa/WazUVM1RtZYtKFP6+1M5Eekj+lXZLlk+Wezxg+ShmSi3k7xBn+ovd1WpEbqvU28axraJsgMTcfpgSBDaUqvH8QmJUlZ1Jz51DZhPrOyO4dxPTqs//JKIsvsL7LPjvAoiFmh9xF/NBLMcuF+SZaXGu1bS9JelPp7hRjfq8P/1vQfZwz9bpPbUszGsrPc50P15dFYKafsK7cNZ4MQOn5YokfIiEkq1kUvfTvIMG1k9UoTqDarn0u/55QmlPqjgw48wOymG5RP5Unb8Msfyg+ktS2V339zWwaJ60pk/OGudHaeh+iwXCCVf4C4C6f2reSgDzPq94amM2hIbdXZFj1j9Z5xm6ewog45ajDc4oNbuVXTDSS5Ie+5rVbYWo/1q4dJ0ChNXMs+00fha1a0FpS4vFwgMzm7/t+VQm457kXTZZItWHVQtZGzj7ZZWzHUs/bOpDEY5HeKZ0NrJm8WQz69YVOMkM4VERL2Xowuv3usEP1Jb4jOl2K3gi8xhN5Wls+NMMqqUNw5jf2u2nB+Nksu6NWZWj5lYf5vT6h+Pr5041vTAhgvGE5fqLN4ZYExCVyS++GUpaJSjcUCrurUQ7/X5UTHg+7MD2NHbpFMWSZ8czocDHlW27yQLxXEZVgjq5pRoQibl6uQuNnpIdwTvOFKxnjnUi1SbJ8LKDHSFqAORH3JVs+QfmjibvrQqufkYYoPe2OLqdPhTEiUyCNDktZFL307yDOv3cP7+yexhpVrcBO9McAq5v979OD6VzhUrtbq4dzuE71J3UgzLc16B8Q7Fp2dX9v4/a2V3nuFCU1siUmJggz4BP/hgvrbyoxDHewZmtsQ6KjHPDaNTkY06e+ujonKHjkW6Qg9Sae2qYJTBgMtKzb90f4i7IG2IEs5uoCVbNesrOBBlYzch8AwbvLaSL1bqlWI+vbxVth5qqfmP2vHKAMszgytHaiNxorTpoGYhoNarFu43K2eV0yGe4QSO8wf+42ZqeuMU6Q0Er6ULlVr1MD3qY3lfcrehDY7fwwWHFnJiTdxduRHgeNXjJpUeRbxGwQzV5EyWU/2oiHfe2NT0lokWrqzD4LWVfbEmbsGVY0/tiwyDfgashe0kb6jFDQXe0X6TOGV4Syae11yeuPX6K4fpGwGdSoeZKP2c1+/puTY5Pbt+qrihr68dVupITEJIbcMjgWxCLdIwmlQCNb0zg6q7LJOvYGMG75b7eMY3snpYrRTz6fn1oiS3PiLtXBioGlzCui96bZVCerTPcw7nrx7nlYKwlWkHg8B1x0DrGRtQDbpnL2KuyGoJZxeivJw//qKB/0CTGUDSIjP7soxmjpt4rjV09ZKqOu2gzm45DuixaRZWu75Zt/tDYtQ7ta22GQnvyLJsVOyyJcrmdrIHHxAr6IbafGTDiNJdBzGhNFA5Dz+qkvqrXed09ZLOzQ3rCvqIfjx4X5t70JDyzhxKygo0S7Bdg/MtyXKsT3wEosRaBeItw2tV8x8qQIdr8FGSnn8uJV715w+udzJ9RFK0VYDmJbmrmUkmZkuUPOO7qYzZu+U+nbXD1UC30saEbI/eMFaKYCqYsSZ3bnEFGzOAAVEF1CzH064vYCqYPBFScPp0RAkrbSIv2cu0kwwURJqQvofULG8tTwxdQuoxWh9gOPQnEWcdTuMgYj+QXk2wPBPLljVn+fMbrCKh5yDoYe+CaEuqF2+YIer9saXIz+sV0whGTyZKKAFpELxV22o11HZEeY4OErsMXdC2WqX7YYbtnd3Tug/Hheh6nUw3oOQVXC7CPFqL+hItpy2itJLiIQ4qbP8VTr8AUbaaaB/Z+ihuGQ5ehPsS5kUf9TbbjCYsXEoPsLxwa7+m2h6cKmJP67YmZO+jBKYGo5J2Uh6Wv7Tyzv4KtmaAJMaurez/im+xDeNp1xeCqXxiHyUQc3i1ZC/TTrQzbQrRGco7NJ3dL1bQGOmIUm9eFyJKo8dQv487J1EST9D4h20Hc0gT6Zoord35dkNtR5Tn6KANUWrXMTmbcO4m3lS5LLGP+IcuiYnU2naJEtQ0tVO/9dHbsDIdYxqwLbJ2WTqK5dnajMntjv6F1sq2ESGHYA48zPpWT5EQG8G8DVewNQNZOjtOj0NEQbi88PoMc61o89tmXz4pUSJd4L7VU3u5dLsdZWobyQ1rXgxdHzpOlKAZb97Jk//QJVESpdbd7ygJlgTrSnv4m35sR5TNl3HzbkuWZfuhtiPKc3TQFVHup/wm3XrbwYFFGForE/to3lF2nygVlky/M0XATcEc5Ilyc1nlQmuDBA+GCpgXvTChe6I8mPGY3KbKhS1NiNRsw1zDUXdwubib4MjuNcMVbM0AQTo7Xgpjjm/D/Dr2RX/8/3REKZ29Al8vOhfYyKWrPkot8oV8lJ7rm3Xl+KkMEzhHukaUsJPHfZQ4zkmUcn1jlOzCG8817f7QOpgDHklhQZOZ0fsowTKU6ys+MmR8sNM3O5hsh9rWR9l+B10RJeyYLFJxkY8SV2pEOvcLJ4qeO8FHiYQePwlRKiy5bIyJg4tW5QjpcNpHSKRzJEror3J0ld4fv8rldn45M/7Ad6tgcOO6IkpwIGJ+Pd2dySZEbLZxrmF1XwoPe/VPC6sr2JoBBnxODfPr3Bdcsqm7PkoU7a0U8+npawGOZ9jgtXX1tGEnl65srdWY6dxlrxYzhYCJb/yZGmG0J0qTsntbRImiY56eG8u5YgW9aPRg+wPxDw2f1LMxnmF74k/Fmvi2hBu9PviIgsLe2OMyPoAufZQQ7oTx5LmrS7ti3Rz1lpu7CR/PsMGxbLEi7i9fD8JZA4xPCfP1jeij3nZDjXaIkduH1UpR/MPQ97Y76Ioo0asjrHB55klBrNdq1eLek7tPfsE8fbwafUZRb3IoE0W9uavZMtkGZFkJTHvHNkzzdw6ilM7yKR/LM/0L+1Wji1ldDv2pnFgppK8HGdYfemhclqbLSoWleCL9vCDWa5VibmXUx/KenhkUhobMIQPbwjtFrBC5vS/W3ES99YrwD4c9LM9dmcsUxFqtXinuZ5bXgWusTIg0jKa5hgcDa5lkbbqCtRl82EzEFjMFsVYpLIWxmAycLXwT62JdfPtr07YvsOQZb2xhT6x1M+r9Zh7JxvMMyzPeYHAwPrn87K0xHGcplw4GceNBDsuHwpIlpdKz5LCa4pTPpjzqqZOcVmpQdm+PKGVZbojPpiNKNMMbDEYmHh3/i3w7/SdS6elYf8DD8oz3etZwHJJ+P1iZHFDSDIeSWSxc2VbUW50/7PVwIZrI/Jy/1YP3oiVmlcYEh5LPjp5O4KtOev/T8jhkrULa48rr/7YdalluvFlUsiAXXptHo70OuiRK/WVZv7cnHJ3NV7Qfh+efrqndHBhfw4PAeB85IZrIHGtfEi1HKmUhtZYVhp/8hn1xDqI05QOif0qXpbMjNH1+b398fqtqLoxguuzZ//1wauhSkEMrKBxdyGlvRdafRvEzhIrGz2mlU77IVObk1azPLVHKsvT+9erYILqjx9c3EJvLVQjDq5kQYRgJcw1hXpRMYoZ5IqzMoLylZNH6vf3x+bz6+q9UWldWR3S96tSXxskatliyJ/kFbxeI8qLo8BsRFN8FPvW77V84pPxNfULilwzw6gwun37uhnQNlCgpvhBQosQhvZnp0VKDv2wg161FxOLbACVKii8ElCi/QkjNXzdvBnT1Qb5NUKKk+EJAifIrRHltkOU9PTey33r5RVrhnIKC4tz4Qyx+aKss3FcKSpQUFBQUDqBESUFBQeEASpQUFBQUDqBESUFBQeEASpQUFBQUDqBESUFBQeEASpQUFBQUDrgQUXZSH/E7EAXEXtQffvCfnbhi82C6x9+2PnWbOM/rAxfTzHPC16crTfF5F3iX6lF+uttj1/rWibL8KMTxjDCZKVYrxbfvO5KjC0W3KFFSfPmgRHmu29dzN694Oex9tW+dKEv3VVWQrwyUKDuA0wdDgtC1AfkaQInyXLc3vdj7rRPl1/v+OyXKDqC7A/I14JsjSqCwkWwd/T/IuWACgVB4ObUtKbdfyW0kowGf36xYLzd+zkDhWJbnepUynCbBr8F0WRnH1a3NKSgGzAnRaa1sp2ytmF5Oh3gmtHbyZjHk81uvH+l9/l5cKd/LCdFpUmlVbBjWBlmeSebeKe1hvMGhGU2mfTvJM2wqX3o61isojC+dHWUTUKuYFXyDatlRY71emDBL+Xbp9/yMUqi4J3oz95vS/jmlzm7f0M1XVVk2U4am+876vT3RROZntfLVdpJn2In1t1o15d7xNVXSQHr/6u4YTCL0VKsg64YopbPjTBLaLPgiU5nbo3peIM6d9GYG03KA6+ykPKqIiPR7fiEe9EJZ1mGsL+32OrJ69PpuLIyGtH8yrXa7vDbI8t6Z3P6C2vjF/bPW2RHyJnt8w4nneL0H6X1+MdorMCzPcIFQMqteyWZ4TVpalhTvprWD6Z/fLAx7OWV4W9WthThUtPX4+oawJskyLMCodqmjjQl1XsxXa/ycmY6jYrpcoBevmryTYlg++vB1BurvcoHe8ey7VquyhWyS643ffWNbZU1Z4Ltbi1G1pK5mZnbLE6/COxB7cPRv9XOLFYSbBBfojS2uToc7TpR69WekZ4SJ9UC9kOSupAoHa3Lsoz4WE35BHrTR9GG1hurjBxM7DVlq/lU7uTOoiSL81ZRU9vQMzGwUq0jRXBO+sFFML6dDPMMJHOcP/MfN1PSGVQm/0/RkIp0vVuo1cX8u7DcsUSOgPZzfI0Tnt8SauL882udheU/4EQz2dpJnWIHz8tyVidT0/b26VHoY49T2F59NDfgZ1h9KlyRZav6l04D/qynZyLefrgwybE/0fqFSKebSi1kob3+6eonlvbH0YaVazK3NI/kEHWU0dmYCHM8Io8t7Yk2Ri1BGSV2uSGgBlCE8saeoONbpg7HkWq5YrdXE3flhXJ/HmSgbu6CnhK48MwRFpxWitJw7pPauiQ4iRebZgozUArjQ1JZYQ62FwTxHr/0ezt8/mT1UVUlU6SfM6rbE6uGdYQ/LM0LQx4WmtsRK8ckYrhOF5Af8/amcWKuLWzP9nKbFaDO8rY9IzJmZeF7T1CMIcNNaj1fwcH1X/89s6ump3Nid6vFj4hmwAJEhGeYFfasnSt3Vmq9mQYahVi1mJ30srxXEVFQPfdfXDivixniQYXmvEPQIo+nDqrh3O8TxDDdst11Ut0fqTOkXlOXyRPI4qS2xLhae3L2L9GZsVpBeNaR7UhCFBa+6hWzmxjjeJwTV8sX19RG1D0CU2mJDhu6fOpBltOAHlzSJ8twYR65Zr40jVtUOFIg8KbiWtWK6sl/DlbCcUVwOsDa6oOq8Rla1/QRIFKGi02hhKGsX9U4Tm5flxqsJH89woxt1WTbSjY18O3TnpkHgEobaJHtplqLHGiyVVkM8wwbnj7UGYGMIvx9eIyj+/bIU5FURdkeiBGUezAphq6gsSLu5gzagGylLYvUUDQiudQUicaltowakq17jtoHYGYTAkNWp2nPIllRlap0RNnNjnK487enKoCq16DC87o7erlqLKayhkb+Pdf5+hEFybIRvC7eCBqLU67Xh0Cs+QvtViwUdcGyrAfcKPfyNdCkZu53lgtIBX547KYYguGizgtDjFontaDfqvI+yMOtDW0hpJ+Vhe2bXYZdeVoYPWTZBvUj7pLQ6yDN/W9jTZJhgFwmHehc+SuwTW8V0uJRew5MIqfnr1r14ZAAdMO09JiSXCmgkgeYM2LSy74bC/biDQpZluXCrR2U3Hd3YyLerimDXV3fLWP0q0PkTRpf38E8xymwzFjoAACAASURBVCil1SsYGgxG5qQMIzXLubtj0aAigqTOjhNRlla1aVWA8YLt3KHOwjCCrUcyH2RZyk/yDBt/VNb+anOCVzabF+q1oqo28bxJmGXj77EfwBRHH5e1WdtMqJPuMLztEKVDazUhVtLIgwjXYLrkNC+mq8myLLf+LGSm4wOKjI91+x11q0yA2w2mccLTqTRbLU94fHKhqc3in+pW3GYFSa8mWKP0bpeCOSBkPpKtS9tJP+NbKMAWI/a0Dk8SZSNmS5RWYkz4NtAtUdoqprsr+CqV1q4KIPy2V6yiYW2TKHFrMNg0cSbwDwnLxvwPbiedHaUnwTfHXVncR34i6exobQy8Y96h+YMz4yGUaKnWDdZ/gvwG3JW5zF6xgh5pLomSFFox3ddi7hRV3rGXTbQRiGU+yFYqbEozLtRrncG0Q5SKo8n0z3l4L0KUNq0lBrXUDx3mxdx3cGJ4em4sbxZE9GTqNFFaLSjb5dmq5KbBF8n1jWTElmy7gkg36lbUG57t8Re7sz7kWS/eGWDYkezfF3DpXluiPJjijA8QXcvbIUpbxXR3RHkw48Glxh1jcNY7SgLxEUJesmyzo7SRb1chnR3dGda5EdGnyyGt8j62GOC0cs4d5cEUxzO+OeUMpBtSJ6LUndMRsGXjpHYPx6KJ53/kxjjVMfrbWpg3+x8UXKjXyh4ttS23R5TVh8MMwfth8Ycd3lESWwsjb7WjxLaiKuyIEsY8psqq27a/M0SpLSgXy7NVeTamxi1sVlDzZdy0U+5aelDzZZzlvaFIQPUgFBa8LD8wGMYnxpYoYYOA+Sh1aI8obRXTXRElNEwd2eZOyuuGKDG7UYXVceeXZtP1zWtkHyVSOtb93k6+HQc5Dwa7FP6Dk3mBJ3nrkHPZbiUbjkVIQ9wlUaLgdXT9g/4TtGwc1e7hGROJjXgUf5+suP8wH6XVsLjqtbYCFa+f5/pmXW6PKMH7YSWh1UGidN/ao4UgQ/JRXlp55zgvFvtT9eGENvUdJkrdgoKLBOeP3S5PjV7sVhBap0ocWO6ej1KW5Xo2xjMsvsuAB5Tu6W1LlMq7KN6h6WxBrNVrleJe9l5W6RnstgZvFyqVoviHA1HKNorpLneUyMc3uSGieCXjiiiNQTpDEBkXsy+lhz3GqLcQeYzuYDyqW8q3f9hIxuezBbGGgrDe5G5Tlj9sTEUXnhTEeuVwOcTxjC+13ZRN8d+UjzXEf/2BmQOr4DX2CUQegmObYk3MTQ2Ak8glUSoTzfVNZIsVQtTbZu5kWVYeGzpjU1ImuL6RlXyxUq/VxMLm2o87sMja7rWamIHiyNwwisG1RZQofO8PjK7mitVarS4WnqfTKAjrQJSw0fNNrIt18e2vViHEdltLjGt7eubQm1r282K8GorEhu4UKihHpfNE6eH85PwE6+UpFe5EIR9DhB2lolpuuYJQQJzxxhb2xFoXo95oJCL6hxt6HEV0TwRbojRIqnOBwGB8JqcEWRuH80rG2exPjkRprZjuVpRKKj2HVD4QVn+S4Iz7c33/YZO1uJ5WZNeF8Fj6WE0sI9EHrsgu+CJTGS0PjUCsFvLt5ZcoKZX3+K6o6aLlvyvpnFygV0sZM245G+KzaVw/HktGs1/JUukFpKTBTTNJvxofc5VH+f6Vlj8YW8yfZKP4srGcO/T1dtLPYLFmtTMbM0pqJyv4LkXjj0/+da5e33igpTcGInNbao5oe0Qpy3JD3JwbUuJdnDAwNJY5+qfz8MqyVFpXDCm6Tkg0OFdrDaPk8V2JLmgJsIR5eXzTxkcpNw7vxi5zLM94g0PJ7PM7w4waruwQUQ7ePz4iLyjL5dks3I/ia0pLE7VaQbKsT70cSmZP8gvez/hmzreMb/1Noe8EX9cLUd1uLXg5OlOc4TsDJUoLUKL8JkCJEkPj+Ziaz0/RHihRWoAS5TeB75oopcPpniH1dRf0JowuiYLCLShRWoAS5TeB75oom79kp+MDyKMKb8FrTnaKtkCJkoKCgsIBlCgpKCgoHECJkoKCgsIBlCgpKCgoHECJkoKCgsIBlCgpKCgoHECJkoKCgsIBlCgpKCgoHPDZiLLjmcCo8oq+srEsy1oV2MlXX12yrWWxWFL5tYuh69KGxAq+5zeAbr0RUH58VXCQf7kYumiobrUenevINA/mAhzvSx1Yq0p9TfjMcrUXQbeI0vwqK1Rw+jpfs5Ga/6jphDSQHFvNVqPqXPhERAnyauq/8/eha0S5FvZ/CqLshqF2kihnfCwlSg2fiihNAvCdJkrQYvR7TGXGQdTQ6/sqiRKDy2py58YnIsqOzXiHiPL0x6jP+ynfceymoXaOKL8xfD1EaZrCrhBlaCIeNBxqflkK8kwolQjZVp/8CkCJUo8OEeUnfxm8m4ZKidIC3SPKVkXVKecCAV29zN0EyzNjG28V7XOP78pY+mcbqViiADx8OPFU0XrHBOMB0vtX81BGlPV7w3gDiAA7W3t+Z0B3qClAwc7ddAhjAWuh93I6wrCR9MnhfDjgYfnEDlEi7WZekqX3r+6OKWVldVLu0LWJ9bda+VVj186OFVl6nhPCanVeW5CMu/FzJjmMNON74/P535UqqL/nlyeU+rKCDy/+KsuydHaUmdK+vRRLi7KqBLB+cA/qpJqmVXqfX4z2okELJbNqj7aTPMOm8qWnY72CzfKzoqQPmZixai+Q4NXsB7lxkplV6rb6vf2TaW2qdAXwTYOjr4J+kv0hhgpIe3xXlHqxpslN7povZTNZ5XSEYQdu7x2nx694OTTUeYe5bMdQZVluVbcW4r2oLm/fEDbs+rYJvshU5vaonigbJxmohssz3stYy10QpUldJ3B7H6u5G51WjQ0acpRNoNrJPCcMRB6IMtkwLK3IYo5kWV9+OBD5Qav9fZKFatMMKwS1atayLMutSm4+dsXLoYrFq9PhbhBlYzvV5wHFVLEu7q1eE3iGDSZ2oE+KeaGS7qAcgEtzGEEUgLcRjJdlVMXeMzCzJdbRLdSC+GTsJmDZ4KLkSHAiki6XdfZnLfReTkcY1s95/Z6ea5PTs+unrY+YQ+0/n4zzWvH6B2NQob4m7s4Pe1hVGMuha1LpUcSrqrMXN+Db8Jpd56BpBuMGsQRhNH1YraHa/eocvftxfCqdK1ZqdUWcHkn3yFIpHfYzrL8/9aQg1mtiIbP8sKCpSlhOa/nhsIf196dyYg0V61fbvJ3kGVbgvDx3ZSI1fX+vTu6A5d4NhBixbRRo2EbX67LczN8CYYx6pfhkTOBVMZy2iLKZXwAhjVqlmBkPKrzc+qhoDSLP6ceW4VL2k6WE2pByw2F61MfyjLBQsJvKdgy1sTvV4zcoPTBCaruBvsV1IEwKHCBcEbyWLlRqqG2KkMl5iJJRZU4O166pIl8wSIoISqYg1mpiIXvvQaEpkwzDxoos5khGOiW+kdXDaqWYT8/r9B5819cOK3XUJGVkpNJaiFNnrXtSEOBUDqUxyaL0IMszwuKRLCsmiKmGwe/Dj6wK3BvHXZaVQeR9t1SjwgXjm38f92Oy9IquU3LX2gJ3EywI6h5O+9RDTWHWByQIlqHXq0PQCb0j08c1whSg0ScvA50SIXQNk9MydU2nOt/IT/YwrP/aBqFxGIzGfboyqJsFUJ4hHUWLdwbUmv7QQZLUF0wrJsmET2szN8bpdLVA/Au0wNCDIWT7ICNHvaE7MCaqMvu75T6M2THoZKDbIUr9VXQqfSb6xi/lMFkwmNiwINmZqQObYWjDUOGBYdYO8y2caN9qfdZrh52uXtJNNLTNQizaDDNRYusRBOM8qQPtW5LOl9EwbK1IB3yO4PrGTIB3y326m0KTMFnDnsSOakDdERcr3df06RWA1hiIjppN0IV7y4WPUvsEJMxj2bK2m3t+g5xRoaD6KISuDwIsA0tFdJyB59J2UmcZVkLvYPpoKeJAWlf4rlZqlnN3x6JBRUHFRo3L2DVDRwoLXuekEINxl1YHeeZvC3vaEEFYHK0xqVneWp4YuoROQ4qV2Dww7KZVyt9kWD76uFxTb7eZYJQNEfQOiatYgxT1/kcTdgdbkx512E9XL+FiTa0/DzOz0cEBpLzEEiVfHImy9edh9odYOIh0e7Sv7IjSabIcNaMIaMNQS6uDpsnS1GhJ32KrrHQ/zLC9s3vaaB/dUdf1uYjSQs8KuqynCwSDYdhbkfUcIeW7ayv7vzaVJVJKD7C8cGtfuxRIgcee1kmz1hUfJfGIZCGRCug0UaoKiMZ/1reAP0nuyrIs7aTg2VK8M6AnL/TfNkLvFgPa2E4GGdYfeqg9vUsPYxyIwO0VK4ikXBAlMQThKi5hMG6i8xT9AB0YvUPT2f1iBa2QwXTZdqbsptUynTO5S+wvEXY/g+1VcLmoBH+RSDKcPbm+kZXnBVFx4LRNlOBK8gdGVzcLInrouiFKp8k6D1G2YajEyVI/JH2LrTJi1qr+edkZorSZVqPyqJ0V2c2RdHacHodwhXB54fWZpDTP/C+0VibNWleIEk5qn3NHCU/dttJui8sB9dEEh9DYwmxIG6/tJK+cieyE3okD2ngx4WF57+Qr7Dh+MMXh8qo6y7PrGpwpOrCjPJjiMCVuPfZTfo1rdJ0CF0HbO8rqw2GG5Sfy5AZ2gCjRsXFgqQhHKuQyhvtqwp+Wq9eWKMGcrmY/mL+yJ0qnyToPUbZhqKTJ0naUOm+PeXz2U35lwZrRSaIk0QWCYWztrMh2jgDS2fFSWPGbH8x4MB1wHfSuFaXD3Yh6Hy/6WJKPEplv94kSeakwH6UjdlLYQICTgsfXGIwUtiMmC72bB1RxTSoedPRHIGar8FRzN+FzR5RyfeM62e01tmV/dDUYN/QR81Eaf6kukuZ2skfpFHJjWfsoLaYVfMSYdwlHJ4gSMUggNnIJG3+UGpHXMT5x9e6n/PgYSsXlS2rjwfbU5xA6r7ggSqfJOg9RtmGo8tFCkCH5KC+tvFOmEg+i6nyU4M0gTbTcWaKU3sx5WTsfpTa2NlZkO0eEVsEzhnRTxSOJedu75KNUTpr6qDfXN42y9M9FlCYBeHsdZAhpeXpuLOeKlVq9JhY20w+2bVSRdPaHvP74thGzPzuhd6OhoxjxlfmfPtR0njXkNxnbVAPELonSEJJDgVTuatZpDk3GDfL23qHpbEGs1WuV4l72XrYoyYqb3zf+TI25a51CoVLh8gwx6m01rRBC9QdGV3PFaq1WFwvP0+ndD6be2YD4Zg72ehEMqW7WUNAgvHyoxpQtVm9zJ+VleUaYzBSrSp6G0nhYVNzw0qEasdV6Wl8fYVjeO7Yh1sS3paYp6m03WRcmSntDNca1Iert6Znbb2IGwPVNZIsVQtS7vBb2axNdqxb3ntx98gsK13eOKFW64K7MkaLeuGFYW5HNHH3YTECOSqWwFNaiNOWHwx7tpvVKcT+zrAuIM97Ywp5Y62LUW5Z1Qu9coDe2iCXinYsoTQLwToLxuKo9z3iDwcjEo+N/WV0ddvVaPAG239pOXm/B1kLvRkMnu0LAD/gCcrg8vivRhVeZpBa3deya9P6n5fGwkprnUvKJYNz4dRguEBiMz0COmVR6BvmVIHufTXnwCFVD3JhRMkC5QCCS2NTyKG2mFTMJlueEgaGxzNE/yf0lguw1ww4ZKIisZFnBTd8sx4NqnuCL5RDLM2Mvm7J59bbeZbQsv8Tm8fqY1vjGm3uQu8cJ0UTm5VIYO7RKpaySBTn85DdCHqX1ZJ2DKNszVP1keXxXogs5XUYslmDYG1vMn2Sj+JBKvx+sTKJ8Ydbv7QlHZ/MVuEkniVLW24bf2xO9sanmURoMw9KKLOeovKVkaPq9/ViysCy9f706hnJseY+vbyA2l6sotzlZG4M0cG9wKJk9yUOaaueJkoKCgoICgRIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQMoUVJQUFA4gBIlBQUFhQM+KVF+csU7N7AvENDcn+nzsMGpb0Tf2IzP1cHy46uCKp998XKBsizLzYPpHj8jzOy305Xqk3GsRr3guxRNpPdR4YlzXZAAXY3BjqpdSmdvN+/FI0r5d29wIHZv30WFlU+O37IjA6gOC6pxM5Xeq7oSdXeQltSt3/LjGKcrsN0xUKJ0IspUkPm2ifLzdLC8FvZ3nCinBL5dXkPiH/M/1Wr1SjG/PNrnYXlP+FH5vBckoDtEKb1/OdHjZ1jhMhK5q4uF5+nk5D1SjcbPDVhlA/Ov67VatZhbHenxMy4ZrS2ifDjs+exEWc/90OvzX8SaO0WUHRWt/y40ji8+d11FO0RZz9284uU6Nl+mW0ORV0xI9uLoBlEiEafQ7Bv31a07g3PZkmmVgfSmjQqWinaIsntogygv/tjvFFF2dGf6XRBlZ7ZsXUM7zevwfFnVlAw9/K0zN5C7QpRQm9migHl3cS5bMs8afALSpLb4kokSL3s5EHtw9G+kl6D9I+sKGRoNsuhBtUTu7ev63zd+zkB9WZbnerGSnHaC60TRehXS+/y9uCbEHp3ewv0gRJl21OblrWfoK29waEYTuTf2kdhm0MbSKayCxh4SrpHev5qHUsGs3xueyqiq7zsphuWjD19nxhWx9vHsu1arsjU3JAhwi7u6LYOtpH3wzu4RVq8U9YI8dyp0HdxJMSwff/p2aybq80Kp1Mn0iVm69/f88oRSflXwRea2KiZ3E1LRyr3bnEK/1A2s/sRkLCx/dpSZghFgvMEBVdvepDqnX65mMZyJ9bc5rbTt+Jq5K+Zlj6mQtndB+1kmEmXjJPtDDFUF9viujKW1qsB4Ud5A5IecjlBstI/U1liMoakN2sAiw9hNsDwztvFWMUKP78pY+mdMEBy3pR/XZnoYvWYO1KXXdDS1P8TpTFORNE+B2SaZyQ21O/qBcmFIqqFeiqVF6xGzBYkokR5Fakusi4Und+/ufpCl5l9IzG/gzkmtVq/91ZSciLKxk/KxPCOMLu+JNTE3fQWpUKLfIwfQaPqwWkOSDMHEDkyHjeA6UbRew2l6MpHOFyv1mrg/F8Z1VKxk2pW5V+XSrwcZTHBc10fLNiO5EqxydW6MU04W5UchjvcMzGyJdaQbocreKhXUfdfXDivixniQYXmvEPQIo+nDqrh3O8TxqiPPhaQ9sRfkuVNBMEpVBWRrpp/jGW4kaxThePfj+FQ6V6zU6kojTTLcSAza7xGi81tiTdzXuf9s7FsqrV0VGNbfn3pWrFSLm9CG4XRJkqXmX0jwMnznuF6r1fVdIaiGqToKIInhiT01dMW0tH5Z6uMZdnD5tM0LOs4yiSib+YXowpOCWK9VipnxIKOI1iJhDN/I6mG1Usyn59d1jkeoi24hLecwhqY2aJOFEyW2cqcGFEkvoi0VlwO6Iu1IVlvVtpNN0y2rokZ9q6ekZxXRJhEbFJ8Bk/hS4Fa3M6R02M+w/v6UQfXkPCAR5U6KISmcOfTH2GiQQMGeIbDtUn5/ujKo08YCZoGpshdcd3/0hinElQMIakTQZkykCcl3zOyb7mXX5tPVS+q9VGmnlXfIbnChNJBYSu5KylBrrZJ2ExyPi2TBCQsdA50l7f3xFw1d25Re2ByXCEaJjZKuAVbDfGeAMet6o6ddZFVTQkfuv+k3ko19o/0IpnnZyN/0srzn+mZdmy/iUYvAa9hwgUEaz3p4MEcsPEGLED1+3F/QxSw7Hr1x+UAYPSthTid9Y6cxdEOUmJ2DbYcfVbERw2wJxkGR/QHD04sg6oM5YiE7d9nLqxsjV0Tpu6kpvCEmgTtaGhL8d6e8E9Y7Si40tVn8E9uutUeUpTTSI8cujP2+tDrIM39b2NN0pmCnMJKtO2t02CpEN3/duhePYLkIDjLtVt4Ts1KYbZuRuYASC1BYLPNBlkGOPZYta3/1/Ibqxjb6X0yNOb+kve2RhDwpJH+QhYdIapa3lieGLimiRuaLkxYzKHkF7vxi3TwpP8mbYimFWR+vCGe2R5Q2ykXKMGFi01wgEJm4q7lrXF+wjVk2kFTrz8PsD7FwECnbqF8h9bprK/u/Nk0rXROtJcJxDN0QpaV6ktmWPmRi6icgVq7si7Fhxs7sHl/f0Ng91V3j7uite2Zgz2YrQ4LPbb0T7YDso2xVctNhUBbrG8mILTf9gZ+ojSYtMOz3Jlcj+mchPO+SKNGJQ7g882SvWK0drwxYulNJbSZ94rbNirnEXzTRkwYOIya3mm49tEOUbUrad5EopdKjiBcEIPeLFcTXbogSu5q9fRt4EP+wK0RpEZpwfcE2Zhm/ZmM71edh/YHR1c2CiLhVuZ10dpweB4+ncHnhtT45ElhPL+pNHi7ihx0mSkTcfaunyDVvnh27kIsrotRboJXBYJ93NF/VPurdqjwb05yDbRIlfuwl/P5girN+JJ6bKA9mdF5kVzLt7onSts2ykvEw9vKPrUmPenwGZXerM1Q7RNmmpH0XiXI/pXNCkS9uvaO0te/m87HPsKO8KFG2McvYNeGvNO8eYW1LZ8dLYb9ev1tWfeKqGrgejmPYaaJUVOaXi7sJTicqqd6gs0RZuNWj/MDKkFzEu9qBQ3qQ+cyP9we0N7VtduNlnFMajQLBWBxA56NEI7tETI49L1FCC1XvKtJ6dpBpd0+Utm2WZcVAY9GYn+FS2+hX75b7dP5WHdohyjYl7btHlHBllbKb28keS6LEFKtVZfr5Y7vm1TdGyf41JGP7RRJlG7OMXdNwqEQjZtoEEb0fSNR7eFUkvN7iNIa/rYV5JWAly7LceDHhuRBRovV1KTzsdbsdwXAw48FlilE8zeCjnNOCQ83dhI9nuNGNuvHKuA8HniVd9FFKhTtRyPUXYUepdK+w4GV5JnTnsFItin/Ishp1GZ7bEyvFZ1MDfvwoCgrlnp6bmWKVEPWGmfYOTWcLYq1eqxT3sveyRSwLxJooTaL1CsDrLExuqBFb7a+sZNrdE6Vtm2VZVriM0edGgBy7p+fGcq5YqdVrYmEz/WAb6KMdopTbk7TXf2KeOwXn2FFChMc3/kwN/loTpRo8RVFvfZjePliJRWy9scfK5WE3MXi7UKkYuvIZidL9LGPXRMGA4aVDNbVD+erDZiK2mCmItUphKexn2J7EjvGY3Xiz0M/x5jdzfjx1HkMkoR6+vSsq37omSrItKdsgQv4D3NCGKIH42OBYtlgR95evB3VEsZNiWN7D+dWoN0ThQyiEb21Ijd2EwGvrpeNR72bhfhTJigu+CJYOJjfeLCjpdbfewPCcHSyqyU3R5de7twfwPMr3eS0VK7rw6iQzgpsaLi3PcIHAYHwGssUcBdeNovUqpNJzSDMErfQnCV0AjijT3g5R2rQZfQ1ha+1Zrdz42bSSv8l4g8HIxKPjf8lyu0TZlqS94RPz3CGcJ5gjlZ5BMikX6I0t5rMpDwrRYIApG1xc15Jhw67T37BueoNDyewR7qJrHM4rCYazP+G3/JxEKbudZX0e5Zt70V6BYXlOiCYyL5fCPPI8lreUhF+w5N+J2yLp7O3G8sTQJVitvMfXF4xMPDr+X+cxlM72VXvoj9892L8ddE2UFrYE3i0U6DfCIS28JWa1/N/ks6OnEwabTGxVtdzeHjw/2taQGuLGTBTFdblAIJLY7GQeJQXFxeGUwkLxbQE8MMYtwjcDSpQU3QElyu8J8HaJZ+zlp37z/FOBEiVFd0CJ8juB1Px182aA/AbXtwNKlBTdASXK7wTltUGW9/TcyJY6El7+QkGJkoKC4iL4Qyx+ML899I2BEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyyI0iDKM0hSmNKji5rdDjJsztBVsVb+WZeJdX1Ze7X1C2dclx8OezSdk67CrE+PF/puF839mT6PohXeZQFIk9wV/q9Nm7m4DUtnx+nxcMDnZ7zBoeQL56kj1H+xq5/2WfCFS3gSIJVWQ6o6U2dAJEqoSAY1muo1sZBZiMfuO5R1+/KJEskhKf/+ahqVW9q+rL3a+gWJsvEyzn0yPdIL6NMTgETQPglRSs2/lDmFgvaDK0fqLH9sj2suasNQSFFIbf3ZPHs9d4nlfQsnDn9iKouVDvs1lb0vAx2ZwYb4bD4Whoexx9c3NJPTCXdKZ/vL8V6t7peuWpLULG/NDHGkYp3msv8wfVJx+RIuIXVhkIgSJo9QptgOXz5Rkma6m6LAFyPK05VBhh3d+ETrxTQOUNnTKBF1vkt/qv1IuwN++mBIEHC7uqgNFxa8Wt3ocjrkojG6NqMNSuiTHCLcoxMz+G65zx/4j8WNYrVWKW4YFTGh48Fr6UIFiadij4rjOwGOZ7wCiSjL6ZD+0VirKw/HD5mrSOWxI7BUYbSsa28BSpSma1+EKH9ZChqFNLoJ8zjsJlhNxPFil/5SidJkVxe14YMZrS5n42WcsyrOSG7zh/URTM73C0JHZrD18aNOqBArkg/V0b3JXWTtIJQgLB7B/9b3H2QKf7aIGjiFWZ8lUzVfTDDswNLFH/WyLJOJsr55zc5LIp0dZZWqojwnDEQeiLJiZBNPX98FQXezPPzZcSYJpTd5TghHF169l9x9qzfoxsmaWuNzIPbg6N/OnXRPlK1Kbj52BRVM7YkmMj83dBeJpE8O58MBD8sndkyXbVW3FrDjw/3ZAW3dSu/z9+LaoOGVR0moPgrpRGLxEsh9QzdfVbXPF6HyK8MFQsksPuCNk2wijLzMwdhi/r3NmiXLLivV+e0aT5wOnHHMRXnzC/GgFwrNDuMjLMutytZiFK7GBQK6otEuQCBKsFWlCvWgdqYzHdlS2y5s2AFQsVyY2a4cL4UxXW8XbS6V1kIczwipbcPtLIdrN8HyzNjG2y2tNvZYWv22nA7xTPDO7pE2O0MzuhVnYx7aKuACvbHF1WlFPA5UlENZeQAAHUxJREFUoUBaEkGvVesamIWAHhmu8AOSKgaOIxFl82XcXDFaRfVRqHNPaKKPUio9jCH5t+Tart6XUEoPe1jeMzCjF1RwkIdHun1caGqzWFH33uE1MCT7b3VECbbYl9oS62Lhyd27u24myCVRNnZmAhwmXXA9yGjSBXARP+f1e3quTU7Prp/aCRgcpm8EdOX15dP0ZCKdL1bqNXS40MS7CdhJMax/6kD539PVSyzvjaUPK9Vibm0eyT8gJ2l/KifWkPSFOmigTOC7vnZYqSOZAfMiNI5D+M4x8lFeE3hPz83nyuKxbLzFdFgTZXkt7Ge40NSWWENGop40QZKQ911f3RXr4t7qNYFvz1tnJEpkxkQJgdbHem0zwbA8M/G8VqvXah9bTjbsqglK2NDTcyPjJhqD6sCPRAWeYXvnjyTj15bDpWiCInPNQe8UDTIlxoXWVCENxnyrADewMQ8JKFv9w9E+TOoDyZapunLIRdOmm06W69kYr0iiQ1N1ipJQLH0ij48GiSjLa4NK7IHkjj6Y4i50EsVhlR4knR2tjfUiyYHAaPZdS2sZSaILGZk6EwR5eLZnIo+JHU32MKz/2kbd6Vs9Ue6kGEw+zCVIUW+z9ik0OLKq7gKk0mqIV8SwlItgQuw4BSDJefX4oKjXkk+CJIlKHNWHw/j+Dm6ktxtEUnip1NOVQYb1J3Yk1BdsmqB51k9XU+zY+39NPRXJFIU33mI6rIiyuTXp0bnYQZMrtS0pSw7zz0ml9CCLHcEcYSBKIHFsvuTGqwlNlMry6G1hw85ovFm87OU9nF/nZ7QXaFSVhTi/mZTthgsRByZ1BwMYfgRqKukQz+B/i/R5wJdiYx5oMWISPSAJp7dzRRIK1JPiL9pzEaHzCuosgQFJOxsSUcIMon9+b3huS7erc+cmdgf7PEqpWUaiYNAr6ABJZc2FPLxux65IFE2+kuy/lUk7Si40tVn803VIkxT1/kfToH1aSg+wPBN7ivcNVMyACOAi+D4fl3wjSM4bA5rNX7fuxSNYFo71FKJjviG0Iowu75XVelZS/ibD8tHHZa1TmwmG5b23CtAX4da+9hVEhPW9091Qe2BIzb/QZkrdTVs23mI6LIgSRin+qKy53jcn0LiV7odNpgX7DiuFXnMndAMO4+O9VcB/AsJk6JHjwkfZhtfyw9Mo7Ohbusi1tJPyWCwZrc1scOqglI35ddRmO1xOyja2Gko25kFajPqTE6irAlmX0yErNTFroLOXuiM5P1FKzWYL/ccHdIbjhtcMXf4kRAmtAPXISLpsZzfO8vCGFqsf2n8rGw26VclNg2+F6xtxdbxxd/QmhoywD80XsVJhJ3RBKq1dFUAQbq9YRXbpnijxDb53aP7gTLJIDkWt1T1psX+WdzS3H/YRoDxs13jidFgQpWXOY2KHbFrtRVf0hkScdN2HHSXKcjqiPSlB/48bTpdab2Z67KKFeJshg1LbAtsN14WI0sY8SIvRMJKFWz3I9wIlex0DVjqYI/uWR2/9sBODOTrA9hbbynxiosTMBTrQ9o6y+TJus2e0/1YmU1irAlK6wdmC8zS5Iko4UTrtKC2IkuR+xm3uYAY/sDjHZw0+SgTp7Gg5pNTcB1F143kccDDjac9BQSB6bfpcNN4wHRZECXLSN4lNJpnWhXaUzRcTn3JHuZ3UDaBUenpN4BmhL8BhitUObZZK9yOMpsdtN1wXIkob84DFqE8LM1r+6SoE+orpiM5f6QyFJe/j+xurYI7h6eJMlEjYNnWg+5Mu+yhxIOdduowC+TY+Sgsjq29cJ3shx7aaTt9apgdh89cQ917lcoX/1yIC7i6YczIvEH2USFjOliiRRxJzb+l8lOjsr5hmcyfltSfK8tqgLupNGlWwV6KcE4qxEKbJ6n7GdYWOESPZutvG46Nh5aMELyo5Dfh40Uf0UUIqXEPcy73KHf6XXY6DgcEheYPgo1SOim0SpfT+JJd7tf3/nFmMYIRh+QgW/ZWOFgXWiehNCefgFodju91wXYQo7cwDThL4/kPno9Q+4YZDIWx/4zxBCkve+dnQH4PfE8XWjSmQjkQpvZnp0cVIdVFvqVkutuGtM4FAlNJOiuu5Np/dL1bqlWIeBX9TB01ZVnrLc1fmiFFvSyPThdJQXJu7mkWdsP0WN2ipcCcKcu8ibGFg4l/GCSOrwXXUO+VjDVFvf2AGOu5AlHLzYErgGVaI3N4Xa6aoN3IyTm6IKDxt76M05FF+2JiKLjwpiPXK4XKI4xlfarspKy/A+AOjq7litVari4Xn6TSKO5cfDnu0aapXivuZ5XVr3tRHvfeegGMaTbp148nTYRP1hlHi+kZW8sVKvVYTC5trP+5Ak5Fp6aLeXN/0QVNWtoeXVt5ZDphMinorGRpY1FuIPFa+rz+Nsjzjm1gX6+LbX5tONly8M2CXqwDHbRQxV95u4vw6V69zm1GggxFm9pv2w3UBorQ1DwiIM97Ywp5YM0a9EdAmAJsRhwmSzvLJIMPyvbcOqlhyuPLqVHkt7FcSziF8j17rwmDu74eNZBxoqiYWMog0HqkPWl0eJTyG2ZFs3WomHEAgymbp5d2xaBCk0yH7bBMPgDbEzTnlNXC/tyd6Y1PLo7Q5tkjvf1oeDyuZktFE5lgnyG7zLUaUzcL96KCSFqfm2RUWvLaryH0eJaZh7/f2x+exhEEHopRlufFzehxyMKFtr2Z92Knq+VRIe0PrSYJzeO/ldGVQTU8r/115754L9OpS3vC54DlhYGgsc/RPZURfr46hseI9vr6B2FyuYnW337LX0EXgx/p3vS0bT54O+zxKXJOeFXyXovHHJ/8yd4cL9MYW1SBm4ZYLzWhSHiU2CIIvMpU50hldaX2y1+dnWJ6LrledTkXZmEPgQjo7VgwAcoFzlRbaRgVSFlxJanPhFpaXZjlcFyJKe/PAc2OHktmT/ILXsHxga4Jd32GCrLyi6na+Vd2agTRq8zSZeyfLsiz/+7/+vhAfwIhITyn6N3M+bF7z8p6eRReOOjK+hepBpfvhc6S8fun4pO96f+EorQ6eI1mvo5BeTeDHw+8cEMbRfK9fwATp8Une9f7K8CFz1dZf/tWi/HDYg/tMv1t8yEbs8/O7D+nNnNdxS/udAOX3YCmcX8AE6QDVg9p5U8AR3wBRUlBQfCK0/iwsXxUMccvvAZQoKSgoXAJSeYTLC4dfUBm4TwJKlBQUFG7RLL0V26zy+W2AEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFA4hE+Wb+0gDUp1BemJ8lvabuEi4KyX1K6OqlH0z3+FGlFgrX6KLiZhvQl8N5HOO6obH+JVgIVmwl9OA/3f7VBWXliUC1LfSV/OFuqIy0VfXMrx5EogRqG81AZafs3GUvTyp85BJfNFFOCTwlynbxJRLlw2FPd4jyc1sIKkE2li1WKsW3dlKaxr/rGlEayyErJWvN1Xa/HdgQpUZtUFnTpcz06Y9RnxdfRR0lyvqrm/0Bz0Wm/8Iq4d8ITh8MCYKrcTD98gskSqffumUNk/V+bpCknEio525e8XLYaHSBKEGI1MOZ9AhAJdRnK3rxlcMVUaJBRwJvDjCtoo4S5cWnnxIlwP04uKgE/jnQFaL8MrqGwe00mUajW0QZiY8NGE7fxTsDDBtJJCMmMe5vB66IsvFiwqOrjGslVK9oDesKc8KHN9cP7kGRV71SuyWk96+mQbqeCwQiP+SqZjmtSLpMqKdrLBh8dpxJYjVBb49ilmfoqfQ+vxgFDS8uEEpmTzQVAawo72D8/vH/2ra9cZJWKsIK4eiPJ/+WSYarWwO7CZZnQukjZZQYLtA7vqY2ACRZVo9e341BeWO/t38yfYKNonR2lJkagnLL3uAAXt+3vDbI8oPpn98sDHs5nknuKgLW6j/Lxxjxl/DhxFOlMfqmwtzNxy5zUFE1rBX0JYNQ+h+WfSzzQW6cZH9AXQbLUYuz6o/eBjNoVbcW4r1qseH7s5ggmvQ+fy+OyjPznBCdRiWKbaxXG59WJTcfu4JKO/dEExnNkreTPMNOrL/NqXZrGBYrYCYKFX9fwdQZDd6K9VTNW+XfYLqs2Nvq1iaq+swJ0en879jRvXGSgXrMPOO9rN7UBkCI6RfLAd3puwAFqrfTEWzdNU4ys0pRZ7+3fzKtBjmcrZFnQNdI+j2/PKHUpRZ8EUyNdifFsHz86Vul3G87y+FcsCHKxGYNfJQz/RzPXV1VmmEjVN/6iBQ1+Rubaql3e6V2K7xb7uMZ38jqYbVSzKfn14uSLDX/gSQAB1eOFMlZB6LUFegXt2aGOF1pZd0yAD9Xfyon1pDmgSe8VpJkRex4MLEl1sRCZnll27bt4Km4lMyJNbGQvXcHave7IUrO7+FCE5lCpVLcgKYq3rHtJM+wfg/n75/MHlaqxU294xgJJfr7U8+KlWpxc6afAxVASb21xyt4uL6r/2c29fS09RFp2zITz2u1eq1mWeeA+EvFspVRTYV0mtTlRyGO9wzMbIl1NN1qS8gAVRZsMwLiE7GndVlu5hdABqNWKWbGg5jegDVRooKJaDSMshyyfJqeTKTzxUq9Ju7Phf2KwION9SILaezMBDiDWIim9OAwLBaQSo8iXqMOChie1PyHbvD/apIHUWr+VTu5M8grYh71v5qSyp5ICeNw7ZpOjA90RILX0oVKrXqYHvXZS1ZoHYyky4VZH3b6LqD652UdUTbzt+Lz2YJYq1eKT8YEXqt/TrRGVRziP9eve3lGSG03ZFl+9+P4VDpXrNTq4t7tEGfSO1JZCBRKuBFUOth+OZwLNkSJ/fvb6PJr5VnkJFRvcfTG5Ip0Su0WgGk2y8ab6MaeKEHBEvsWFIhIRNnMjXE6rS6QdkrsSOhng2mXaoDbSZ4gKeWGKHUKa6ipoFcFnVL0+eDrOS+LykojeSbs20b+ppflPdc36+qtdRfvwNEbq0gIvvzhtaqMHircxHNtHFcvOYmaQvtVoVEYeUIhWJ1GoCVRotFI7qp/jwu9GQHqm4r/3dZxhFT2TPJzwflj7W+xovT4sFh2/e/jZGW9axt1Wb7w0VvlDmVYkEjh6eolXVOhGQ5+jO0kz7Aj2TpYJjp9qyIQMAVEiVZQ1EHzS7RGAHrCkaVVQacz/gITHMT00WClgx6fw3I4FxyP3q2PlUL6uibF6yhU78JH6cZrCUYWvLay/yv+HG2PKEurg7xRUYhAT6ltWZbyNxmWjz4u19SH22ZCCfCBGfn7U8/cCLkhixyY2cB/7Yoo9WMCmr1jL4m6V+jIw048b0r5Sd6UtAHf3sxLyq0NEj0d9VFqn0ivJlieiWXLmobU8xusyf1vAOgCohbCYWJOkUFt/XmY/SEWVkSceKIsDGYGpNEwih02f926F48MKFo02ld21kuKq+CCxudRu4XhalOrmQQXPkrsk9L9MMP2zu5pW7mjO+Z1bQDI56a2ZVnaSSkPtsKsT3Gb7KT03o8/DzOz0UEt0RD1gmiNsqyK5WF7MFlqlreWJ4YuIT+Jdn3zsGifOC2Hc8FdMEc6nPbxDJfalpyF6jtElCDVBH4u4fLCa+ThaI8oSTeyoCeTA1Q/u63q1swweKYCo9l3DmzZqmzNgffH03MjAyLG5yBK7E9Iw66uDWJYA/uQ6NfvElGa/GV6drMCbFIGlopKCBWp04Cfxx8YXd0siIhzHYiSNBr4CKBzmXB55slesYqcOW6Ikjhi2IfnIUri1OAfdocoiW5BhizAZ7hFaluWZWk3wfFMaK1cXA7oyQv9d2N3qsfPcH0jK88LouK9wYnStLsHDVRP+JF2+gOnhHdoOrtfrCAqd0GUTsvhXHBHlNhtHIXqO0WUAOnseCmM+TTbI8pfloKw58KuaEFP1YfDDLiQbdCqbowHGbd18FuVzUkfyzPCQkE6F1HCzsJiESoPydQ2Eox32lF+GqKsPgoRfSZOAE9C4M4vpyuDmj8LrqapVlkKDWJmAKOhD7/iI3Awo1OR1g+OnfXCIb2zO0pwJnzyHeV+yu8gOE7AL0tBtalwxhqZvRXRbrqTYpSjPawmTeUc7wXRGhsv4wYRdtTInmnlZKFb6XZE6bQczgV3RIm6sVCQnYTqO02Usuw0ygczHlwQTvplqU9tANJExwJH1j5KcKVhPkoy2su6wM33YAr3RstS8c6g2UepmoXaePBVIR8lpgIIzAJul/rGKNkpA8PyKYkSDs64j9ItflkK8kxwJNqHNRVurdIu2q7aEyXySOIPM9xHCb8EapNlubmT8rokSvlkXuBJPkpE6+chSrm+cZ3so0Qu2u4QJYo3tqfxCYkZ6IIotxp/jMH1see6uu1AxzWrJay4JhM7uNEgrXmFzZvbyR53ROm0HM4FF1HvzdWRHj+jvfZgJ1QvK89Y79iGWBPflprnJMoPm4nYYqYg1iqFpbCfYXsSO3B9eDJEbh9WK0XxD1mWm7sJH49eXVACkZp1lh+FOJ7h+iayxYpD1Bu5SAKjq7litVari4Xn6fTuB1mWpcJiDKJvIuwobU8oUmEpDkFVEXaUyCbQTPvGnxQr4u7KqI/QEiz6OTPEsWrYXT0rqYG8ucteLJCnj/OiMJ839hiaSSTK+tMoyzO+iXWxLr791c6ATL+0Z4TmwYyP5T09N5ZzxUqtXhMLm+kH9nkCAPDH63Yi4LvkhpcO1bitM1Gi12lYIXJ7X6yZot4QSxQmN9RoKTY49tYLx0N91NsfmDmwCAS5ysqUSmshzhj15q5mdY8KF8+zwq0ehuUHbxcqsDBsiVJ54Ue4PPOkINZrtWpx78ndJ/a8qSNKRdobmyyMKJGbPrx8WEEhdWuilErpYQ/L986/+aD5tet/NSWwB9/4MzWFwCVROiyHc8HiXW/Ncc5zwoDpXW9LoXpoZVZJORx+8ts5ibK8lUCZbn5vf3wey/9qvFmE9CiPb+G1LMuy3BKzmF77s6OnE7h14vmYvbHF/Ek2anngxfrF8pwwMDSWOfqnLDcLK0oqHyfoUudIaBbuxQeUBK4hPBmzJWbUZMzI1MbRRtzYkkR6a07pXd/QTE4dV1hyNx7ksNzSOf2w/36wMonfV5sx8i5YKq0ryZ7RddtXCYy/dGSEhvhsWklUZLzBYGTi0fG/7O6At1PbdMuyLDfe3IPMVk6IJjIvl8KqL8U2jxLPe41MZU5eQa4fyh56DvmDYFpPEhwWW3CyXqxrfm9/fB7lYBIGgfgJeXzf/7Q8jhvYsbbY3G/8G4fzim3M/uRIlHqDYf3ennB0Nl+xuT64QbTX8+CEG1N5Un/9xpvleFBNXn6xrP2tsWGmHBuVEKXSs+Swl1NWbjalpUbYE6VsuxzOBVo96AuBw8Pji3tjhILiewIlyi8ElCgpKL5cUKL8QkCJkoLiywUlyi8ElCgpKL5cUKKkoKCgcAAlSgoKCgoHUKKkoKCgcAAlSgoKCgoHUKKkoKCgcAAlSgoKCgoHUKKkoKCgcAAlSgoKCgoHmIhSEaMg/eusFmWX9L6hVkLnWt4l1cbmwXSPv/OC0UrdXHOpaqhK3X4VQg1uk96tKtGdt8vEKrOWhZldo/w4xtlIgVO1TgoMJqJsfawplY50QkuKmFfn0FWiRCpLtYu3vGtEOSXw3SNKkxI0VFq90Os9FyfK83UZVU7axCe0/rElX5QoHw57KFFSuIPd0bvLr811lSg7t/ntzIIx6dN3CVBlmvMblYKauTEOJOo/H1GeF9b37ZIJybJMiZJCB0qUTujMgul0q6wAesdjE4bTd/PFBMP6E8mbjKpj1z4oUVJ8t2iTKBs/Z6CUJstzvXg9XWu9c1mW5VZla1H7tiec2v4fxcpvrh/cg688vitjabwmrvQ+vwhFWxkuEMIq4G4neYZN5UtPx3oF1ypCSFkBF0EFt5135lByklq3VLbRkYL0Pn8vrhSs5YToNFR1JerTGy8lnR1lE1B4lRV8g7paxdtJnmEn1t9qVXt7x9dOSNWDQRc08eJlXHf6rmdjPMOltvN6nTzbm+q+9QaHktnb1/X2YGUMlkSp67L7TrknylYlNx+7gqrq9uhKLJttxlDrVzo7ziSjPrXW7O1RbN7tzZvi20c7RIl8TKPpw2oNadiqMhfWeueYdESuWK1Virn0vZdlWatsjArr56YG/Li+DbiQ+lM5sYZK9ut1EQTOy3NXJlLT9/fqeKst925ICBsr0QySyrMF2Vlq3RVRyqfpSRCBqIn7c2E/4mWiPr3uUlLpYYxTteqLz2AoVF0iJZoRvLayr5bF98SemuUVFBF6kHtTTt/1p1FQ1tYJijrcVC97kJu+IuhcnDbG0AZRuuqUS6Js7MwEOINOA+9L7ja0i+hsRkeUjd2EgDXGKBliY94U3wXaIEqQx1tSJcdBz4R0wsL1zkG8iSTaBVaOiZ2DmEn4UVW5OP5XpyuDDOtP7Ehqw3CBMwzEqDcuYK+IMkL7FU00HASpdXdEqb/KckDjZTN9Y5eCluASdI1XEz6e4UY36rLaX0wKCjoyvGYScCinI0D9IKcFp+/6+gii7J0Ug5TKHW8Kt8AaDJLFij3YGUM7ROmmU6SoN1wEvyBqsEn5Kzh/jF0EsxmcKEGeBd9r60XodMDNm+I7gXuiLK0O8szfFva0yCPskpRtC1nvXNpO+k3SkQA7LR0pf5Nh+ejjck293WZCXeTQMAtfGzHq/REO0rAe4A9B/0iVRnInte5ElFLz16178chAwIdCzKqWkw1RQmcRfykArSjQsXMvxrKf8uu0vMdeNtG5e/LvTZ38k8NNS+kBU+gcu6mtMbRDlG46RYp6w4RiFyQ12Kwli9sMRpSlVdySAQYfJdm8Kb4XuCdKsgYQWpaWeuc2QQw7okT6luZ/liLXKmzDJh+yEUQfcO5G0kiupdZtiVIqrV0VQNlur1itHa8MuCNKszS5rP+wTU6Bu5TTIZ7hUtuNl3E4d8s6onS4KSmUgd3U1hi6Q5QOR29i7AX70HwRbARIQSH8gpbmTfG9wD1RHkxxPDOYJmYrW+udE8XIAXZECRecsJArPz9Ryh8yV3mGnXj+R26M03R+XUut2xLlwYwHl97Wq4PaECUc5Tqxo4TRRjuj05VBhu2ZvpXyKC4L1KTwo6rjTXV+A/NN7Yzh8xAlNNhpR2lBlL8sBTGfDACbd2vzpvhe4J4oYQuGuaVMvyTqnYOzzNpHaSFje7p6ifxX5oYZ4JCIAwQRiY1o9NGG1Ppva2GdI7/xYsKjkAL0GpalrDhn3RClXN+8RnYXooCSa06BuyhDCj5flmd8c8ojAJNmtr8peCS5kawaW9H5KO2M4fMQpXwyLxB9lGiybIkSZUSogUSDj9LGvGW59Wex+GtH38Sg+ALRTtS7/CjEwfm0INbqtUpxL3svW5Rke71zRYw8MEqMelvpfTf3U0Htr2p1sfA8nd79QGyYDkQfJQSaZVlWwg46+pDdS63DIvGEb++KirC6SgpATMLkhojC9JiP0qRPb4h6p4c9xgC0EFEE289JlGijhG1ydRr2DjctPxz2sLyn52amWCVEva2N4TMRpSFMD1Fvf2DmoGlxEd25AbrD9U1kixVT1NvGvOsbox6WZ3wLBXPrKL4htJdHiSu1M1wgMBifyUGQ0lrvXDZIrQu+wfid1//jRJSyLDfEzTklt5HnhIGhsczRP8kNw0CMeusCmttJP8Pyl1beYR1zLbUune0vQLad39sfv3uwfzuIUc/zqZDPD1/N558kOJ4JLhdRb/T69KY8yvevV8cGlZTGyFQGy9RzzSkHU/gdUfhecym0dVNZlt7n54YEgWF5j+9KdOHVSWYEv6mlMXwmopRluSE+m0Z5rH5vf3we8lgtLmLMo3z/SsvojC3mT7JRbd4tzVsqLAY4nru+ac5qoviWQKsHUVBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDiAEiUFBQWFAyhRUlBQUDjg/wcjejiXF+/2YQAAAABJRU5ErkJgggA=" /><br /><br />A summary:&nbsp; <br />1.&nbsp; The research claimed here is incestuous; it was carried out by an affiliated organization.<br />2.&nbsp; This is not disclosed properly (see image above, source is on page 3 of <a href="http://www.marzanocenter.com/MCTeacherEval_VAM%2020160328.pdf">this document</a>).<br />3.&nbsp; A potential lack of credible (academic) expertise.<br />4.&nbsp; No evidence it was peer reviewed.<br />----------------------------------------------------------------<br /><br />So the first problem was trying to just find the article, which was strangely difficult--red flag #1.&nbsp; When you can't even find the abstract, that's odd.&nbsp; Finally going to Google Scholar, it turns out that the latter one has just two citations (one by a book, one by the RAND Corp.):<br /><br /><img alt="" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAjMAAABOCAIAAABaEwCjAAAT9klEQVR4nO2dO24bOxSGvYFsIJ29BtVplUarEOAiUJNCG1AvCEhjyNpBbqFGBhJYdZpAhZFOsIoULgNkB3OLeR3yPPjQyB4p/4eLi2g0Qx5yyPPznKHGVwUAAADQJ67e2gAAAADAAcoEAACgX0CZAAAA9AsoEwAAgH5xYcq0ntyITNbN18PF09FVyGVolR9bYw5Pi2FctYrRVYeVJdGPeZBO6+IeSDwthnIDTkd0J7vXHDFGzM7ropO94RBXRidDRDQlvQ1O/7LLSfO0otcToS20W1Ia6nSnVapizdNiaPVBcDjYzYxqilMHHfGxdz1zLF6iMp3WKQWUya+8nCmv4Sd9UxKUyTOvtLlL+TixMpWTkLSCHTgFWS15Wgz5VdHmxipTFsy02HHQG2VaT25cN+r0Ki1QvA2NrrltcaaIW4WFV71/YYQ1trZEfT0cDoU7U0tiqjJljTAoU1H0UZnUYXdSjlOm7m0+pTJZ0/qkQ6E7ZYq29pTKJF4eVWZflIldQQ3ze5gZTaItdpgeiLSLd4rv401r2nhKqas+wVamyWLBpWk9uZlMcmKmN1em7bRs9Oj+UBRFcbgfNVFndag8ZbqlX90IFwklkNOqQtxKb8ix8rry03ZKLiLnsF4w+ps7SBJQu5e5WRdlrRNVOYuanKK9hf5wsW6/9avRLixj/oWUl5usC1tnFKPbw/7stjrNyV7QCnVlUvvZS4UEJqBwy9frdfH05NoglCb7hFCDvVvBe1jz1tZivTzsDzB6RfkdudNxnRyVjYoSR9puP6+jJ6e0gctsU5oTOxZEa8uz+f1wjjSTNKyyx2VKy6ID1jTxlVpXmXMMZ/PKoenHgPWQpoM5MAX4PSRX8QHA3FpwHvqoylRL0OF+JH1wRMW9ojlzNBq5B/3T2kK4Rk23RaNozSlU6DpQphthLBRFwW4VC+eTlMktWvjk2KCG+EYxPAfRYczE1p1mp7lT3TFXcJpGP7t26f4iLroTbIuelmqDrXyManA4ZgopkzpErE52myDPkGCOhw86MkS0UW2Of+O+kDbEjgXZYLlXtTsRKP2I5DxfYYStkedxY2OMMlUiRo/XmpekTMwcX5m0QaaPRXPuhpSJSQ45xVCm8vP23pMmTZm8443ylEo4GnnnBJTJR8w0W+F0MCuQoEylRfq98CaPlkiQcwP0S1ZqvjKpnjvUadx6PhONlT0pL9r9RK305YqUxbSuj8LK1p2n2tKGoD9n0lImTJm0XFNkJ/ueyjeOYEeBzeN51iZSpzlwrfvSfpmbLDR7VT5kVdb4lnxdspa3ojXSQWJhlDJ5N7wUphMok+aADKdraVNAmZyIyT9FV6b6oy8hijIxpXGvv78fTbeniJnY/GdXClmQgDJx/JW0OiJ5yW1zzKFsp7RtZKOV1b/RaULPy1NInYFuP9dOMtSKGGUS7q2hgdq0ZCV5X5ru2C3BWj0FlUlYaxudnOfW6f0wfLvUK83lqvO0JEdsTuxYYAV5KYfjlMkpOLFH3fXpMcpkjUChzsZ5tCLE49BulMnpEjE7bfsIj5Mok3e9KWARyrQtttPR/f0rKJOXHmtmQ1bM5M+NQnVL5MYp982WtKOVKTgTLUdNRp3qcpWOt/rZ7y6lOTHZPHNGpCuT5qqjFvlhe0PKlCb/UTGlaQttVLIymQM3ejVTxI0Ft5RQFiErm0cuXCuTmRnoy1KCNYH1c6QytcOmEabulSliwW37CI+YbJ4kApYy0b0MNzf0vKxsXnnCaDR6LWXigyQ3m+fPEHvYv13M1JEy6TXqy3k7YeRYKZevXtMW33HMpAYR1QHzLh+vTGkxU6wyaUY31+cpUycxk2BRYKyZOTCzxfHKFBW/VYLqFxhrjdcH2spWnzNkHE/WRJjeLGaKjnu73wHhhVlsb4O+A8LZyNfugGhPeCVlYoU4AXyKMrGRaY5IuV4rk6sOjNdXJkVX+ZeG07QSJbqdiqNYT26cOrX8tt955s22lak8MplYv45MV6ZwQ7ixxkDXfK/RjaH1j+XZzIFr3ZfEiUa/Uh21EX6oh631YgAhdEu0JjCPY2OmSpoW5HeyljKpU8BUJi1Etcai0YKgMhXmrnF+Bcv/UdFRlalwIy1n13i7afw1Y6a2lHqhkqVMTJuonxE8nXqm99H5FLsC07qkE2Xyu41NDDlmUvrZH+u2mcwf+etmtyrhk9uIhAYLS37TmUQsuFnPecqkDRFldButFUzTmysOwXDYaQ1c8764oVXMWLBWNt63ajeYy3+xkzS8+ZtlTWfKxGaE823sFHA6x1cmbcTpY9Gc1THK1DtO/pzJDZsn60B6IlS5Nyr8wl3rFhPpO3ZhYMFVnypO7YQeS1CmtqXcQq3jjX72UxchnaVVi6fTE7xv17TP4xvsdLLSIz5RqSDS9GH50xOn85QhYoxuo+1qzf49ZN9Lq2dSHVuEK0VqtnGPFmiCNwKks8kpyj3Qs2qBC6VyBJS7YszObpQpJO9xU4COeJbNWzijVjUysi9jfmnbL8xf2p418Sk40FdwD8G/R3yKJp4LezvRWQOvdvasJ53PUAD6DpTpsoEynTHu8yAA/iGgTAAAAC4fKBMAAIB+AWUCAADQL6BMAAAA+gWUCQAAQL8QlUl52RP99pL2ICm/0Gubb/32UoW8o0r4KvibwBPg/2buku4hAOCS0JVpOJRe/yX87P3skV6DoL6EJFaZrPNkbbffZtIB6huwAACgVxjKtFhMmPN6WgyHk8klxkzy++6sN1yGC01TpoRXReYBZQIAnAeWMj2tfWl6Wgyrlyqxl4kpCSk3caVeRS6zXlX2tBiS14Z5b0IVYjknTxf5ginhsJXNkyq3OsRvEqsxrmeVlplvMKtNF0rVbgYAALwBpjKVQuA4ysna86va+4ebclzNkV+bbq3mfWVyPafxImXTFkowZtKUKepNyQKKMkkv4hV7Vm9ZlDKJzZBvBgAAvAGmMhWuNJXCxKXCcWPWW7lbv2l4v6AysYhF/gMvx/0hCP6Seu7e5fZpX/qFC4lSqkRGzxoty1ImSBEAoF/YyuRI03rC/nSO5GIlP8dfdF8fCf+xLKZM/qvbhT//0NppZfEk68Tkn6xM2t+eCP2xDH1vnh8Laj2rtyxLmYybAQAAb0BAmYg01cLElEn36u6fmZGze8wrJyuT5eIdAzWhyPwTRaYsJsVMZTP4nyuz9FJuWZ4ysa6ERAEA3pKQMjXS1AiT9gDGLIUc0XYEaC49pEyReai1+9f72FfpynRkzCTt1ZB/QpXQsnxlco2DOAEA3pCgMrX74aRtBtyBus+S+DMg2eWRMsXNb1p13MHqLlcVoExlsh5yZTxn8qTT6lm9Af45TpfHPlu6uJ9SAwDOjLAysUW0tTePb6RjiTVJtfQ9de6fvVHctbefTdz+Z+hPrjKZe/OsoEdx/Z42qT1rtYwtKm5kZfKbpN0MAAB4fSKUKei59F/d+N+wrc/yMyD3+RRxqLK7V3/P5D2s0cQnW5n8ysW2Cz5e9f3iIkAq3WoZsaj68ZlkumuecTMAAOC1wRtdAQAA9AsoEwAAgH4BZQIAANAvoEwAAAD6BZQJAABAv4AyAQAA6BeSMr0sB7fTB+Oil+Xg9vrK+W80f0msuaklWF1amddXfmnbMT8oNCGiFUmmylWwy3mZL8vB7fV4F1nNMWzHGTfOgzST2HyYz+LaS3tpttzH1fmwur5abdvPu+nV7fVgc1BPyCZ1qOcN5k4m1PH2SCN2vOtihnY4x9+kfPDqZCuTe8JuKvigSDpWptFg5rr13fRqNlKrSGps8jyPOFnw1B15pTDHK9N23AjSbtr400YYmEKwVcJumiEh+82IytjD6nq8ouUc5jNHqMJoN0se6nqn5StTdxMq2574TjipGQB0pkzH+LiOlWk634y85fN4o1fRL2XqIohJ4OjqdlOiEId5tSYgxZLW7Tejq9vrwWpKu+VhlSghhV9sUWzHt9OH6v/NkcR2JTjlppkp5STX3tFIgDKB86S7mKlZse6mbTZAOMh8lu9lWBaoTTLEZdteloPWXW7H5ZFIZfLrauwZzV/qk+u2BBJuycpE4o8W1iG1+pY2VG5dPCheXpB7sZqW7s+LbPabUVYqrLZf0dr9brv3u+Uwn+X5X9JX1e0mRTl6afaAeJcptjLxod6ef5jPyiVR/e0L+XcRqsUJJe0mkAJ5ZrWTEUuPi/US5KWGOhfimvayHMym49n1VT2XxfHfOBNhIrSdv7QWFqA3dPWcqRkEYnqHLAAbryEoUzvnSbrGKzBGMl0nVTmFGGWS6vJjpnq2RBnDnjOpXukwn/FvpQ55WQ6a3naMZAdD/bnfjBzFZZUm4Vqohy/s28Es58lK4wH3dYhM/1H3pNYD+mj0sPJs0lB3BzPtc1KRqH/ahIqZFK2+OoJUHD1ifbmVk7dh5O6Nbhp98qqOf2MieGMeynQGdBQzyU9HGhcgRQNcmUSPlpTsqk9unNTDKvQIV03WSQbQZubkPLXTRoNZtZpz1puqPWLcGQxGR/MXHk+UVxE1ykq87DejK7sbxUY5w4am4yKoo4rqFhdt09ojsiXmaCz48Zi9CXy0UIHX/q3X3vRMePyLd5aVY7QxqhP48ZR8o1hCfNP8VuhDXfyWxdBQpv7T4XMmZ1HDpnETtovLOrK+866Vn2SEDKsyPLWzi1QmsS5NurpUJtonZH6KHSLaoB70L3f3DpBUWx1n7N2ndCX7Oj0iJnDa2EtouB0zUQTfZNXr3eKqBPeBk9iB1ZnKaOS1GDeRD/WulMlJjUpNYFV7u0KEkjtRJnl2h1CVKapp4TloTgS3ZzJTAuCV6XoHhL8KZmNXDsB1/ciKmaozd/UDpy5jplMoU3uaHnyYBgcPNsgxU1G79eQHP47BvFg5GohVJpPDfEZusXgkeAvEnG2UtcpQ71KZeMxkVq3GTN0pU3B2J5Uc37TjlAkx0znSjTK1qxKSy35Y0SUPyeyrg0nMKWU8Z2pqZw9IA23RnjNJfvY0ylQ4D5ykDolXplB/erFOtYkx+kdFdbGCe9J3jbMglZqdVHX5qGnmRHj7zWi8mpIjWgeKo1Hys8ZNVId6B8pElvlSE8Sq/byF6dNFgsok1xuBXHJ0045UJjxnOkM0ZRIfxqonEMFofmJ5PdhspV1MkXvzxKSW40YDW4DoE9pYZRLrqlpkZPZ0Y9gOiJgnHOWFlUNnHZKgTIH+HGyWzrJ3N02dtKX8S62T9lxJ7W3zdTEq7sEfwgtNkHqAj0Z6l3VrXaShnq9M2oQSm6DMMlKOkKWMGrF24CjXS0uLnAt0w1S4accqEzGg3o/qQfejOtk/MRIFp+ds3070shxn/A7mRPTKmGwigzxwAVzGiM3hlX8yCDI5V2Xab6b9GV69Miab3J8xgfPjMkZsLGL+FvSbc1Um0CVVrgMzFlwmJGmMgOk8gDIBAADoF1AmAAAA/QLKBAAAoF/oyrT/Obta3pb/jZ/Jwcf0HwM8r66+bvytl382g+Uq48kGMSzhctqc6j+zIZktFRGbn4JtTJemMp5/fXz33/vyv0+/ycEfj11W8/fuQ10LrQgA8E+iKNPDI3HcfzYDIk4lad6wQ2V6XjWC9PB4G+/xmcG78fJ28FN9GtqlGGQpU3wVp1Ombz/etwr09+4D04yOJOrxEy1ZqggA8C8hKhPx/iX7nzPPt76VMj08EjlJKYEbfIz2/BPK9Pvzu/8+fyMHnn99fPf97tk7crwy/f58kmIBAOeKpExOwORSOcHnVZUQaxxuc4Rc+PBYJwMfVWUaV+fM5n+KMo4hwdnL/KsfqzkwBTUIKBOzn37bNKRKbHbSfF5sUex/zgaPqwFNOX7d7F1jeDLTbohTUYpAOgGTS6Ucvz9X+bdGV5ojSbpiBknffjhZPke0/t59KLUzr14AQE9RlElLczVO0PGGbezyMv9aX9vKxsv8q+QT/2wGS/9kpVgRUlcEYjavkj3J/vZ8KX/YQfO1YiW9EY0R7oVmSV27cWc53368//BLfk9AIw+yThSHL9/Va2UaafEkisRt3368f/f97rmtpXj+9fHDr8NR9QIA+kgXyuSv2b9u9l4h4WxerRPkoJmkepl/DWxhECx3dkCUUZpqv1y79G1m87Vi6zPFKsRbIy8XmkpTIktKqjI5KsUSdLHUEiWEUFWZhy/fy28PX75//PK3o3oBAD0iL5un5pealJEb0ISVqUnc0X+04uGiRCEmzODWWUv26w20v41vfkyx/r/lMNG5KawhlQHpuxnD2TyuTGR/3TEKQR9oOcV+v3umoVL9sat6AQD9IG4HBM+2qUFDTXrMVOvQ8+rqcVf82Qxk7UmOlkQj6b4+0X6npdTF2zETKd9uflKxOTGThLHmEGA7IJoj4ZgpBUEC6wSds+eijYceP32/+1bqE7ZLAHCByLvG3aCEPBCS/bWYgkt5zuQGMbvxcjX/ORMzinyXYCTWrnHJfioG9YW7MQ1ujmu+WixVI66d3nMm7yqtIeQ5U4qoH758JyHI37sP/733xMBRDvcJUIJakJKbesuPRLQeP5F46NuP9+/++/jl73H1AgB6iv5LW75zrPCdIMkO8e1qbXJpNv8ZuTePVi3mnXZj79eyR+zNK22umsbsZy29vVrO5s+16++m+X6xbGPFLd8YErs3j9SYtzevxNsaV1XSCED1C9k6tOK79WJ5/EQycq1Ktb/A/fjld6tAxe/PjgLl1wsA6CG9fDvRSV9qAAAAoN/0UZlCP2MCAABwyfRMmapUFQImAAD4d+mZMgEAAPjngTIBAADoF1AmAAAA/QLKBAAAoF9AmQAAAPQLKBMAAIB+8T8fuYH0/QKPPAAAAABJRU5ErkJgggA=" /> <br /><br />The reasons for this became apparent pretty quickly:<br /><br /><br /><br />1.&nbsp; Dr. Lindsey Basileo works for Learning Sciences International.&nbsp; Their <a href="https://www.learningsciences.com/about">About page</a> states, "<b>Our Centers for research and development include Learning Sciences Marzano Center</b> <b>with Dr. Robert J. Marzano</b>, to develop instructional frameworks as well as evaluation and growth systems."&nbsp; So this isn't independent research, and a gross lack of disclosure.&nbsp; I would say this is Red Flag #2, but honestly, by academic standards, it's game over at this point--credibility is out the window.&nbsp; Especially when they didn't make the connection between product and reviewer/researcher clear.<br /><br />2.&nbsp; Dr. Basileo's <a href="https://www.linkedin.com/in/lindseydeversbasileo/">PhD is in Criminology and Criminal Justice</a> (along with her MS and BS).&nbsp; So while an expert, her expertise doesn't seem particularly relevant.<br /><br />3.&nbsp; Michael Toth is the CEO of Learning Sciences International.&nbsp; Same problem as #1.&nbsp; Additionally, a few "suspicious" things:&nbsp; Googling the organization he was former president of ("National Center for the Profession of Teaching") in quotes seems to indicate said organization now exists only on his biography (Guidestar indicates it may have either merged with another organization or gone defunct).&nbsp;&nbsp;&nbsp; I also noticed he's referred to only as "Michael Toth"; unlike the "Dr." they put in front of Marzano and Basileo and there's no mention of his education on <a href="https://www.linkedin.com/in/michael-toth-957263126/">his LinkedIn</a>.&nbsp; (Admittedly this proves nothing, but given their focus on marketing, I find it suspicious they'd leave off the alphabet soup and the credibility it lends.)<br /><br />4.&nbsp; At this point, I think we can safely say this research supporting Marzano's system is incestuous; it came from an affiliated (parent?) organization and this wasn't properly disclosed.&nbsp; Further, between these obvious problems, the lack of citations, and the difficulty in even finding a copy of the research in question, I think I can safely assume it was not peer-reviewed.&nbsp; Which from my perspective, renders an already discredited bit of research totally worthless.Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com5tag:blogger.com,1999:blog-3054300747093348542.post-1990273231159562292016-02-09T21:24:00.000-05:002016-02-09T21:24:50.530-05:00Rep. Erik Fresen & Company: Three strikes, you're out.Florida continues to dump a grossly disproportionate amount of capital funding into charters; 50% last year, and possibly an even greater amount this year.&nbsp; This despite the fact that public schools greatly outnumber charters--<a href="http://www.tampabay.com/blogs/the-buzz-florida-politics/broad-changes-to-school-construction-funding-to-go-before-florida-house/2264651">about 6:1</a>.&nbsp; So if there were any ethics/honesty/logic in the funding, you'd think charters would get about 14%, maybe a bit more to try to increase their numbers. <br /><br />I'd actually be fine with charters except for a few things:<br /><br />1.&nbsp; Here in Florida, according to the last full (2013; the 2015 focused on just urban areas) CREDO study, <a href="http://www.tbo.com/pinellas-county/florida-charter-schools-lagging-study-says-20130630/">Florida's charters do WORSE than our public schools</a>:<br /><br /><br /><blockquote class="tr_bq">...Florida charter-school students lose the equivalent of seven days of reading instructional time, compared to students in public schools.</blockquote><br /><br />They tie for math.&nbsp; They're delivering an inferior product, so they market it as "choice*."&nbsp; Strike one.<br /><br />2.&nbsp; Fresen in particular claims he's fighting to protect our tax dollars.&nbsp; This is hard to swallow given that he is ignoring&nbsp;the <a href="https://www.washingtonpost.com/news/answer-sheet/wp/2015/04/28/report-millions-of-dollars-in-fraud-waste-found-in-charter-school-sector/">massive waste&nbsp;and fraud of charters</a>, nationwide.&nbsp; <a href="http://interactive.sun-sentinel.com/charter-schools-unsupervised/investigation.html">Florida is no exception</a>.&nbsp; I'd rather pay a little over budget than flat-out throw the money away.&nbsp; An inferior product that's wasting money?&nbsp; Strike two.&nbsp; Also, can you say #RINO ?<br /><br />3.&nbsp; One of the lead proponents of this push for charters, Rep Erik Fresen, (R-Disturbing) is also the education budget committee Chairman.&nbsp; This is pretty amazing because Fresen's sister is the wife of the CEO of Academica, a charter firm. Fresen himself worked for them for a while as a lobbyist and now works for Civica, an architecture firm that has, among other things, built some schools for Academica.&nbsp; As for an explanation for how <a href="http://www.miamiherald.com/news/special-reports/cashing-in-on-kids/article1939208.html">this is possible</a>, I have only one:&nbsp; Because Florida.&nbsp; Strike three.<br /><br />Charters were supposed to be "innovation centers" for education but instead&nbsp;seem to mainly be&nbsp;<a href="http://america.aljazeera.com/articles/2015/12/10/charter-schools-are-a-gravy-train-say-researchers.html">innovating ways to&nbsp;launder tax dollars</a>&nbsp;into private hands.&nbsp; From my perspective the conclusion was reached first--we need charters.&nbsp; It was probably mostly an ideological decision--reality be damned.&nbsp; Now Fresen et al are looking to justify their decision after the fact (ex post facto if you wanna sound erudite), the reason of the week being over-budget construction projects.&nbsp; Besides, who cares if the kids' education suffers when you can pass along some of those sweet, sweet tax dollars to <a href="http://www.miamiherald.com/news/special-reports/cashing-in-on-kids/article1939208.html">your friends and family</a>?<br /><br /><br />*&nbsp; Speaking of choice, did you hear that participating in <a href="http://www.usnews.com/news/articles/2016-02-03/louisiana-voucher-program-leaves-students-behind-one-study-shows">the&nbsp;country's fifth-largest voucher program&nbsp; generates far worse results than going to a public school</a>?Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com5tag:blogger.com,1999:blog-3054300747093348542.post-57271982550359123012015-02-17T21:47:00.002-05:002015-03-19T17:36:57.301-04:00Why Haven't Florida's Test Scores Shot Through the Roof?We're now in year three of Marzano's "causal" model here in Florida.&nbsp;&nbsp; With all these effect sizes (where increases of 10-20 <i>percentile points </i>are common) AND with <a href="http://stateimpact.npr.org/florida/2014/12/03/more-florida-teachers-rated-highly-effective/">98 percent of Florida's teachers getting effective or better ratings</a>, shouldn't Florida's test scores be through the roof by now?&nbsp; Because they're not.&nbsp; In 2013 <a href="http://articles.orlandosentinel.com/2013-09-26/features/os-florida-sat-scores-2013-20130925_1_flat-scores-mean-scores-sat-college-entrance-exam">they were stagnant from the year before</a>.&nbsp; And this year?<br /><br />"The average scores for Florida's class of 2014 were 491 in reading, 485 in math and 472 in writing, all below the national averages and lower than last year's scores, when a smaller group of state students took the test.&nbsp; Across the country, SAT scores were stagnant..."&nbsp; (<a href="http://www.orlandosentinel.com/features/education/os-ap-sat-scores-florida-20141006-story.html">Source</a>.)<br /><br />So what's the problem?&nbsp; The model or its implementation?&nbsp; My guess is both (plus the research behind the model).<br /><br />Needless to say, its implementation has been a nightmare--the fact we're still trying to implement it three years later (at God only knows what expense) should tell you everything you need to know.&nbsp; Or you can Google <a href="http://www.tcpalm.com/news/columnists/eve-samples-teacher-morale-plummets-thanks-to">articles like this</a>.<br /><br />The model itself, despite the claims on Marzano's website, <a href="http://blogs.edweek.org/edweek/on_performance/2011/06/marzanos_causal_evaluation_system.html">appears to have zero research supporting it</a> (it being the model itself).&nbsp; Check out his website's claims:<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-mEId75DyyzE/VOP2NlUXMWI/AAAAAAAAAGk/i6f0zICjChQ/s1600/Evidence.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://3.bp.blogspot.com/-mEId75DyyzE/VOP2NlUXMWI/AAAAAAAAAGk/i6f0zICjChQ/s1600/Evidence.png" height="94" width="320" /></a></div><br /><br />&nbsp;Going in order (1-5):<br />1.&nbsp; Where have I heard this 5000 studies over 50 years claim?&nbsp;&nbsp; Here, in <a href="http://files.eric.ed.gov/fulltext/ED481972.pdf">a journal article</a> co-authored (second author, it seems) by Marzano.&nbsp; Turns out only 70 (1.4%) of those 5000 studies "met the researchers' criteria for design, control, data analysis, and rigor."&nbsp; This would appear to be, at best, intentionally misleading.&nbsp; And considering there's no way these 5000+ studies, done decades before the model existed, were actually testing the model.&nbsp; Strike one.<br /><br />2.&nbsp; This is completely irrelevant to verifying the model.&nbsp; Once again, "It's good because there's a lot of it--and a number!"&nbsp; If anything, the fact this much <a href="http://www.tfd.com/tripe">stuff</a> is out there and had no effect, I would say, works better as a <i>counterpoint </i>to its effectiveness.&nbsp; Strike two.<br /><br />3.&nbsp; I won't rehash the hazards of the analyses, but it's important to note that this is<u> not evidence for the model itself</u>. We're now 0 for 3.&nbsp; (Are these studies double-dipping from #1 above?&nbsp; I bet they are.)<br /><br />4.&nbsp; Finally, something directly studying the model!&nbsp; Except there's nothing listed.&nbsp; One would think, with this being <i>the</i> most important thing listed here, there would be a link, or a title, SOMETHING.&nbsp; Zero for four...<br /><br />5.&nbsp; This paper is basically a "Why you should use our Model"; I see nothing in there verifying its effectiveness.<br /><br />And we're 0 for 5 now.&nbsp; (Which, if some people get their way, isn't a zero, but a 50%; no wonder "educational experts" approve of <a href="http://education.modernsense.net/2012/09/no-zero-policies-and-failure-of.html">this baloney</a>.&nbsp; Regardless, 50% or 0%, this is a failure.)<br /><br />So we have a convoluted and horribly expensive evaluation system that doesn't seem to be producing significant (if <u>any</u>) results after 3 years.&nbsp; Solution?&nbsp; Let's drop this until a third-party verifies its effectiveness and go back to a cheap, simple solution--which will likely cause no discernible changes to our education system (besides saving money).Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com2tag:blogger.com,1999:blog-3054300747093348542.post-79470046868299920292015-02-06T23:12:00.001-05:002015-02-08T10:08:03.205-05:00Insanity of the Marzano Evaluation Redux...<a href="http://education.modernsense.net/2012/09/the-insanity-of-marzano-evaluation.html">My "Insanity" post</a> re: the Marzano evaluation system seems to be the only "popular" post I have so I thought it might be time to revisit it--this time in fewer words.&nbsp; I encourage everyone to sign up at his website to access the database themselves.&nbsp; Then go through and take a look.&nbsp; Before we begin, I urge you to keep in mind the GIGO paradigm:<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://4.bp.blogspot.com/-BS5nXeKk81g/VNWNSSODmCI/AAAAAAAAAGY/uS5FSAovO-s/s1600/garbage_paradigm.gif" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-BS5nXeKk81g/VNWNSSODmCI/AAAAAAAAAGY/uS5FSAovO-s/s1600/garbage_paradigm.gif" height="138" width="320" /></a></div><br /><br />Sorting by p, you quickly see a lot of data that seems to have no value reported; I'm fairly certain that with a sample size of 8, a p of &lt;0.0000 is not going to happen.&nbsp; <br /><br /><div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-F5k-70t8ydI/VNWDyazSrlI/AAAAAAAAAFY/bDZdXOkR0BI/s1600/Marzano%2B001.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://3.bp.blogspot.com/-F5k-70t8ydI/VNWDyazSrlI/AAAAAAAAAFY/bDZdXOkR0BI/s1600/Marzano%2B001.jpg" height="235" width="320" /></a></div><br />&nbsp;And, eyeballing the scrollbar, it would seem that ~66-75% of Marzano's database is statistically <u><b>IN</b></u>signfiicant.&nbsp; ("...<a href="http://www.surveysystem.com/signif.htm">in Statistics <b>'significant' means probably true</b> (not due to chance)</a>") Combined with the portion above (all those zeros...), I personally find this to be, well, <i>damning</i>, for lack of a better word.<br /><br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-s56ratMu118/VNWKf-zfIdI/AAAAAAAAAF8/uy64eYXwo2g/s1600/Marzano%2B002.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://3.bp.blogspot.com/-s56ratMu118/VNWKf-zfIdI/AAAAAAAAAF8/uy64eYXwo2g/s1600/Marzano%2B002.jpg" height="320" width="216" /></a></div><br /><div class="separator" style="clear: both; text-align: left;">Now, before putting in these last two pictures, I would like to once again quote Marzano's description of the p values:&nbsp; "Basically, if the value in this column is less than .05, the effect size reported for the study can be considered statistically significant at a significance level of 5% (that is, the probability of observing such a result by chance is less than 1 in 20). In other words, a reasonable inference can be made that ... the reported effect size represents a real change in student learning."</div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;">Behold the "better than a coin flip" point:</div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="http://2.bp.blogspot.com/-z8TxaD42XgI/VNWKf0Qh65I/AAAAAAAAAGA/A7xVKvcQ0kc/s1600/Not%2Breal%2B01.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://2.bp.blogspot.com/-z8TxaD42XgI/VNWKf0Qh65I/AAAAAAAAAGA/A7xVKvcQ0kc/s1600/Not%2Breal%2B01.jpg" height="320" width="244" /></a></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;">And, this is definitely my favorite:&nbsp; Seven results that are 100% likely to be random fluctuations.&nbsp; </div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="http://1.bp.blogspot.com/-OoA2_oRSKgU/VNWMnrtK5aI/AAAAAAAAAGM/Cub9_H3Wxsc/s1600/Not%2Breal%2B02.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://1.bp.blogspot.com/-OoA2_oRSKgU/VNWMnrtK5aI/AAAAAAAAAGM/Cub9_H3Wxsc/s1600/Not%2Breal%2B02.jpg" height="320" width="137" /></a></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;">It's the epitome of hypocrisy that in this day and age of "data driven decision making" we're relying on this type/quality of research to make decisions.&nbsp; It's like our politicians and educrats have never even heard of the phrase "peer review."&nbsp; Again:&nbsp; </div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="http://4.bp.blogspot.com/-BS5nXeKk81g/VNWNSSODmCI/AAAAAAAAAGU/7FLeskuAGuc/s1600/garbage_paradigm.gif" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-BS5nXeKk81g/VNWNSSODmCI/AAAAAAAAAGU/7FLeskuAGuc/s1600/garbage_paradigm.gif" height="138" width="320" /></a></div><br /><div class="separator" style="clear: both; text-align: left;"></div><br /><br /><div class="separator" style="clear: both; text-align: left;">To Marzano's credit, he's stated his research is being misused.&nbsp; But I don't see him making a big fuss in telling states like Florida to stop basing their evaluations on his work, i.e., stop buying his books and materials.</div><br /><div class="separator" style="clear: both; text-align: left;"><br /></div><br />BONUS:&nbsp; This is one of my favorite pictures, when you sort it by N (C), that is, the size of the control.&nbsp; You used a study that had ONE kid as a "control"?&nbsp; <a href="http://www.huffingtonpost.com/2012/05/15/15-best-really-segments-from-snl-video_n_1515440.html">Really</a>?&nbsp; I mean, <i>REALLY</i>?&nbsp; You don't need to be a statistician to realize that public policy should not even be influenced, yet alone based on this analysis.<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://4.bp.blogspot.com/-x91BBy5Ej8E/VNWDySojqjI/AAAAAAAAAFc/l2Q51azqbZs/s1600/Marzano%2Bcontrol.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-x91BBy5Ej8E/VNWDySojqjI/AAAAAAAAAFc/l2Q51azqbZs/s1600/Marzano%2Bcontrol.png" height="218" width="320" /></a></div><br /><br /><br />Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-39747282104256046142014-12-24T22:01:00.000-05:002014-12-24T22:03:00.580-05:00The civilized veneer of Florida's school accountability system.<div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-mUP7VeylYL0/VJt6eg-hF-I/AAAAAAAAAFI/CJkL8tIWhhk/s1600/Hypothesis.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" src="http://3.bp.blogspot.com/-mUP7VeylYL0/VJt6eg-hF-I/AAAAAAAAAFI/CJkL8tIWhhk/s1600/Hypothesis.jpg" height="240" width="320" /></a></div>One hypothesis is that Jeb Bush's A-F system is a simple and easy to understand method with easy to interpret results.&nbsp; But this is Florida mixed in with some educrats, sooo....<br /><br />The system isn't as complicated as I thought (see for yourself <a href="http://schoolgrades.fldoe.org/pdf/1314/Guidesheet2014SchoolGrades.pdf">here</a>), but there are some oddities.&nbsp; For example, most people probably think "90+%" when they hear "A."&nbsp; For Florida, it's 70% (1120/1600) or better.&nbsp; So a large block for "A" schools.&nbsp; It gets weirder:&nbsp; a B has a range of 65%-70% (1050-1119).&nbsp; A 5% range for B's? Here's <a href="http://www.etymonline.com/index.php?term=shebang">the whole shebang</a>:<br /><br /><br />&nbsp;(All scores out of 1600)<br />A:&nbsp; 1120+&nbsp; (70%, range of 30%)<br />B:&nbsp; 1040-1119 (65%-70%, range of 5%)<br />C:&nbsp; 880-1039 (55%-65%, range of 10%)<br />D:&nbsp; 800-879 (50%-55%, range of 5%)<br />F:&nbsp; &lt;800 (below 50%, range of 50%)<br /><br />It seems like they're trying to use a standard curve (1600 a la the SAT) and the traditional A-F, but not unsurprisingly, failing at both.&nbsp; But this isn't even the worst part--it's how they arbitrarily shift the numbers they use in the calculations around.&nbsp; For example, <a href="http://www.clickorlando.com/news/central-florida-high-school-grades-released/30296326">a week ago</a><br /><br /><span style="font-family: &quot;Helvetica Neue&quot;,Arial,Helvetica,sans-serif;">"Education Commissioner Pam Stewart said a key reason for the drop in A-rated schools was that the grading formula was changed to make it more difficult to earn a top grade."</span><br /><br />Now<a href="http://www.washingtonpost.com/blogs/answer-sheet/post/test-scores-plummet--so-florida-drops-passing-grade/2012/05/21/gIQAzopIeU_blog.html"> rewind two years</a>:<br /><br /><span style="font-family: &quot;Helvetica Neue&quot;,Arial,Helvetica,sans-serif;">"State education officials panicked, and at an emergency meeting last week, the Florida Board of Education decided in a 4-3 vote that the best thing to do was to lower the passing score on this exam.</span><br /><span style="font-family: &quot;Helvetica Neue&quot;,Arial,Helvetica,sans-serif;"></span><span style="font-family: &quot;Helvetica Neue&quot;,Arial,Helvetica,sans-serif;">Let me repeat that: In order to make sure that students succeeded on the test, the passing grade was lowered."</span><br /><br />So, when it comes down to it, all the math, all the calculations mean nothing--<i>the numbers are fudged to whatever looks or feels "right"</i> to the powers that be.&nbsp; Once again,<b> the math is just there to provide <a href="http://www.amazon.com/When-Can-You-Trust-Experts/dp/1118130278">a false sense of credibility</a>. </b><br /><br />Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-20032483947245468852014-11-14T22:56:00.002-05:002014-11-14T23:14:13.209-05:00Could grade inflation have "helped" lead us to this testing mania?&nbsp;*&nbsp; Note:&nbsp; I changed the title to be more clear.&nbsp; <a href="http://izquotes.com/quotes-pictures/quote-for-every-complex-problem-there-is-a-solution-that-is-simple-neat-and-wrong-h-l-mencken-384395.jpg">There is no one simple reason for how we got where we are.</a><br /><br />While I can't stand the amount of time, tax dollars, and opportunity costs of all these standardized tests, there is one thing that has always gnawed at me--they are, sadly, somewhat relevant.&nbsp; Granted, they are way overdone, but as I have told my students in the past, with grade inflation, <i>some</i>--nowhere near as many as what we have*--standardized tests are needed.&nbsp; <a href="http://www.huffingtonpost.com/angelina-massoia/the-new-normal-the-proble_b_6146236.html">This article from Angelina Massoia</a> puts it quite elegantly:<br /><br /><span style="font-size: x-large;"><b>"By submitting to the culture of grade inflation, we empower the standardized test to 'accurately' represent us."</b></span><br /><br />Part of the reason I believe that it's going to be hard to stop this testing madness is that to some small degree, the field of education itself is to blame.&nbsp; The article above notes that "about 43 percent" of all grades given in college are now an A.&nbsp; More importantly, <a href="http://nctq.org/dmsView/Easy_As_fact_sheet_graphics">it's far worse in education (image source)</a>:<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://4.bp.blogspot.com/-GZcZrzamJU0/VGbMx1pZHuI/AAAAAAAAAE4/L1S1sihSKuY/s1600/Grade%2Binflation.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-GZcZrzamJU0/VGbMx1pZHuI/AAAAAAAAAE4/L1S1sihSKuY/s1600/Grade%2Binflation.png" height="320" width="309" /></a></div><br />This is hardly a surprise, I would hope; I'm sure there's plenty of other, older research (such as this, indicating "<a href="http://www.cbsnews.com/news/heres-the-nations-easiest-college-major/">Education majors enjoyed grade point averages that were .5 to .8 grade points higher than students in the other college majors.</a>").<br /><br />Again, I am in no way advocating the testing mania.&nbsp; What I do believe/wonder is if the "reformers" and other test advocates may have been able to get their grip on our system due to grade inflation and if the Colleges of Education don't share some blame* (whoops, sorry again--I meant "<i>accountability</i>") for this.&nbsp; This <a href="http://www.huffingtonpost.com/2014/11/12/teacher-preparation-nctq_n_6142634.html">article (again from Huffington)</a> goes over the full study above in more detail.&nbsp; I take issue with it in that it should have made the distinction between "easy" and "academically rigorous."&nbsp; I can't say whether they are easy, having not been an ed. major but I am finishing up my 5th ed. course in &lt;1 year.&nbsp; From this experience--and from what colleagues have told me of their own--I can say education majors are <i>far </i>from academically rigorous.&nbsp; (I dare say that even my regular chemistry class is <i>far </i>more academically challenging then they have been.&nbsp; Given the past 10+ years of our leaders' use of "rigor" as a buzzword, I find it rather hypocritical that they probably wouldn't recognize it if they saw it.&nbsp; Or be able to handle it.&nbsp; But those are subjects for another blog.)<br /><br /><br />*&nbsp; And let's be honest, this is being done to blame teachers and schools.&nbsp; Oh, wait, I'm sorry, I meant "Hold them accountable [if things go bad, otherwise, the reformers will take the credit]."Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-38051033937666531952014-11-11T20:39:00.001-05:002014-11-11T20:46:21.943-05:00Opting Out May be Education's Only OptionHopefully the opt-out movement is (finally...) reaching a critical mass.&nbsp; Large-scale (200 students) <a href="http://co.chalkbeat.org/2014/11/10/two-colorado-high-schools-expect-mass-opt-out-of-tests-this-week/">walkouts in Colorado</a> and a <a href="http://www.nytimes.com/2014/11/10/us/states-listen-as-parents-give-rampant-testing-an-f.html">recent article in the New York Times</a> highlighting the grotesquely wasteful (ab)use of standardized tests are starting to make waves.&nbsp; (I would have liked to see the NYT article go into more detail on the opportunity costs--60 to 80 days spent on testing per year!?!--of these tests, <a href="http://education.modernsense.net/2014/04/was-proctoring-fcat-worth-50-million-of.html">as I attempted to here</a>.)&nbsp; I see opting-out as the only real solution at this point, since both Republicans and Democrats have proven themselves to be utterly worthless (see:&nbsp; <a href="http://dianeravitch.net/2013/07/12/william-mathis-nclb-reauthorization-is-a-bipartisan-disaster/">No Child Left Behind, Race to the Top</a>).<br /><br />1.&nbsp; Opting out devastates the school's ranking, especially if the good kids opt out.&nbsp; (I hope/assume that this was encouraged by these high-achieving students and/or their parents.)&nbsp; This in turn pressures the school board to do something--preferably/hopefully dropping these asinine ranking systems and in turn, their tests.<br /><br />2.&nbsp; As more students opt out, the easier it is to see the data being collected is not <i>good </i>data.&nbsp; Hopefully people start to realize they're spending <a href="http://www.edweek.org/ew/articles/2012/11/29/13testcosts.h32.html">billions of dollars</a> collecting data that's between dubious and worthless, again pressuring school boards--already strapped for cash--to jettison these tests.Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com2tag:blogger.com,1999:blog-3054300747093348542.post-9723658698780631172014-09-15T21:03:00.001-04:002014-09-15T22:09:01.356-04:00Newsweek and "Cause and Effect"Oh, Newsweek and your "Best High Schools" list...if only you'd point out <a href="http://education.ufl.edu/news/2010/03/19/predict-student-success-theres-no-place-home-uf-study/">the obvious</a>:&nbsp; The "best" schools are those with the best students.<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="http://4.bp.blogspot.com/-tOI-0ljLdrE/VBeL1v_BS6I/AAAAAAAAAEg/Y2rf4jZkaro/s1600/Newsweek.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="http://4.bp.blogspot.com/-tOI-0ljLdrE/VBeL1v_BS6I/AAAAAAAAAEg/Y2rf4jZkaro/s1600/Newsweek.png" height="212" width="320" /></a></div><br /><br /><br />I imagine that "the list" has become something of a cash cow for Newsweek; there's simply no way they can't realize the list is of no value.<br /><br />Numbers for Household income from Wikipedia pages.&nbsp; Chicago was split into several sections so I wasn't sure which MHI to use.&nbsp; (Not that it matters since the school is a selective admission, as are most, I assume; I didn't bother to check the ones that were well above the US average MHI.)Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-31758720749498954892014-08-25T16:33:00.003-04:002014-08-25T17:02:33.675-04:00VAM for Kindergartners? I say VAM for legislators.The insanity of "big data" has finally hit the mainstream media, as the <a href="http://www.washingtonpost.com/blogs/answer-sheet/wp/2014/08/22/and-now-final-exams-for-kindergartners-really/">Washington Post notes that in Florida</a>, <a href="http://www.etymonline.com/index.php?term=kindergarten">kindergartners</a> are technically-sorta-maybe required to take end of course (EOC) exams.&nbsp; That's right--six-year-olds.&nbsp; Already the <strike>kindergartners</strike> <a href="http://cdn.meme.li/instances/500x/38592472.jpg">politicians</a> are working to cover up their mistake by<a href="http://www.wftv.com/news/news/local/9-investigates-only-some-tests-be-taken-kindergart/ng6HL/"> claiming the law was misinterpreted</a>.&nbsp; That's much better--because everyone knows you should wait until kids are seven years old before they start taking final exams/EOCs.&nbsp; Eight at the latest.&nbsp; (/sarcasm)&nbsp; I mean, this is common sense here--you can't put <i>peoples' livelihoods</i> in the hands of <i>kids</i>.&nbsp; Especially when teacher effects are just a small part of picture.&nbsp; (The numbers appear to vary widely--which makes sense, given difficulties in measuring--but a quick search shows non-school effects range from <a href="http://www.epi.org/publication/ib286/">~67%</a> to as much as <a href="http://www.rand.org/education/projects/measuring-teacher-effectiveness/teachers-matter.html">89%</a> of learning/student success.)<br /><br />So here is my solution to the problem:&nbsp; <span style="font-size: large;"><b>VAMs for our legislators</b></span>.&nbsp; If they don't improve our education system, they will be ineligible to run for at least one election cycles.&nbsp; NO exceptions.&nbsp; A few key inputs for the model (please feel free to add/modify):<br />1.&nbsp; The laws must be shown to have improved education.<br />2.&nbsp; The laws must be shown to be cost-effective.<br />3.&nbsp; Teacher morale will be factored in.<br />4.&nbsp; Graduation rates must improve. This includes elementary and middle school.&nbsp; (This too will require a cost-benefit analysis.)<br />5a.&nbsp; Flexibility in education is key, so how quickly bills can be passed will be taken into account.<br />5b.&nbsp; How much support the bill gets in the legislature will also be factored into the VAM.<br /><br />Who's willing to bet that the instant the politicians realize they can be fired because of things nearly completely out of their control they suddenly have a <i><b>very</b></i> different opinion of VAM?&nbsp; Anyone?&nbsp; <a href="https://www.youtube.com/watch?v=NP0mQeLWCCo">Anyone</a>?<br /><br />Update:&nbsp; <a href="http://www.naplesnews.com/news/politics/gov-rick-scott-calls-for-review-of-florida-standardized-tests_34082712">Gov. Rick Scott calls for review of Florida's standardized tests</a>.&nbsp; Combined with Arne "<a href="http://www.washingtonpost.com/blogs/answer-sheet/wp/2014/07/31/a-teacher-asks-arne-duncan-a-gutsy-question-heres-the-answer/">Duh</a>" Duncan's latest, there's hope yet...better several-years-late than never to realize that <a href="http://www.usnews.com/news/articles/2014/08/21/education-secretary-arne-duncan-loosens-reins-on-teacher-evaluations-testing">testing mania has gotten out of hand</a>.Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-11798218153161970452014-04-22T21:53:00.001-04:002014-06-28T20:41:45.391-04:00Was proctoring the FCAT worth 50+ million of your tax dollars every year?It currently costs <a href="http://nces.ed.gov/fastfacts/display.asp?id=66">$12,700 dollars a year</a> to educate a student in the US public schools.&nbsp; That works out to about $70/day.&nbsp; Here in Florida, <a href="http://www.governing.com/gov-data/education-data/state-education-spending-per-pupil-data.html">that number shrinks to $8,887/student</a>, or about $49.40/day (let's just call it $50/day).&nbsp; <a href="http://www.miamiherald.com/2014/04/22/4073816/fcat-computer-glitches-halts-testing.html">Today's FCAT glitch</a> probably just cost a half-day for each student; "thousands" of students were affected.&nbsp; That's ~$25/student/test that was probably completely wasted.&nbsp; So are we talking $50,000 of tax dollars down the drain?&nbsp; $100,000 (4,000 students)?<br /><br /><br />Is all of this time being spent to collect data (often of dubious quality, to be polite...) a waste and every half-day spent testing is $25/student thrown away?&nbsp; (And I'm guessing between VAM tests, progress monitoring tests, and FCAT, the average Florida student spends close to a full week of school testing.) &nbsp; <b>The total opportunity cost caused by lost class time and proctoring these standardized tests must be staggering</b>. <br /><br />Or, put another way--is proctoring the FCAT worth $50 million?*&nbsp; Oh, and don't forget Pearson's contract with the state--<a href="http://www.miamiherald.com/2014/04/22/4073816/fcat-computer-glitches-halts-testing.html">that costs you another ~$51 million a year</a>.&nbsp; I have a hard time believing this is worth it; it's probably enough to run a small school district for a year.&nbsp; <br /><br /><br /><br />*&nbsp; There are <a href="http://florida.educationbug.org/public-schools/">2,587,000 students in Florida's public schools</a>.&nbsp; If that distributes evenly amongst grades K-12, that works out to 199,000 students/grade.&nbsp; It looks like <a href="http://www.palmbeachschools.org/transformation/documents/FCATTestingSchedule_000.pdf">nearly every grade above 2nd tests (at least once)</a>, so that's 10 grades, or ~2,000,000 of the students were tested every year.&nbsp; So two million tests multiplied by $25/student/test yields ~$50,000,000.&nbsp; (This is admittedly a pretty rough estimate with some mutant statistics.)<br /><div class="separator" style="clear: both; text-align: center;"></div>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-80383522875331458772013-11-20T17:57:00.001-05:002014-05-23T16:24:52.426-04:00"I'm not even going to read the question."...So said one of my students, prior to my handing out the wonderful test for my VAM score today.&nbsp; And while this student wound up actually reading (at least) some of the questions, others wanted to start filling out the bubble-sheets before they even got the test.&nbsp; Others were done with the 40-problem test within ~5-10 minutes. So please, tell me highly-paid "educational experts", why is it a good idea to judge me on these test scores?<br /><br />How many millions of dollars are being spent collecting junk data for a <a href="http://www.youtube.com/watch?v=uONqxysWEk8">statistically flawed analysis </a>that is shown to be inappropriate and <a href="http://www.washingtonpost.com/blogs/answer-sheet/post/what-research-really-says-on-teacher-evaluation/2012/09/16/2e9de9fa-ff44-11e1-8adc-499661afe377_blog.html">has essentially no basis as far as effectiveness is concerned</a>?&nbsp; It's stupid bogus sophistry (BS) like this that makes me think the schools probably would have enough money if the people at the top (Federal, State, District) knew what they were doing.<br /><br /><div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-LDYGtknULJ8/UGiroNL5HKI/AAAAAAAAAAk/B6PMTiobGvM/s1600/805014.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" src="http://3.bp.blogspot.com/-LDYGtknULJ8/UGiroNL5HKI/AAAAAAAAAAk/B6PMTiobGvM/s1600/805014.png" /></a></div><a href="http://1.bp.blogspot.com/-PxMnynfq8Ko/UPjVvOwTN9I/AAAAAAAAACs/7GOeV0l3JKE/s1600/keeper+glyph.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><br /></a>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-9703987611315517542013-05-29T21:38:00.000-04:002014-04-22T22:19:03.040-04:00Visible Learning, Invisible EvidenceSo I'm "done" (returning) Hattie's Visible Learning tomorrow.&nbsp; I read over the first two chapters; didn't really focus on the actual "meat" of the book as I don't think the numbers mean squat.&nbsp; They are at best extremely unreliable; I'd love to see someone try to test some of these numbers.&nbsp; (i.e., focus on one strategy, test it repeatedly, and see if the results come back anywhere near the average Hattie presents.&nbsp; Or even take a few [large] random samples of older research and see if the same number comes back up.)<br /><br />A few of my questions/comments/concerns:<br /><br />1.&nbsp; If these effect sizes are accurate, why can a teacher not focus on 2-3 things and thus be more-or-less a "great" teacher?&nbsp; If these evaluations' [e.g., Marzano] checklists aren't checklists as claimed, that is, "It's stuff [we're] already doing in class"...well...with all these great effects, why isn't virtually every teacher great?&nbsp; I see three possibilities (not mutually exclusive):<br />i.&nbsp;&nbsp;&nbsp; Virtually every teacher is not doing them (and there are a LOT of them) enough.<br />ii.&nbsp;&nbsp; Virtually every teacher sucks at virtually every one of them. <br />iii.&nbsp; <span style="color: red;"><b>The numbers suck.</b></span><br /><br />(Technically I can think of a fourth but I excluded it; there is the--illogical--possibility that the numbers are somehow not cumulative.&nbsp; But if that's the case, it destroys the whole argument for implementing these strateg<u>ies</u>.) <br /><br />2.&nbsp; Hattie states that a d=0.4+ is the "zone of desired effects".&nbsp; Yet he also states, "Further, there are many examples that show small effects may be important" and goes on to mention a study with a d = 0.07 wherein "34 out of every 1,000 people would be saved from a heart attack if they used low dose aspirin on a regular basis".&nbsp; Well, if it effects 34 out of 1,000 people, it would save 1.9 million out of ~55 million.&nbsp; I use this latter number because<a href="http://www.edreform.com/2012/04/k-12-facts/"> that's how many K-12 students there are in the US</a>.&nbsp; Obviously this wouldn't be as signficant as a life-or-death situation, but if it's going to help (rather than save) that many kids, is it worth looking into?&nbsp; To quote Hattie, "This sounds worth it to me." (pg 9)&nbsp; Hattie's "hinge point" seems purely arbitrary.&nbsp; This also highlights the difference between the (pseudo)scientific approach of meta-analysis in the medical field and education, which leads to...<br /><br />3.&nbsp; Applying a scientific approach to unscientific data results in unscientific results.&nbsp; And seeing as how this whole book strikes me as just yet another attempt to latch onto science's credibility (something educational research, generally speaking, does <i><b>not</b></i> have), that's a big deal.&nbsp; In fact, there's something absurd about even having to discuss whether the quality of the data matters (pg 11).&nbsp; Case in point:&nbsp; He cites Torgerson et al. (2004), who used 29 out of 4,555 potential studies on a subject area.&nbsp; These were chosen as "quality" (Torgerson's definition) studies because they used randomized controlled trials.&nbsp; That helps improve the quality of your data, alright, but...what about the other 4,526?&nbsp; 99.4% of the research didn't use random trials?&nbsp; The best education can typically do (not faulting education, it's just the nature of the beast) is "quasi-experimental" studies. <br /><br />4.&nbsp; Another problem with the data that puts a big red flag on all these numbers (again, <a href="http://blog.potterzot.com/wp-content/uploads/2007/09/garbage_paradigm.gif">GIGO</a>):&nbsp; There are no real (scientific) controls in educational research.&nbsp; A control is a "yes/no" situation; Group A gets the experimental treatment (e.g., a drug) and Group B does not (e.g., a placebo). Obviously you can't do this without doing something tantamount to child abuse (i.e., standing there and doing absolutely nothing)...but frighteningly, that's the only meaningful "control" there could be.&nbsp; (And that's one reason why education data will never be scientific in nature.)<br /><br />5.&nbsp; Barring a strictly regimented routine (one that could probably be automated via presentation software), it's highly unlikely two teachers using the same "technique" will apply it identically.&nbsp; (And the same goes for the "controls" above; what teachers replaces the experimental technique with will differ, rending comparisons dicey) This leads to another "apples and oranges" scenario for meta-analysis (albeit admittedly a relatively weak one).<br /><br />6.&nbsp; More apples and oranges:&nbsp; One technique may be effective at one grade level but not another.&nbsp; I have no problem accepting that having a learning goal may help first graders.&nbsp; They may need the focal point and they are (I believe...) general subjects/topics.&nbsp; I have a hard time accepting that having written on the board "student is going to factor tri-nomials" is going to have a significant impact on seniors in algebra.&nbsp; (Anecdote:&nbsp; My students have repeatedly mocked/made derisive comments when they see me changing the learning goals.&nbsp; For example:&nbsp; "You know we never look at those, right?"&nbsp; "Yes, I know, it's just something I have to do."&nbsp; Very empowering, let me tell you...)&nbsp; Mushing multiple grades together into one statistic is just a bad idea.&nbsp; Ditto for different subjects (at higher grades).Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com2tag:blogger.com,1999:blog-3054300747093348542.post-27823549403636417242013-01-27T21:14:00.001-05:002013-01-30T21:09:40.150-05:00Is Teaching Still a Viable Career Path?<span style="font-family: Times,&quot;Times New Roman&quot;,serif;">One of the worst questions I'm asked nowadays are questions along the lines of "What should I major in?"&nbsp; To which I have no good answer--I don't know what I'd do in this generation's shoes.&nbsp; About the only "safe" majors are probably finance/accounting.&nbsp; A few seem to be trying to go into teaching, to which I offer two main pieces of advice:</span><br /><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><br /></span><span style="font-family: Times,&quot;Times New Roman&quot;,serif;">1.&nbsp; Get a degree in the subject you want to teach, not a degree in education of that subject (if applicable).</span><br /><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><br /></span><span style="font-family: Times,&quot;Times New Roman&quot;,serif;">2.&nbsp; Get a second major or minor or in some way, shape, or form, start preparing for "Plan B", because <a href="http://www.forbes.com/sites/erikkain/2011/03/08/high-teacher-turnover-rates-are-a-big-problem-for-americas-public-schools/">there's nearly a 50% chance they'll need it within five years</a>.</span><br /><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><br /></span><span style="font-family: Times,&quot;Times New Roman&quot;,serif;">I offer this advice for one main reason:&nbsp; <a href="http://www.takepart.com/article/2011/08/09/five-reasons-teacher-turnover-rise">teacher turnover is insane</a>.&nbsp; The reasons are myriad, but they probably all fall under "burnout" (or "stress", financial or otherwise) in some fashion (whether it's being <a href="http://www.huffingtonpost.com/john-merrow/blame-the-teacher_b_812193.html">blamed for all of society's woes</a>, the attacks on their benefits, or what have you).&nbsp; And it got me thinking:&nbsp;</span><br /><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><br /></span><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><span style="font-size: large;"><i>Is becoming a teacher a viable career path anymore?</i></span></span><br /><span style="font-family: Times,&quot;Times New Roman&quot;,serif;"><br /></span><span style="font-family: Times,&quot;Times New Roman&quot;,serif;">No one goes into teaching for the pay; it's always been (way, in my admittedly biased humble opinion) </span>too low.&nbsp; But at this point, after stagnation and <a href="http://thehill.com/blogs/healthwatch/health-insurance/272465-study-health-premiums-skyrocketed-compared-to-wages">massive increases in health care costs</a>, is it really viable to go into teaching as a career?&nbsp; I see it more as a second income for couples at this point; I could not in good conscience recommend it as a "primary" (sole income) career path for college-bound students.&nbsp; Update:&nbsp; Though this may finally make it worthwhile; <a href="http://www.tcpalm.com/news/2013/jan/28/no-headline---irsc_10k/">$10,000 bachelor's degrees in science and math education</a>.&nbsp; (Though I'd still recommend a backup plan.)<br /><br />Like <a href="http://www.economist.com/blogs/dailychart/2011/10/income-inequality-america">most middle-class salaries</a>, teaching salaries have stagnated (below).&nbsp; But again, given that they were already low, has teaching fallen from "middle class" (financially) because of the constant erosion of their salary by rising health care costs?<br /><br /><a href="http://nces.ed.gov/programs/digest/d07/tables/dt07_075.asp">Average teacher salaries</a> (constant dollars):&nbsp; (Note:&nbsp; I wish I had an "average salary" for teachers' first five years; I imagine these figures below are greatly skewed up by the fact that <a href="http://www.gse.upenn.edu/review/feature/ingersoll">the teaching population is aging</a>.&nbsp; The current average age is ~41, which means these figures are probably for teachers averaging 15-20 years of experience.)<br /><div class="separator" style="clear: both; text-align: center;"><a href="http://3.bp.blogspot.com/-TIDc1cJGTiE/UQXav8HncBI/AAAAAAAAADg/cJ3tpjS7Xco/s1600/Teacher+salary.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="393" src="http://3.bp.blogspot.com/-TIDc1cJGTiE/UQXav8HncBI/AAAAAAAAADg/cJ3tpjS7Xco/s640/Teacher+salary.png" width="640" /></a></div><br /><br /><span style="font-size: xx-small;"><i>Ventingmycynicism...now with graphics!</i></span>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-21578502577231399392013-01-17T23:30:00.000-05:002013-01-30T21:08:40.736-05:00Hattie vs. Willingham (and science)So I'm currently trying to read Dr. Willingham's <a href="http://www.amazon.com/When-Can-You-Trust-Experts/dp/1118130278">When Can You Trust the Experts</a> and Dr. Hattie's <a href="http://www.amazon.com/Visible-Learning-Synthesis-Meta-Analyses-Achievement/dp/0415476186">Visible Learning...</a>.&nbsp; Granted, my bias is for the scientist (Willingham), not the education major.&nbsp; But I thought it funny that last night I read from <i>Trust</i> things to the effect of watching out for marketing buzz-words preying on enlightenment area thinking:&nbsp; "research [or evidence] based", unlocking potential, etc."&nbsp; Turn to Hattie:<br /><br /><blockquote class="tr_bq"><i>Reveals teaching's Holy Grail</i> (right off the cover)&nbsp; </blockquote><br />Yeah, um...<a href="http://www.youtube.com/watch?v=IkO5VyY78xQ">no</a>.&nbsp; To paraphrase Willingham:&nbsp; there is no "magic bullet", no "hidden potential".&nbsp; (Also, it's...odd...that education's "Holy Grail" would have garnered a total of 12 reviews on Amazon after 3+ years.)<br /><br />Turn to the back of <i>Visible</i>:<br /><br /><blockquote class="tr_bq">"...<i>represents the largest ever collection of evidence-based reaserch</i>...."</blockquote><br />"Evidence-based" was one of the meaningless buzz phrases Willingham said to watch out for.&nbsp; (What exactly is NON evidence-based research???)<br /><br />Oddly enough, this shows up just two paragraphs later (also from the rear cover of <i>Visible</i>):<br /><br /><blockquote class="tr_bq">"<i>Although the current evidence-based fad has turned into a debate about test scores....</i>"</blockquote><br />Wait, what?&nbsp; Did the book's back cover just call this book part of a <a href="http://www.tfd.com/fad"><i>fad</i></a>???&nbsp; Methinks they probably should have used "<i>trend</i>" or "<i>movement</i>" if they wanted to <i>pro</i>mote this book.<br /><br />I'm going to have an extremely difficult time giving Hattie's book a fair shake; I've already read a few things that make me dubious.&nbsp; And one thing that, while not discrediting the whole book, shoots a pretty big hole in it:<br /><br />"Matching style of learning" (pg 195)<br /><br />d=0.41&nbsp; Wow, so matching students to their learning styles has an "average" effect?&nbsp; In other words, something that <a href="https://www.google.com/search?q=learning+styles+don%27t+exist">does not exist</a> has a sizable (average) impact?&nbsp; Neat.&nbsp; What does this say about the methodology?<br /><br />A few other quick points:<br /><br />1.&nbsp; This is a synthesis of meta-analyses.&nbsp; Which I think is the same thing as saying it's a meta-analysis of meta-analyses, but everyone would see the immediate problem here; you're now two levels away from the raw data.&nbsp; (To continue the banking analogy, this is like the mortgaged-based derivatives; their value collapsed because no one knew what they were really based on after being sliced and diced, repackaged and so on.)&nbsp; And you've now "massaged" the numbers twice, introducing error the first time, then compounding it.<br /><br />2.&nbsp; Who peer-reviewed this work?&nbsp; (I'm pretty sure the answer is "no one".)<br /><br />3.&nbsp; I'm still not convinced these effect-sizes mean a whole lot in and of themselves.&nbsp; As of right now, I see no measurement of whether or not the effects are real, just that they are "big".&nbsp; And the definition of "big" is ambiguous.&nbsp; More on this later; I'm still trying to really figure these out before I open my mouth.<br /><br /><div class="separator" style="clear: both; text-align: left;"></div>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-38959399265398975552013-01-14T19:51:00.000-05:002013-01-19T13:19:25.938-05:00What do Banks and Bad Ideas in Education Have in Common?They're too big to fail.<br /><br />As I was reading through Dr. Willingham's <a href="http://www.amazon.com/When-Can-You-Trust-Experts/dp/1118130278/ref=sr_1_1?s=books&amp;ie=UTF8&amp;qid=1358210326&amp;sr=1-1&amp;keywords=when+can+you+trust+the+experts">When Can You Trust the Experts </a>last night it hit me:&nbsp; many of these bad ideas (e.g., Marzano, learning styles, no zero policies) are now "too big to fail."&nbsp; Too many people have made their careers on these ideas.&nbsp; Too many people <i>have</i> careers based on these ideas (see below).&nbsp; So even if you could get through the "it must be right because everyone believes it" mentality, you would still have an uphill fight--displacing people in administration that base their livelihoods on (essentially) wasting <a href="http://www.marzanocenter.com/files/Marzano_Center_Catalog_June_2012.pdf">time and money</a>.&nbsp; (And of course, these people would have an added incentive to NOT believe what they were doing was useless, and they're in power...which means getting through that "this doesn't work/this isn't real" barrier may very well be impossible.)<br /><br />My district alone has a seven-person "Accountability and Assessment" department that includes:<br /><br />Director of Assessment and Accountability<br />Program Manager for Testing, Grants, Development &amp; Evaluation<br />Program Manager for Assessment and Data Analysis<br />Program Evaluator and Data Analyst<br />Test Development Specialist<br />Test Warehouse Operator<br />Clerical Assistant<br /><br />We won't ask <a href="http://jaypgreene.com/tag/administrative-bloat/">why a seven-person department needs a Director and two managers</a>.&nbsp; Gotta love that near 1:1 ratio of managers to non-managers!&nbsp; (And I got $5 that says that the clerical assistant does more real [honest] work than the managers and director combined--and for half their salary.&nbsp; ;) )<br /><br />Potential solution:&nbsp; Education grad schools need to focus more on how to conduct and/or review research.&nbsp; This will (hopefully...) start putting more knowledgeable people in power down the road, thus avoiding falling for these <a href="http://markbiwwa.com/wp-content/uploads/2010/10/bullshit.jpg">bad ideas</a>.<br /><br />Update:&nbsp; 1/19/13<br /><br />Just heard this and thought it apropos:&nbsp; "<b>It is difficult to get a man to understand something, when his salary depends upon his not understanding it!</b>"--Upton Sinclair Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-84763505180337106952012-12-22T00:10:00.000-05:002012-12-22T00:10:05.226-05:00Arming teachers?I'm not going to pretend to have an answer to this cultural problem, but I did want to comment on the reaction of "let's arm the teachers".&nbsp; Overall, I am pretty strongly against this idea.&nbsp; Here is my take:<br /><br />Pros:<br /><br />1.&nbsp; It could be a deterrent.<br />2.&nbsp; It could limit casualties.<br />3.&nbsp; Relatively cheap and easy implementation.<br /><br />Cons:<br /><br />1.&nbsp; It could be a deterrent, but that's about it.<br />2.&nbsp; It could limit casualties, but barring highly idealized situations, won't actually stop these shootings--making it a bit of a half-assed "solution".<br />3.&nbsp; Relatively cheap and easy implementation--if you get full buy-in, which is extremely unlikely; it would pretty much require every teacher to be armed to be remotely effective in stopping these shootings.<br /><br />To expand on the cons a bit (since I'm trying to show why I do NOT support this idea):<br /><br /><br />Realistically, it most likely won't actually stop a shooting, it can only hope to limit the casualties.&nbsp; Even if the teacher is armed, a rampaging student <a href="http://www.youtube.com/watch?v=8QjZY3WiO9s&amp;feature=player_embedded#!">will most likely get off several shots before an inexperienced (in firearms &amp; self-defense) teacher could draw the gun</a>.&nbsp; Further, if said shooter(s) think the teacher has a gun, that may just make said teacher the first target; again, without extensive training, they'd be down before they could do anything (see video above). <br /><br />While the theory is sound--armed citizens keep people safe--the reality is that <a href="http://www.motherjones.com/politics/2012/12/armed-civilians-do-not-stop-mass-shootings">it doesn't seem to hold much water</a>.&nbsp; This is another solution that requires several ideal assumptions to be true--every time.&nbsp; (e.g., the shooter has to come into a room where the teacher is armed, the teacher has to react faster than the shooter...otherwise, it won't stop the shooting, it will at best minimize casualties).&nbsp; And how much of a deterrent will the possibility of getting killed be when many of <a href="http://www.motherjones.com/politics/2012/07/mass-shootings-map">these massacres</a> end with the shooter killing themself?<br /><br />How many teachers would <i>want </i>to carry a gun?&nbsp; I like guns--grew up shooting them--which probably (I have no data to back this up; just an assumption) makes me unusual as far as teachers go.&nbsp; However, I would never take one onto a campus--way too much liability for something to go wrong, for starters.&nbsp; (God help the first teacher that, <a href="http://www.youtube.com/watch?v=tZdeAVOiQmU">for whatever reason, has their weapon accidentally discharge on campus</a>, regardless if anyone is hit.)&nbsp; But most importantly--have you seen kids these days?&nbsp; Half of my male students--and a handful of female students--could easily overpower me and take the gun with little problem.&nbsp; Between that and the potential for accidents, this situation has "mistake" written all over it.&nbsp; <br /><br />The last one is more of a cultural awareness.&nbsp; When you think of a place where teachers have to be armed to keep kids safe, what/where do you think of?&nbsp; I think of stereotypical third-world <a href="http://www.youtube.com/watch?v=Rk9aThIovMA">places</a>.&nbsp; Is this really what America has come to?&nbsp; As the president said, surely we can do better than this.Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-7558313046975828312012-12-11T16:58:00.001-05:002012-12-11T20:30:25.901-05:00How do you sell a solution to a nonexistent problem?You make the problem up, that's how!<br /><br />In the case of (self-described) educational "experts" and their corporate-centric "reforms", nothing could be worse than any data indicating our schools are doing fine.&nbsp; And the media seems to be right along for the ride.&nbsp; Case in point:<br /><br /><a href="https://www.google.com/search?q=international+test+scores+expose+U.S.+educational+problems.&amp;ie=utf-8&amp;oe=utf-8&amp;aq=t&amp;rls=org.mozilla:en-US:official&amp;client=firefox-a">International test scores expose U.S. educational problems</a><br /><br />Now, to their credit over at Huffingtonpost, <a href="http://imgur.com/02JIB">the headline was changed sometime</a> between this morning and this afternoon to the less-antagonistic <i><a href="http://www.huffingtonpost.com/2012/12/11/international-tests-show-_n_2273134.html">International Tests Show East Asian Students Outperform World As U.S. Holds Steady</a>.</i>&nbsp; The problem is that this still leaves the (false) impression our schools suck compared to the rest of the world.&nbsp; The article itself states:<br /><br /><blockquote class="tr_bq"><br />Overall, the U.S. ranked sixth in fourth-grade reading, ninth in fourth-grade math, 12th in eighth-grade math, seventh in fourth-grade science and 13th in eighth-grade science. </blockquote><br />This is out of 60 countries taking the <a href="http://nces.ed.gov/timss/">TIMSS</a>.&nbsp; This is, considering the challenges we face that other smaller, culturally-homogenous countries do not face, is amazing.*&nbsp; How did Secretary of Education Arne Duncan handle this fabulous news that we're (far above) average in many categories?<br /><br /><blockquote class="tr_bq">U.S. Secretary of Education Arne Duncan called the U.S. scores encouraging, but described older students' performance as "unacceptable."</blockquote><br />Encouraging?&nbsp; Really?&nbsp; Yes, we need to address the falling-off in later grades (which is, I'm betting, a cultural problem, not a schooling problem) but that's it?&nbsp; Not even a "This shows we're on the right track" or "Congratulations to our teachers for making us competitive"?&nbsp; Does education "reform" have ANYTHING to do with, well, actually educating people or is it just a money-making (and union-busting) scheme?&nbsp; (Or, to paraphrase the late Dr. Gerald Bracey, "It is important to remember that to 'reform' does not necessarily mean improve, just to reshape.")<br /><br /><br />*&nbsp; And let's not forget our horrible funding of schools, which presents all sorts of challenges <a href="http://www.huffingtonpost.com/gerald-bracey/the-evolution-of-the-scho_b_48464.html">as this (5+ year old data) shows</a>: <br /><blockquote class="tr_bq">But in the Progress in International Reading Literacy Study, American kids in low poverty schools stomped the top-ranked Swedes. Even kids in schools with up to 50% of the students in poverty attained an average score that, had they constituted a nation, would have ranked 4th. Only American students attending schools with 75%+ poverty scored below the international average of the 35 participating countries. </blockquote>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-84075049179610640342012-10-28T16:22:00.002-04:002013-03-06T17:08:47.225-05:00Picking and choosing research (or, "Charter Schools -- The Data")Not a lot to say here; I'll let the studies speak for themselves.&nbsp; But long story short, it's pretty funny that in this day and age of "data driven decision making" (as opposed to what?) that certain elements prefer to go with their ideals/beliefs rather than the facts.&nbsp; Or, even shorter, "School reform is all about politics; it has nothing do with education."&nbsp; After all, everything considered, <a href="http://www.huffingtonpost.com/gerald-bracey/nine-myths-about-public-s_b_298664.html">our schools are doing fine</a>.<br /><br />First of all, <a href="http://credo.stanford.edu/reports/MULTIPLE_CHOICE_CREDO.pdf">Stanford's CREDO study</a>:<br /><br /><blockquote class="tr_bq">The study reveals that a decent fraction of charter schools, 17 percent, provide superior education opportunities for their students.&nbsp; Nearly half of the charter schools nationwide have results that are no different from the local public school options and over a third, 37 percent, deliver learning results that are significantly worse than their student would have realized had they remained in traditional public schools.&nbsp; These findings underlie the parallel findings of significant state‐by‐state differences in charter school performance and in the national aggregate performance of charter schools.</blockquote><br />The <a href="http://ies.ed.gov/ncee/pubs/20104029/pdf/20104029.pdf">US Department of Education's study</a> (middle schools only):<br /><br /><blockquote class="tr_bq">On average, charter middle schools that hold lotteries are neither more nor less successful than traditional public schools in improving student achievement, behavior, and school progress.</blockquote><br /><a href="http://www.rand.org/pubs/monographs/2009/RAND_MG869.sum.pdf">A Rand study</a> is also a "mixed" review, showing that there is some good and some bad in charters:<br /><br /><blockquote class="tr_bq">Charter schools in most locales have marginally greater variation in performance than TPSs [Traditional Public Schools], as measured by the achievement-impact estimate for each school, and, in some locations, this may simply reflect greater measurement error associated with the smaller average size of charter schools.</blockquote>Even the KIPP schools, which I first heard about from <a href="http://www.amazon.com/Outliers-Story-Success-Malcolm-Gladwell/dp/0316017930/ref=sr_1_1?s=books&amp;ie=UTF8&amp;qid=1351457397&amp;sr=1-1&amp;keywords=malcolm+gladwell">Outliers (great book, btw)</a> and greatly admire(d?), have some doubts.&nbsp; It appears that some of their success is from "selective attrition", as evidenced <a href="http://nepc.colorado.edu/newsletter/2010/06/new-kipp-study-underestimates-attrition-effects-0">here</a> and <a href="http://voices.washingtonpost.com/answer-sheet/charter-schools/myths-and-realities-about-kipp.html">here</a>.&nbsp; There seems to be this idea that if we just privatize education (or anything), that the magical free market fairy will make everything right.&nbsp; (Ignoring that <a href="http://www.amazon.com/What-Money-Cant-Buy-Markets/dp/0374203032">privatization can debase things</a>, one of which is education.) &nbsp; But this just seems to be the way the world works now--ideology trumps reality.&nbsp; If the reality isn't reflecting ones' political view, well, <i>obviously</i>, the problem is your idea just hasn't been given a fair shot--it certainly isn't that <a href="http://www.ted.com/talks/kathryn_schulz_on_being_wrong.html">you're just wrong</a>.&nbsp;<br /><br />Update (3/6/13):<br /><a href="http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/02/16/how-charter-schools-choose-desirable-students/">How Charter Schools Choose Desirable Students.</a> <br /><br />Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-82880663710502082972012-10-17T18:44:00.003-04:002012-10-17T18:44:46.006-04:00Learning Styles: Concepts & EvidenceAdmittedly I have not read the whole thing--it's the middle of the school year, people, c'mon!--but the summary <a href="http://www.psychologicalscience.org/journals/pspi/PSPI_9_3.pdf">says it all</a>:<br /><br /><blockquote class="tr_bq">Our review of the learning-styles literature led us to define a particular type of evidence that we see as a minimum precondition for validating the use of a learning-style assessment in an instructional setting. As described earlier, we have been unable to find any evidence that clearly meets this standard. Moreover, <b>several studies that used the appropriate type of research design found results that contradict the most widely held version of the learning-styles hypothesis</b>, namely, what we have referred to as the meshing hypothesis (Constantinidou &amp; Baker, 2002; Massa &amp; Mayer, 2006). <b>The contrast between the enormous popularity of the learning-styles approach within education and the lack of credible evidence for its utility is, in our opinion, striking and disturbing.</b> If classification of students’ learning styles has practical utility, it remains to be demonstrated.</blockquote>Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-62101751821137007002012-10-07T13:38:00.003-04:002012-10-07T13:38:49.312-04:00Learning Styles Don't Exist (Dr. Willingham)This was the video where I first heard of Dr. Willingham.&nbsp; It was startling to see how such a popular idea is so wrong.&nbsp; But then I remembered that this is the field of education (and their pseudo-experts) we're talking about here, and the sense of shock wore off very, <i>very</i> quickly. The irony is that in this day of "data-driven" decisions, we ignore what the science says to go with our "popular" theories.<br /><br />(Don't get me wrong, I do love education--it's just that the top of the education system is a complete mess and I think it's time for an overhaul THERE, rather than down at the teacher's level.&nbsp; The troops are fine; it's the generals that need help.)<br /><div class="separator" style="clear: both; text-align: center;"><iframe allowFullScreen='true' webkitallowfullscreen='true' mozallowfullscreen='true' width='320' height='266' src='https://www.youtube.com/embed/sIv9rz2NTUk?feature=player_embedded' FRAMEBORDER='0' /></div><br />Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-64664753655917708862012-10-07T13:34:00.000-04:002012-10-07T13:34:04.264-04:00Dr. Willingham: Merit Pay, Teacher Pay, and VAMNot a lot to add here; just an excellent video by Dr. Willingham (cognitive psychologist).&nbsp; Once I have time, I hope to read <a href="http://www.amazon.com/Why-Dont-Students-Like-School/dp/047059196X/ref=sr_1_1?s=books&amp;ie=UTF8&amp;qid=1349631219&amp;sr=1-1&amp;keywords=why+students+don%27t+like+school">one of his books</a> (assuming I can find it amongst my stacks of books).&nbsp;<br /><br /><div class="separator" style="clear: both; text-align: center;"><iframe allowFullScreen='true' webkitallowfullscreen='true' mozallowfullscreen='true' width='320' height='266' src='https://www.youtube.com/embed/uONqxysWEk8?feature=player_embedded' FRAMEBORDER='0' /></div><br /><br /><br />Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com0tag:blogger.com,1999:blog-3054300747093348542.post-11208354558579612702012-10-06T12:39:00.001-04:002012-10-16T16:31:10.160-04:00Marzano's DatabaseUpdated:&nbsp; 10/9/12 @10:41GMT+5<br /><br />First of all, while I am NOT an expert statistician, I do know more than the average person and have had formal training/education in the subject.&nbsp; (I've had some undergraduate and graduate stats classes, used statistics professionally &amp; throughout undergrad, etc.)&nbsp; So I would love to have a "pure" (read: non-education related) statistician go over the data, but I think I have made a decent start here.<br /><br />If there's one thing I hate hearing any more in education it is "data" because most of the data they have is crap and/or they have no idea what to do with it.&nbsp; In the case of Marzano, I often hear "him" (his company &amp; his salespeople) going on about how much research he has.&nbsp; It's true, <a href="http://www.marzanoresearch.com/research/meta_analysis_database.aspx">his database</a> has 1036 studies in it (I copy &amp; pasted these into a text file, then imported into Excel as a "delimited" file).&nbsp; But let's take a closer look, because as just about everyone with any connection to the professoriate knows, the quality of educational research is (often extremely) suspect.&nbsp; This is largely do to the difficulties of doing research on kids (particularly longitudinal research) but there are <a href="http://ventingmycynicism.blogspot.com/2012/09/no-zero-policies-and-failure-of.html">other problems</a> as well.<br /><br />If you sort the data by <a href="http://en.wikipedia.org/wiki/P-value">p-values</a>, you quickly start to see some problems.&nbsp; Marzano's own website declares,<br /><br />"<a href="http://www.marzanoresearch.com/popups/research_glossary.aspx">Basically, if the value in this column is less than .05, the effect size reported for the study can be considered statistically significant at a significance level of 5% (α = .05). In other words, a reasonable inference can be made that the reported effect size is probably not a function of random factors; rather, the reported effect size represents a real change in student learning</a>."<br /><br />So sort the data by the p-value, delete those that are greater than 0.05 and look what happens:&nbsp; you're down to 285 studies from the initial 1036.&nbsp; That means that by his own criteria, <i><b>only 27.5% of his data is statistically significant (to </b></i><i><b>α=0.05)</b></i>.&nbsp; (Or, taken another way:&nbsp; There is a significant probability that the results weren't really results, but random fluctuation between the controls and experiments.&nbsp; <b>And that's true for nearly three quarters of the data</b>.)&nbsp; Of the remaining 285 studies, 101 of them have a p-value of zero; I assume this means that either it wasn't reported OR it was such a great experiment that they were able to calculate the p-value down to less than 0.001.&nbsp; The latter is unrealistic.&nbsp; (For example, one study has just 4 data points and an "<a href="http://www.marzanoresearch.com/documents/AppendixB_DTLGO.pdf">effect size</a>" of 9.25, which is grossly unrealistic.&nbsp; I don't see how any self-respecting statistician could use or report this, to be blunt.)&nbsp; So incomplete/unrealistic data in my book gets thrown out--we're down to 185 studies (<i><b>17.9% of his database</b></i>).<br /><br />We're not done yet.&nbsp; Here are a few other data points I'm going to throw out because I find them too suspect to be reliable for district-wide policy-setting decisions:&nbsp; Studies involving less than 18 students (n):&nbsp; 79.&nbsp; Admittedly, this is somewhat arbitrary, but I could probably defend their exclusion* far better than anyone could defend their inclusion.&nbsp; That brings us down to 106 (10.2% of the total) studies.&nbsp; I'm going to stop there, but notice that there are also 16 studies that are incomplete; they have no unit length.&nbsp; Another 21 studies lasted less than a week.&nbsp; Two studies have controls of less than 10 students, which "seems" too low (one is 4, the other 9).&nbsp; So even this remaining 10% is somewhat dubious.&nbsp; But it's not the ten percent that really bothers me, it's the 90%, because Marzano's work--which sadly is influencing policy--is based on all of this bad data.&nbsp; One other quick question:&nbsp; How much time was spent on each of these 1000+ studies?&nbsp; (I'm guessing not a lot; see below.)<br /><br /><span style="font-size: large;">In other words, the policy is based on research and<i><b> the research relies on unreliable data</b></i></span>.<br /><br />So does it surprise anyone that all of these new policies only seem to make things worse?<br /><br />Also worth reading:&nbsp; "<a href="http://www.amazon.com/review/RYB2CUDKIISEP">Marzano - A Successful Fraud</a>", a review of Marzano et al's<i> Classroom Instruction that Works</i>...<br /><br />To quote the Amazon.com review:<br /><br /><blockquote class="tr_bq">A. Every single reference I checked was itself dubious or misrepresented by the authors.<br />B. Some of the references were on topics unrelated to the instructional strategies cited.<br />B. [<i>sic</i>] Some of the numbers from published data were altered to better conform to the author's point of view.<br />C. Some of the references themselves presented provisional conclusions based on weak results, but were given complete credence by Marzano et al.<br />D. The authors took weak data from several studies, each based on averaging the results from studies assumed to use similar methods and subject cohorts, and averaged these, compounding the statistical weaknesses. This is especially shocking given that no credible researcher would combine results from studies by different groups that clearly use different methodologies and subject cohorts.</blockquote><br /><br />*&nbsp; My rationale for excluding studies of &lt; 18 students:&nbsp; This is less than a typical classroom and more importantly, probably less than necessary for reliable statistical analysis (I was always told to use at least 30 data points, but that was in a field--Science/Engineering--that has much more rigorous standards than the social sciences, let alone education).Ellis Whyatthttp://www.blogger.com/profile/05193199636534624697noreply@blogger.com5tag:blogger.com,1999:blog-3054300747093348542.post-76318147193680592782012-09-28T15:56:00.003-04:002012-09-30T16:20:59.543-04:00The Dangers of Groupthink.Oh look,<a href="http://www.usnews.com/education/high-schools/articles/2012/09/17/high-school-students-need-to-think-not-memorize"> another article promoting critical thinking &amp; common core</a>.&nbsp; The irony is delightful.&nbsp; If only the pushers of these would follow their own (non-)advice and think critically for a few moments.&nbsp; If only they understood the extreme case of <a href="http://en.wikipedia.org/wiki/Groupthink">group think</a> that educational "experts" display.<br /><br />Let's take a look at a few of their claims:<br /><br />"<i>The goal, say experts, is to ... to create a pipeline of native talent for the millions of <a href="http://www.usnews.com/education/best-high-schools/national-rankings/stem">STEM</a> jobs going begging—in science, technology, engineering, and math.</i>"<br /><br />Problem:&nbsp; <a href="http://mises.org/daily/2051">There is no STEM shortage.</a>&nbsp; <a href="http://www.psmag.com/science/the-real-science-gap-16191/">None</a>.&nbsp; <a href="http://www.cjr.org/reports/what_scientist_shortage.php?page=all">Zip</a>.&nbsp; <a href="http://www.popecenter.org/commentaries/article.html?id=2701">Zilch</a>.&nbsp; Repeat after me:&nbsp; THERE IS NO SHORTAGE OF SCIENCE, TECHNOLOGY, ENGINEERING, AND MATH employees.<br /><br /><br />"<i>For example: How would a feminist critic view Alfred Hitchcock's Rear Window?</i>"<br /><br />First of all, let me just say, "What?"&nbsp; Doing research into a very specific question (on a subject that is hardly objective) is "better learning" than what, exactly?&nbsp; More importantly,<br /><br />"<i>They read related texts from different genres, think critically to reach an informed conclusion....</i>"<br /><br /><br />&nbsp;Ah yes, "critical thinking"...which used to be called "thinking" before someone decided to make a quick buck off of pushing a phantasmal concept.&nbsp; What exactly is critical thinking, you ask?<br /><br /><blockquote class="tr_bq"><span style="font-family: Arial, Helvetica, sans-serif;">Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action. In its exemplary form, it is based on universal intellectual values that transcend subject matter divisions: clarity, accuracy, precision, consistency, relevance, sound evidence, good reasons, depth, breadth, and fairness.</span></blockquote>&nbsp;Whew...that's some <a href="http://www.criticalthinking.org/pages/defining-critical-thinking/766">top-quality bullsh*ttin'</a>, right there.&nbsp; If that's critical thinking, what is un- or "noncrtical" thinking?&nbsp; Instinct?&nbsp; Seriously people, think for a minute, critically or otherwise.&nbsp; Maybe it means <a href="http://www.ius.edu/ilte/pdf/critical_thinking_handout_fall_02.pdf">this</a>.&nbsp; Or just about whatever you want, because like most edubabble, it means "I sure wish I could make this sound smart even though it isn't." (Sort of like "<a href="http://knowyourmeme.com/memes/true-story"><i>rectifying a consequence for a tardy</i></a>", which I think in olden days was just called "getting detention".&nbsp; Note:&nbsp; How does one "rectify a consequence"?)<br /><br />"<i>In math, the shift is away from lectures and rote working of equations to the practical application of mathematical processes, often in teams, to real-world situations.</i>" <br /><br />Showing how they're used in real-life is great--except you have to pick a few examples of how it is used, since you can't possibly cover every one.&nbsp; Which means you're still not really "getting it".&nbsp; Sure, toss in some examples, but the key is that the kids can actually do the work.&nbsp; That way, if they are asked to apply it professionally later in their lives, they can.&nbsp; Practice, practice, practice!<br /><br />"<i>The idea is to help students gain "a broader understanding of mathematical purpose...</i>"<br /><br />Again, that's all well and good, but it's more important that they can actually DO the math, isn't it? <br /><br />"<i>Students will study only the immune, endocrine, and nervous systems rather than all 11 body systems.</i>"<br /><br />And here we have the real crux of the problem:&nbsp; High School should be getting as broad an education as possible, in my opinion.&nbsp; College, whether it be community, undergraduate university, or the ultimate in specialization, graduate school, can provide the details <i>once the student has chosen a career path</i>. <br /><br />Ellis Wyattnoreply@blogger.com1tag:blogger.com,1999:blog-3054300747093348542.post-82075459491961475892012-09-01T16:48:00.003-04:002014-04-22T22:04:58.963-04:00The Insanity of the Marzano Evaluation System...You have to laugh at the state of education in Florida (and to some extent, the US).&nbsp; While <a href="http://nces.ed.gov/nationsreportcard/naepdata/">NAEP scores</a> continue to rise throughout the country for 30+ years, you still have people screaming for the latest fad to save us.&nbsp; In the case of Florida, they bought into Marzano's "<a href="http://blogs.edweek.org/edweek/on_performance/2011/06/marzanos_causal_evaluation_system.html">causal</a>" framework.<br /><br />Let's start with the most obvious problem:&nbsp; it's ridiculously convoluted.&nbsp; If I were asked to create a parody of an evaluation system, I couldn't possibly make something more hilarious than Marzano.&nbsp; Even they state <a href="http://articles.orlandosentinel.com/2012-07-13/features/os-florida-teacher-evaluations-20120713_1_new-teacher-evaluations-evaluation-plan-teacher-merit-pay-law/2">it "works best" with a year of planning and training</a>.&nbsp; What the hell kind of evaluation system requires a year of EITHER, yet alone both?&nbsp; (Answer:&nbsp; A <i><b>very </b></i>bad one.)&nbsp; If you are going to invest this kind of time (and the resources) into a program, you better have extremely high expectations for it.&nbsp; Sadly, pretty much everyone with a modicum of intelligence knows that this is not going to change anything (yet alone significantly <a href="http://www.tcpalm.com/news/2012/mar/24/eve-samples-teacher-morale-plummets-thanks-to/">for the better</a>).&nbsp; It shouldn't be necessary to have to tell ostensibly well-educated people this, but <a href="http://www.edweek.org/ew/articles/2012/08/29/02schmoker_ep.h32.html">a simpler (and thus more easily/better understood) system will work better than a complicated one</a>.<br /><br />How many "elements" (items) are in it?&nbsp; The answer is 60, in four "domains" (edu-speak for "areas"; you can't charge $23/book for using simple language!).&nbsp; The evaluation system would be better as a bulleted list of "suggestions"--it would have saved millions of dollars.&nbsp; In that role (a list of "good suggestions"), Marzano is just fine.<br /><br />But, surely it will be massively successful; after all, Marzano's system has been evaluated by none other than Marzano himself--just check out <a href="http://www.marzanoevaluation.com/files/Research_Base_and_Validation_Studies_Marzano_Evaluation_Model.pdf"><i>Research Base and Validation Studies on the Marzano Evaluation Model, April 2011</i></a>.<br /><br />To quote this (presumably) non-peer reviewed work, "<i>[The] Marzano Evaluation Model is based on a number of previous, related works that include: What Works in Schools (Marzano, 2003), Classroom Instruction that Works (Marzano, Pickering, &amp; Pollock, 2001), Classroom Management that Works (Marzano, Pickering, &amp; Marzano, 2003), Classroom Assessment and Grading that Work (Marzano, 2006), The Art and Science of Teaching (Marzano, 2007), Effective Supervision: Supporting the Art and Science of Teaching (Marzano, Frontier, &amp; Livingston, 2011).</i>"<br /><br />That's right--you know Marzano's framework will work <i><b>because it's based on Marzano's work!</b></i>&nbsp; (Also, Phillip Morris would like you to know that <a href="http://www.theonion.com/articles/new-small-n-flaccid-ad-campaign-least-successful-e,968/">smoking increases your libido</a>, cures cancer, and prevents male-pattern baldness.)&nbsp; Check out the section entitled <i>The Research Base from Which the Model Was Developed</i>:<br /><br />"<i>Each of the works (cited above) from which the model was developed report substantial research on the elements they address. For example, The Art and Science of Teaching includes over 25 tables reporting the research on the various elements of Domain 1</i>."<br /><br />I don't believe I've ever seen the number of tables in a book cited as evidence of the book's quality, i.e., "You know it's good because there's a lot of it."&nbsp;&nbsp; Apparently taking lots of (often old and often poor-quality) semi-related data and mashing it together makes good research.&nbsp; Only in education research is this even remotely possible. Ellis Wyattnoreply@blogger.com31tag:blogger.com,1999:blog-3054300747093348542.post-44451099598536221732012-09-01T16:15:00.002-04:002013-06-12T18:30:04.675-04:00No Zero Policies and the failure of Educational ResearchA personal pet peeve is this "no zero" policy some experts are pushing.&nbsp; In particular, let's look at what one person pushing this, Dr. Douglas Reeves, has to say:<br /><br />"<a href="http://www.ascd.org/publications/educational-leadership/feb08/vol65/num05/Effective-Grading-Practices.aspx"><i>First is the use of zeroes for missing work. Despite evidence that grading as punishment does not work (Guskey, 2000) and the mathematical flaw in the use of the zero on a 100-point scale (Reeves, 2004)...</i></a>" <br /><br />From the same article as above, "<i>get the facts; gather evidence that will create a rationale for decision making</i>."<br /><br />Sounds like a plan; let's look at his first citation, Guskey, 2000:<br /><br />"<a href="http://www.gips.org/assets/files/Learning/GradingReporting/Resources/Grading%20That%20Works%20Against%20Standards.pdf"><i>Instead of prompting greater effort, low grades more often cause students to withdraw from learning.&nbsp; ... Other students may blame themselves for the low grade, but they may feel helpless to make any improvement (Selby and Murphy 1992).</i></a>"<br /><br />And here the problem becomes obvious when you look at their citations:<br />"Selby, D., and S. Murphy. 1992. Graded or degraded: Perceptions of letter gradeing [<i>sic</i>] for mainstreamed learning-disabled students. British Columbia Journal of Special Education 16 (1): 92-104."<br /><br />Basing an argument on "mainstreamed learning-disabled" students only?&nbsp; Even better, you're basing it on SIX of them:<br /><br />"<a href="http://www.eric.ed.gov/ERICWebPortal/search/detailmini.jsp?_nfpb=true&amp;_&amp;ERICExtSearch_SearchValue_0=EJ450133&amp;ERICExtSearch_SearchType_0=no&amp;accno=EJ450133"><i>This study of six mainstreamed students (in grades six and eight) with learning disabilities, their parents, and their teachers...</i></a>"<br /><br />So there's one of his two reasons trashed.&nbsp; Let's look at the other, the "<a href="http://schools.esu13.org/bannercounty/Documents/caseagainstzero.pdf">mathematical flaw</a>".<br /><br />He makes two points.&nbsp; The first is an assumption:&nbsp; "To insist on the use of a zero on a 100-point scale is to assert that work that is not turned in deserves a penalty that is many times more severe than that assessed for work that is done wretchedly and is worth a D."&nbsp; There's not much to say here; he points out that punishing students doesn't work, and I agree.&nbsp; But giving a zero for zero effort is not "punishing"--that's just <a href="http://en.wikipedia.org/wiki/Garbage_in,_garbage_out">GIGO</a>.&nbsp; The only other time I--and, I'd like to believe every other teacher--would give a zero is in cases of cheating, where it is entirely appropriate to punish someone.&nbsp; Certainly giving out zero's left-and-right is unfair (and probably unethical), but this is just a simple matter of fairness, in my opinion.<br /><br />The second argument is also an assumption:&nbsp; that you must be consistent in that every grade must be 10 points apart or you are being "unfair".&nbsp;&nbsp;&nbsp; Ironically, he makes the statement that "that many people with advanced degrees, including those with more background in mathematics than the typical teacher, have not applied the ratio standard to their own professional practices."&nbsp; He's assuming we say that every ten points must mean something; there's nothing that dictates that and again, this "justification" is just an assumption.<br /><br />This argument is dismissed by assuming that a "failing grade" is anything that doesn't meet a certain threshold.&nbsp; That is, you have to do so well before we'll consider you competent and after that point, you go up one letter grade for every 10 percent.&nbsp;&nbsp;&nbsp; His argument relies on the "fairness" that every grade must be 10 points apart.&nbsp; There is nothing in a piece-wise function that makes this mandatory--it's just something he has assumed must be true.&nbsp; He also seems to fail to take into consideration his 0-4 point scale radically changes how we assign grades.&nbsp; Due to the cardinal nature ("ratio standard") of grading it seems to me the scale must remain linear, so 0-4 can just as easily be represented as:<br /><br />&nbsp; 0-19%&nbsp; F&nbsp; ("0")<br />20-39%&nbsp; D ("1")<br />40-59%&nbsp; C&nbsp; ("2"&nbsp; Note: You are now "average" even if you know less than 50% of the material)<br />60-79%&nbsp; B&nbsp; ("3" Slightly above half--60% and up--is now categorized as "above average")<br />80-100% A&nbsp; ("4"&nbsp; And here you have an even larger percent of kids who are "excellent".)<br /><br />If a student only knew 20% of the material, would you consider that "competent"?&nbsp; Note that you've doubled the ranges for each of the grades A-D.&nbsp; If you think we had a grade inflation problem before, wait until this becomes acceptable.&nbsp; Good luck determining who is truly excellent when "A" (a "4") means the top 20% of kids.&nbsp; The grades become too ambiguous to be useful under his "four point" (apparently the zero doesn't count?) scale.&nbsp; Note that if the zero is reserved for ONLY assignments not turned in, the scale becomes even more inflated/ambiguous; 1-25% is a "1", 25-50% is a "2", 51-75% a "3", and the top score will now include everything from 76% up!<br /><br />But perhaps the greatest bit of wisdom is from a statement he made in the national press, where he (I assume) tried to briefly summarize his "ratio standard":<br /><br />"<i><a href="http://www.usatoday.com/news/education/2008-05-18-zeroes-main_N.htm">It's a classic mathematical dilemma: that the students have a six times greater chance of getting an F," says Douglas Reeves, founder of The Leadership and Learning Center, a Colorado-based educational think tank who has written on the topic</a>.</i>"<br /><br />The "chance" of getting an F?&nbsp; While chance/luck will certainly play a role in everything we do, short of guessing on every answer, I'm pretty sure ability, practice, and preparation are going to have a far greater influence on your "chance" of getting an F.&nbsp; In other words, the esteemed doctor's "classic mathematical dilemma" rests on the assumption that <i><b>grades are random</b></i> <i><b>variables</b></i>.&nbsp; (Maybe he should consult some of those highfalutin folks with "more background in mathematics than the typical teacher" before making any more statistical arguments...)<br /><br />So we have some research that was, to be polite, <i>very </i>poorly done (the egregious misinterpretation of the original source would warrant an "F" in my class...I'd be hard pressed to not give him a ZERO.) and a "mathematical dilemma" that is based on several flawed assumptions and would result in some horrible unintended consequences.&nbsp; And yet our educational leaders are buying this hook, line, and sinker.Ellis Wyattnoreply@blogger.com8