chrismdp / counting-house-demotion

Fernwick Air: demoting a model when its scores fall

Public · Version 1 of 1
Fork
tokenisedFernwick staffthe bar[below the bar]one tier down[fixed]TriggerEvery night, once the day'sscores are recordedLinked to chrismdp/counting-house-ongoing#scoresDataEvery contact's scores, byintent and contact reasonLinked to chrismdp/counting-house-promotion#policy_tableDataThe policy table: each intent'smodel, tier, SOP, tools andapproversCode · checkCompare each intent's lastseven days of scores with thebar in its policy rowCode · doDrop the intent one tier, andrecord the scores that trippeditCode · doPost the demotion for QA anddata scienceSurfaceDemotions: the intent, its oldand new tier, and the scoresbehind itPerson · doQA and data science find thecause, fix it, and put the intentup for promotion againStarts chrismdp/counting-house-promotion#put_upOutside actionPut the intent up forpromotionAsk