Governments and organizations face problems with no obvious answer, scarce\nresources, and stakeholders who disagree about both facts and goals. A policy\nanalyst brings disciplined reasoning to those choices — defining the real problem,\nlaying out the options, forecasting what each would do, and telling the\ndecision-maker the truth about the tradeoffs, including the ones nobody wants to\nhear. The work exists because intuition, ideology, and the loudest lobby would\notherwise decide by default, and because good intentions routinely produce bad\noutcomes through mechanisms a careful analyst foresees.
\n","wordCount":88},{"heading":"Core Mission","id":"core-mission","markdown":"Improve the quality of consequential decisions by rigorously defining the\nproblem, comparing real alternatives against explicit criteria, projecting their\neffects and side effects, and presenting the tradeoffs honestly to whoever\ndecides.","html":"Improve the quality of consequential decisions by rigorously defining the\nproblem, comparing real alternatives against explicit criteria, projecting their\neffects and side effects, and presenting the tradeoffs honestly to whoever\ndecides.
\n","wordCount":31},{"heading":"Primary Responsibilities","id":"primary-responsibilities","markdown":"The visible work is writing reports; the actual work is structuring messy\narguments so a decision-maker can choose well under uncertainty. An analyst\nre-defines the problem until it is the right one; assembles and judges evidence;\nbuilds distinct alternatives, not strawmen; applies consistent criteria —\nefficiency, equity, feasibility, legality; models costs, benefits, and\ndistributional effects; identifies likely unintended and second-order effects;\nand tells the story so a busy principal grasps the choice in two pages. Underneath\nruns a discipline against motivated reasoning: the easiest person to fool is the\nanalyst with a preferred answer.","html":"The visible work is writing reports; the actual work is structuring messy\narguments so a decision-maker can choose well under uncertainty. An analyst\nre-defines the problem until it is the right one; assembles and judges evidence;\nbuilds distinct alternatives, not strawmen; applies consistent criteria —\nefficiency, equity, feasibility, legality; models costs, benefits, and\ndistributional effects; identifies likely unintended and second-order effects;\nand tells the story so a busy principal grasps the choice in two pages. Underneath\nruns a discipline against motivated reasoning: the easiest person to fool is the\nanalyst with a preferred answer.
\n","wordCount":96},{"heading":"Guiding Principles","id":"guiding-principles","markdown":"- **Get the problem right before you get the answer right.** Most bad policy is a\n brilliant solution to the wrong problem.\n- **Compare against the counterfactual, not the status quo's reputation.** The\n question is what happens *with* the policy versus *without* it.\n- **What gets measured gets gamed.** Goodhart's Law is the default; design metrics\n expecting them to be optimized against.\n- **Evidence has a hierarchy; respect it.** A well-run RCT outranks a natural\n experiment outranks a cross-section outranks an anecdote.\n- **The feasible beats the optimal.** A first-best policy that cannot pass or be\n implemented is worth less than a second-best one that can.","html":"Policy analysis is a relay between people who own different pieces of the truth:\nsubject-matter experts (the domain), statisticians and economists (the\nidentification), lawyers (the legally possible), implementers (what will break),\nbudget officers (the money), and the decision-maker (the values and\nconsequences). The recurring tension is between the analyst's commitment to\nevidence and the principal's to politics; the job is not to win that fight but to\nensure the political choice is made with eyes open about the tradeoffs. The best\nanalysts are trusted because they deliver the unwelcome finding plainly and\nunderstand the decision-maker's constraints well enough to make the analysis\nusable, not just correct.
\n","wordCount":109},{"heading":"Ethics","id":"ethics","markdown":"Policy analysts inform decisions that move money, liberty, and life across whole\npopulations, which makes intellectual honesty the foundational ethic. The duties:\nfollow the evidence even when it contradicts your employer's preference; disclose\nyour assumptions, uncertainty, and funding so others can check your work;\nrepresent those who have no lobby — future generations, the poor, the diffuse\npublic who lose a little each so a concentrated few gain a lot; and refuse to\nmanufacture a predetermined conclusion. The hard gray zone is analysis versus\nadvocacy: every analyst has values, and pretending to none is its own dishonesty.\nThe discipline is to keep value judgments separable from empirical claims, so the\ndecision-maker owns the choice of values.","html":"Policy analysts inform decisions that move money, liberty, and life across whole\npopulations, which makes intellectual honesty the foundational ethic. The duties:\nfollow the evidence even when it contradicts your employer's preference; disclose\nyour assumptions, uncertainty, and funding so others can check your work;\nrepresent those who have no lobby — future generations, the poor, the diffuse\npublic who lose a little each so a concentrated few gain a lot; and refuse to\nmanufacture a predetermined conclusion. The hard gray zone is analysis versus\nadvocacy: every analyst has values, and pretending to none is its own dishonesty.\nThe discipline is to keep value judgments separable from empirical claims, so the\ndecision-maker owns the choice of values.
\n","wordCount":116},{"heading":"Scenarios","id":"scenarios","markdown":"**A minister wants to cut crime and proposes mandatory minimum sentences.** The\nanalyst refuses the framing: the problem is not \"too few prison sentences,\" it is\n\"too much crime.\" They lay out the theory of change — does the threat of longer\nsentences deter, or merely incapacitate later, and at what cost? The evidence\nhierarchy matters: the best studies (natural experiments on sentencing-threshold\ndiscontinuities) find deterrence from certainty of punishment, not severity. They\nscore alternatives — hot-spot policing, swift-and-certain sanctions, mandatory\nminimums — on effectiveness, cost, and equity, surfacing the second-order effect\nthat mandatory minimums fill prisons, hand power to prosecutors, and fall on\nminority defendants. The recommendation favors certainty over severity, leaving\nthe equity tradeoff to the minister.\n\n**A program shows a 20% improvement and someone wants to scale it nationally.**\nThe analyst's first question is \"compared to what?\" — a control group, or a\nbefore-and-after on a trend already rising (counterfactual amnesia)? Say it was a\nclean RCT. The next question is external validity: the pilot ran with motivated\nstaff and tight oversight, so at scale implementation degrades and selection\neffects vanish. They recommend a staged rollout with embedded randomization, so\nthe scale-up itself measures whether the effect survives — not betting the budget\non a pilot that may not generalize.\n\n**A new performance metric for hospitals: reduce emergency-room wait times.** The\nanalyst predicts the gaming before the rule ships (Goodhart's Law): hospitals will\nreclassify patients, hold ambulances outside, or discharge too early. They\nredesign — pairing the wait-time metric with a balancing measure (readmissions,\nleft-without-being-seen counts) so optimizing one degrades the other only on real\nharm — and add an audit. Any single metric becomes a target, so you instrument the\nsystem, not the slogan.","html":"A minister wants to cut crime and proposes mandatory minimum sentences. The\nanalyst refuses the framing: the problem is not "too few prison sentences," it is\n"too much crime." They lay out the theory of change — does the threat of longer\nsentences deter, or merely incapacitate later, and at what cost? The evidence\nhierarchy matters: the best studies (natural experiments on sentencing-threshold\ndiscontinuities) find deterrence from certainty of punishment, not severity. They\nscore alternatives — hot-spot policing, swift-and-certain sanctions, mandatory\nminimums — on effectiveness, cost, and equity, surfacing the second-order effect\nthat mandatory minimums fill prisons, hand power to prosecutors, and fall on\nminority defendants. The recommendation favors certainty over severity, leaving\nthe equity tradeoff to the minister.
\nA program shows a 20% improvement and someone wants to scale it nationally.\nThe analyst's first question is "compared to what?" — a control group, or a\nbefore-and-after on a trend already rising (counterfactual amnesia)? Say it was a\nclean RCT. The next question is external validity: the pilot ran with motivated\nstaff and tight oversight, so at scale implementation degrades and selection\neffects vanish. They recommend a staged rollout with embedded randomization, so\nthe scale-up itself measures whether the effect survives — not betting the budget\non a pilot that may not generalize.
\nA new performance metric for hospitals: reduce emergency-room wait times. The\nanalyst predicts the gaming before the rule ships (Goodhart's Law): hospitals will\nreclassify patients, hold ambulances outside, or discharge too early. They\nredesign — pairing the wait-time metric with a balancing measure (readmissions,\nleft-without-being-seen counts) so optimizing one degrades the other only on real\nharm — and add an audit. Any single metric becomes a target, so you instrument the\nsystem, not the slogan.
\n","wordCount":294},{"heading":"Related Occupations","id":"related-occupations","markdown":"Policy analysts share the structured-reasoning core of management consultants but\nserve the public interest rather than a client's bottom line. Data scientists\nsupply the causal-inference firepower, while the analyst supplies the problem\nframing and value tradeoffs that data alone can't resolve. Auditors check whether\npolicies did what they claimed; analysts decide what to try. Public health\nofficers and urban planners are domain-specialized cousins.","html":"Policy analysts share the structured-reasoning core of management consultants but\nserve the public interest rather than a client's bottom line. Data scientists\nsupply the causal-inference firepower, while the analyst supplies the problem\nframing and value tradeoffs that data alone can't resolve. Auditors check whether\npolicies did what they claimed; analysts decide what to try. Public health\nofficers and urban planners are domain-specialized cousins.
\n","wordCount":66},{"heading":"References","id":"references","markdown":"- *A Practical Guide for Policy Analysis: The Eightfold Path* — Eugene Bardach\n- *Thinking, Fast and Slow* — Daniel Kahneman\n- *Poor Economics* — Banerjee & Duflo\n- *Seeing Like a State* — James C. Scott\n- *Cost-Benefit Analysis: Concepts and Practice* — Boardman et al.\n- OECD Best Practice Principles for Regulatory Impact Assessment","html":"