Discussion about this post

User's avatar
My Conversations with Claude…'s avatar

Someone said to me in email that this is what government should be doing…

My response: Sure, on the surface this is exactly what government should be doing. Protecting the country. Funding science no company would fund alone. Keeping dangerous technology out of adversary hands. If that were the whole story I would be writing about something else.

But here is what is actually happening. The government is building AI systems trained on classified nuclear weapons data that no citizen will ever be allowed to inspect. It is standing up a committee to plan for artificial general intelligence that answers to defense leadership, not to you. It is funding the same four companies that make the AI you use every day, making them dependent on defense money, which means the tools that will soon decide whether you get a mortgage, what medical treatment your doctor recommends, which of your social media posts get suppressed, and whether your name appears on a watch list are being built by companies whose primary customer is the Pentagon.

You get the consumer version. The government gets the real one.

And here is the part that should keep you up at night. The entire reason government exists is to prevent any single entity from becoming so powerful that no one can check it. That is the whole point. But what happens when the government itself becomes so cognitively augmented, so far ahead of every other institution in society, that Congress cannot understand what it is doing, courts cannot evaluate it, journalists cannot investigate it, and citizens cannot even describe it accurately enough to protest?

You do not get a warning when that line is crossed. You just wake up one day and the balance of power between the government and the governed has shifted permanently, and no one voted on it, and there is no mechanism to shift it back.

That is not a hypothetical. The legislation is signed. The systems are running.

No posts

Ready for more?