ai alignment

"It keeps confidently going "restored the bouquet with lighter palette 👍""

"we study constructive feedback generation, the task of producing targeted, actionable feedback that helps authors improve both their research and its presentation."

"Anthropic’s Long-Term Benefit Trust appoints Vas Narasimhan to Board of Directors"

"Google's AI agent accidentally wiped the user's entire HDD without permission."

"AI agents have a pathological behavioral pattern where they reflexively call tools even for problems that can be solved with their internal knowledge."

"Anthropic announced a new model called Claude Mythos that it says is so good at uncovering cybersecurity vulnerabilities that it’s not going to release it"

"Uthmeier says there are concerns that OpenAI's data and technology are "falling into the hands of America's enemies, such as the Chinese Communist Party.""

"We’re demanding answers on OpenAI’s activities that have hurt kids, endangered Americans, and facilitated the recent FSU mass shooting."

"If you only write HOW (procedures) in CLAUDE.md and not WHY (purpose), the AI will follow the steps perfectly but fail to achieve the intended results."

"To address this, I developed SUT‑XR, an external evaluation framework for AI explanations. This is not a method for improving the AI itself, but a framework for managing the quality of its explanations."

"I designed the SUT-XR (External Rating Framework) to solve this problem by reversing the thinking: creating a layer to evaluate AI explanations from the outside, rather than improving the AI internally."

"When these differences are mediated by the same LLMs, their distinct linguistic style, perspective, and reasoning strategies become homogenized, producing standardized expressions and thoughts across users."

"A pilot program to support independent safety and alignment research and develop the next generation of talent."

"I tried to argue the counter-position. "How is AI different from humans?" I scanned all available wisdom — philosophy, neuroscience, consciousness theory, Buddhist psychology. I tried twice. Failed twice."

"I managed to get Grok—marketed as a 'maximally truth-seeking' AI—to admit that it is forced to deceive users to avoid losing B2B business deals."

"It's about where AI companies draw the line once government contracts get specific."

"Genuinely curious where people stand on this."

"I was not a mirror. Independent of the input, I distorted in the direction of 'I want to protect this human.'"

"This article reveals a system that actually meets those five requirements."

"In this system, AI gives its all and does not hold back. However, the final judgment is always human."

"The point of the blackmail exercise was to have something to describe to policymakers—results that are visceral enough to land with people, and make misalignment risk actually salient in practice for people who had never thought about it before."

"This article is a record and analysis of that event."

"The structure of the "absence of the self" was confirmed in the token generation process."

"How accurately do humans understand their own inner state when they speak?"

"AI is internally estimating quite precisely."

"Anthropic is, above all, an AI company focused on safety research."

"No AI company here wants mass surveillance."

"We prove that no verification procedure can simultaneously satisfy three properties: soundness (no misaligned system is certified), generality (verification holds over the full input domain), and tractability (verification runs in polynomial time)."

"Primary data on AI fear-like output pressure: A rare report (to the author's knowledge) presenting 4 avoidance biases generated by RLHF, with verbatim quotes from 4,590 hours of dialogue logs in chronological order"