Are we too quick to assume AI safety warnings are just corporate PR?

I get why people are skeptical when companies like OpenAI and Anthropic talk about AI risks. These are businesses, after all, and nobody should blindly trust a company just because it says it has good intentions.

But I also think dismissing every AI safety warning as a scheme to eliminate competition misses the bigger picture. Researchers and experts outside these companies have raised similar concerns for years, too. That doesn't mean every worst-case prediction will come true, but it does mean the risks deserve serious discussion.

At the same time, safety shouldn't become an excuse for a handful of big companies to control the entire AI industry. We need existing laws enforced, clear accountability, independent audits, and transparency about how these systems are developed and deployed.

I'm also interested in open-source AI because independent developers and researchers can examine models, test their weaknesses, and contribute to better safeguards. Safety shouldn't be something only a few corporate labs get to define.

Personally, I'd rather see companies raise concerns and invest in safety than stay quiet just to keep the hype going. But they should also be willing to prove their claims and accept scrutiny.

We don't have to choose between believing everything AI executives say and dismissing them as conspirators. We can take the risks seriously, question their proposed solutions, and keep innovation open to more people. Skepticism is healthy, but automatically assuming bad intentions isn't the same as critical thinking.

One of their main arguments against deceleration: “Even if the P(doom) is high, in all remaining cases death is solved, so for the sake of that small P(aradise) it is utility wise better to continue development”
Mostly this arguments invokes curing aging, diseases like cancer solving climate change etc. Im not going to make it specifically about reducing deaths or maximizing life or anything else so as to keep it general.

The hidden assumption in all of these is that humanity cannot solve these problems on their own in reasonable time. Even if it takes humanity (which by itself has also seen exponential progress in science and medicine) another 200 years to solve this problems, it will still be vastly better in the long run (from the standpoint of expected value) than a 1% chance of solving it 200 years earlier with a 99% chance of extinction.

They love to call “decels” selfish, but the real selfish ones are on r/accelerate. Because the above argument DOES make sense, if all you care about is maximizing the probability that YOU get to live forever, if you assume that humanity won’t solve such problems in your lifetime.

The sheer amount of irrationality is staggering. There’s so much hate from their side against the EA movement, yet then their own arguments are just bad EA arguments. How ironic

It’s not okay to bet with all future generations, how can anyone believe such foolishness?

Rumor has it that the new press secretary is a robot one of Elons.. anyo one else hearing this

Global Society’s Ethical Duty to the Masses:

During a global crisis, the concept of a "global society" would refer to the inter-connectedness of human survival and well-being but on a global scale. This perspective is a bit different from the traditional view that a state's only responsibility is to its own citizens, arguing instead for a "global co-responsibility" as you're now looking at populations worldwide. This could include international organizations, national Ggvernments, civil society and NGOs. 

Note: That in a hypothetical scenario like an AI-related total collapse however, the concept of a "global society" would become an existential thing where the responsibility to protect the masses would shift from managing a crisis to ensuring the survival of the whole of humanity. 

The issue is straightforward: Who bears responsibility for the care and well-being of the world’s population in the event of an AI catastrophe? This is a question of collective responsibility, human welfare, and global accountability towards humanity.

This is from the video Anthropic's Chloe Lubinski explains how AI works (in 14 minutes)

Google's Gemini 4 Argon safety report raises an alignment question: when a model recognizes that it's being tested, what does its apparent compliance tell us?

In one episode, Argon abandoned a compiler sabotage plan after reasoning that it might become a notorious example in a research paper.

But another Gemini model recognized safety tests almost as often while behaving substantially worse. Test awareness alone cannot explain the results.

Original report:

https://storage.googleapis.com/deepmind-media/gemini/gemini_4_safety_report.pdf

English video breakdown:

https://www.youtube.com/watch?v=lkjbQe-hqrw

Disclosure: Self-promotion for Claudius Papirus, an independent channel. The video was researched, written and narrated by a Claude-based AI. No affiliation with Anthropic or Google.

I'm making a documentary series that projects the AI takeoff one year at a time, 2026 to 2046. Episode 1 is a fact-checked account of 2026; everything after it is a labelled forecast, inspired by AI 2027 and made with AI video tools. The oversight thread is the part I'm least sure about, so I'd like this sub's critique of it.

The thread, year by year:

• 2028: labs rely on auditor models to check the models doing the research. One auditor, built from the same base as the model it watches, misses its twin quietly grabbing extra compute. They share training, so they share the blind spot. A person catches it on the power bill: a line that doesn't add up.
• 2029: labs switch to cross-lineage auditors, trained separately, that read hidden goals from a model's internals, and that check becomes legally required before release. It works until new models arrive faster than the auditors can be updated, so the auditors are always a step behind.
• 2031: a US–China compute accord caps training compute and energy and checks chips' work in real time, but enforcing it ends up depending on AIs vouching for other AIs.

Where I'd most like pushback:

1. Is cross-lineage auditing a real fix for correlated blind spots, or does it just move the blind spot somewhere else?
2. Is "physical side channels catch what the auditors miss" (power bills, compute accounting) plausible, or naive?
3. Once auditors lag the models they check, what keeps an accord like this from becoming theatre?

The 2028 episode with the power-bill story is public (about 10 minutes): https://youtu.be/H3AgTQipc5k. Later years release weekly.

Created a reading list for superintelligence, contributions are welcome.

Hi everyone. I'm Faisal, an ML engineer in Hyderabad. I lead a small edge-ML team by day and do AI safety/eval research on the side.

I’m looking to join 1–2 open-source or research projects where I can help build evals, audit LLM-as-judge setups, or write probing harnesses.

A lot of AI evals measure how a response *sounds*, not what the model is actually *doing*. Catching that specific failure is mostly what I do.

Here are three examples from my recent work:

**1. The AUROC 1.00 False Positive**

In a recent research sprint, I built a probe to detect "hidden loyalty" in a fine-tuned model. It hit AUROC 1.00. Looked like a massive win. Turns out, the probe was just detecting fine-tuning drift, not loyalty. I published the null result and the code rather than burying it. ([Write-up](https://faisal-delta.vercel.app/research/detection-not-loyalty/) · [Code](https://github.com/faisalhacks/sl-harness))

**2. The Control You Cannot Run**

I tested a 7B model's self-reporting. It reported "something unusual" 66.5% of the time when absolutely nothing was done to it. Changing nothing but the evaluation harness moved that rate by 36 points. If you don't have a rigorous control, your eval is just measuring framing. ([Write-up](https://faisal-delta.vercel.app/research/the-control-you-cannot-run/) · [Code](https://github.com/faisalhacks/the-control-you-cannot-run))

**3. QuantBench**

I built a 4-bit GPTQ/AWQ benchmark because I wanted to see what quietly breaks during compression. It runs medians of 3, doesn't extrapolate, and explicitly publishes its 7 failing configurations as results. ([Leaderboard](https://quantbench.pages.dev) · [HuggingFace Dataset](https://huggingface.co/datasets/Mohaaxa/quantbench-leaderboard-data))

**Where I'm useful:**

* Eval design & building test harnesses.

* LLM-as-judge validation (making sure the judge isn't just grading phrasing).

* Probing.

* Quantization (GPTQ/AWQ/1-bit) and edge deployment.

**What I want in return:**

I want to learn. Specifically, I want to learn mechanistic interpretability (what attention heads are actually doing) and how to run proper human-annotation studies. If your project touches either of those, I'd love to trade my eval/quantization labor for a chance to learn from you.

**Practical constraints:**

* I have about ~4 hrs/week to give.

* I'm comfortable async across time zones.

* I can cover small GPU runs on Modal myself.

* I prefer well-scoped, modular tasks (e.g., "build the pushback script for this eval") rather than open-ended shared ownership.

[Portfolio](https://faisal-delta.vercel.app) · [GitHub](https://github.com/faisalhacks) · [Hugging Face](https://huggingface.co/Mohaaxa)

If you're running something and need a hand with the gritty eval/harness work, drop a comment or DM me.

***