All Publications

arXiv

Preprint ServerGood(3)

Open-access preprint server for STEM fields

Credibility Rating

3/5

Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

274

Resources

162

Citing pages

1

Tracked domains

Tracked Domains

arxiv.org

Resources (274)

274 resources

			Summary
Risks from Learned Optimization	paper	2019-06-05	S	17
Anthropic: "Discovering Sycophancy in Language Models"	paper	-	S	10
Debate as Scalable Oversight	paper	2018-05-02	S	9
Training Language Models to Follow Instructions with Human Feedback	paper	2022-03-04	S	8
Kaplan et al. (2020)	paper	2020-01-23	S	8
Concrete Problems in AI Safety	paper	2016-06-21	S	8
AI Control Framework	paper	2023-12-12	S	7
Gaming RLHF evaluation	paper	2022-08-30	S	7
AI Alignment: A Comprehensive Survey	paper	-	S	7
OpenAI's GPT-4	paper	2023-03-15	S	6
Hoffmann et al. (2022)	paper	2022-03-29	S	6
Turner et al. formal results	paper	2019-12-03	S	6
Sparse Autoencoders	paper	2024-04-22	S	6
Kenton et al. (2021)	paper	2021-09-08	S	6
Hadfield-Menell et al. (2017)	paper	2016-11-24	S	5
Langosco et al. (2022)	paper	2021-05-28	S	5
Brown et al. (2020)	paper	2020-05-28	S	5
Emergent Abilities	paper	2022-06-15	S	5
Representation Engineering: A Top-Down Approach to AI Transparency	paper	2023-10-02	S	5
Is Power-Seeking AI an Existential Risk?	paper	2022-06-16	S	5
Chain-of-thought analysis	paper	2022-01-28	S	5
Perez et al. (2022): "Sycophancy in LLMs"	paper	-	S	5
arXiv	paper	2023-12-14	S	4
"Are Emergent Abilities a Mirage?"	paper	2023-04-28	S	4
Langosco et al. (2022)	paper	2022-10-04	S	4

Rows per page:

Page 1 of 11

Citing Pages (162)

AI Accident Risk Cruxes Adversarial Training Agent Foundations Agentic AI AGI Development AI Acceleration Tradeoff Model AI-Assisted Alignment AI Control AI-Augmented Forecasting AI Timelines AI Alignment Alignment Evaluations Alignment Robustness Trajectory Model Anthropic Authentication Collapse Authentication Collapse Timeline Model Center for AI Safety Capabilities-to-Safety Pipeline Model Capability-Alignment Race Model Capability Elicitation AI Capability Threshold Model Carlsmith's Six-Premise Argument The Case Against AI Existential Risk The Case For AI Existential Risk Center for Human-Compatible AI China AI Regulatory Framework Cooperative IRL (CIRL)Autonomous Coding Collective Intelligence / Coordination AI Compounding Risks Analysis Model AI-Driven Concentration of Power Constitutional AI AI Content Authentication Cooperative AI AI Governance Coordination Technologies Corrigibility Corrigibility Failure Corrigibility Failure Pathways AI Risk Critical Uncertainties Model AI-Induced Cyber Psychosis Autonomous Cyber Attack Timeline Dan Hendrycks Dangerous Capability Evaluations Dario Amodei AI Safety via Debate Deceptive Alignment Deceptive Alignment Decomposition Model Deep Learning Revolution Era Deepfakes Google DeepMind AI Safety Defense in Depth Model Dense Transformers AI Distributional Shift AI Doomer Worldview AI Policy Effectiveness Eliciting Latent Knowledge (ELK)Emergent Capabilities Epistemic Collapse AI-Era Epistemic Infrastructure AI-Era Epistemic Security Epistemic Sycophancy Epistemic Virtue Evals Epoch AI AI Evaluations AI Evaluation Evan Hubinger FAR AI AI Flash Dynamics Formal Verification (AI Safety)AI-Powered Fraud Goal Misgeneralization Goal Misgeneralization Probability Model Goal Misgeneralization Research Governance-Focused Worldview AI Governance and Policy Heavy Scaffolding / Agentic Systems AI-Human Hybrid Systems Instrumental Convergence Instrumental Convergence Framework Interpretability Is Interpretability Sufficient for Safety?AI Safety Intervention Effectiveness Matrix AI Safety Intervention Portfolio AI-Induced Irreversibility Large Language Models Large Language Models AI-Driven Legal Evidence Crisis Light Scaffolding AI Value Lock-in Long-Horizon Autonomous Tasks Long-Timelines Technical Worldview Mesa-Optimization Mesa-Optimization Risk Analysis Meta AI (FAIR)METR Minimal Scaffolding Machine Intelligence Research Institute Third-Party Model Auditing Multi-Agent Safety Multipolar Trap (AI Development)Multipolar Trap Dynamics Model Open Source AI Safety OpenAI Optimistic Alignment Worldview Paul Christiano Persuasion and Social Manipulation Power-Seeking AI Power-Seeking Emergence Conditions Model Preference Optimization Methods Probing / Linear Probes Process Supervision AI Proliferation AI Proliferation Risk Model Provable / Guaranteed Safe AI Provably Safe AI (davidad agenda)AI Risk Public Education Reasoning and Planning Redwood Research Representation Engineering AI Alignment Research Agendas Reward Hacking Reward Hacking Taxonomy and Severity Model Reward Modeling AI Risk Activation Timeline Model AI Risk Interaction Network Model RLHF Safety-Capability Tradeoff Model AI Safety Research Allocation Model AI Safety Research Value Model Sam Altman AI Capability Sandbagging Scalable Eval Approaches Scalable Oversight AI Scaling Laws Scheming Scheming & Deception Detection Scheming Likelihood Assessment Scientific Knowledge Corruption Scientific Research Capabilities Self-Improvement and Recursive Enhancement Seoul Declaration on AI Safety Sharp Left Turn Similar Projects to LongtermWiki: Research Report Situational Awareness Sleeper Agent Detection AI Safety Solution Cruxes Sparse Autoencoders (SAEs)State-Space Models / Mamba AI Model Steganography Sycophancy Sycophancy Feedback Loop Model AI Safety Technical Pathway Decomposition Technical AI Safety Research Tool-Use Restrictions Tool Use and Computer Use Treacherous Turn Voluntary AI Safety Commitments Weak-to-Strong Generalization Why Alignment Might Be Easy Why Alignment Might Be Hard AI Winner-Take-All Dynamics Yoshua Bengio

Publication ID: arxiv

arXiv | Publications | Longterm Wiki | Longterm Wiki