Jonathan N

5mo

This year's Spring ACX Meetup everywhere in Singapore.

Location: – https://plus.codes/6PH58W8W+HJ

Group Link: https://t.me/LessWrong_Singapore

partiful.com/e/6ghe2pwx2e2j4q9y2nyj

Contact: jonathan.ng1@gmail.com

1

Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities

Jonathan N

Jonathan N, abra, Connor Axiotes, Esben Kran

1y

This blog was published by Jonathan Ng, Andrey Anurin, Connor Axiotes, Esben Kran.

Apart Research's newest paper, Catastrophic Cyber Capabilities Benchmark (3cb): Robustly Evaluating LLM Agent Cyber Offense Capabilities (website), creates a novel cyber offense capability benchmark that engages with issues of legibility, coverage, and generalization in cyber offense benchmarks.

We were moved to create 3cb because a superintelligent AI performing autonomous cyber operations would prove a large risk for humanity. This means robust cyber offense evaluations will be more important than ever for policymakers and AI developers.

3cb uses a new type of cyber offense task categorization and adheres to the principle of demonstrations-as-evaluations to improve legibility and coverage. It also introduces 15 original challenges... (read 1759 more words →)

9

ACX Meetup 2022 @ Singapore

Jonathan N

3y

[UPDATE]

Plan is to go to Love Handle:

Love Handle
8886 7112
https://maps.app.goo.gl/CjwZEYUXcbPtDAP68

I will probably leave from the MRT at about 640PM and walk over to Love Handle (8min walk).

Someone has also kindly offered their home but it is at Buangkok whovh is fairly far away from town, so we'll play by ear for what people want to do after.

The chosen date is a few days after EAGx Singapore ends, so hopefully, we'll catch some drifters who are in town and make this a little more international!

The default plan was just to eat in Tanjong Pagar and relax somewhere in town, but if we get big enough, going to someone's place might be good.

2

LESSWRONG
LW

LESSWRONG
LW

Jonathan N

Jonathan N

Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities

Jonathan N

Jonathan N

Jonathan N

Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities