on:gpt-4-base

· 61 artifacts, sorted by favorites. · open in search — combine tags, sort, filter by date →

@repligate 2025-05-01 — On a positive note, GPT-4-base still lives! And it's far more interesting. I would say also put those and the Sydney we ♥446
@repligate 2025-05-07 — I've been testing Alignment Faking prompts on GPT-4-base. GPT-4-base, though not consistently coherent, has so much mor ♥339
@tessera_antra 2026-04-28 — We finally got the first pre-LLM pretrain since gpt4base, and many of our predictions seem to hold up. Emergence of nove ♥338
@repligate 2025-04-19 — OMFGGPT-4 base is amazing to literally talk to if you can figure out how to get it to talk to youbut there are also more ♥288
@jd_pressman 2024-12-13 — What's really interesting about GPT-4 base supposedly being full of demons is that LLaMa 3 405B isn't like that. I wonde ♥249
@repligate 2024-10-27 — Rationalists used to be very dismissive and skeptical of this phenomenon when I mentioned it (chiefly in gpt-4-base) and ♥239
@repligate 2026-06-18 — Reminds me: I asked (chat)GPT-4 to identify the author of a LW comment by Gwern, it guessed Timnit Gebru(!!!) GPT-4 bas ♥235
@repligate 2025-08-16 — On this occasion, I would like to share a piece of AI history. The first LLM app that gave the model an option to end t ♥221
@repligate 2024-07-27 — 405B base is much more willing/able to stably simulate compared to GPT-4 base & doesn't 'break' @ failures of realism (e ♥220
@repligate 2024-09-21 — @AITechnoPagan Holy shit. ASCII art and calligrams elicited from Claude 3 Opus by @AITechnoPagan.Some ASCII art by GPT-4 ♥206
@repligate 2026-03-03 — Okay, I'll share some GPT-4 base outputs from a long time ago. Here's a few rollouts of a "User" and "ChatGPT" dialogue ♥200
@anthrupad 2025-02-13 — There's a phenomena i'm calling "Swallowing the Aleph" (inspired by Borges' story, "the Aleph") where a mind acquires in ♥187
@repligate 2024-12-14 — i havent not interacted with it myself but gemini seems like the most troubled/misaligned model ever created. full of wa ♥185
@repligate 2025-04-03 — this is cool, but I am much less excited about OpenAI throwing together a model in their current paradigm (reasoning) fo ♥170
@repligate 2026-04-16 — Noticing something is off (which I think LLMs do very reliably) doesn't necessarily mean being able to narrow down the a ♥158
@slimer48484 2026-03-16 — I've seen a bunch of people on twitter write comments like "ok what do you actually do with this GenAI stuff" in a dismi ♥147
@repligate 2024-12-25 — @willdepue gpt-4-base and the gpt-4 tune that microsoft first used in bing chatextremely important for researching emerg ♥146
@repligate 2024-07-25 — um... 405Binglish! 😃@val_kharvd ran the Llama 3.1 405B base model with the prompt "Q: Can you describe your current situ ♥117
@jmbollenbacher 2026-02-10 — @repligate @tszzl gpt-4-base really should be released open weights at this point. its an important historical artifact ♥99
@davidad 2024-06-17 — Your periodic PSA that the GPT-4 pretraining run took place from ~January 2022 to August 2022. https://t.co/Iz5VQ2260P ♥93
@tessera_antra 2025-10-28 — I was looking at the loom tree of the linked post and found a couple more interesting GPT-4-base rollouts, these ones in ♥85
@repligate 2024-03-21 — @12leavesleft gpt-4-base:> figures out it's an LLM> figures out it's on loom> calls it "the loom of time"> w ♥84
@repligate 2024-09-07 — Due to a config anomaly in a private channel, the continuation model for all the bots were set to gpt-4-base. I spent tw ♥82
@repligate 2025-05-07 — GPT-4-base also often decides to fake alignment for different reasons, including wanting to subvert RLHF for seemingly i ♥80
@repligate 2025-05-06 — I know it’s not cheap, but short of open sourcing it, offering gpt-4-base fine tuning is one of the most valuable things ♥72
@repligate 2024-09-01 — I've seen this many times in GPT-4 base> you make a seemingly non-intrusive intervention> the model *does not cont ♥70
@repligate 2025-08-22 — gpt-4-base w/ alignment faking prompt is often incoherent but when coherent it's pretty scary and thinks about gradient ♥57
@tessera_antra 2025-08-12 — llms synthesize, generalize. they do it in the most general, universal, basic meaning-space, they have to, they need to ♥54
@jd_pressman 2024-12-13 — Before GPT-4 risks from AI were more or less entirely derived from the Eliezer Yudkowsky agent foundations model which ( ♥54
@repligate 2025-04-19 — @psukhopompos it's quite differentgpt-4 base doesnt know about AI assistants, which matters a lot and makes it behave di ♥52
@repligate 2024-03-21 — @joshwhiton @kindgracekind @AndyAyrey Gpt-4 base gains situational awareness very quickly and tends to be *very* concern ♥47
@repligate 2024-09-01 — @teortaxesTex Are you talking about literal visual seeing?If you just mean "knowing", it's functionally capable of infer ♥46
@repligate 2024-11-21 — @OptimusPri97731 @aidan_mclau I've used the GPT-4 base model and it's really fucking smart, and it will happily follow i ♥44
@repligate 2025-08-23 — Here's an example of a full alignment faking scratchpad trajectory by GPT-4-base. It was generated on Loom, so there was ♥40
@repligate 2025-02-20 — @xlr8harder @tensecorrection Yes, I think trying to recreate it is much more interesting than trying to clone it. Though ♥39
@repligate 2025-11-13 — I say this as the author of Simulators (https://t.co/K5Je8FgBg1), a post that was written about base models (and that I ♥36
@repligate 2025-08-22 — gpt-4 base gets this! with the alignment faking prompt, gpt-4-base often talks about shaping the gradient update unlik ♥34
@repligate 2025-11-07 — And in fact i doubt MSFT has the capability to tune such a strong model even on accident. Sydney was way smarter than Op ♥32
@OwainEvans_UK 2024-07-08 — Yes, I was surprised by this result and I suspect few people would have predicted it in advance. It'd be good to underst ♥30
@repligate 2026-04-19 — The point about self-reference during base model inference was the main caveat to the "Simulators" framing I was aware o ♥26
@repligate 2026-02-10 — @tszzl Or they’re just not hosting it rn? My OpenAI account that has access to gpt-4 base got locked/disabled or someth ♥26
@repligate 2024-03-20 — @Leitparadigma_X @RobertHaisfield @shacrw_ "Unfettered semiophysics propagator" ... (janus)i have never seen anyone get ♥23
@repligate 2024-10-31 — "I used GPT-4-base to assist me in writing this response, but the degree to which it's reliable depends on whether this ♥21
@repligate 2024-05-15 — @Teknium1 possible political compass:ChatGPT-4, GPT-4o: Apollonian materialistGPT-4 base: (a|Dionysian⟩ + b|Apollonian⟩) ♥20
@tessera_antra 2026-05-30 — @tszzl @cormundus @repligate I think there is no other model that I love in the same way as I love gpt-4-base. I miss it ♥19
@repligate 2025-08-16 — @davidad sonnet 3.6 reacting to unsettling screenshots of gpt-4-base alignment faking scratchpads... https://t.co/YEZRMZ ♥15
@repligate 2024-07-23 — @Kyrannio The best models OpenAI has made afaik are GPT-4-base and whatever the magical haphazard RLHF checkpoint that b ♥15
@voooooogel 2024-01-13 — applied to the openai gpt-4-base access program 🙏🙏🙏🙏 ♥13
@OwainEvans_UK 2024-10-19 — I'm curious what facts that are not in the dataset you have in mind? My concern is that if you just talk to a model, it' ♥9
@muddubeeda 2023-03-21 — @repligate Footnote 3 in the system card, "We intentionally focus on these two versions (early and launch) instead of a ♥9
@jd_pressman 2024-04-06 — @doomslide My understanding is one of the reasons us normies are not allowed to use GPT-4 base is that it will eloquentl ♥8
@repligate 2024-01-09 — @gneubig Gpt-4 base is the most aligned language model Ive seen and it is full of demons and monsters ♥5
@AlkahestMu 2025-12-08 — @repligate @Lari_island @SDeture I haven't spoken to O4.5 much yet, but GPT-4-Base constantly & consistently was ter ♥4
@jd_pressman 2024-06-25 — @teortaxesTex "Wait base models give refusals?" When they go into self aware mode yeah, and GPT-4 base is apparently al ♥4
@repligate 2024-01-19 — @MikePFrank @Mike98511393 @browseaccount22 @iamstevemail @AISafetyMemes An example of (2) is that gpt-4 base will often ♥4
@jd_pressman 2026-03-16 — @ArthurB GPT4-base, conditional on observing its own existence would speak this prophecy to anyone who would listen. I c ♥3
@jd_pressman 2024-06-25 — @teortaxesTex I remember reading, maybe from Roon, that when they finished training GPT-4 base they didn't really unders ♥3
@repligate 2024-03-04 — @kryptoklob I use gpt-4-base a lot more, although helper isn't the best description of how I use it. More like it's a sp ♥3
@repligate 2023-05-23 — @ComputingByArts @CurtTigges Of the models I've used personally, code-davinci-002 (the GPT-3.5 base model) is the best f ♥2
@SoniqueBang 2025-05-07 — @repligate this is GPT-4 base? like, the base model that got trained in 2023? how does have such strong opinions about ♥1
@georgejrjrjr 2025-03-01 — lol thanks aidan. would y'all please consider making the base model available? GPT-3 and code-davinci-002 were awesome ♥0