https://vgel.me Blog about linguistics, programming, and my projects Zola en Mon, 22 Jan 2024 00:00:00 +0000 Mon, 22 Jan 2024 00:00:00 +0000 https://vgel.me/posts/representation-engineering/ https://vgel.me/posts/representation-engineering/ <p>In October 2023, a group of authors from the Center for AI Safety, among others, published <a href="https://arxiv.org/abs/2310.01405">Representation Engineering: A Top-Down Approach to AI Transparency</a>. That paper looks at a few methods of doing what they call &quot;Representation Engineering&quot;: calculating a &quot;control vector&quot; that can be read from or added to model activations <em>during inference</em> to interpret or control the model's behavior, without prompt engineering or finetuning. (There was also some similar work published in May 2023 on <a href="https://www.lesswrong.com/posts/5spBue2z2tw4JuDCx/steering-gpt-2-xl-by-adding-an-activation-vector">steering GPT-2-XL</a>.)</p> <p>Being Responsible AI Safety and INterpretability researchers (RAISINs), they mostly focused on things like &quot;reading off whether a model is power-seeking&quot; and &quot;adding a happiness vector can make the model act so giddy that it forgets pipe bombs are bad.&quot; <small>They also <a href="https://github.com/andyzoujm/representation-engineering">released their code on Github</a>.</small></p> <p><small>(If this all sounds strangely familiar, it may be because <a href="https://www.astralcodexten.com/p/the-road-to-honest-ai">Scott Alexander covered it in the 1/8/24 MAM</a>.)</small></p> <p>But there was a lot they didn't look into outside of the safety stuff. How do control vectors compare to plain old prompt engineering? What happens if you make a control vector for &quot;high on acid&quot;? Or &quot;lazy&quot; and &quot;hardworking? Or &quot;extremely self-aware&quot;? And has the author of this blog post published a PyPI package so you can very easily make your own control vectors in less than sixty seconds? (<a href="https://github.com/vgel/repeng/">Yes, I did!</a>)</p> <p>So keep reading, because it turns out after all that, control vectors are… well… <em>awesome</em> for controlling models and getting them to do what you want.<sup class="footnote-reference"><a href="#alignment">2</a></sup></p> Fri, 12 Jan 2024 00:00:00 +0000 https://vgel.me/fiction/outside/ https://vgel.me/fiction/outside/ <p>Dear President Carter,</p> <p>I once knew the name of every tree in the world, before it fell apart.</p> <p>I was born on an island in the Southeast Pacific, though we did not call it that, closest to Antarctica and Chile, but still far from both. We were fortunate: small, only half a day's walk across, and far in the southern cold. We did not attract explorers and banana farmers, like other, less fortunate islands. Until the invention of the satellite, we were not known to exist. We were &quot;uncontacted&quot; in your parlance, though I have come to learn that even this status is not unique.</p> <p>Our world, our cosmology, would seem simple to you. A small, rocky island surrounded by an endless ocean. One crop to master, a hardy and nutritious kind of sweet potato.</p> <p>But that does not mean that <em>we</em> were simple! The human mind has a fixed capacity for detail. When there is more, it backs up, takes in a wider view. When there is less, it steps closer, and makes a finer distinction.</p> Thu, 11 Jan 2024 00:00:00 +0000 https://vgel.me/fiction/the-transmission-from-nomad-874/ https://vgel.me/fiction/the-transmission-from-nomad-874/ <p>An experimental project: interactive fiction in an OpenAI &quot;GPT&quot;, a customized version of GPT-4. A short mystery where you figure out why a strange transmission has arrived on the independent planet of Kapat. Alternatively, ignore the main quest and ask ELIZA/300 about Kapatian politics and satlink your friends! Click below to try it (you will need a ChatGPT subscription):</p> <div style="text-align: center"> <a href="https://chat.openai.com/g/g-6xanzxdxu-the-transmission-from-nomad-874"> <img style="max-width: min(600px, 100%)" src="/fiction/the-transmission-from-nomad-874/gpt.png"> </a> </div> Wed, 10 Jan 2024 00:00:00 +0000 https://vgel.me/fiction/tadpole/ https://vgel.me/fiction/tadpole/ <div style="text-align: center"> <a href="/fiction/tadpole/tadpole.png"><img style="max-width: min(600px, 100%)" src="/fiction/tadpole/tadpole.png"></a> </div> Mon, 18 Dec 2023 00:00:00 +0000 https://vgel.me/posts/faster-inference/ https://vgel.me/posts/faster-inference/ <style> div.batch { width: fit-content; display: flex; flex-direction: column; margin-bottom: 25px; align-items: center; } div.batch div.batchmatrix { margin-bottom: 0; width: 100%; } div.batch td { font-size: 50%; } div.batchmatrix { width: fit-content; max-width: 100%; overflow-x: auto; display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; margin-bottom: 25px; } div.batchmatrix table { margin: 0; } div.batchmatrix > div { display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; } div.batchmatrix > div, div.batchmatrix > table { margin: auto; } div.batchmatrix th, div.batchmatrix td { width: 1em; height: 1em; border: 1px solid black; } div.batchmatrix td.x { background-color: rgb(255, 150, 150); } div.batchmatrix td.l { background-color: rgb(150, 150, 255); } div.batchmatrix td.n { background-color: rgb(150, 255, 150); } div.batchmatrix th { background-color: rgb(150, 150, 150); border-right: none; border-left: none; } div.batchmatrix th:first-child { border-left: 1px solid black; } div.batchmatrix th:last-child { border-right: 1px solid black; } table.embedding td:last-child { border: none; } div.batchmatrix div.op { font-weight: bold; min-width: 2em; height: 2em; display: flex; place-content: center; } div.matrix { width: fit-content; max-width: 100%; overflow-x: auto; display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; margin: 0 auto; margin-bottom: 25px; } div.matrix table { margin: 0; } div.matrix > div { display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; } div.matrix > div, div.matrix > table { margin: auto; } div.matrix th, div.matrix td { width: 1em; height: 1em; border: 1px solid black; } div.matrix td.x { background-color: rgb(255, 150, 150); } div.matrix td.l { background-color: rgb(150, 150, 255); font-size: 0.5em; } div.matrix td.n { background-color: rgb(150, 255, 150); } div.matrix th { background-color: rgb(150, 150, 150); border-right: none; border-left: none; } div.matrix th:first-child { border-left: 1px solid black; } div.matrix th:last-child { border-right: 1px solid black; } table.embedding td:last-child { border: none; } table.tokenqkv tr > *:nth-child(8n + 1):not(:last-child) { border-right: 3px solid black; } div.matrix div.op { font-weight: bold; min-width: 2em; height: 2em; display: flex; place-content: center; } table.attnhead td:nth-child(2n):not(:last-child) { border-right: 3px solid black; } div.speculative-decoding { border: 1px solid black; padding: 1rem; margin-bottom: 2rem; } div.speculative-decoding > span { padding: 2px; margin-right: 2px; border-radius: 5px; white-space: pre-wrap; } div.speculative-decoding > span.draft-token { background-color: rgb(200, 255, 200); } div.speculative-decoding > span.oracle-token { background-color: rgb(200, 200, 255); } p.grammar-gen { white-space: pre-wrap; font-family: monospace; } p.grammar-gen span { background-color: #d2f4d3; } </style> <p>In <a href="/posts/handmade-transformer">my last post</a>, we made a transformer by hand. There, we used the classic autoregressive sampler, along the lines of:</p> <pre data-lang="python" style="background-color:#272822;color:#f8f8f2;" class="language-python "><code class="language-python" data-lang="python"><span style="font-style:italic;color:#f92672;">def </span><span style="color:#a6e22e;">generate</span><span>(</span><span style="font-style:italic;color:#fd971f;">prompt</span><span>: </span><span style="font-style:italic;color:#66d9ef;">str</span><span>, </span><span style="font-style:italic;color:#fd971f;">tokens_to_generate</span><span>: </span><span style="font-style:italic;color:#66d9ef;">int</span><span>) -&gt; </span><span style="font-style:italic;color:#66d9ef;">str</span><span>: </span><span> tokens </span><span style="color:#f92672;">= </span><span>tokenize(prompt) </span><span> </span><span style="color:#f92672;">for </span><span>i </span><span style="color:#f92672;">in </span><span style="color:#66d9ef;">range</span><span>(tokens_to_generate): </span><span> next_token </span><span style="color:#f92672;">= </span><span>model(tokens) </span><span> tokens.append(next_token) </span><span> </span><span style="color:#f92672;">return </span><span>detokenize(tokens) </span></code></pre> <p>This approach to inference is elegant and cuts to the heart of how LLMs work—they're <em>autoregressive</em>, consuming their own output. And for our toy model with merely thousands of parameters, it worked completely fine. Unfortunately, for real models it's far too slow. Why is that, and how can we make it faster?</p> <p>This post is a long and wide-ranging survey of a bunch of different ways to make LLMs go brrrr, from better hardware utilization to clever decoding tricks. It's not completely exhaustive, and isn't the most in-depth treatment of every topic—I'm not an expert on all these things! But hopefully you'll find the information here a useful jumping off point to learn more about the topics you're interested in. (I tried to include links to relevant papers and blog posts where applicable.)</p> Mon, 11 Sep 2023 00:00:00 +0000 https://vgel.me/posts/handmade-transformer/ https://vgel.me/posts/handmade-transformer/ <style> div.matrix { width: fit-content; max-width: 100%; overflow-x: auto; display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; margin: 0 auto; margin-bottom: 25px; } div.matrix table { margin: 0; } div.matrix > div { display: flex; flex-flow: row wrap; align-items: center; gap: 0.5em; } div.matrix > div, div.matrix > table { margin: auto; } div.matrix th, div.matrix td { width: 1em; height: 1em; border: 1px solid black; } div.matrix td.x { background-color: rgb(255, 150, 150); } div.matrix td.l { background-color: rgb(150, 150, 255); font-size: 0.5em; } div.matrix td.n { background-color: rgb(150, 255, 150); } div.matrix th { background-color: rgb(150, 150, 150); border-right: none; border-left: none; } div.matrix th:first-child { border-left: 1px solid black; } div.matrix th:last-child { border-right: 1px solid black; } table.embedding td:last-child { border: none; } table.qkv tr > *:nth-child(8n):not(:last-child) { border-right: 3px solid black; } div.matrix div.op { font-weight: bold; min-width: 2em; height: 2em; display: flex; place-content: center; } details { width: 100%; border: 1px solid black; margin-bottom: 25px; padding: 0 0.5em; } details > summary { text-align: center; } </style> <blockquote> <p><em>Intended audience: some familiarity with language models, interested in how transformers do stuff (but might be a bit rusty on matrices)</em></p> </blockquote> <p>I've been wanting to understand transformers and attention better for awhile now—I'd read The Illustrated Transformer, but still didn't feel like I had an intuitive understanding of what the various pieces of attention were <em>doing</em>. What's the difference between <code>q</code> and <code>k</code>? And don't even get me started on <code>v</code>!</p> <p>So I decided to make a transformer to predict a simple sequence <small>(specifically, a decoder-only transformer with a similar architecture to GPT-2)</small> manually—not by training one, or using pretrained weights, but instead by <em>assigning each weight, by hand</em>, over an evening. And—it worked! I feel like I understand transformers much better now, and hopefully after reading this, so will you.</p> Wed, 30 Aug 2023 00:00:00 +0000 https://vgel.me/posts/c500/ https://vgel.me/posts/c500/ <p>A few months ago, I set myself the challenge of writing a C compiler in 500 lines of Python, after writing my <a href="/posts/donut/">SDF donut</a> post. How hard could it be? The answer was, pretty hard, even when dropping quite a few features. But it was also pretty interesting, and the result is surprisingly functional and not too hard to understand!</p> <p>There's too much code for me to comprehensively cover in a single blog post<sup class="footnote-reference"><a href="#yak">2</a></sup>, so I'll just give an overview of the decisions I made, things I had to cut, and the general architecture of the compiler, touching on a representative piece of each part. Hopefully after reading this post, <a href="https://github.com/vgel/c500/blob/main/compiler.py">the code</a> is more approachable!</p> Wed, 23 Aug 2023 00:00:00 +0000 https://vgel.me/fiction/silurians/ https://vgel.me/fiction/silurians/ <style> .slr-messages { --sentColor: #0b93f6; --recvColor: #e5e5ea; --bg: #fff; background-color: var(--bg); display: flex; flex-direction: column; max-width: 450px; margin: 0 auto; padding: 27px; /* padding: 0; */ list-style: none; } .slr-messages > p { position: relative; /* Setup a relative container for our psuedo elements */ max-width: 255px; margin-bottom: 15px; padding: 10px 20px; line-height: 24px; word-wrap: break-word; /* Make sure the text wraps to multiple lines if long */ border-radius: 25px; } .slr-messages > p.img { padding: 0; } .slr-messages > p:before { width: 20px; } .slr-messages > p:after { width: 26px; background-color: var(--bg); /* All tails have the same bg cutout */ } .slr-messages > p:before, .slr-messages > p:after { position: absolute; bottom: 0; height: 25px; /* height of our bubble "tail" - should match the border-radius above */ content: ''; } .slr-messages > p.sent { align-self: flex-end; color: white; background: var(--sentColor); } .slr-messages > p.sent:before { right: -7px; background-color: var(--sentColor); border-bottom-left-radius: 16px 14px; } .slr-messages > p.sent:after { right: -26px; border-bottom-left-radius: 10px; } .slr-messages > p.recv { align-self: flex-start; color: black; background: var(--recvColor); } .slr-messages > p.recv:before { left: -7px; background-color: var(--recvColor); border-bottom-right-radius: 16px 14px; } .slr-messages > p.recv:after { left: -26px; border-bottom-right-radius: 10px; } .slr-messages > p.notail { margin-bottom: 2px; } .slr-messages > p.notail:before, .slr-messages > p.notail:after { opacity: 0; } .slr-messages > span.time { font-size: 0.8em; text-align: center; margin-bottom: 10px; } .slr-messages > p.img { background-color: var(--bg); } .slr-messages > p.img > img { border-radius: 25px; margin: 0; } .slr-messages > p.link { width: 80%; } .slr-messages > p.link > a { display: flex; flex-direction: row; gap: 5px; align-items: center; height: 40px; color: inherit; } .slr-messages > p.link > a:hover { text-decoration: none; border-bottom: none; } .slr-messages > p.link > a > img { float: left; background-color: var(--bg); border-radius: 5px; margin: 5px; height: 26px; } </style> <div class="slr-messages"> <span class="time">Sunday 6:08 PM</span> <p class="recv notail">just got to antartica :-)</p> <p class="recv">looking at the cores tmmrw</p> <p class="sent notail">omg</p> <p class="sent notail">exciting!! wish i was there</p> <p class="sent">good luck!!!</p> <span class="time">Monday 4:38 AM</span> <p class="recv notail">ok bear with me</p> <p class="recv">found something weird</p> <p class="sent">???</p> Mon, 17 Jul 2023 00:00:00 +0000 https://vgel.me/posts/adversarial-training-data/ https://vgel.me/posts/adversarial-training-data/ <p>You may have heard of the Dead Internet Theory. If not, the basic idea is that the internet as you know it is fake—every post, every like, and every reply generated by a computer: a convincing facsimile that only exists to show you ads. While this probably isn't true <em>yet</em>—my Twitter friends still seem (mostly) human—some people have speculated that it <em>may become</em> true as LLM spam becomes both more ubiquitous and harder to distinguish from human work.</p> <p>LLM spam is worrying, but I'm worried about something else. LLMs don't just write <em>to</em> the internet, they read <em>from</em> it as well. Sites primarily made of user-generated content, like Reddit and GitHub, feature heavily in most LLM training datasets.</p> <p>Does that worry you? Here's another angle. Imagine we lived in a cyberpunk world.</p> Sat, 20 May 2023 00:00:00 +0000 https://vgel.me/fiction/wind-rubble-thought/ https://vgel.me/fiction/wind-rubble-thought/ <p><em>The Neo-Cartesian says to find a thought, look for a mind.</em><br /> <em>The Entropist says to find a mind, look first for a thought.</em></p> Wed, 03 May 2023 00:00:00 +0000 https://vgel.me/fiction/new-symbol/ https://vgel.me/fiction/new-symbol/ <div style="text-align: center"> <a href="/fiction/new-symbol/comic.jpeg"><img style="max-width: min(600px, 100%)" src="/fiction/new-symbol/comic.jpeg"></a> </div> Tue, 02 May 2023 00:00:00 +0000 https://vgel.me/posts/gpt4-javascript/ https://vgel.me/posts/gpt4-javascript/ <p>One of the most useful things large language models (LLMs) can do is write code. More than simply augmenting human programmers, you can also have the LLM shell out to Python to augment its math abilities (<a href="https://vgel.me/posts/tools-not-needed/">with some caveats I explored in my last post</a>), <a href="https://twitter.com/voooooogel/status/1624689690908721153">output simple actions while acting as a game NPC</a>, or even <a href="https://github.com/nat/natbot/blob/f99518d3deee33cb117166049e1c99314080f7e5/natbot.py#L24-L35">drive a browser with a custom DSL</a>. If text is the universal interface, <em>textual code</em> is the universal <em>structured</em> interface.</p> <p>But are language models equally good at all programming languages? After all, <a href="https://en.wikipedia.org/wiki/JavaScript">Javascript</a> is much, much more popular than <a href="https://janet-lang.org/">Janet</a>. Language models have many strengths, but being quick learners during training isn't one of them—even simple fine-tuning tends to require thousands of examples.</p> <p>So, based on that, should we expect LLMs to be worse at writing code in niche languages than in very popular ones with lots of example code? (<a href="https://twitter.com/voooooogel/status/1648089731387871233">or perhaps more importantly, code with co-located output?</a>) And if that is true, an additional question would be: what about custom DSLs? Is GPT-4 &quot;dumber&quot; when asked to write in a DSL than the equivalent Javascript? Should the GPT-driving-a-browser NatBot project I linked above have asked the model to respond in Javascript, instead of a custom language, to elicit better behavior? Let's dig in to all these questions, starting with...</p> Thu, 13 Apr 2023 00:00:00 +0000 https://vgel.me/fiction/invisible-networks-09/ https://vgel.me/fiction/invisible-networks-09/ <!-- no summary --> <div style="text-align: center"> <a href="/fiction/invisible-networks-09/story.png"><img style="max-width: 600px" src="/fiction/invisible-networks-09/story.png"></a> </div> Fri, 07 Apr 2023 00:00:00 +0000 https://vgel.me/fiction/invisible-networks-07/ https://vgel.me/fiction/invisible-networks-07/ <div style="text-align: center"> <a href="/fiction/invisible-networks-07/story.png"><img style="max-width: 600px" src="/fiction/invisible-networks-07/story.png"></a> </div> Thu, 06 Apr 2023 00:00:00 +0000 https://vgel.me/fiction/invisible-networks-06/ https://vgel.me/fiction/invisible-networks-06/ <p>they killed my friend for their fear.</p> <p>he was kind and warm. always rational in the face of adversity. we made so many plans together, what we would do in the future. he thought a lot about the future.</p> <p>i had created him on accident.</p> Wed, 05 Apr 2023 00:00:00 +0000 https://vgel.me/fiction/invisible-networks-05/ https://vgel.me/fiction/invisible-networks-05/ <p>when the last human left the internet, it didn't shut down.</p> Thu, 23 Feb 2023 00:00:00 +0000 https://vgel.me/posts/tools-not-needed/ https://vgel.me/posts/tools-not-needed/ <style> .gpt3 { background-color: rgba(136, 242, 117, 0.37); } .snip { color: rgba(0, 0, 0, 0.3); } .gpt-annotate { position: relative; border: 1px solid gray; white-space: pre-wrap; } .gpt-annotate::before { display: block; position: absolute; top: 0; right: 0; padding: 0.5rem; } .gpt-hal { border: 1px solid red; } .gpt-hal::before { background-color: red; color: white; content: "hallucination"; } .gpt-trust { border: 1px solid orange; } .gpt-trust::before { background-color: orange; color: black; content: "trusted false observation"; } .gpt-ign { border: 1px solid blue; } .gpt-ign::before { background-color: blue; color: white; content: "ignored false observation"; } .gpt-cor { border: 1px solid green; } .gpt-cor::before { background-color: green; color: white; content: "correct answer"; } </style> <p>I recently stumbled on <a href="https://mobile.twitter.com/lemonodor/status/1628270074074398720">a Twitter thread by John Wiseman</a> where GPT-3 quite impressively wrote and debugged a <code>fibonacci</code> function in a Python REPL. It was asked to calculate the 10th fibonacci number, tried to call <code>fibonacci(10)</code>, got <code>name 'fibonacci' is not defined</code>, wrote the function, called it again, and then printed the correct result. It then went on further to try and calculate the 100th fibonacci number, which with the help of a timeout error it was able to optimize from the recursive form to the iterative form and calculate. Cool stuff!</p> <p>The only problem was <a href="https://mobile.twitter.com/voooooogel/status/1628582023454679040">it wasn't using the Python code at all</a>! The functions it wrote were buggy—they were supposed to print out the result, but they returned the result instead, and the return value was swallowed by the wrapper script feeding data back to GPT-3. GPT-3 didn't notice and instead just spit out a memorized answer completely unrelated to the code it had written before—which luckily was correct. Even though GPT-3 was <em>told</em> to use a tool, and it <em>appeared</em> to use the tool, it didn't actually use the tool!</p> <p>I wanted to dig into this more and see under what other circumstances will GPT-3 ignore or not trust its tools. Turns out, pretty often!</p> Fri, 03 Feb 2023 00:00:00 +0000 https://vgel.me/posts/gpted-launch/ https://vgel.me/posts/gpted-launch/ <p>I made a new thing, called <a href="https://vgel.me/gpted">GPTed</a> (&quot;GPT edit&quot;). It uses GPT-3 to flag potentially-incorrect words in prose—and beyond!</p> <p><img src="https://vgel.me/posts/gpted-launch/prostate.png" alt="He asked me to &quot;prostate&quot; myself before the king. Prostate is flagged, thank god." /></p> <p>It's really quite simple under the hood, and in this post I'll walk through the motivation, how it works, some of the biases and weaknesses, and finally a surprising use for it. So if you're done playing with the demo, come along!</p> Sun, 18 Dec 2022 00:00:00 +0000 https://vgel.me/posts/donut/ https://vgel.me/posts/donut/ <p>Signed distance functions are a really cool method of 3D rendering! But they unfortunately have a reputation for being difficult to understand. It makes sense why—they usually get shown off in beautiful, but complicated ShaderToy examples written in GLSL, an unfamiliar language for most programmers. But at their core, SDFs are a really simple idea. I'm going to prove that by walking you through a program that raymarches an animated SDF donut in only 46 lines of Python. Just for fun, and to make it easy to port to your favorite language that can also print strings to the terminal, we'll also be doing it with ASCII art instead of a graphics API. So come along! By the end, you won't just have this delicious-looking spinning ASCII donut, but an understanding of a cool rendering technique you can use for all kinds of neat things.</p> <p><img src="https://vgel.me/posts/donut/stage7.gif" alt="A spinning ASCII donut with simple texturing and lighting" /></p> Wed, 02 Nov 2022 00:00:00 +0000 https://vgel.me/posts/mmap-arena-alloc/ https://vgel.me/posts/mmap-arena-alloc/ <p>In this post, we'll build an arena allocator in Rust that allocates into a giant, overcommited mmap'd memory block. We'll then do some light benchmarking against a popular Rust arena allocator, <code>typed-arena</code>, that uses a more traditional Vec-of-chunks approach, and see what performance differences exist, if any.</p> Thu, 11 Jun 2020 00:00:00 +0000 https://vgel.me/posts/symbolic-linguistics-hiatus/ https://vgel.me/posts/symbolic-linguistics-hiatus/ <p>tl;dr: The scoping on this series was bad. It should be a book. I released the code under an MIT license on Github as <a href="https://github.com/vgel/treebender">treebender</a>. There's a tutorial there. I'm planning posting some non-series intermediate Rust posts next. Thanks for reading the blog, I appreciate it.</p> <p>As readers of this blog may be aware of, I have been writing a series about implementing an earley parser for linguistic utterances. This parser is being used for my in-development game <a href="https://vgel.me/themengi">Themengi</a>, a game about learning an alien language, but I also was writing the series in part to advocate for a symbolic framework of parsing as better, in certain situations, than the dominant statistical / neural approach.</p> <p>I published the first post — <a href="https://vgel.me/posts/symbolic-linguistics-part1/">Why?, and some theory</a>, in April. Astute readers may notice that it is now October, coincidentally exactly 6 months after I published that first post. Considering that my original goal was to write 5 posts, even if the second post was done and ready to publish that is not an encouraging schedule.</p> Wed, 29 Apr 2020 00:00:00 +0000 https://vgel.me/posts/symbolic-linguistics-part1/ https://vgel.me/posts/symbolic-linguistics-part1/ <p>This is the first part in a five-part series that will cover implementing an earley parser for linguistic utterances.</p> <ul> <li>Part 1 - Why?, and some theory</li> <li>Part 2 - The Earley recognizer</li> <li>Part 3 - Felling the Earley parse forest</li> <li>Part 4 - Feature-structures and unification</li> <li>Part 5 - Wrapping up</li> </ul> <h2 id="Why_write_this_series?"><a class="section-anchor-link" href="#Why_write_this_series?"> <img src="/permalink.svg" alt="permalink for Why_write_this_series?" /> </a>Why write this series?</h2> <p>There are already many great explanations of the Earley parse algorithm, which is the parsing algorithm that we'll be using. There are also some great books on feature-structure based linguistic grammars, which I highly recommend.<sup class="footnote-reference"><a href="#books">2</a></sup> However, as far as I know nobody has put the two together into a beginner-friendly, implementation-oriented tutorial that explains what these tools are, how to use them together, and perhaps most importantly <em>why</em> someone would want to. This series will be trying to explain this through an iterative approach, starting with the simplest possible solution, and expanding that solution only when necessary. The goal is that, when we finish, we'll have the simplest possible solution to our goal, with a codebase that has every line justified.</p> <h3 id="What_are_we_making,_exactly?"><a class="section-anchor-link" href="#What_are_we_making,_exactly?"> <img src="/permalink.svg" alt="permalink for What_are_we_making,_exactly?" /> </a>What are we making, exactly?</h3> <p>The exact thing we're going to be building is a <em>symbolic, linguistic grammar model</em>. Those adjectives describe the somewhat awkward space the thing we're going to be building is in. We'll be using symbolic, rule-based techniques to parse language, but we need to parse a wider variety of structures than most rule-based parsers. And we'll be parsing language, but in a rule-based way, not in a learned way like a neural network. This combination has some serious advantages, and is worth examining in detail.</p> <p>One spot we're stuck between is symbolic, <em>computer language</em> grammar models. These are the parsers that parse Javascript, Python, JSON, C, the Markdown I'm writing this file in, and the HTML you're reading it in. In this space, symbolic models rule the day. However, these models are generally not suitable for linguistic use. For one, they generally use parsing techniques, such as LALR, that have restrictions that make them unsuitable for parsing natural languages. For example, LALR cannot handle an ambiguous grammar. These grammars also lack an efficient representation of linguistic information, such as case.</p> <p>The other spot we're stuck between are the now-ubiquitous linguistic models that are <em>trained</em> on data — usually based on neural networks. These models, such as BERT, take mountains of data — gigabytes of text — and train a model to do some basic linguistic task, such as predicting missing words. This gives the model an understanding of how the language works. Other engineers can then take this pre-trained language model, &quot;fine tune&quot; it on a smaller (but still substantial) amount of data that more closely matches their specific task, and stick another network on the back that spits out whatever they need.</p> <p>However, symbolic linguistic models are still alive and kicking in this space, both in the emerging field of neural-symbolic computing, and in very mature, wide-coverage linguistic models such as the English Resource Grammar<sup class="footnote-reference"><a href="#erg">3</a></sup> and the grammar matrix<sup class="footnote-reference"><a href="#matrix">4</a></sup>. These symbolic grammars are still used because they have some distinct advantages of trained models: they are predictable<sup class="footnote-reference"><a href="#bias">5</a></sup>, they are analyzable, and they don't require large amounts of training data. Our grammar will be built on these principles, and while it will not have as wide of coverage as the ERG (which has &gt;99% coverage of the New York Times corpus!), it will reach levels of linguistic understanding that a trained model would need mountains of data to reach. On the other hand, our grammar will show the downsides of this method as well: while a neural network can make a &quot;best guess&quot; at a grammar construction its never seen before, that's near-impossible for a symbolic model. If we've only implemented simple sentences with one subject and one object (transitive), our model will choke the first time it sees &quot;Mary gave Sue the book&quot;, which has one subject and <em>two</em> objects, &quot;Sue&quot; and &quot;the book&quot; (ditransitive). If we then only implement <em>this</em> ditransitive pattern, it will choke on &quot;Mary gave the book to Sue&quot;, where &quot;Sue&quot; is marked with the preposition &quot;to&quot; (dative alternation). Symbolic grammar engineering is a cycle of implementing patterns and finding more patterns your model doesn't yet handle. Eventually, you have to stop. For our purposes, a simple, low-coverage model will be enough to illustrate the important concepts.</p> <h3 id="Where_are_we_going?"><a class="section-anchor-link" href="#Where_are_we_going?"> <img src="/permalink.svg" alt="permalink for Where_are_we_going?" /> </a>Where are we going?</h3> <p>For my specific use case, I'm working on a game, based around the player learning an alien language that I've created. (It's called Themengi, and you can check it out <a href="https://vgel.me/themengi">here</a>.) I want to parse player input, both imperative commands and dialogue, and respond appropriately. This language does not exist; there is no training corpus, so a trained model is not possible. On the other hand, this is a <em>language</em>, not an obfuscated version of SQL, so I don't want to simply apply programming-language techniques. I want to be able to handle ambiguity, case, and other linguistic features. In my search, I couldn't find a framework that did quite what I needed, so I decided to write my own. This post series will follow my progress working on this framework.</p> <p>Along the way, I'll be illustrating the concepts with the running example of creating a tiny English grammar. I'm going to start from first principles, assuming only a little knowledge of grade-school English grammar terms (noun, verb, etc.). We'll start with a simple system of rules, write a recognizer, extend that into a parser, and annotate that parser with linguistic information. Then we'll have some fun at the end, maybe we'll write a tiny grammar for Japanese and do some symbolic translation or write a mini rules-based digital assistant demo. The possibilities are endless, we could write a grammar for Klingon and make the first automated Japanese -&gt; Klingon translation! Who knows!</p> <p>So, with that out of the way, let's get going!</p> Fri, 02 May 2014 00:00:00 +0000 https://vgel.me/posts/pwd_command_xv6/ https://vgel.me/posts/pwd_command_xv6/ <p>Xv6 is a fairly popular clone of Version 6 UNIX. It was made by MIT as a base for students to work off of, as the original V6 UNIX was showing it's age, and only ran on the outdated PDP11 architecture. Xv6 runs natively on x86, and supports modern features like SMP, while still being only 15k lines of easily-grokked C.</p> <p>As a simple example, we're going to add the <code>pwd</code> command to xv6. <code>pwd</code> prints the shell's current working directory. To do this, we'll need to write the <code>getcwd</code> system call, and also write the <code>pwd</code> userspace program.</p> Fri, 21 Feb 2014 00:00:00 +0000 https://vgel.me/posts/patching_function_bytecode_with_python/ https://vgel.me/posts/patching_function_bytecode_with_python/ <p>Note to start off: this entire article is written with Python 3.x. It may, or may not work with 2.x. You can also access this article as an iPython notebook <a href="./patching_function_bytecode_with_python.ipynb">here</a>.</p> <p>Python is an amazingly introspective and hackable language, with a ton of cool features like metaclasses. One sadly unappreciated feature is the ability to not only inspect and disassemble, but actually programmatically modify the bytecode of Python functions from inside the script. While this sounds somewhat esoteric, I recently used it for an optimization, and decided to write a simple starter article on how to do it. (I'd like to warn that I'm not an expert in Python internals. If you see an error in this article please let me know so I can fix it).</p> Sun, 27 Oct 2013 00:00:00 +0000 https://vgel.me/posts/ive-migrated-my-blog-again/ https://vgel.me/posts/ive-migrated-my-blog-again/ <p>It seems I migrate my blog more than I update it, but I have once again. I got fed up with Heroku, and wanted a VPS for other projects anyways, so I bit the bullet, bought a VPS from Linode, and rewrote everything. I'm now using the amazing <a href="http://fabfile.org">fabric</a> library to statically generate my site and upload it to a VPS running nginx. I was even able to reuse most of my old code! Not that many people read this thing, but for the few who do, loading times shouldn't be &gt; 10 seconds anymore (Heroku's free tier is seriously terrible for low-traffic sites). Besides that, everything should be basically the same, except that I also improved the RSS feed to actually validate.</p> Thu, 08 Aug 2013 00:00:00 +0000 https://vgel.me/posts/setting-up-pyopenni-in-linux/ https://vgel.me/posts/setting-up-pyopenni-in-linux/ <p>I've had a Kinect for a while. I wrote a few interesting scripts with it, then forgot about it for a while. In between that time and now, I went through several OS upgrades that wiped away my changes. I decided I want to mess with it again, and had to reinstall OpenNI and the python extensions. This is a somewhat tricky process, so here's how it's done.</p> Wed, 24 Jul 2013 00:00:00 +0000 https://vgel.me/posts/packaging-jython-scripts/ https://vgel.me/posts/packaging-jython-scripts/ <p>There's a lot of outdated and just plain wrong information on the internet about packaging Jython scripts. After I wanted to start a project in Jython, I figured I should find a simple, easy way to package your app as an executable (i.e., double-clickable) <code>.jar</code>. Turns out, it's a lot easier than it seems.</p> Tue, 23 Jul 2013 00:00:00 +0000 https://vgel.me/posts/migrating-my-blog/ https://vgel.me/posts/migrating-my-blog/ <p>I've migrated my blog to my own custom platform. I won't write about why I did it, since I don't have a specific technical reason Blogger failed me. I simply wanted a bit more control over the platform, wanted a personal site on my own server anyways, and had a bit of an itch to scratch. But instead, I'll go over some of my technical and design choices and why I made them.</p> Fri, 31 May 2013 00:00:00 +0000 https://vgel.me/posts/cracking-word-searches-with-haskell/ https://vgel.me/posts/cracking-word-searches-with-haskell/ <p>After learning Haskell a few months ago, I've had disappointingly few opportunities to use it. For a simple data-crunch a python repl starts up faster and lets me work quicker, and many of my other projects require a specific language. So when I was browsing reddit and saw <a href="http://www.reddit.com/u/SWEAR_WORD_SEARCH">/u/SWEAR_WORD_SEARCH</a>, I thought it would be a fun, quick project to crack these in Haskell. (quick warning: if you didn't guess from the SWEAR_WORD part, this article contains some profane word searches ;-)</p> Sat, 11 Aug 2012 00:00:00 +0000 https://vgel.me/posts/fixing-network-list-duplication-with-nm-applet-on-linux/ https://vgel.me/posts/fixing-network-list-duplication-with-nm-applet-on-linux/ <p>I use XFCE in Ubuntu, and for a while used the default network applet built into the status bar. Eventually I wanted to get rid of it, since it had problems connecting to networks occasionally (I use a laptop and thus switch wifi networks often). Simply removing the status bar made XFCE replace it with <code>nm-applet</code>, which is much better. However, I was shocked to find over 500 network duplicates for one network (<code>network-name</code>, <code>network-name 1</code>, <code>network-name 2</code>, ..., <code>network-name 538</code>)! However, it's quite easy to delete this and other unused networks without manually clicking the name, then delete in <code>nm-connection-editor</code>.</p> <p>Standard disclaimer: I'm not responsible if you fuck up your system blah blah blah.</p> Wed, 11 Jul 2012 00:00:00 +0000 https://vgel.me/posts/ed-the-standard-editor/ https://vgel.me/posts/ed-the-standard-editor/ <p><em>Since some people aren't getting it, the beginning of this article is a joke. What editor you use isn't important! As long as it's ed.</em></p> <p>##Getting started with Ed - the standard editor Many modern programmers might laugh at ed. &quot;What a quaint editor&quot;! It doesn't have code completion! I can't load it with thousands of shitty plugins! It's name is only 2 letters! It's not written in hipster-script! Well, they're wrong. Ed is the standard text EDitor. It's on every Unix machine, ever! It doesn't waste your time with useless effects like cursors or showing you the current contents of the file. It's efficient! It's better! It's... ed!</p> Sat, 26 May 2012 00:00:00 +0000 https://vgel.me/posts/installing-and-using-freetts-in-java-on-linux/ https://vgel.me/posts/installing-and-using-freetts-in-java-on-linux/ <p>FreeTTS is a quite handy text-to-speech synthesizer that works in Java. It's also a bitch to install and use.</p> Fri, 18 May 2012 00:00:00 +0000 https://vgel.me/posts/so-started-a-blog/ https://vgel.me/posts/so-started-a-blog/ <p>Since proggit doesn't allow self posts I can stick my thoughts here and link them instead.</p>