As an applied machine learning engineer (aka hacker 👨💻 aka flying ninja 🐱👤), I’m consistently looking for better and faster ways to stay on top of the deep learning and software development circuit. After comparing various sources for research, code, and apps. I’ve discovered that a significant amount of awesome NLP code is not on arXiv and not all NLP research is on GitHub. To obtain a wider scope of current NLP research and code, I’ve created the NLP Index! A search-as-you-type search engine containing over 3,000 NLP repositories (updated weekly) 🔥. …
In previous releases of the NLP Cypher, I’ve signaled my desire for cryptic clues and puzzles as reasoning challenges for NLP models to chew on. The rationale being that if NLP models can come close to human performance on a task that requires n-order logic to solve, a new avenue in performance could be opened other than merely pattern recognition of syntax (which is the current hack of SOTA language models).
A new paper this week delivered a new dataset full of cryptic crossword (not to be confused with a traditional crossword puzzle) clues and benchmark results using the T5…
Hey Welcome Back! We have a nice surprise in store for everyone. At Quantum Stat, we built an NLP model fine-tuning platform called Imperium! We are really excited to release it after so much hard work we put in.
One small step for man…
One giant leap for monkeys playing pong with their mind…
Welcome back. This week we have a good one for you. But first… Neuralink, Elon Musk’s brain chip company, implanted a chip in a monkey’s skull so it could play pong wirelessly. Winning! And if you’re the type to create the next level Star Trek tech, they have open positions available. 🙉
Excited to announce that the Graphbrain library had a major update this past week. It now includes a more extensive documentation with tutorials and notebooks for quick experimentation.
Graphbrain is a…
Hey, Welcome Back! This is probably a good time to take you down the rabbit hole on the state of the Super Duper NLP Repo (SDNR)😎 .
If this is your first time hearing about the SDNR, it’s a handy repository of more than 300 Colab notebooks (and counting) focusing on natural language processing (NLP). Colab is essentially a Jupyter notebook that one can use and share via a web-based kernel. The best part of these notebooks, is that you can use a free GPU, usually a K80 or a T4 or even a TPU (if you are feeling dangerous)…
Hey Welcome Back. A lot of things happened in the past 24 hours! Well first, Alon Gal, a cybersecurity dude, who we first mentioned many months ago on the Cypher regarding his tweet mentioning a humongous bitcoin wallet that hackers were attempting to crack on the dark web, well he’s back. And this time, his tweet went viral. A vulnerability on Facebook (patched in 2019) exposed 533 million Facebook users worldwide(32,126,812 based in the US). Metadata such as phone numbers, emails, names, and other things were exposed. Initially the data was being traded on the dark web, but as of…
In the 02.21.21 newsletter, we highlighted EleutherAI’s ambitions for building an open-sourced version of the uber large GPT-3 175B param model. And this week, they released two versions in the sizes of 1.3B and 2.7B params as a stepping stone towards paradise. Here’s how the current GPT models stack up. 👇
Hey, welcome back! Let’s kick off the newsletter with a lucid sonic dream from a very crafty GAN 😵🍄. But wait, what is that exactly? For direct experience check out the video below. TL;DR: a savvy dev trained a GAN to generate acid-trip art that transitions in sync with music. This isn’t NLP related but hey, still cool! Here’s the library, it runs on TF-v1, now go get a wav file and play some Pink Floyd:
If you enjoy this read, please give it a 👏👏 and share with friends… 😎
pip install tf-transformers
Just when you…
Happy Pi Day!
Let’s talk about “Cryptonite: How I Stopped Worrying and Learned(?) to Love Ambiguity”
Cryptonite is a cryptic clue, a short phrase or sentence with a misleading surface reading, whose solving requires disambiguating semantic, syntactic, and phonetic wordplays, as well as world knowledge.
Hey Welcome back! Had a loooong weekend of busy busy, so this week’s NL will be less wordy than usual, but we’ll be back to normalcy next week.
Oh and by the way,
Maybe… the universe is just a giant neural network… 🤷♂️
At least that’s the new theory out of MIT. FYI, it sounds eerily similar to Stephen Wolfram’s graph approach to physics.
The only question I have is, who’s running the compute? 🤷♂️
FYI, we added 25 new notebooks to the Super Duper NLP Repo!! 👇
OpenChat is an awesome repo where one can interact with top…