The Downfall of Twitter from Behind the Scenes

Aug 14, 2023

Twitter is a very useful social media platform that I use a lot. I rarely look at my Facebook or Instagram; usually, I have hundreds of notifications piled up. But Twitter is a great platform to quickly check in real time if others are experiencing the same service outage as you, or to gather information (for example, seeing how great web3 is doing thanks to Molly White).

So Elon Musk probably smoked too much pot and started blabbering about buying Twitter. He made a knee-jerk price offer that he quickly realized was wildly inflated and tried to back out of the binding agreement for various trumped-up reasons. Eventually, he was forced to go through with the transaction, and shortly after October 26, 2022, Elon Musk walked into the San Francisco Twitter HQ carrying a sink, orchestrating a visual pun of “let that sink in”. Unfortunately, everything else in this blog post is not funny.

Twitter had a tremendous amount of debt, and Elon’s biggest task was trying to fix the finances. As one cost-saving measure, he fired over 80% of Twitter employees. Eighty percent—let that sink in. This probably left barely enough employees to keep the business operational. I have a hunch he counted on people working overtime, as at his other companies like Tesla, SpaceX, or Neuralink. During one period at Tesla, Musk famously slept in the manufacturing facilities trying to increase Model 3 production rates. I have serious reservations about how much work-life balance anyone could find when that is the example being set. I work for two startups and appreciate the startup grind, but as a team lead, I strongly discourage any of my team members from working overtime because it’s not sustainable: it leads to burnout and declining productivity. But the main reason is that I want my employees to be fulfilled, happy, and balanced.

Along those lines, there were also plans to convert part of the San Francisco HQ into a hotel, or some office rooms into living quarters for employees. That’s another move that would actually be handy if I were a developer there, but yet again catastrophic for work-life balance. Since we are talking about buildings, I must mention that Elon Musk pulled some despicable and low-blow moves: he simply doesn’t pay rent for the New York, London, and San Francisco locations. I understand the lawyers’ characterization of San Francisco’s deterioration; however, if someone doesn’t like a location, they should relocate instead of refusing to pay rent. Musk already moved some of his companies’ headquarters to Texas. It’s pretty irresponsible not to pay, because that not only puts the landlord in a pickle, but also causes a chain reaction. Large companies like Allianz behind some of the property trusts needed to be bailed out with huge bank loans to survive Musk’s move.

Firing employees and not paying rent only decreases the spending side of the equation; there’s also a need to increase business income. This is the part I had the opportunity to watch up close, since Sportsboard—where I’m the Director of Product Engineering—relies heavily on Twitter to gather signals. A recruiting chunk of the business revolves around prospective high school athletes who are desperately seeking athletic scholarship offers from colleges. It’s a convention that athletes advertise their stats on Twitter and tweet whenever they get an offer from a college. They also tweet about their selection process and finally their choice of college. Sportsboard knows the Twitter handles of prospective athletes and checked four times a day to see if any of them had new offers. These reads were API calls, and we could get away with the free pricing tier in the past. But then came Elon Musk.

I won’t even go into details such as how the v2 API doesn’t have all the functionality of v1.1. That is almost a nonissue compared to the pricing debacle. Understandably, Twitter needed money to patch gigantic budget holes. However, the way Musk went about it was in his signature dorky style (completely detached from reality). To better understand what happened, here is an analogy: if Twitter were an airline, imagine these were the ticket types (the new pricing tiers):

  • Free: you carry your luggage and run on the ground behind the airplane—completely unrealistic
  • Basic: for $100, you cannot have any luggage and you hang off the wheels of the airplane—still pretty useless
  • Enterprise: for $42,000, you can rent the whole plane out—absolutely unaffordable

I’m not kidding; read the referenced article about this. This didn’t fit anyone’s needs; 99.99% of companies cannot afford the exorbitant Enterprise access level, which was the only one that contained enough rate limits even for grandma reading Twitter. Even companies that are big enough to afford the Enterprise tier were fed up: Microsoft gave the middle finger to this lunacy. It’s eye-watering to read that above the $42,000 monthly price, there are also $125,000 and $210,000 tiers. The Yahoo article states that many businesses “suspend their Twitter integration projects”.

There was only one option left to deal with such incompetence: web scraping. Immediately after seeing the pricing tiers, I predicted that many developers’ only choice would be to resort to web scraping. Web scraping is finicky, ugly, unstable, and almost like black magic. I truly hate web scraping from the bottom of my heart, and the new pricing tiers caused me several months of grief I’ll NEVER EVER forget.

Scraping is slower than a pure data API request (thus bad for the client, besides being finicky and unstable), and on the other hand, it’s detrimental to Twitter as well because it puts ten times more pressure on the backend than a simple API request: instead of just handing over data, the React web framework works tirelessly to stitch together a page, inject advertisements, and add all kinds of fluff, only to hand that over to a bot that will strip it back down and consume it. It’s all-around bad.

It would be in everyone’s best interest to provide reasonable pricing tiers. I can imagine how Elon Musk saw the size of the budget hole and tasked analysts with querying API subscriber numbers and activity. I truly want to believe that sane Twitter marketing people pleaded with Musk on their knees not to impose tiers that are completely out of touch with reality. But when you have an overinflated ego and are out of touch with reality, surrounded by yes-men (who didn’t want to be fired along with the other 80%), you ignore warnings and, like a petulant child, just go ahead with a bad decision.

My prediction came true, and Twitter must have gotten the memo because after some time, a new access tier appeared. Now the imaginary airline had these tickets:

  • Free: you carry your luggage and run on the ground behind the airplane
  • Basic: for $100, you cannot have any luggage and you hang off the wheels of the airplane
  • Pro: for $5,000, you pay for a first-class seat, but the rate limits are still ‘meh’: you still cannot bring any luggage, and you are nickel-and-dimed at every turn. This means that the rate limits are still way lower than the old FREE tier!!!
  • Enterprise: for $42,000, you can rent the whole plane out

Notice that the coach ticket that everyone craves is still missing! What kind of marketing minds are behind this? I don’t have a marketing degree, but I can tell you FOR SURE, without a doubt, that the pricing structure is broken. I tried to contact Twitter’s sales department (hunting for phone numbers, browsing Developer Forums, filling out forms) to no avail. All I want is a coach ticket. This would result in more income for Twitter; it would be in their best interest as well. But Elon Musk’s style is a poop emoji instead of reason.

All the scraping and tier adjustments foreshadowed trouble, but I could not have predicted one thing: that this whole swirling mess would reach Twitter’s end users! End users might have already noticed that some indicator accounts and services were no longer operating, greatly decreasing the value and usefulness of the platform. But Elon Musk’s next step was unbelievable: he limited the number of tweets read by a person to 600 a day! The stated reason behind the move was high scraping activity. Elon Musk speculated that AI companies were scraping data to train their large language models, but I’m confident that practically every non-billionaire developer simply had to resort to scraping, which caused the “surprising” scraping uptick. End users knew nothing about these behind-the-scenes struggles and were left dumbfounded.

This helped fuel signups for Meta’s new Threads platform, and Elon Musk yet again acted like a petulant child about that. As for Sportsboard, I’d want to pay for something in between Basic and Pro (say, $250/month with reasonable rate limits, at least matching what they offer with the $5,000 tier), but Twitter offers no such option. We are moving away and gathering information from other sources.

Transforming Twitter into an “everything app” like WeChat in China is an ambitious vision; however, after firing 80% of the developers, it’s guaranteed that there aren’t enough engineering resources to execute a complete overhaul like that. WeChat’s key feature is that it’s also a payment platform, which requires an entirely different set of competencies: financial expertise, specialized security, and banking compliance (to name a few). And as long as there isn’t any half-reasonable API tier pricing, there won’t be any uptick in developer revenue—the whole platform will just sink into oblivion. The other—more significant—source of income is advertising, but that was sabotaged as well: Elon flat out told advertisers to go F themselves. Seriously, for real, I’m not joking.

Elon Musk undoubtedly has some great ventures, but when your ego is inflated to hot-air balloon proportions, you become so draconian that people walk on eggshells around you, and you are effectively surrounded by yes-men (even if you don’t recognize or admit it)—combined with too many drugs, stubbornness, and detachment from reality—this is a recipe for disaster. I’m very sad about Twitter. It was a great platform, and while destroying its reputation might take years, that unraveling is happening right now.

Comments loading...