Everyone seems to be speaking and tweeting about AI. You’ve most likely heard all of it at this level: AI can assist you write higher. AI can assist you tweet sooner. AI is coming on your job (let’s simply put that idea to relaxation — AI is a instrument, not a alternative).
However can AI assist your social captions carry out higher?
As a busy social media marketer, something that guarantees to make the content material creation course of simpler and sooner is interesting. However we wished to search out out if utilizing AI really impacts engagement and attain, particularly on Twitter.
Do human-written captions have higher engagement and attain than AI-written ones? Does the Twitter algorithm penalize tweets written by AI? I ran an experiment to search out out.
Coming quickly 👀
Huge information! An AI caption author for Instagram, Fb, Twitter, and LinkedIn powered by ChatGPT is coming to Hootsuite. Be a part of our mailing listing and be one of many first to know extra.
Speculation: Human-written Twitter captions will get extra engagement and attain than AI-written captions
Our educated guess is that human-written Twitter captions will get extra engagement and attain than ones written by AI.
Twitter is a conversational platform. Individuals love tweets with a transparent voice, and Twitter customers love participating with different people. We suspect folks received’t be drawn to a tweet that doesn’t sound prefer it got here from a human.
However would folks actually know if a tweet was written by AI or not? And in that case, how would that affect attain and engagement?
Let’s discover out.
However first, a caveat: Currently, the instrument we used for this experiment, doesn’t declare to be a alternative for a human author. The instrument is supposed for use in collaboration, so we’re positively taking a couple of liberties right here.
Methodology
To check whether or not human-written Twitter captions generate extra engagement and attain than AI-written ones, I shared three units of tweets on my private Twitter account. Every set of tweets used the identical format so that they may very well be pretty in contrast.
For this experiment, I posted two tweets that had been textual content solely, two tweets that included a hyperlink, and two tweets with a visible.
To compose the AI-generated tweets, I used Currently, a instrument that repurposes long-form content material into bite-sized social captions.
(You possibly can join the Currently app with Hootsuite to finalize, schedule, and auto-publish your posts proper inside your Hootsuite dashboard)
To get began, you submit a chunk of content material like a weblog submit or a podcast into the generator.
It’ll then analyze the content material and generate captions so that you can assessment and edit. After you edit, you’ll be able to ship them on to Hootsuite to be scheduled.
Some issues to recollect about Currently and every other AI-powered content material creation instruments: First, you need to prepare it. For AI instruments to generate content material that sounds essentially the most such as you or your model, they’ve to know your voice, content material, and viewers. That is why Currently asks you to submit a long-form piece earlier than it will probably generate captions.
One other factor to notice about AI-generated content material is that it nonetheless must be edited by a human.
After Currently comes up with tweets based mostly on the content material you submitted, you’ll be able to edit them for voice, readability, and context. Currently then makes use of these insights to create higher content material the following time. The extra you employ it, the extra it’ll begin to sound like one thing that your model would really submit.
As soon as I had my human-written captions created, I used Hootsuite’s Currently integration to generate comparable tweets utilizing the identical long-form items of content material. I then drafted them in Hootsuite and used the really useful posting time function to get them scheduled.
Outcomes
I checked the efficiency of every tweet about 24 hours after I posted (the Twitter lifecycle strikes quick). Listed below are the outcomes:
| Tweet | Human-written caption engagement charge | AI-written caption engagement charge |
|---|---|---|
| Textual content-only tweet | 14.14% | 4.06% |
| Tweet with hyperlink | 8.47% | 7.5% |
| Tweet with visible hyperlink | 5.71% | 2.22% |
I compiled the engagement charge for every tweet as an summary of how they carried out. I’ll dig into particular metrics for each beneath.
Tweet #1: Textual content-only tweet
Since I’m utilizing Currently’s AI instrument for this experiment, I needed to concentrate on paraphrasing long-form items of content material for these captions.
Right here is the primary tweet I wrote for this experiment. For this tweet, I paraphrased a quote I contributed to an article about freelance work routines.
And listed here are the outcomes of this tweet, based on Hootsuite Analytics. It generated an engagement charge of 14.14%, 28 whole engagements, and 198 impressions.
So far as the type goes, it is a regular tweet for me. I like so as to add voice by means of asterisks, and I’m a sucker for utilizing parentheses in my writing. Parenthetical statements (statements that qualify or make clear one thing and normally have a set of parentheses round them) are a good way to speak further data and supply extra context (see what I did there?). Plus, sentences with parentheses simply add that further human ingredient should you ask me.
All that to say, after I had the AI generate an analogous tweet from the identical article, I didn’t edit it so as to add my common human touches as a result of I wished to see the way it’d carry out by itself.
Listed below are the outcomes of the AI-generated caption. It generated an engagement charge of 4.06%, 5 whole engagements, and 123 impressions.
For this primary tweet comparability, the human-written caption carried out higher. Is that due to the shortage of parentheses? Possibly, however most likely not.
There are a couple of components that would’ve influenced this tweet’s efficiency, so let’s strive once more with one other kind of tweet.
Tweet #2: Tweet with hyperlink
For my subsequent comparability, I wished to see how a tweet with a hyperlink would carry out. I paraphrased an article I wrote about sorts of profession paths for individuals who work in content material advertising (particularly freelance vs. full-time roles).
Right here is the tweet I wrote:
With all of the job uncertainty many are going through currently, this text I wrote for @superpathco seems like a well timed reminder.
Freelancing does not must be an all-or-nothing transfer! Many people I spoke to for this piece do it on the aspect or in between jobs. https://t.co/EI8rePLBuS
— Sam Lauron (@Sam_Lauron) February 8, 2023
And listed here are the outcomes of this tweet. It generated an engagement charge of 8.47%, 32 whole engagements, and 378 impressions.
This tweet included a hyperlink to the article and a point out of the model I wrote it for. This tweet had higher attain than my final, and I believe it’s because the model I discussed quote retweeted it. I checked Twitter’s native analytics for extra metrics, and this tweet acquired 21 element expands and 5 hyperlink clicks. Fascinating!
For the AI-written caption, I had Currently paraphrase the identical article and generate a tweet for it. It additionally included the hyperlink and a point out (which I had so as to add), however I didn’t change something in regards to the textual content that it generated.
“It is good to know freelancing is there in case my profession ever takes me down that path once more!” It is not unusual for FT content material entrepreneurs to tackle freelance work on the aspect or transition between FT and freelance all through their careers. @superpathco
— Sam Lauron (@Sam_Lauron) February 16, 2023
Listed below are the ultimate outcomes from that tweet. It generated a 7.5% engagement charge, 6 whole engagements, and 80 impressions. I additionally checked out Twitter’s analytics for this tweet and it acquired one element develop and two hyperlink clicks.
My human-written tweet outperformed the AI-generated one for this spherical. Whereas the engagement charge was about the identical, the tweet I wrote acquired over 4 occasions as many impressions, seemingly as a result of it acquired retweeted.
Would the AI-generated caption have carried out higher if it had additionally been retweeted? Possibly. Would it not have acquired extra hyperlink clicks if it had extra attain? Maybe. However you possibly can additionally argue that it wasn’t retweeted or clicked on as a lot as a result of the caption itself wasn’t as participating.
Let’s do another take a look at.
Tweet #3: Tweet with visible hyperlink
For my remaining tweet comparability, I wished to incorporate one thing visible to see how that made an affect on engagement and attain. I used two articles I’ve written for Hootsuite for comparability. (Once more, since I’m utilizing Currently for this experiment, the tweets needed to be based mostly on a long-form piece of content material).
Every of them has an analogous thumbnail picture and would seem equally within the feed. Plus, each articles cowl an analogous subject — social accessibility — so the content material may very well be pretty in contrast.
Right here’s the primary tweet I shared with a caption that I wrote.
When you’ve labored in social media in the previous couple of years, you already know that digital accessibility and inclusivity are high priorities.
In my newest for @hootsuite I share why Fb alt textual content is one technique to make your content material extra accessible and discoverable. https://t.co/huQ5AksuCg
— Sam Lauron (@Sam_Lauron) February 9, 2023
And right here’s the way it carried out:
This tweet generated a 5.71% engagement charge, 8 whole engagements, and 140 impressions. It acquired a few likes and one remark. Based on Twitter’s native analytics, this tweet additionally acquired one hyperlink click on and 5 element expands.
I had Currently generate a tweet for an additional article I wrote on an analogous subject about TikTok auto captions. I ought to observe that the AI paraphrased the article for the primary a part of the tweet, however I had so as to add the second line for some context and to incorporate the point out as my first tweet did.
Need extra folks to devour your TikTok movies? Make the viewing expertise as accessible and pleasing as doable by including auto captions.
Learn extra about auto captions in my first article for @hootsuite: https://t.co/JhSjH0TQ0g
— Sam Lauron (@Sam_Lauron) February 13, 2023
Listed below are the outcomes from this tweet:
Total, this tweet didn’t carry out nice. It hardly had any attain or engagements — no likes, feedback, retweets, or hyperlink clicks. Nevertheless it did get a few element expands.
As soon as once more, the human-written tweet outperformed the AI-generated textual content.
What do the outcomes imply?
Finally, all of my human-written tweets carried out higher than the AI-written captions. I admittedly don’t have a big following on my private Twitter account, so none of those metrics are too thrilling. However I do assume they exhibit (on a really small scale) that extra human-sounding tweets resonate higher on the platform.
Listed below are a few of my takeaways from this experiment:
AI-written captions is usually a time saver
I’ll be trustworthy: I could also be a author, however it takes me an embarrassing period of time to jot down a tweet — particularly one which paraphrases an extended article. I used to be amazed at how rapidly the AI instrument was in a position to give you captions, even when they weren’t publish-ready.
Whether or not writing comes naturally to you or not, arising with inventive captions each week takes time and vitality away out of your different duties, like strategizing or participating with followers. So when it’s your job to jot down dozens of social captions on any given day or week, utilizing an AI instrument can prevent a whole lot of time.
A instrument like Currently is very useful should you use Twitter to share long-form content material like weblog posts. This instrument can create dozens of captions from one piece, which suggests you’ll be able to have a month’s work of Twitter captions created in a matter of minutes.
AI-written captions nonetheless want a human contact
Since Currently generated dozens of captions for every article I gave it, there have been a ton of captions that didn’t make the lower. A few of them had been first rate, however others had been simply plain complicated and would’ve wanted a whole lot of modifying.
When you use a instrument to generate captions, you’ll nonetheless must assessment and edit them, a minimum of to start with — particularly so as to add voice.
AI instruments normally don’t perceive the total context of a tweet and don’t know your model voice proper off the bat. Most AI instruments have to be skilled to higher perceive what you need them to do and to get your model’s tone proper. It could actually take time for these instruments to catch on, however the extra you employ them and tweak what they write, the extra they may adapt.
So far as whether or not or not AI-written captions straight affect attain? The jury’s nonetheless out. In my experiment, all of my human-written captions had higher attain than the AI-written ones, however that would’ve been as a result of the content material itself resonated extra. It’s exhausting to say if the platform knew the AI-written tweets had been, in actual fact, written by AI. But when I needed to guess, I’d say that Twitter doesn’t penalize you for utilizing AI to jot down your captions.
Finally, should you’re going to make use of AI to jot down Twitter captions, consider them extra as a place to begin. You’ll have to make use of your social experience to make them participating and publish-ready, however you’ll be able to knock them out a lot sooner than should you had been ranging from scratch.
Save time through the use of Hootsuite to handle your Twitter presence alongside your different social channels. You possibly can run contests, share movies, schedule posts, and monitor your efforts — all from one handy dashboard! Attempt it free of charge at present.
Do it higher with Hootsuite, the all-in-one social media instrument. Keep up to the mark, develop, and beat the competitors.
