I frequent Tumblr a lot, and during my time there I’ve gained an appreciation for the particular culture and quirks that Tumblr users have. In particular, I’ve noticed many different typing behaviors and patterns that occur in text posts that Tumblr users create. These posts are tagged with “#text post,” and can vary in subject matter from personal anecdotes, to insightful/funny quotes, moments of revelation over something, etc. I wanted to collect the text in these posts and see if I can create some sort of overarching Tumblr narrative out of them, possibly by analyzing common words/topics/tags/themes/phrases/sentence patterns that occur in these posts. I’m thinking some sort of interactive encyclopedia of the common Tumblr mannerisms that occur in these posts could be interesting. Either that, or a Tumblr bot which generates hopefully realistic text posts based on the patterns it observes in the collected posts.
I have another idea which I also scraped some data for and which I might do instead. It involves tracking posts with the tag “otp” (short for one-true-pairing). Tumblr users often pair or “ship” fictional characters together, draw fanart for these pairings, etc. I was thinking of exploring this peculiar hobby by doing an analysis on which of these pairings is most popular among Tumblr users. However, I think I would have to narrow it down to otp’s from one fictional universe, since collecting data for all otp’s is kind of overwhelming, since you need to parse out the names of the otp’s in the tags/posts and that is hard to do for every fandom ever.
Code:
public class HelloTemboo {
public static void main(String[] args) throws Exception {
// Instantiate the Choreo, using a previously instantiated TembooSession object, eg:
TembooSession session = new TembooSession("sakski", "myFirstApp", "key");
RetrievePostsWithTag retrievePostsWithTagChoreo = new RetrievePostsWithTag(session);
// Get an InputSet object for the choreo
RetrievePostsWithTagInputSet retrievePostsWithTagInputs = retrievePostsWithTagChoreo.newInputSet();
// Set inputs
retrievePostsWithTagInputs.set_APIKey("key");
retrievePostsWithTagInputs.set_Tag("text post");
// Execute Choreo
RetrievePostsWithTagResultSet retrievePostsWithTagResults = retrievePostsWithTagChoreo.execute(retrievePostsWithTagInputs);
// Parse JSON response using org.json
JSONObject results = new JSONObject(retrievePostsWithTagResults.get_Response());
// Get items array
JSONArray items = results.getJSONArray("response");
for(int i = 0; i < items.length(); i++) {
JSONObject item = items.getJSONObject(i);
System.out.println(item);
}
}
}
Here’s some of my data from the first idea:
{“date”:”2015-01-27 10:18:19 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:null,”body”:”<p>Oh my god, my WiFi cut off for like an hour or so, and I thought I was going to die. ORZ<\/p>”,”tags”:[“Text post”,”My post”,”=’C”,”I’m so dependent on the Internet it’s not even funny…”,”/weeps”],”short_url”:”http://tmblr.co/ZBjMQx1bo9TUr”,”post_url”:”http://brumalbreeze.tumblr.com/post/109289265077/oh-my-god-my-wifi-cut-off-for-like-an-hour-or-so”,”id”:109289265077,”state”:”published”,”blog_name”:”brumalbreeze”,”slug”:”oh-my-god-my-wifi-cut-off-for-like-an-hour-or-so”,”note_count”:0,”timestamp”:1422353899,”reblog_key”:”YgZ8ewFo”}
{“date”:”2015-01-27 10:16:46 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:null,”body”:”<p>true friendship is trading a pidgey for an arceus<\/p>”,”tags”:[“pidgey”,”arceus”,”pokemon”,”friendship”,”text post”],”short_url”:”http://tmblr.co/Z5WaJy1bo9ImZ”,”post_url”:”http://carbink.tumblr.com/post/109289221155/true-friendship-is-trading-a-pidgey-for-an-arceus”,”id”:109289221155,”state”:”published”,”blog_name”:”carbink”,”slug”:”true-friendship-is-trading-a-pidgey-for-an-arceus”,”note_count”:4,”timestamp”:1422353806,”reblog_key”:”eStwvD28″}
{“date”:”2015-01-27 10:12:48 GMT”,”highlighted”:[],”format”:”html”,”type”:”chat”,”title”:null,”body”:”My brother: Wanna hear something that’ll make you cry?\nMe: ….sure\nMy brother: School.”,”tags”:[“school”,”fml”,”so tru”,”text post”,”relatable”],”short_url”:”http://tmblr.co/Z__OCt1bo8scj”,”post_url”:”http://therandompandah.tumblr.com/post/109289105837/my-brother-wanna-hear-something-thatll-make-you”,”dialogue”:[{“phrase”:”Wanna hear something that’ll make you cry?”,”name”:”My brother”,”label”:”My brother:”},{“phrase”:”….sure”,”name”:”Me”,”label”:”Me:”},{“phrase”:”School.”,”name”:”My brother”,”label”:”My brother:”}],”id”:109289105837,”state”:”published”,”blog_name”:”therandompandah”,”slug”:”my-brother-wanna-hear-something-thatll-make-you”,”note_count”:2,”timestamp”:1422353568,”reblog_key”:”BSRThf8E”}
{“date”:”2015-01-27 10:09:14 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:null,”body”:”<p>I most certainly should not be allowed to have my phone after midnight because I do not make good decisions and do things like hit up a bunch of people on Tinder.<\/p>”,”tags”:[“text post”,”personal”,”someone please take the internet away from me”,”it’s bad”,”tinder”],”short_url”:”http://tmblr.co/ZfOdvl1bo8R6p”,”post_url”:”http://pwentx.tumblr.com/post/109288993203/i-most-certainly-should-not-be-allowed-to-have-my”,”id”:109288993203,”state”:”published”,”blog_name”:”pwentx”,”slug”:”i-most-certainly-should-not-be-allowed-to-have-my”,”note_count”:0,”timestamp”:1422353354,”reblog_key”:”H760QPNd”}
{“date”:”2015-01-27 10:09:01 GMT”,”highlighted”:[],”format”:”html”,”type”:”chat”,”title”:”Getting sick one day before exam”,”body”:”me: God, I feel awful.\r\nmy brain: maybe you’re just pretending.\r\nme: I feel dizzy and sick, I can’t eat or read…gah.\r\nmy brain: But what if…you’re just pretending?\r\nme: What if, I am?”,”tags”:[“thank you brain”,”text post”,”me”,”sick”,”exam”,”finals”,”cold”,”being sick”,”brain”,”conversation with my brain”,”study time”],”short_url”:”http://tmblr.co/Z3e9es1bo8Pww”,”post_url”:”http://sayhellonana.tumblr.com/post/109288988346/getting-sick-one-day-before-exam”,”dialogue”:[{“phrase”:”God, I feel awful.”,”name”:”me”,”label”:”me:”},{“phrase”:”maybe you’re just pretending.”,”name”:”my brain”,”label”:”my brain:”},{“phrase”:”I feel dizzy and sick, I can’t eat or read…gah.”,”name”:”me”,”label”:”me:”},{“phrase”:”But what if…you’re just pretending?”,”name”:”my brain”,”label”:”my brain:”},{“phrase”:”What if, I am?”,”name”:”me”,”label”:”me:”}],”id”:109288988346,”state”:”published”,”blog_name”:”sayhellonana”,”slug”:”getting-sick-one-day-before-exam”,”note_count”:0,”timestamp”:1422353341,”reblog_key”:”BsOalPTL”}
{“date”:”2015-01-27 10:07:37 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:”She has a shitty personally and the face to match.”,”body”:””,”tags”:[“personal”,”lol”,”text post”],”short_url”:”http://tmblr.co/ZyP1gw1bo8FmA”,”post_url”:”http://zombehh512.tumblr.com/post/109288946698/she-has-a-shitty-personally-and-the-face-to-match”,”id”:109288946698,”state”:”published”,”blog_name”:”zombehh512″,”slug”:”she-has-a-shitty-personally-and-the-face-to-match”,”note_count”:0,”timestamp”:1422353257,”reblog_key”:”79dhQvaa”}
{“date”:”2015-01-27 10:05:49 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:”Hmm, might have to buy Guild Wars 2 on payday! “,”body”:”<p>Now that there’s a Beta version for Mac users. :)<\/p>”,”tags”:[“Non-Sims”,”Text post”,”Guild Wars 2″],”short_url”:”http://tmblr.co/ZrDOUw1bo83Jv”,”post_url”:”http://beautifulplumbobs.tumblr.com/post/109288895737/hmm-might-have-to-buy-guild-wars-2-on-payday”,”id”:109288895737,”state”:”published”,”blog_name”:”beautifulplumbobs”,”slug”:”hmm-might-have-to-buy-guild-wars-2-on-payday”,”note_count”:6,”timestamp”:1422353149,”reblog_key”:”wike22eL”}
{“date”:”2015-01-27 10:05:48 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:null,”body”:”<p>Teen Beach Movie is actually the greatest ever and someone needs to buy me the soundtrack.<\/p>\n\n<p>Regardless of the fact that it’s literally Hairspray, Cry Baby, Fat Albert, and Grease all in one.<\/p>”,”tags”:[“personal”,”text post”,”disney channel”,”teen beach movie”,”maia mitchell”,”ross lynch”,”disney”],”short_url”:”http://tmblr.co/Z45Iiw1bo83Fj”,”post_url”:”http://radicalshmatical.tumblr.com/post/109288895469/teen-beach-movie-is-actually-the-greatest-ever-and”,”id”:109288895469,”state”:”published”,”blog_name”:”radicalshmatical”,”slug”:”teen-beach-movie-is-actually-the-greatest-ever-and”,”note_count”:0,”timestamp”:1422353148,”reblog_key”:”yLQ7vlyb”}
{“date”:”2015-01-27 10:05:41 GMT”,”highlighted”:[],”format”:”html”,”caption”:””,”type”:”photo”,”photos”:[{“caption”:””,”alt_sizes”:[{“width”:500,”url”:”https://41.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_500.jpg”,”height”:621},{“width”:400,”url”:”https://40.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_400.jpg”,”height”:497},{“width”:250,”url”:”https://36.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_250.jpg”,”height”:311},{“width”:100,”url”:”https://41.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_100.jpg”,”height”:124},{“width”:75,”url”:”https://40.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_75sq.jpg”,”height”:75}],”original_size”:{“width”:500,”url”:”https://41.media.tumblr.com/e73387980746585fce92cf50bd6c50bb/tumblr_nitypheE531rmq5mgo1_500.jpg”,”height”:621}}],”tags”:[“text”,”text post”,”amazing”,”love you”],”short_url”:”http://tmblr.co/ZZIRgt1bo82Hs”,”post_url”:”http://withclassylife.tumblr.com/post/109288891510″,”image_permalink”:”http://withclassylife.tumblr.com/image/109288891510″,”id”:109288891510,”state”:”published”,”blog_name”:”withclassylife”,”slug”:””,”note_count”:0,”timestamp”:1422353141,”reblog_key”:”o09mBNrf”}
{“date”:”2015-01-27 10:04:42 GMT”,”highlighted”:[],”format”:”html”,”type”:”text”,”title”:null,”body”:”<p>I\u2019m awake early in the morning! I need more blogs to follow! like this and I\u2019ll check you out!<\/p>”,”tags”:[“follow”,”follow for follow”,”like this”,”text post”,”new blogs”,”followers”,”morning”,”like”,”follow me”],”short_url”:”http://tmblr.co/Zr3RTx1bo7xJN”,”post_url”:”http://itsonlynoon.tumblr.com/post/109288862935/im-awake-early-in-the-morning-i-need-more-blogs”,”id”:109288862935,”state”:”published”,”blog_name”:”itsonlynoon”,”slug”:”im-awake-early-in-the-morning-i-need-more-blogs”,”note_count”:0,”timestamp”:1422353082,”reblog_key”:”fMAm0ann”}
