Skip to content

Commit

Permalink
updates
Browse files Browse the repository at this point in the history
  • Loading branch information
infominer33 committed Jun 18, 2019
1 parent 5806aba commit 809760d
Show file tree
Hide file tree
Showing 4 changed files with 106 additions and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/2019-02-24-github-pages-starter-pack.md
Original file line number Diff line number Diff line change
Expand Up @@ -327,7 +327,7 @@ I'm wondering if I can move these documentation theme layouts, or even this post

Use `redirect_from: internal/url` to change the location you are publishing, but keep old links.
Use `redirect_to: https://external.url` to send visitors somewhere else (perhaps you want it to live on another site, but not lose your valuable links :)
{: .notice--info}
{: .notice }



Expand Down
105 changes: 105 additions & 0 deletions _posts/2019-06-17-exporting-tweet-histories.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
---
layout: post
title: "Mining, Exploring, Exporting: Creating Content CSV Tweet Histories"
description: "Export your tweets to CSV, filter in a spreadsheet and publish."
tags: [twitter, export, webpub, csv, data, jekyll]
categories: [content-creation]
image:
feature: twitter-export-csv.png
caption: [rob-murray/jekyll-twitter-plugin/](https://github.com/rob-murray/jekyll-twitter-plugin/) - A Liquid tag plugin for the Jekyll blogging engine that embeds Tweets, Timelines and more from Twitter API
thumb: /images/twitter-export-thumb.png
modified: 2019-06-18T22:22:22-23:00
excerpt: I was using re-tweets as a way to save information for future examination. I couldn't keep up, manually. Now will sort through it with a spreadsheet program, and collect info here.
redirect_from:
- export-tweets-csv/
permalink: content-creation/export-tweets-csv/

---

Around a year ago, I began retweeting all the most valuable information I found on twitter. Then, I would periodically scroll back and manually paste the links into the channels of a discord server, organized by category.

The problem with that, is if you are scrolling through your history, it has to load, and it's easy to miss that particualr tweet where I know I left off.

Eventually, I gave up. More recently, my workflow has become much more direct. When I see a valuable resource (typically via mobile on a smoke break), I click the share button and send it directly to it's appropriate channel.

I've found this to be quite an efficient solution, however... There's the matter of what about all those links I re-tweeted with intention to categorize, but never got around to.

**What do?**

# Export Tweets to CSV

So, this is the hard part. Finding a *free* app that will get as many tweets as you need.

For now, I know [vicinitas.io](https://www.vicinitas.io/free-tools/download-user-tweets) allows you to download up to 3200 tweets to csv, which was enough for me.

In the future, this page will fill with everything related to exporting and publishing content from twitter.

From there, I threw the CSV in Libre Office Calc (an ok free version of Excell). I was able to filter the 3200 tweets to include only those related to identity.

I am going to share more about how, exactly, I make the content from csv. In the meantime:

## Resources

This is a game changer! While searching for resources to add in this post, I found [rob-murray/jekyll-twitter-plugin](https://github.com/rob-murray/jekyll-twitter-plugin)!!!
{: .notice}

* [twitterdev/tweet-updates](https://github.com/twitterdev/tweet-updates) - This repository contains information about the updates to Tweet formats for attachments and simplified replies. -[developer.twitter.com - tweet updates](https://developer.twitter.com/en/docs/tweets/tweet-updates.html)
* [hridaydutta123/awesome-twitter-tools](https://github.com/hridaydutta123/awesome-twitter-tools)

## Twitter Related Gists
* [yanofsky/tweet_dumper.py](https://gist.github.com/yanofsky/5436496) - A script to download all of a user's tweets into a csv
* [arikfr/export_lists.py](https://gist.github.com/arikfr/58e491e0cdbe36a9e48c) - Simple script to export Twitter lists to CSV]
* [vickyqian/twitter crawler.txt](https://gist.github.com/vickyqian/f70e9ab3910c7c290d9d715491cde44c) - A Python script to download all the tweets of a hashtag into a csv

## Twitter GitHub Repos

* [kennethreitz/twitter-scraper](https://github.com/kennethreitz/twitter-scraper) - Scrape the Twitter Frontend API without authentication.
* [rtweet.info](https://rtweet.info)
* [mkearney/rtweet](https://github.com/mkearney/rtweet) - bird R client for interacting with Twitter's [stream and REST] APIs
* [mkearney/rtweet-workshop](https://github.com/mkearney/rtweet-workshop)
* [hrbrmstr/21-recipes]() - An R/rtweet edition of [Matthew A. Russell's Python Twitter Recipes Book](https://rud.is/books/21-recipes/)
* [twintproject/twint](https://github.com/twintproject/twint) - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
* [taspinar/twitterscraper](https://github.com/taspinar/twitterscraper) - Scrape Twitter for Tweets
* [AdrienGuille/TweetStreamer](https://github.com/AdrienGuille/TweetStreamer) - A command line tool for collecting tweets via Twitter's public streaming API
* [DocNow/twarc](https://github.com/DocNow/twarc) - A command line tool (and Python library) for archiving Twitter JSON
* [Jefferson-Henrique/GetOldTweets-python](https://github.com/Jefferson-Henrique/GetOldTweets-python) - A project written in Python to get old tweets, it bypass some limitations of Twitter Official API.
* [jennybc/scream](https://github.com/jennybc/scream) - Get replies and quotes of a tweet
* [snovvcrash/tweetlord](https://github.com/snovvcrash/tweetlord) - bird Twitter profile dumper (downloader) with authorization swapping
* [Datamine/Archive-Tweets](https://github.com/Datamine/Archive-Tweets) - Archive and Delete Liked and Posted Tweets


## Cross-posting
* [renatolond/mastodon-twitter-poster](https://github.com/renatolond/mastodon-twitter-poster) - Crossposter to post statuses between Mastodon and Twitter

## Bots - Code

* [freeCodeCamp/100DaysOfCode-twitter-bot](https://github.com/freeCodeCamp/100DaysOfCode-twitter-bot) - Twitter bot for #100DaysOfCode [@_100DaysOfCode](https://twitter.com/_100DaysOfCode)
* [bonzanini/Book-SocialMediaMiningPython](https://github.com/bonzanini) - Companion code for the book "Mastering Social Media Mining with Python
* [botwiki/botwiki.org](https://github.com/botwiki/botwiki.org) - Tutorials, articles, datasets and other resources for creating useful, interesting, artistic and friendly online bots.
* [huginn/huginn](https://github.com/huginn/huginn) - Create agents that monitor and act on your behalf. Your agents are standing by!

## Clean Feed

* [MikeMcQuaid/TwitterDelete](https://github.com/MikeMcQuaid/TwitterDelete) - Delete your old, unpopular tweets.

## Nerd Stuff

* [mattdodge/Tweet-2-RSS](https://github.com/mattdodge/Tweet-2-RSS)
* [vzqzac/twgitbot](https://github.com/vzqzac/twgitbot) - A node.js bot that checks a github repo changes and tweets it to your Twitter account
* [Kikobeats/fetch-timeline-cli]() - Fetch Twitter user's timeline from your terminal zap.
* [kikobeats.github.io/fetch-timeline-cli/](https://kikobeats.github.io/fetch-timeline-cli/)


## Data

* [tylerpearson/twitter-most-followed-scripts](https://github.com/tylerpearson/twitter-most-followed-scripts) - Scripts to find the most commonly followed Twitter accounts by a group of people [tmf.tylerp.me](http://tmf.tylerp.me)
* [tylerpearson/twitter-most-followed-site](https://github.com/tylerpearson/twitter-most-followed-site)
* [tylerpearson/twitter-bio-analyzer-script](https://github.com/tylerpearson/twitter-bio-analyzer-script)
* [justinlittman/twitter-scraper](https://github.com/justinlittman/twitter-scraper) - A tool for scraping tweet ids from the Twitter website.
* [geofurb/Ornitholog](https://github.com/geofurb/Ornitholog) - Open-source Twitter collection and archiving tool for tracking specific topics and collecting bulk data.
* [motazsaad/tweets-collector](https://github.com/motazsaad/tweets-collector) - Collect tweets (tweets corpus) using Twitter API. Collection can be based on hashtags, keywords, geographical location


## Templates

* [HoussemDellai/social-media-templates](https://github.com/HoussemDellai/social-media-templates) - Provides templates for using Twitter, Youtube, Instagram, Flickr, Foursquare and Eventbrite API with Xamarin Forms.
Binary file added images/twitter-export-csv.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/twitter-export-thumb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 809760d

Please sign in to comment.