Dumbo Tweet Importer

Import a Twitter archive into a Mastodon account.

Twitter	Mastodon

Usage

Dumbo requires modifications be made to your Masotodon server. The Mastodon API does not allow inserting posts in the past. In order to write statuses which occur in the past, a created_at parameter is needed.

Modifying Official Mastodon

The following patches should be applied to the Mastodon web app.

Mastodon 4.x

Note: These diffs were produced against Mastodon v4.1.7. Slight changes may be needed for other 4.x versions.

app/controllers/api/v1/statuses_controller.rb:

@@ -61,4 +61,5 @@
       visibility: status_params[:visibility],
       language: status_params[:language],
+      created_at: status_params[:created_at],
       scheduled_at: status_params[:scheduled_at],
       application: doorkeeper_token.application,
@@ -130,4 +130,5 @@
       :language,
       :scheduled_at,
+      :created_at,
       media_ids: [],
       media_attributes: [

app/services/post_status_service.rb:

@@ -58,4 +58,5 @@
     @visibility   = @options[:visibility] || @account.user&.setting_default_privacy
     @visibility   = :unlisted if @visibility&.to_sym == :public && @account.silenced?
+    @created_at   = @options[:created_at]&.to_datetime
     @scheduled_at = @options[:scheduled_at]&.to_datetime
     @scheduled_at = nil if scheduled_in_the_past?
@@ -99,6 +99,8 @@
     Trends.tags.register(@status)
     LinkCrawlWorker.perform_async(@status.id)
-    DistributionWorker.perform_async(@status.id)
-    ActivityPub::DistributionWorker.perform_async(@status.id)
+    if not @options[:created_at]
+      DistributionWorker.perform_async(@status.id)
+      ActivityPub::DistributionWorker.perform_async(@status.id)
+    end
     PollExpirationNotifyWorker.perform_at(@status.poll.expires_at, @status.poll.id) if @status.poll
   end
@@ -174,4 +174,5 @@
       visibility: @visibility,
       language: valid_locale_cascade(@options[:language], @account.user&.preferred_posting_language, I18n.default_locale),
+      created_at: @created_at,
       application: @options[:application],
       rate_limit: @options[:with_rate_limit],

Mastodon 3.x

Note: These diffs were produced against Mastodon v3.5.3. Slight changes may be needed for other 3.x versions.

app/controllers/api/v1/statuses_controller.rb:

@@ -46,4 +46,5 @@
       visibility: status_params[:visibility],
       language: status_params[:language],
+      created_at: status_params[:created_at],
       scheduled_at: status_params[:scheduled_at],
       application: doorkeeper_token.application,
@@ -110,4 +111,5 @@
       :visibility,
       :language,
+      :created_at,
       :scheduled_at,
       media_ids: [],

app/services/post_status_service.rb:

@@ -95,6 +95,8 @@
     Trends.tags.register(@status)
     LinkCrawlWorker.perform_async(@status.id)
-    DistributionWorker.perform_async(@status.id)
-    ActivityPub::DistributionWorker.perform_async(@status.id)
+    if not @options[:created_at]
+      DistributionWorker.perform_async(@status.id)
+      ActivityPub::DistributionWorker.perform_async(@status.id)
+    end
     PollExpirationNotifyWorker.perform_at(@status.poll.expires_at, @status.poll.id) if @status.poll
   end
@@ -168,4 +170,5 @@
       visibility: @visibility,
       language: valid_locale_cascade(@options[:language], @account.user&.preferred_posting_language, I18n.default_locale),
+      created_at: @options[:created_at],
       application: @options[:application],
       rate_limit: @options[:with_rate_limit],

Apply these patches and then restart the app or container.

When you are completely done with your import you can undo these changes. Either revert manually, reinstall the app, or recreate the container.

Running Dumbo

TODO

License

Copyright 2022 Jake Wharton

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

   http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.