I’ve been running Diaspora for maybe over a year on a server I own (AMD FX-8120 w/32GB RAM, 110GB SSD, Slackware64 GNU/Linux 14.2 up-to-date stable.) Several upgrades worked fine. However Diaspora often crashes (with a HTTPD 503 error) though usually I was able to restart and login. Now (even after a reinstall) it doesn’t seem able to restart anymore. What other information, logs/excerpts, or console output (and how to redirect it) do I need to post to find out what to do next? (BTW, I hope no one asks for an entire log as I’d seen some grow to about 120MB.)
The output of script/server when crashing, and log/eye_processes_stderr.log and log/production.log would help to see what’s wrong. (No complete logs, last 100ish lines should be enough)
This forum software seems poorly-designed for entering fixed-width text. I tried to enter all these logs like that in a couple ways, which didn’t work; I give up on that.
output of script/server (until I pressed ^C)
I, [2019-01-22T17:48:25.427233 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] load_external_pid_file: pid_file not found
I, [2019-01-22T17:48:25.427474 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:25.428130 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] daemonizing: `bin/bundle exec sidekiq` with start_grace: 2.5s, env: 'RAILS_ENV=production', <14114> (in /usr/local/lib64/diaspora/diaspora)
I, [2019-01-22T17:48:25.428171 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] sleeping for :start_grace 2.5
I, [2019-01-22T17:48:26.164289 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14088> not found
E, [2019-01-22T17:48:26.164390 #13902] ERROR -- : [diaspora:web] exit status 1, process <14088> (from /usr/local/lib64/diaspora/diaspora/tmp/pids/web.pid) was not found; ensure that the pid_file is being updated correctly (you should check the process logs ["/usr/local/lib64/diaspora/diaspora/log/eye_processes_stdout.log", "/usr/local/lib64/diaspora/diaspora/log/eye_processes_stderr.log"])
E, [2019-01-22T17:48:26.164435 #13902] ERROR -- : [diaspora:web] process <> failed to start (:not_really_running)
I, [2019-01-22T17:48:26.164751 #13902] INFO -- : [diaspora:web] switch :crashed [:starting => :down] monitor by user
I, [2019-01-22T17:48:26.165121 #13902] INFO -- : [diaspora:web] schedule :check_crash (crashed)
I, [2019-01-22T17:48:26.165175 #13902] INFO -- : [diaspora:web] <= monitor
I, [2019-01-22T17:48:26.165212 #13902] INFO -- : [diaspora:web] => check_crash (crashed)
W, [2019-01-22T17:48:26.165253 #13902] WARN -- : [diaspora:web] check crashed: process is down
I, [2019-01-22T17:48:26.165291 #13902] INFO -- : [diaspora:web] schedule :restore (crashed)
I, [2019-01-22T17:48:26.165336 #13902] INFO -- : [diaspora:web] <= check_crash
I, [2019-01-22T17:48:26.165369 #13902] INFO -- : [diaspora:web] => restore (crashed)
I, [2019-01-22T17:48:26.165453 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14088> not found
I, [2019-01-22T17:48:26.165686 #13902] INFO -- : [diaspora:web] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:26.165840 #13902] INFO -- : [diaspora:web] executing: `bin/bundle exec unicorn -c config/unicorn.rb -D` with start_timeout: 15.0s, start_grace: 2.5s, env: 'RAILS_ENV=production PORT=' (in /usr/local/lib64/diaspora/diaspora)
I, [2019-01-22T17:48:27.928663 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :started [:starting => :up] crashed
I, [2019-01-22T17:48:27.928913 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= restore
W, [2019-01-22T17:48:37.929167 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check_alive: process <14114> not found
I, [2019-01-22T17:48:37.929264 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] delete pid_file: /usr/local/lib64/diaspora/diaspora/tmp/pids/sidekiq1.pid
I, [2019-01-22T17:48:37.929589 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :crashed [:up => :down] crashed
I, [2019-01-22T17:48:37.929923 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :check_crash (crashed)
I, [2019-01-22T17:48:37.930077 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => check_crash (crashed)
W, [2019-01-22T17:48:37.930120 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check crashed: process is down
I, [2019-01-22T17:48:37.930156 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :restore (crashed)
I, [2019-01-22T17:48:37.930189 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= check_crash
I, [2019-01-22T17:48:37.930219 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => restore (crashed)
I, [2019-01-22T17:48:38.030433 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] load_external_pid_file: pid_file not found
I, [2019-01-22T17:48:38.030717 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:38.034431 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] daemonizing: `bin/bundle exec sidekiq` with start_grace: 2.5s, env: 'RAILS_ENV=production', <14142> (in /usr/local/lib64/diaspora/diaspora)
I, [2019-01-22T17:48:38.034514 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] sleeping for :start_grace 2.5
I, [2019-01-22T17:48:38.319140 #13902] INFO -- : [diaspora:web] sleeping for :start_grace 2.5
I, [2019-01-22T17:48:40.535055 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :started [:starting => :up] crashed
I, [2019-01-22T17:48:40.535309 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= restore
I, [2019-01-22T17:48:40.819455 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14124> not found
E, [2019-01-22T17:48:40.819534 #13902] ERROR -- : [diaspora:web] exit status 1, process <14124> (from /usr/local/lib64/diaspora/diaspora/tmp/pids/web.pid) was not found; ensure that the pid_file is being updated correctly (you should check the process logs ["/usr/local/lib64/diaspora/diaspora/log/eye_processes_stdout.log", "/usr/local/lib64/diaspora/diaspora/log/eye_processes_stderr.log"])
E, [2019-01-22T17:48:40.819566 #13902] ERROR -- : [diaspora:web] process <> failed to start (:not_really_running)
I, [2019-01-22T17:48:40.819821 #13902] INFO -- : [diaspora:web] switch :crashed [:starting => :down] crashed
I, [2019-01-22T17:48:40.820128 #13902] INFO -- : [diaspora:web] schedule :check_crash (crashed)
I, [2019-01-22T17:48:40.820178 #13902] INFO -- : [diaspora:web] <= restore
I, [2019-01-22T17:48:40.820208 #13902] INFO -- : [diaspora:web] => check_crash (crashed)
W, [2019-01-22T17:48:40.820242 #13902] WARN -- : [diaspora:web] check crashed: process is down
I, [2019-01-22T17:48:40.820272 #13902] INFO -- : [diaspora:web] schedule :restore (crashed)
I, [2019-01-22T17:48:40.820303 #13902] INFO -- : [diaspora:web] <= check_crash
I, [2019-01-22T17:48:40.820338 #13902] INFO -- : [diaspora:web] => restore (crashed)
I, [2019-01-22T17:48:40.820403 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14124> not found
I, [2019-01-22T17:48:40.820580 #13902] INFO -- : [diaspora:web] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:40.820710 #13902] INFO -- : [diaspora:web] executing: `bin/bundle exec unicorn -c config/unicorn.rb -D` with start_timeout: 15.0s, start_grace: 2.5s, env: 'RAILS_ENV=production PORT=' (in /usr/local/lib64/diaspora/diaspora)
W, [2019-01-22T17:48:50.535566 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check_alive: process <14142> not found
I, [2019-01-22T17:48:50.535688 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] delete pid_file: /usr/local/lib64/diaspora/diaspora/tmp/pids/sidekiq1.pid
I, [2019-01-22T17:48:50.536139 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :crashed [:up => :down] crashed
I, [2019-01-22T17:48:50.536527 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :check_crash (crashed)
I, [2019-01-22T17:48:50.536679 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => check_crash (crashed)
W, [2019-01-22T17:48:50.536724 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check crashed: process is down
I, [2019-01-22T17:48:50.536761 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :restore (crashed)
I, [2019-01-22T17:48:50.536795 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= check_crash
I, [2019-01-22T17:48:50.536825 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => restore (crashed)
I, [2019-01-22T17:48:50.637112 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] load_external_pid_file: pid_file not found
I, [2019-01-22T17:48:50.637451 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:50.639937 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] daemonizing: `bin/bundle exec sidekiq` with start_grace: 2.5s, env: 'RAILS_ENV=production', <14172> (in /usr/local/lib64/diaspora/diaspora)
I, [2019-01-22T17:48:50.640030 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] sleeping for :start_grace 2.5
I, [2019-01-22T17:48:52.366609 #13902] INFO -- : [diaspora:web] sleeping for :start_grace 2.5
I, [2019-01-22T17:48:53.140551 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :started [:starting => :up] crashed
I, [2019-01-22T17:48:53.140791 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= restore
I, [2019-01-22T17:48:54.866922 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14154> not found
E, [2019-01-22T17:48:54.867002 #13902] ERROR -- : [diaspora:web] exit status 1, process <14154> (from /usr/local/lib64/diaspora/diaspora/tmp/pids/web.pid) was not found; ensure that the pid_file is being updated correctly (you should check the process logs ["/usr/local/lib64/diaspora/diaspora/log/eye_processes_stdout.log", "/usr/local/lib64/diaspora/diaspora/log/eye_processes_stderr.log"])
E, [2019-01-22T17:48:54.867039 #13902] ERROR -- : [diaspora:web] process <> failed to start (:not_really_running)
I, [2019-01-22T17:48:54.867297 #13902] INFO -- : [diaspora:web] switch :crashed [:starting => :down] crashed
I, [2019-01-22T17:48:54.867624 #13902] INFO -- : [diaspora:web] schedule :check_crash (crashed)
I, [2019-01-22T17:48:54.867664 #13902] INFO -- : [diaspora:web] <= restore
I, [2019-01-22T17:48:54.867693 #13902] INFO -- : [diaspora:web] => check_crash (crashed)
W, [2019-01-22T17:48:54.867725 #13902] WARN -- : [diaspora:web] check crashed: process is down
I, [2019-01-22T17:48:54.867767 #13902] INFO -- : [diaspora:web] schedule :restore (crashed)
I, [2019-01-22T17:48:54.867795 #13902] INFO -- : [diaspora:web] <= check_crash
I, [2019-01-22T17:48:54.867820 #13902] INFO -- : [diaspora:web] => restore (crashed)
I, [2019-01-22T17:48:54.867885 #13902] INFO -- : [diaspora:web] load_external_pid_file: pid_file found, but process <14154> not found
I, [2019-01-22T17:48:54.868062 #13902] INFO -- : [diaspora:web] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:48:54.868192 #13902] INFO -- : [diaspora:web] executing: `bin/bundle exec unicorn -c config/unicorn.rb -D` with start_timeout: 15.0s, start_grace: 2.5s, env: 'RAILS_ENV=production PORT=' (in /usr/local/lib64/diaspora/diaspora)
rc.diaspora stop
W, [2019-01-22T17:49:03.141560 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check_alive: process <14172> not found
I, [2019-01-22T17:49:03.141674 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] delete pid_file: /usr/local/lib64/diaspora/diaspora/tmp/pids/sidekiq1.pid
I, [2019-01-22T17:49:03.142007 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :crashed [:up => :down] crashed
I, [2019-01-22T17:49:03.142355 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :check_crash (crashed)
I, [2019-01-22T17:49:03.142484 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => check_crash (crashed)
W, [2019-01-22T17:49:03.142527 #13902] WARN -- : [diaspora:sidekiq:sidekiq1] check crashed: process is down
I, [2019-01-22T17:49:03.142564 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] schedule :restore (crashed)
I, [2019-01-22T17:49:03.142598 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= check_crash
I, [2019-01-22T17:49:03.142654 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] => restore (crashed)
I, [2019-01-22T17:49:03.242924 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] load_external_pid_file: pid_file not found
I, [2019-01-22T17:49:03.243240 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :starting [:down => :starting] crashed
I, [2019-01-22T17:49:03.245766 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] daemonizing: `bin/bundle exec sidekiq` with start_grace: 2.5s, env: 'RAILS_ENV=production', <14202> (in /usr/local/lib64/diaspora/diaspora)
I, [2019-01-22T17:49:03.245848 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] sleeping for :start_grace 2.5
I, [2019-01-22T17:49:05.746339 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] switch :started [:starting => :up] crashed
I, [2019-01-22T17:49:05.746598 #13902] INFO -- : [diaspora:sidekiq:sidekiq1] <= restore
^CI, [2019-01-22T17:49:05.769729 #13902] INFO -- : [Eye] => command: stop_all
eye_processes_stderr.log:
bin/bundle:3:in `load'
bin/bundle:3:in `<main>'
master failed to start, check stderr log for details
Mysql2::Error: Table 'diaspora_production.people' doesn't exist: SHOW FULL FIELDS FROM `people`
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/mysql2-0.5.2/lib/mysql2/client.rb:131:in `_query'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/mysql2-0.5.2/lib/mysql2/client.rb:131:in `block in query'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/mysql2-0.5.2/lib/mysql2/client.rb:130:in `handle_interrupt'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/mysql2-0.5.2/lib/mysql2/client.rb:130:in `query'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_mysql_adapter.rb:214:in `block (2 levels) in execute'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies/interlock.rb:46:in `block in permit_concurrent_loads'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/concurrency/share_lock.rb:185:in `yield_shares'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies/interlock.rb:45:in `permit_concurrent_loads'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_mysql_adapter.rb:213:in `block in execute'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_adapter.rb:613:in `block (2 levels) in log'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/monitor.rb:214:in `mon_synchronize'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_adapter.rb:612:in `block in log'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/notifications/instrumenter.rb:21:in `instrument'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_adapter.rb:604:in `log'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_mysql_adapter.rb:212:in `execute'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/mysql/database_statements.rb:26:in `execute'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_mysql_adapter.rb:223:in `execute_and_free'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_mysql_adapter.rb:855:in `column_definitions'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/abstract_adapter.rb:167:in `columns'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/schema_cache.rb:67:in `columns'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/connection_adapters/schema_cache.rb:73:in `columns_hash'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/model_schema.rb:471:in `load_schema!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/attributes.rb:233:in `load_schema!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/attribute_decorators.rb:50:in `load_schema!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/model_schema.rb:464:in `block in load_schema'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/monitor.rb:214:in `mon_synchronize'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/model_schema.rb:461:in `load_schema'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/model_schema.rb:343:in `columns_hash'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/dynamic_matchers.rb:60:in `block in valid?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/dynamic_matchers.rb:60:in `each'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/dynamic_matchers.rb:60:in `all?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/dynamic_matchers.rb:60:in `valid?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/dynamic_matchers.rb:9:in `respond_to_missing?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/scoping/named.rb:189:in `respond_to?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/scoping/named.rb:189:in `valid_scope_name?'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activerecord-5.1.6/lib/active_record/scoping/named.rb:166:in `scope'
/usr/local/lib64/diaspora/diaspora/app/models/person.rb:106:in `<class:Person>'
/usr/local/lib64/diaspora/diaspora/app/models/person.rb:7:in `<top (required)>'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:292:in `require'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:292:in `block in require'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:258:in `load_dependency'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:292:in `require'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:379:in `block in require_or_load'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:36:in `block in load_interlock'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies/interlock.rb:12:in `block in loading'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/concurrency/share_lock.rb:149:in `exclusive'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies/interlock.rb:11:in `loading'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:36:in `load_interlock'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:357:in `require_or_load'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:335:in `depend_on'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/activesupport-5.1.6/lib/active_support/dependencies.rb:251:in `require_dependency'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:476:in `block (2 levels) in eager_load!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:475:in `each'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:475:in `block in eager_load!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:473:in `each'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:473:in `eager_load!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/engine.rb:354:in `eager_load!'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/application/finisher.rb:67:in `each'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/application/finisher.rb:67:in `block in <module:Finisher>'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/initializable.rb:30:in `instance_exec'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/initializable.rb:30:in `run'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/initializable.rb:59:in `block in run_initializers'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:228:in `block in tsort_each'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:431:in `each_strongly_connected_component_from'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:349:in `block in each_strongly_connected_component'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:347:in `each'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:347:in `call'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:347:in `each_strongly_connected_component'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:226:in `tsort_each'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/2.4.0/tsort.rb:205:in `tsort_each'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/initializable.rb:58:in `run_initializers'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/railties-5.1.6/lib/rails/application.rb:353:in `initialize!'
/usr/local/lib64/diaspora/diaspora/config/environment.rb:7:in `<top (required)>'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/sidekiq-5.2.3/lib/sidekiq/cli.rb:278:in `require'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/sidekiq-5.2.3/lib/sidekiq/cli.rb:278:in `boot_system'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/sidekiq-5.2.3/lib/sidekiq/cli.rb:53:in `run'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/gems/sidekiq-5.2.3/bin/sidekiq:12:in `<top (required)>'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/bin/sidekiq:23:in `load'
/usr/local/lib64/diaspora/diaspora/vendor/bundle/ruby/2.4.0/bin/sidekiq:23:in `<top (required)>'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli/exec.rb:74:in `load'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli/exec.rb:74:in `kernel_load'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli/exec.rb:28:in `run'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli.rb:424:in `exec'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/vendor/thor/lib/thor.rb:387:in `dispatch'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli.rb:27:in `dispatch'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/vendor/thor/lib/thor/base.rb:466:in `start'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/cli.rb:18:in `start'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/gems/2.4.0/gems/bundler-1.16.6/exe/bundle:30:in `block in <top (required)>'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/site_ruby/2.4.0/bundler/friendly_errors.rb:124:in `with_friendly_errors'
/usr/local/lib64/diaspora/.rvm/rubies/ruby-2.4.5/lib/ruby/gems/2.4.0/gems/bundler-1.16.6/exe/bundle:22:in `<top (required)>'
bin/bundle:3:in `load'
bin/bundle:3:in `<main>'
master failed to start, check stderr log for details
production.log:
[2019-01-22T17:48:19] INFO PID-14079 TID-69917236612900 Sidekiq: Cron Jobs - add job with name: clean_cached_files
[2019-01-22T17:48:19] INFO PID-14079 TID-69917236612900 Sidekiq: Cron Jobs - add job with name: cleanup_old_exports
[2019-01-22T17:48:19] INFO PID-14079 TID-69917236612900 Sidekiq: Cron Jobs - add job with name: queue_users_for_removal
[2019-01-22T17:48:19] INFO PID-14079 TID-69917236612900 Sidekiq: Cron Jobs - add job with name: recheck_scheduled_pods
[2019-01-22T17:48:20] INFO PID-14079 TID-69917236612900 Sidekiq: Cron Jobs - add job with name: recurring_pod_check
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: check_birthday
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: clean_cached_files
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: cleanup_old_exports
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: queue_users_for_removal
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: recheck_scheduled_pods
[2019-01-22T17:48:33] INFO PID-14114 TID-70177417678620 Sidekiq: Cron Jobs - add job with name: recurring_pod_check
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: check_birthday
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: clean_cached_files
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: cleanup_old_exports
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: queue_users_for_removal
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: recheck_scheduled_pods
[2019-01-22T17:48:46] INFO PID-14142 TID-70341746315040 Sidekiq: Cron Jobs - add job with name: recurring_pod_check
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: check_birthday
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: clean_cached_files
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: cleanup_old_exports
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: queue_users_for_removal
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: recheck_scheduled_pods
[2019-01-22T17:48:59] INFO PID-14172 TID-70122717663000 Sidekiq: Cron Jobs - add job with name: recurring_pod_checkAnd here is your problem: your database is either empty or at least incomplete. If you did a reinstall, you didn’t restore the backup properly?
Apparently that was the problem this time; worked after I tried restoring the database again; thanks @supertux88! However that wasn’t the problem before the recent reinstall, as it was working for months then never started again (until reinstall then fixing database.) Well, actually it was intermittently crashing for months. That will probably continue unless a new version upgrade fixes something. It wasn’t so important when all the previous times I could just restart anyway, but that’s not really how it should work…
Here’s the script I use to (re)start/stop, and I’m wondering if Diaspora always has enough time after Redis starts or sometimes doesn’t, then doesn’t start. That might explain why sometimes it didn’t start (after reboots) but not why it regularly crashed then was able to restart anyway.
#!/bin/sh
# start/stop/restart Diaspora
#restart Diaspora:
diaspora_restart()
{
/etc/rc.d/rc.redis restart
su -l diaspora -c "cd diaspora&&RAILS_ENV=production bin/eye restart web"
su -l diaspora -c "cd diaspora; script/server&"
}
# start Diaspora:
diaspora_start()
{
/etc/rc.d/rc.redis start
su -l diaspora -c "cd diaspora; script/server&"
}
# stop Diaspora:
diaspora_stop()
{
su -l diaspora -c "cd diaspora&&RAILS_ENV=production bin/eye stop diaspora"
/etc/rc.d/rc.redis stop
}
case "$1" in
'restart')
diaspora_restart
;;
'start')
diaspora_start
;;
'stop')
diaspora_stop
;;
*)
echo "usage $0 start|stop|restart"
esac