double number of concurrent crawlers

CHANGELOG.md

@@ -12,6 +12,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 ### Changed
 
 - Bring back `develop` staging backup (now managed in DNS)
+- Increase default number of concurrent crawlers to 100
 
 ### Deprecated
 

backend/config/config.exs

@@ -60,7 +60,7 @@ config :backend, :crawler,
   status_count_limit: 5000,
   personal_instance_threshold: 10,
   crawl_interval_mins: 30,
-  crawl_workers: 50,
+  crawl_workers: 100,
   blacklist: [
     # spam
     "gab.best",