mirror
/
moonstream
kopia lustrzana https://github.com/bugout-dev/moonstream
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
3 107 Commity
108 Gałęzie
40 Tagi
21 MiB
Wykres commitów

796 Commity (moonworm-crawlers-improvements)

Autor SHA1 Wiadomość Data
Andrey 49ad69e869 Uncomment heartbeat 2023-10-12 14:11:19 +03:00
Andrey ac2a1c11e3 Rewrite insert logic. 
1. Add new label_name_unverified which go to db without confirmatios.
2. Add insert as 1 operation in sql with deduplication.

Blocks cache will include labels_table.
As well state of database will go to blocks cahce once per from/to blocks range.

Add delete from database label with label_name_unverified wich already exists ind database.
 2023-10-11 16:14:47 +03:00
Andrey c3dd0bac9b direct write. 2023-10-04 15:04:22 +03:00
Andrey 3a19d014a0 Add changes. 2023-09-21 22:56:22 +03:00
Andrey a1bcd0ccc8 Deduplicate tx_hash and use any instead of in. 2023-09-21 14:18:10 +03:00
Andrey 4a578df82c Add mypy fixes. 2023-09-20 19:45:17 +03:00
Andrey 9521ba8075 Temp state. 
Refactor blocks cache.
 2023-09-20 19:38:28 +03:00
Andrey 6b618b89fa Crawlers improvements. 
Added initial fix with event deduplication by selector instead of event hash.
Functions call get selector from entry tags.
 2023-09-20 13:19:38 +03:00
Andrey 21a0fc4157 Fix lint.. 2023-09-11 19:30:00 +03:00
Andrey bb4bc7f778 Add improvments. 2023-09-11 17:27:03 +03:00
Andrey d07ec13bf6 Add Shadowcorns. 2023-09-11 16:53:14 +03:00
kompotkot 4c5e6cc327 Requirements update and deployment zksync mainnet scripts 2023-08-30 13:11:17 +00:00
kompotkot ec918609db ZkSync mainnet support changes 2023-08-30 12:58:50 +00:00
Andrey adea116388 Fix missing networks for blockchains. 2023-08-29 20:33:38 +03:00
Andrey 3d85f1767d Bump version replace networks. 2023-08-29 07:19:25 +03:00
Andrey f49b7c4a78 zkSync in crawlers. 2023-08-29 06:41:47 +03:00
Andrey 95439825a3 Add changes. 2023-08-18 19:33:48 +03:00
Andrey a991549ea6 Add status check of running task. 2023-08-16 05:21:44 +03:00
Andrey 1ae366ab7d Update bugout version. 2023-08-10 16:29:37 +03:00
Andrey c4b18145b0 Merge branch 'main' into historical-crawl-fixes 2023-08-03 02:30:43 +03:00
Andrey 9246950293 Merge branch 'main' into historical-crawl-fixes 2023-08-03 02:25:56 +03:00
kompotkot 92dbfe5576 Mooncrawl entity migration to spire 2023-08-01 08:58:36 +00:00
Andrey 6462d84d65 Add missing parameter. 2023-07-28 08:28:14 +03:00
Andrey Dolgolev f820129205
Merge pull request #873 from moonstream-to/leaderboard-generator 
Leaderboards worker
 2023-07-27 19:00:17 +03:00
Andrey 323784f8b2 Fix function filter degradetion. 2023-07-27 09:22:23 +03:00
Andrey f2f078b9c3 add variable to sample.env 2023-07-27 07:06:14 +03:00
Andrey be7a7e0267 fix typo. 2023-07-27 07:01:11 +03:00
Andrey bf7f6497c5 Add changes. 2023-07-27 06:59:01 +03:00
Andrey 3215e5d719 Add leaderboards dir. 2023-07-26 23:52:35 +03:00
Andrey 4d1d242c81 Add loggers and fixes. 2023-07-26 23:51:15 +03:00
Andrey 6c11fb3d0f Add working leaderboard update. 2023-07-26 20:20:17 +03:00
Andrey 88d0f91706 Add new metadata method. 2023-07-26 16:31:10 +03:00
Andrey cb1137fd39 Add init version. 2023-07-26 16:21:56 +03:00
Andrey 9f38e19d9d Fix URI method name. 2023-07-25 10:29:37 +03:00
Andrey 4891f1b5fe Add erc1155 token_ids. 2023-07-25 09:41:41 +03:00
Andrey Dolgolev 24aeada59c
Merge pull request #867 from moonstream-to/add-new-metadata-state-task 
Add new address in tasks.
 2023-07-25 14:36:54 +03:00
kompotkot 3bbc47a36d ZkSync historical crawlers 2023-07-24 15:28:07 +00:00
Andrey 60d98a8627 Add historical crawl worker. 2023-07-24 17:20:18 +03:00
Andrey 78bc0770f5 Add new address in tasks. 2023-07-24 16:59:58 +03:00
kompotkot f768369f05 ZkSync Era testnet moonworm crawler deployment 2023-07-20 10:38:43 +00:00
Andrey e16558bd9e Refactor connection managers. 2023-07-16 09:06:28 +03:00
Andrey 40f498e5a9 Remove local session. 2023-07-14 23:49:27 +03:00
Andrey 0d6259a52d Fix metadata session managment. 2023-07-14 19:42:59 +03:00
Andrey 177c2caf28 Add changes. 2023-07-13 15:00:40 +03:00
Andrey 22f4af26a2 Fixes. 2023-07-13 14:27:16 +03:00
Andrey 9fa794a856 Remove print. 2023-07-13 12:33:52 +03:00
Andrey ff3899d8d5 Add changes. 2023-07-13 12:32:17 +03:00
kompotkot 5bd81bfefa Fixed int parse for zksync model 2023-07-13 11:05:37 +00:00
kompotkot a9186181d8 Basic zksync sync and missing services 2023-07-13 08:52:30 +00:00
kompotkot fefd11a5d3 Bumped version of mooncrawl 2023-07-13 08:35:43 +00:00