55 Commits

Author SHA1 Message Date
Cezary Haliniarz
6bc65760f6 feat: add Evmos token (#133) 2022-08-16 13:59:02 +02:00
Cezary Haliniarz
587cc12b73 chore: rename $YYAV3SA1 to YYAV3SA1 (#131) 2022-08-11 22:27:55 +02:00
hatskier
3fa12444f1 chore: added YYAV3SA1 token to the avalanche manifest 2022-07-26 17:01:49 +02:00
Dmitrii
ac2d711505 add nft from custom urls to tokens.json, update ADD NEW TOKEN documentation (#115) 2022-07-15 19:41:09 +02:00
Cezary Haliniarz
a8495e5a47 chore: apply prettier to all files (#116) 2022-07-07 15:33:05 +02:00
Cezary Haliniarz
c8e86cfc07 feat: move configuration to env variables (#95) 2022-07-07 11:28:25 +02:00
Cezary Haliniarz
43a5006180 chore: add more fields to oracle registry contract (#100)
* chore: add more fields to oracle registry contract

* Renames
2022-06-23 01:57:40 +02:00
Cezary Haliniarz
b62dafef7f feat: add coinbase to ccxt fetcher (#96)
* feat: add coinbase to ccxt fetcher

* Remove plain coin from ccxt

* Remove coinbase fetcher remainings

* Repopulate main manifest
2022-06-23 01:56:04 +02:00
Cezary Haliniarz
abba13e464 fix: data issues after check 01.06.2022 (#94) 2022-06-14 15:32:19 +02:00
Cezary Haliniarz
09700b1ac4 feat: add GLMR token price (#82) 2022-06-01 12:51:10 +02:00
hatskier
4d0e6ff502 chore: Stox -> Stacks 2022-05-31 14:51:47 +02:00
hatskier
42ada28dc6 chore: created a script for automated data sources config generation 2022-05-30 18:50:23 +02:00
hatskier
4e37570a4c chore: new avalanche prod nodes registered 2022-05-29 20:29:58 +02:00
hatskier
367a6f188f chore: added ecdsaPublicKey to nodes config 2022-05-20 17:05:38 +02:00
hatskier
e20cff7211 chore: registered the first demo twap provider 2022-05-18 18:24:32 +02:00
hatskier
19c8d99f81 chore: updated avalanche manifest 2022-05-18 12:28:58 +02:00
Alex Suvorov
2c0742093e fix: sources cleaning and refactoring (#71)
* bundlr integration code added

* added bundlr and arweave scripts

* bundlr integrated, arweave signing and tx posting removed

* few fixes after tests

* tests fixed

* 0.4.25

* Hatskier/connecting to bundlr (#41)

* Hatskier/streamr broadcaster (#36)

* initial structure for streamr broadcaster

* streamr proxy implemented

* tests fixed

* npm dependencies updates, docker versions upgraded, streamr building problem fixed

* fixes after ppe's review

* another try to fix tests

* Hatskier/running node in app runner (#38)

* experiment with built-in express app

* few fixes and improvements in Docker configuration and express server

* tests fixed

* tried t fixed github CI tests

* tests disabled temporary

* implemented a tool to analyze historical arweave fees

* streamr broadcaster improved

* Hatskier/drand fetcher (#39)

* drand fetcher implementation

* drand fetcher fixed

* sending values in package in http package broadcaster + added workflow for automated publishsing to ECR Public

* another try to run public ecr deployment

* dockefile path updated in workflow configuration

* updated ecr-public deployment workflow

* added support for omitSourcesInArweaveTx param

* docker-avalanche-2 tool created

* bugfix for sources cleaning

* swithed exitIfARBalanceLow to warnIfARBalanceLow on node start

* added SOS cryptocurrency support

* 0.4.22

* env config validation improved, added debug logging

* removed debug logging

* created a script for automated random config generation

* added 2 new providers

* 0.4.23

* 0.4.24

* bundlr integration code added

* added bundlr and arweave scripts

* bundlr integrated, arweave signing and tx posting removed

* few fixes after tests

* tests fixed

* 0.4.25

* added a new script: prepare-light-tokens-config-for-redstone-api.js

* fix: one failed broadcaster should not block another broadcaster

* removed unused import

* Hatskier/connecting to bundlr (#45)

* changed default source timeout to 15s

* changed default source timeout to 20s

* improved broadcasting for several http cache layers

* Registration update (#49)

* changed default source timeout to 15s

* changed default source timeout to 20s

* improved broadcasting for several http cache layers

* removed signature and replaced signer address with signer public key

* removed unused code

* redstone gateway connected, dockerfiles updated

* added price estimation script for bundlr

* Update providers registration

Co-authored-by: hatskier <suvorovalex1997@gmail.com>
Co-authored-by: c-gma <sigma@deltaprime.io>

* fix: removed streamr to test a hypothesis that it influenced nodes performance

* chore: added logging of helpful details (evm address, git commit)

* chore: added diagnostic info printing

* removed coinbase fetcher

* chore: data sources cleaning and fixing

* chore: ccxt fetchers refactoring

* chore: reverted dev.json manifest in sample-config.json

* Trigger docker update

* Update README.md

* chore: removed unused code and comments after review

Co-authored-by: Jakub Wojciechowski <jakub@alice.si>
Co-authored-by: c-gma <sigma@deltaprime.io>
2022-05-16 00:40:07 +02:00
hatskier
d722861fbd chore: stocks and rapid manifests updated 2022-05-12 22:03:29 +02:00
hatskier
ea24afc471 chore: removed custom urls assets from main manifest 2022-05-11 16:53:33 +02:00
hatskier
5ba1ce6a54 feat: connected DEN for manifest id fetching 2022-05-10 21:56:03 +02:00
hatskier
7777b50120 chore: updated custom-urls manifest 2022-05-10 14:53:21 +02:00
Alex Suvorov
07235b8f63 Hatskier/custom urls fetcher (#68)
* bundlr integration code added

* added bundlr and arweave scripts

* bundlr integrated, arweave signing and tx posting removed

* few fixes after tests

* tests fixed

* 0.4.25

* added a new script: prepare-light-tokens-config-for-redstone-api.js

* fix: one failed broadcaster should not block another broadcaster

* removed unused import

* changed default source timeout to 15s

* changed default source timeout to 20s

* improved broadcasting for several http cache layers

* removed signature and replaced signer address with signer public key

* removed unused code

* redstone gateway connected, dockerfiles updated

* added price estimation script for bundlr

* config generation improved

* error logging improved and added sample twaps manifest

* draft twap implementation added

* added mechanism to disable arweave backup

* twap calculation logic implemented

* updated TwapFetcher structure to support signature verification

* few fixes in twap fetcher

* added CELO and AVAX tokens to rapid manifest

* twap fetcher implementation completed

* added a script to print all available fetchers

* added tests for twap fetcher

* Edge cases

* minor updates

* edge cases fixes

* added symbol to id mapping in base fetcher implementation

* added more symbols and sources

* added required files for manifest generation

* updated symbols config

* removed unused ARS symbol

* 0.4.26

* fixed yf-unofficial tests

* 0.4.27

* added private dockerfiles to gitignore

* added example manifest for custom urls

* added PoC for custom-urls fetcher

* 0.4.28

* updated custom-urls PoC

* customUrlsDetails -> customUrlDetails

* 0.4.29

* reverted signer address verification

* 0.4.30

Co-authored-by: c-gma <sigma@deltaprime.io>
2022-05-09 17:50:11 +02:00
Alex Suvorov
767ae7c662 feat: connecting to bundlr network (#40)
* bundlr integration code added

* added bundlr and arweave scripts

* bundlr integrated, arweave signing and tx posting removed

* few fixes after tests

* tests fixed

* 0.4.25

* added a new script: prepare-light-tokens-config-for-redstone-api.js

* fix: one failed broadcaster should not block another broadcaster

* removed unused import

* changed default source timeout to 15s

* changed default source timeout to 20s

* improved broadcasting for several http cache layers

* removed signature and replaced signer address with signer public key

* removed unused code

* redstone gateway connected, dockerfiles updated

* added price estimation script for bundlr

* feat: twaps (#50)

* config generation improved

* error logging improved and added sample twaps manifest

* draft twap implementation added

* added mechanism to disable arweave backup

* twap calculation logic implemented

* updated TwapFetcher structure to support signature verification

* few fixes in twap fetcher

* added CELO and AVAX tokens to rapid manifest

* twap fetcher implementation completed

* added a script to print all available fetchers

* added tests for twap fetcher

* Edge cases

* minor updates

* edge cases fixes

Co-authored-by: c-gma <sigma@deltaprime.io>

* feat: twaps (#66)

* config generation improved

* error logging improved and added sample twaps manifest

* draft twap implementation added

* added mechanism to disable arweave backup

* twap calculation logic implemented

* updated TwapFetcher structure to support signature verification

* few fixes in twap fetcher

* added CELO and AVAX tokens to rapid manifest

* twap fetcher implementation completed

* added a script to print all available fetchers

* added tests for twap fetcher

* Edge cases

* minor updates

* edge cases fixes

* feat: symbol to id mapping (#52)

* added symbol to id mapping in base fetcher implementation

* added more symbols and sources

* added required files for manifest generation

* updated symbols config

* removed unused ARS symbol

* 0.4.26

* fixed yf-unofficial tests

* 0.4.27

* added private dockerfiles to gitignore

Co-authored-by: c-gma <sigma@deltaprime.io>

Co-authored-by: c-gma <sigma@deltaprime.io>
2022-04-28 00:10:49 +02:00
hatskier
8a1adc33c3 prepared tutorial for the first and simplified redstone-node local execution 2022-04-27 12:30:50 +02:00
Cezary Haliniarz
cdc29a9ac7 fix: remove name from update manifest script (#64) 2022-04-27 00:41:49 +02:00
Cezary Haliniarz
08a9f9a2ae feat: move oracle contract scripts to sequelizer (#65) 2022-04-27 00:41:27 +02:00
Cezary Haliniarz
6de30f3808 feat: add oracle contract scripts and cli (#57) 2022-04-22 10:49:23 +02:00
Cezary Haliniarz
a27f193f09 chore: updates after testing local node (#60) 2022-04-22 02:34:11 +02:00
Cezary Haliniarz
c55559eb7b feat: add redstone oracle registry (#51) 2022-04-20 09:32:21 +02:00
hatskier
dfbc0a3a7e added 2 new providers 2022-02-07 02:40:15 +01:00
hatskier
c67d7c4b66 created a script for automated random config generation 2022-02-07 02:09:44 +01:00
hatskier
459cefcd3d added SOS cryptocurrency support 2022-01-12 17:33:55 +01:00
hatskier
67d2c5ecfb docker-avalanche-2 tool created 2021-12-30 03:58:28 +01:00
Alex Suvorov
8dd07c3ffa Hatskier/streamr broadcaster (#36)
* initial structure for streamr broadcaster

* streamr proxy implemented

* tests fixed

* npm dependencies updates, docker versions upgraded, streamr building problem fixed

* fixes after ppe's review

* another try to fix tests

* Hatskier/running node in app runner (#38)

* experiment with built-in express app

* few fixes and improvements in Docker configuration and express server

* tests fixed

* tried t fixed github CI tests

* tests disabled temporary

* implemented a tool to analyze historical arweave fees

* streamr broadcaster improved

* Hatskier/drand fetcher (#39)

* drand fetcher implementation

* drand fetcher fixed

* sending values in package in http package broadcaster + added workflow for automated publishsing to ECR Public
2021-12-08 16:49:07 +01:00
Alex Suvorov
079e418a75 Hatskier/latin american currencies update (#35)
* updated manifests with the new reverted latin american currencies

* tokens config updated
2021-11-16 00:52:15 +01:00
hatskier
6f763195a3 rapid and stocks manifests updated 2021-11-14 23:30:55 +01:00
Alex Suvorov
fd2f119787 Added some Latin American currencies (#33)
* Added some Latin American currencies (#31)

* api-dojo-rapid fetcher updated

* manifests updated

* minor improvement in the api-dojo-rapid-fetcher

Co-authored-by: DCota <32775237+DaigaroCota@users.noreply.github.com>
2021-11-09 16:36:00 +01:00
Alex Suvorov
c5529142f6 Hatskier/running avalanche node (#32)
* initial implementation of multi-broadcasting support

* public Dockerfile added, passing config through environment variables initial implementation

* generated manifest for redstone-avalanche provider, improved tools for manifest generation

* added docker:build command to package.json

* docker script updated

* avalanche manifest updated

* VRT token address updated

* coingecko token config updated

* added qi and yak tokens to config

* ccxt updated, implemented more fetchers for yak, qi and frax tokens

* tokens config updated (added redstone-avalanche provider)
2021-11-09 01:04:14 +01:00
Alex Suvorov
4944d0ac5f Initial implementation of multi-broadcasting support (#28)
* initial implementation of multi-broadcasting support

* broadcaster base class rewritten as an interface

* providers.json updated

* 0.4.20

* public Dockerfile added, passing config through environment variables initial implementation (#29)
2021-11-08 12:14:05 +01:00
hatskier
aa0dcc7911 introduction and system architecture added to the compiled docs 2021-09-26 21:41:40 +02:00
hatskier
e2835518d6 node documentation extended 2021-09-26 18:15:40 +02:00
Alex Suvorov
2f5fa27a4d Hatskier/adding lite evm signature (#17)
* evm lite signer implemented

* lite signature generation connected to single prices and price packages

* tests implemented for lite evm signature

* manually added logos for verto tokens to predefined config

* tokens config updated

* getLiteDataBytesString and getDataToSign made public in EvmPriceSigner

* 0.4.5

* 0.4.6

* 0.4.7

* redstone-node version updated

* 0.4.10

* 0.4.11

* tsconfig updated to copy manifests to dist folder

* 0.4.12

* verto tag renamed to pst

* 0.4.13

* 0.4.14

* Hatskier/adding pangoling fetcher (#18)

* pangolin fetcher implementation

* tests implemented

* PST and pangolin token fixes

* pangolin added to sources config

* tokens config update intstructions added to README

* AVAX tokens added to config

* 0.4.15

* added avax tag to some avalanche tokens

* 0.4.16

* bad ccxt sources removed

* evm address added to providers.json

* 0.4.17

* unstable tokens removed

* pangolin manifests for different base tokens added

* main manifest cleaned up, added pangolin fetchers

* pangolin-aablock fetcher fixed

* tests fixed

* renamed all-supported-tokens.json to main.json

* implemented a tool for redstone-rapid manifest creation

* trader-joe fetcher implemented

* manifests updated for tokens from avalanche ecosystem

* sources config updated

* JOE and WAVAX tokens added to config

* tests added for DEXes

* 0.4.18

* added providers to some avalanche tokens

* 0.4.19

* ccxt version updated

* fixes after ppe's review
2021-09-06 09:32:36 +02:00
hatskier
c565784cba bugfix for new coingecko tokens 2021-08-14 18:35:39 +02:00
Alex Suvorov
8d79951a35 Hatskier/config generation scripts (#16)
* script for config generation created

* implemented scripts for token list generation for new fetchers

* unused files removed

* script structure created for token config generation script

* script for token config generation created

* updated config scripts to use source logos from redstone cdn

* created scripts for cdn images, updated tokens config

* added more logo images for tokens

* token logos published to redstone cdn

* donwload-symbol-logos script improved

* added 100+ new tokens from coingecko source

* manifest for redstone-rapid updated
2021-08-11 14:33:13 +02:00
Alex Suvorov
726ebe104e Hatskier/config generation scripts (#15)
* script for config generation created

* implemented scripts for token list generation for new fetchers

* unused files removed

* script structure created for token config generation script

* script for token config generation created
2021-08-09 19:45:42 +02:00
Alex Suvorov
ae78874756 Hatskier/ccxt fetchers (#14)
* ccxt fetcher implementation

* ccxt fetchers connected

* tests fixed

* verto refactoring, ccxt fetchers manifests updated

* ccxt tests implemented

* old fetchers refactoring started

* USDT fetching mocked in tests

* coingecko and coinbase fetchers refactoring

* ecb fetcher refactoring

* kyber fetchers refactoring

* uniswap and sushiswap fetchers refactoring

* yf-unofficial fetcher refactoring

* manifests updated for ccxt fetchers

* increased timeout for ccxt fetchers

* ccxt manifest generation script improved. Now it compares prices from ccxt fetchers  with existing redstone-api prices

* manifests updated

* BTMX token removed from coingecko source

* ccxt manifests updated

* tmp log file removed

* enableRateLimit set to false for ccxt fetchers

* increased maxPriceDeviation for unpopular tokens

* implemented script for sources-list generation

* fixes after review: fetcher files renaming

* fixes after review: replaced string type with ExchangeId for ccxt fetchers

* fixes after review: replaced lodash methods with built-in functions

* fixes after review: classes refactored

* fixes after review: const renamed MAX_RESPONSE_TIME_TO_RETRY_FETCHING_MS

* ccxt manifest generation script updated to support option of avoiding new tokens adding

* fixes after review: refactored fetching additional pricing data for USDT and ETH inside extractPrices method

* unstable sources removed

* aggregation mechanism improved, tests added

* added providers.json to redstone-node configs
2021-08-04 19:56:28 +02:00
Alex Suvorov
5aff5c93f3 Hatskier/api-dojo-rapid fetcher implementation (#12)
* fetchers refactoring started, yahoo-finance-rapid fetcher implemented

* fix in tests

* yahoo-finance fetcher renamed to api-dojo-rapid (#13)
2021-07-20 13:45:38 +02:00
piotruda
51f0aed63e Frontend tokens config (#9)
* Sources list with images

* Moved lists to src/config

* Running scripts from root

Co-authored-by: Piotr Duda <piotrduda1992@gmail.com>
2021-07-16 14:05:08 +02:00
piotruda
f2640901d7 Frontend tokens config (#8)
* Token list generator

* Token list generator - automation

* Token list generator - code cleanup

* Review corrections

Co-authored-by: Piotr Duda <piotrduda1992@gmail.com>
2021-07-14 19:30:22 +02:00
hatskier
a042c47688 added tool for evm private keys generation 2021-06-15 16:49:33 +02:00