aboutsummaryrefslogtreecommitdiffstats
path: root/packages/pipeline/src/scripts
Commit message (Collapse)AuthorAgeFilesLines
* Fix linter errorsLeonid Logvinov2018-12-138-22/+22
|
* Make pull_missing_blocks script consider all events with block numbers (#1420)Alex Browne2018-12-121-1/+14
|
* track idex orderbook snapshots (#1397)zkao2018-12-122-0/+121
| | | * Track Idex and Oasis Orderbook Snapshots
* Refactor event scraping and add support for scraping ERC20 approval events ↵Alex Browne2018-12-123-10/+86
| | | | | | | | (#1401) * Refactor event scraping and add support for scraping ERC20 approval events * Add tests for data_sources/contract-wrappers/utils
* change to camelCasexianny2018-12-111-1/+1
|
* rename variable and define default in only 1 locationxianny2018-12-081-2/+2
|
* Fix/pipeline/ohlcv (#1393)Xianny2018-12-061-22/+16
| | | The OHLCV script in data pipeline quits early when we get no data from Crypto Compare. Sometimes Crypto Compare gives us a valid empty response (e.g. when we query for way back in time) and we need to just continue. This adds better filtering for the types of Crypto Compare responses to detect when we should continue and when we should really quit.
* Fix RadarRelay timestamps (#1391)Alex Browne2018-12-061-2/+3
| | | | | | * Fixing rr timestamps * Apply prettier
* Fix prettierAlex Browne2018-12-051-18/+11
|
* Address PR feedbackAlex Browne2018-12-054-28/+31
|
* Use a string template in packages/pipeline/src/scripts/pull_missing_events.tsFabio B2018-12-051-1/+1
| | | Co-Authored-By: albrow <stephenalexbrowne@gmail.com>
* Fix linterAlex Browne2018-12-051-1/+1
|
* pull OHLCV records from Crypto Compare (#1349)Xianny2018-12-051-0/+101
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [WIP] pull OHLCV records from Crypto Compare * lint * refactor to pull logic out of script and into modules * add entity test for ohlcv_external entity * implement rate limit and chronological backfill for ohlcv * add unit tests; cleanup variable names * Fetch OHLCV pairs params from events table * better method names * fix outdated test * lint * Clean up after review * oops * fix failing test * better filtering of most recent records * fix bug when generating pairs * fix default earliest backfill date * fix bug with retrieving backfill time * prettier
* Token_orderbook_snapshots for Ddex and Paradex(#1354)zkao2018-12-052-0/+142
| | | | | | * Implements the TokenOrderbookSnapshot Table * Scripts, Data Sources and Entities to pull Ddex and Paradex API data.
* Add script for parsing competing dex trades from Bloxy (#1355)Alex Browne2018-12-051-0/+51
|
* updating comment for 0x trusted tokensJake Ellowitz2018-12-051-4/+5
|
* metadata and trusted sources in same raw tableJake Ellowitz2018-12-051-4/+4
|
* Pull token metadata re trusted tokensJake Ellowitz2018-12-052-2/+53
|
* Add script for pulling missing block dataAlex Browne2018-12-051-0/+83
|
* Check for special characters in table name in pull_missing_eventsAlex Browne2018-12-051-3/+7
|
* Add support for pulling Cancel and CancelUpTo eventsAlex Browne2018-12-051-42/+81
|
* Optimize database operations in pull_missing_events scriptAlex Browne2018-12-051-9/+26
|
* Add workaround for broken save methodAlex Browne2018-12-051-1/+21
|
* Fix chunk size in pull_missing_eventsAlex Browne2018-12-051-1/+1
|
* Use built-in chunk feature of TypeORM save methodAlex Browne2018-12-051-7/+2
|
* Change some column types from varchar to numericAlex Browne2018-12-051-1/+1
|
* Add raw schema prefix to query in pull_missing_eventsAlex Browne2018-12-051-1/+1
|
* Implement scraping sra orders from radar relayAlex Browne2018-12-051-16/+17
|
* Preliminary work for adding RR order book scrapingAlex Browne2018-12-051-0/+52
|
* Configure linter with --format stylish and fix linter errorsAlex Browne2018-12-052-0/+2
|
* Configure TypeORM for migrations. Add new package.json scripts.Alex Browne2018-12-052-6/+6
|
* Add better error handling for immediately invoked async functionsAlex Browne2018-12-053-85/+6
|
* Reorganize entities. Make scripts work from any directory.Alex Browne2018-12-053-3/+3
|
* Split index.ts into multiple scripts in scripts/ and detect last known block ↵Alex Browne2018-12-053-0/+172
| | | | when pulling events
* Remove old code. Create function for getting contract events via etherscanAlex Browne2018-12-054-1228/+0
|
* Rebase pipeline branch off developmentAlex Browne2018-12-054-0/+1228