aboutsummaryrefslogtreecommitdiffstats
path: root/packages/pipeline
Commit message (Collapse)AuthorAgeFilesLines
* Change type of transactions.gas_used and gas_price to BigNumber/numericAlex Browne2018-12-064-9/+31
|
* Fix prettierAlex Browne2018-12-062-25/+18
|
* Address PR feedbackAlex Browne2018-12-0621-81/+96
|
* Use a string template in packages/pipeline/src/scripts/pull_missing_events.tsFabio B2018-12-061-1/+1
| | | Co-Authored-By: albrow <stephenalexbrowne@gmail.com>
* Fix typo in packages/pipeline/src/parsers/bloxy/index.tsFabio B2018-12-061-1/+1
| | | Co-Authored-By: albrow <stephenalexbrowne@gmail.com>
* Fix linterAlex Browne2018-12-061-1/+1
|
* pull OHLCV records from Crypto Compare (#1349)Xianny2018-12-0612-16/+491
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [WIP] pull OHLCV records from Crypto Compare * lint * refactor to pull logic out of script and into modules * add entity test for ohlcv_external entity * implement rate limit and chronological backfill for ohlcv * add unit tests; cleanup variable names * Fetch OHLCV pairs params from events table * better method names * fix outdated test * lint * Clean up after review * oops * fix failing test * better filtering of most recent records * fix bug when generating pairs * fix default earliest backfill date * fix bug with retrieving backfill time * prettier
* Token_orderbook_snapshots for Ddex and Paradex(#1354)zkao2018-12-0614-0/+669
| | | | | | * Implements the TokenOrderbookSnapshot Table * Scripts, Data Sources and Entities to pull Ddex and Paradex API data.
* Add script for parsing competing dex trades from Bloxy (#1355)Alex Browne2018-12-069-4/+498
|
* Introduce framework for running basic tests for entities (#1344)Alex Browne2018-12-0625-52/+698
| | | | | | | | | | | | | | | | | | | | | | * Introduce framework for running basic tests for entities * Add pipeline tests to CircleCI config * Make pipeline tests more configurable and fix CircleCI config * Add coverage dir to pipeline package * Add basic tests for all exchange event entities * Add tests for remaining entities * Create separate test scripts in package.json and add new info to README * Update db_setup.ts to revert migrations even if you are using docker * Automatically pull the postgres image if needed * Add comment about why NumberToBigIntTransformer is needed
* [pipeline] Add additional documentation to the README (#1328)Alex Browne2018-12-061-0/+113
|
* Reduce number of blocks per query in pull_missing_eventsAlex Browne2018-12-061-1/+1
|
* updating comment for 0x trusted tokensJake Ellowitz2018-12-064-13/+8
|
* metadata and trusted sources in same raw tableJake Ellowitz2018-12-0610-55/+75
|
* Pull token metadata re trusted tokensJake Ellowitz2018-12-0612-2/+208
|
* Add script for pulling missing block dataAlex Browne2018-12-064-4/+91
|
* Check for special characters in table name in pull_missing_eventsAlex Browne2018-12-061-3/+7
|
* Add support for pulling Cancel and CancelUpTo eventsAlex Browne2018-12-066-90/+170
|
* Add transactionHash to CancelUpToEvent and CancelEvent entitiesAlex Browne2018-12-063-1/+6
|
* Optimize database operations in pull_missing_events scriptAlex Browne2018-12-061-9/+26
|
* Add homepage_url to relayersAlex Browne2018-12-063-7/+22
|
* Add workaround for broken save methodAlex Browne2018-12-062-2/+22
|
* Fix chunk size in pull_missing_eventsAlex Browne2018-12-061-1/+1
|
* Use built-in chunk feature of TypeORM save methodAlex Browne2018-12-061-7/+2
|
* Change some column types from varchar to numericAlex Browne2018-12-0611-46/+121
|
* Add raw schema prefix to query in pull_missing_eventsAlex Browne2018-12-061-1/+1
|
* Rename taker and maker amounts in sra_ordersAlex Browne2018-12-062-2/+15
|
* Implement scraping sra orders from radar relayAlex Browne2018-12-067-24/+52
|
* Preliminary work for adding RR order book scrapingAlex Browne2018-12-061-0/+52
|
* Update schema for sra_ordersAlex Browne2018-12-062-6/+49
|
* Pointing entities to raw schemaJake Ellowitz2018-12-0610-132/+129
| | | | Fix linter issues
* Mapping dev schema to initial migrationJake Ellowitz2018-12-064-1/+208
|
* Configure linter with --format stylish and fix linter errorsAlex Browne2018-12-0612-7/+81
|
* Configure TypeORM for migrations. Add new package.json scripts.Alex Browne2018-12-066-30/+21
|
* Rename Transaction.ts to transaction.tsAlex Browne2018-12-063-0/+0
| | | | | | Rename Relayer.ts to relayer.ts Rename Block.ts to block.ts
* Add better error handling for immediately invoked async functionsAlex Browne2018-12-064-85/+20
|
* Rename table and column namesAlex Browne2018-12-0610-98/+172
|
* Reorganize entities. Make scripts work from any directory.Alex Browne2018-12-0615-14/+38
|
* Split index.ts into multiple scripts in scripts/ and detect last known block ↵Alex Browne2018-12-064-92/+95
| | | | when pulling events
* Remove unused function parameter in index.ts scriptAlex Browne2018-12-061-2/+2
|
* Use bigint for gasUsed and gasPrice in TransactionAlex Browne2018-12-062-5/+7
|
* Update relayer code to use new relayer-registry formatAlex Browne2018-12-064-6/+14
|
* Remove outdated info from READMEAlex Browne2018-12-061-21/+0
|
* Add build:ci to pipeline package.jsonAlex Browne2018-12-061-0/+1
|
* Implement fetching and parsing relayer infoAlex Browne2018-12-065-6/+107
|
* Implement support for getting and parsing blocks and transactionsAlex Browne2018-12-065-0/+149
|
* chore: Fix tslint config.Alex Browne2018-12-062-2/+2
|
* Fix bugs in merge_v2_events script and disable verbose loggingAlex Browne2018-12-062-2/+5
|
* Enable verbose loggingAlex Browne2018-12-061-1/+1
|
* Rename index.ts -> merge_v2_eventsAlex Browne2018-12-061-0/+0
|
* Update script to work with existing v1 pipeline dataAlex Browne2018-12-0610-40/+90
|
* Update pipeline to use new @0x npm org for importsAlex Browne2018-12-067-16/+16
|
* Update to use ContractWrappers + Infura instead of EtherscanAlex Browne2018-12-0610-242/+85
|
* Rebase and update to use new modularized artifactsAlex Browne2018-12-066-2289/+8
|
* Add tests for SRA order conversionAlex Browne2018-12-063-4/+83
|
* Re-add missing testsAlex Browne2018-12-063-90/+164
|
* Add soruceUrl to SraOrder entityAlex Browne2018-12-062-1/+4
|
* Add preliminary support for scraping orders from SRA endpoints (no ↵Alex Browne2018-12-068-12/+134
| | | | pagination, only RR support for now)
* For event entities, rename address -> contractAddress and make it a primary keyAlex Browne2018-12-065-11/+19
|
* Implement scraping and parsing exchange CancelUpTo eventsAlex Browne2018-12-063-9/+45
|
* Use multi-primary keys for event and filter null logIndexesAlex Browne2018-12-064-6/+15
|
* Implement scraping and parsing exchange cancel eventsAlex Browne2018-12-065-10/+81
|
* Make event parsing more functional and less class-basedAlex Browne2018-12-063-65/+21
|
* Re-organize event parsing and decodingAlex Browne2018-12-067-175/+206
|
* Add support for decoding asset dataAlex Browne2018-12-065-36/+94
|
* Add typeorm and begin inserting database recordsAlex Browne2018-12-066-13/+89
|
* Make contractAbi a parameter of getContractEventsAsyncAlex Browne2018-12-064-11/+29
|
* Add tests for etherscan eventsAlex Browne2018-12-065-10/+124
|
* Restructure pipeline package. Create data-sources dirAlex Browne2018-12-064-75/+96
|
* Remove old code. Create function for getting contract events via etherscanAlex Browne2018-12-0624-1895/+2368
|
* Rebase pipeline branch off developmentAlex Browne2018-12-0625-0/+2001