Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | add special case to scrape OHLCV for eth/usd (#1428) | Xianny | 2018-12-14 | 1 | -10/+34 |
| | |||||
* | Fix bug that occurs when token metadata decimals is undefined. (#1426) | Alex Browne | 2018-12-13 | 2 | -4/+18 |
| | | | | | | * Fix bug that occurs when token metadata decimals is undefined. * move toBigNumberOrNull to utils | ||||
* | Fix linter errors | Leonid Logvinov | 2018-12-13 | 8 | -22/+22 |
| | |||||
* | Make pull_missing_blocks script consider all events with block numbers (#1420) | Alex Browne | 2018-12-12 | 1 | -1/+14 |
| | |||||
* | track idex orderbook snapshots (#1397) | zkao | 2018-12-12 | 9 | -20/+490 |
| | | | * Track Idex and Oasis Orderbook Snapshots | ||||
* | Refactor event scraping and add support for scraping ERC20 approval events ↵ | Alex Browne | 2018-12-12 | 12 | -194/+421 |
| | | | | | | | | (#1401) * Refactor event scraping and add support for scraping ERC20 approval events * Add tests for data_sources/contract-wrappers/utils | ||||
* | perform null check on token metadata (#1412) | Xianny | 2018-12-11 | 1 | -1/+1 |
| | |||||
* | Fix/pipeline/ohlcv ratelimit (#1403) | Xianny | 2018-12-11 | 2 | -20/+18 |
|\ | | | | | | | Use time-based throttling and increase batch size of CC query | ||||
| * | change to camelCase | xianny | 2018-12-11 | 2 | -3/+3 |
| | | |||||
| * | lint: remove unused variable | xianny | 2018-12-08 | 1 | -1/+0 |
| | | |||||
| * | refresh rate limit every second instead of every minute | xianny | 2018-12-08 | 1 | -3/+3 |
| | | |||||
| * | cleanup: stray import, rename variable | xianny | 2018-12-08 | 1 | -4/+3 |
| | | |||||
| * | query CC with larger batch size | xianny | 2018-12-08 | 1 | -3/+4 |
| | | |||||
| * | rename variable and define default in only 1 location | xianny | 2018-12-08 | 2 | -4/+5 |
| | | |||||
| * | upgrade throttling code | xianny | 2018-12-08 | 1 | -13/+11 |
| | | |||||
* | | Implement prefer-template tslint rule | kao | 2018-12-08 | 2 | -4/+4 |
|/ | |||||
* | Fix/pipeline/ohlcv (#1393) | Xianny | 2018-12-06 | 2 | -31/+43 |
| | | | The OHLCV script in data pipeline quits early when we get no data from Crypto Compare. Sometimes Crypto Compare gives us a valid empty response (e.g. when we query for way back in time) and we need to just continue. This adds better filtering for the types of Crypto Compare responses to detect when we should continue and when we should really quit. | ||||
* | Fix RadarRelay timestamps (#1391) | Alex Browne | 2018-12-06 | 2 | -4/+8 |
| | | | | | | * Fixing rr timestamps * Apply prettier | ||||
* | Change type of transactions.gas_used and gas_price to BigNumber/numeric | Alex Browne | 2018-12-05 | 2 | -7/+9 |
| | |||||
* | Fix prettier | Alex Browne | 2018-12-05 | 1 | -18/+11 |
| | |||||
* | Address PR feedback | Alex Browne | 2018-12-05 | 17 | -62/+63 |
| | |||||
* | Use a string template in packages/pipeline/src/scripts/pull_missing_events.ts | Fabio B | 2018-12-05 | 1 | -1/+1 |
| | | | Co-Authored-By: albrow <stephenalexbrowne@gmail.com> | ||||
* | Fix typo in packages/pipeline/src/parsers/bloxy/index.ts | Fabio B | 2018-12-05 | 1 | -1/+1 |
| | | | Co-Authored-By: albrow <stephenalexbrowne@gmail.com> | ||||
* | Fix linter | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | pull OHLCV records from Crypto Compare (#1349) | Xianny | 2018-12-05 | 8 | -16/+344 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [WIP] pull OHLCV records from Crypto Compare * lint * refactor to pull logic out of script and into modules * add entity test for ohlcv_external entity * implement rate limit and chronological backfill for ohlcv * add unit tests; cleanup variable names * Fetch OHLCV pairs params from events table * better method names * fix outdated test * lint * Clean up after review * oops * fix failing test * better filtering of most recent records * fix bug when generating pairs * fix default earliest backfill date * fix bug with retrieving backfill time * prettier | ||||
* | Token_orderbook_snapshots for Ddex and Paradex(#1354) | zkao | 2018-12-05 | 10 | -0/+488 |
| | | | | | | * Implements the TokenOrderbookSnapshot Table * Scripts, Data Sources and Entities to pull Ddex and Paradex API data. | ||||
* | Add script for parsing competing dex trades from Bloxy (#1355) | Alex Browne | 2018-12-05 | 6 | -4/+298 |
| | |||||
* | Introduce framework for running basic tests for entities (#1344) | Alex Browne | 2018-12-05 | 11 | -29/+70 |
| | | | | | | | | | | | | | | | | | | | | | | * Introduce framework for running basic tests for entities * Add pipeline tests to CircleCI config * Make pipeline tests more configurable and fix CircleCI config * Add coverage dir to pipeline package * Add basic tests for all exchange event entities * Add tests for remaining entities * Create separate test scripts in package.json and add new info to README * Update db_setup.ts to revert migrations even if you are using docker * Automatically pull the postgres image if needed * Add comment about why NumberToBigIntTransformer is needed | ||||
* | Reduce number of blocks per query in pull_missing_events | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | updating comment for 0x trusted tokens | Jake Ellowitz | 2018-12-05 | 3 | -8/+7 |
| | |||||
* | metadata and trusted sources in same raw table | Jake Ellowitz | 2018-12-05 | 9 | -53/+55 |
| | |||||
* | Pull token metadata re trusted tokens | Jake Ellowitz | 2018-12-05 | 11 | -2/+162 |
| | |||||
* | Add script for pulling missing block data | Alex Browne | 2018-12-05 | 3 | -3/+89 |
| | |||||
* | Check for special characters in table name in pull_missing_events | Alex Browne | 2018-12-05 | 1 | -3/+7 |
| | |||||
* | Add support for pulling Cancel and CancelUpTo events | Alex Browne | 2018-12-05 | 4 | -87/+150 |
| | |||||
* | Add transactionHash to CancelUpToEvent and CancelEvent entities | Alex Browne | 2018-12-05 | 3 | -1/+6 |
| | |||||
* | Optimize database operations in pull_missing_events script | Alex Browne | 2018-12-05 | 1 | -9/+26 |
| | |||||
* | Add homepage_url to relayers | Alex Browne | 2018-12-05 | 2 | -7/+8 |
| | |||||
* | Add workaround for broken save method | Alex Browne | 2018-12-05 | 2 | -2/+22 |
| | |||||
* | Fix chunk size in pull_missing_events | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | Use built-in chunk feature of TypeORM save method | Alex Browne | 2018-12-05 | 1 | -7/+2 |
| | |||||
* | Change some column types from varchar to numeric | Alex Browne | 2018-12-05 | 8 | -35/+57 |
| | |||||
* | Add raw schema prefix to query in pull_missing_events | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | Rename taker and maker amounts in sra_orders | Alex Browne | 2018-12-05 | 1 | -2/+2 |
| | |||||
* | Implement scraping sra orders from radar relay | Alex Browne | 2018-12-05 | 6 | -22/+52 |
| | |||||
* | Preliminary work for adding RR order book scraping | Alex Browne | 2018-12-05 | 1 | -0/+52 |
| | |||||
* | Update schema for sra_orders | Alex Browne | 2018-12-05 | 1 | -6/+1 |
| | |||||
* | Pointing entities to raw schema | Jake Ellowitz | 2018-12-05 | 8 | -9/+9 |
| | | | | Fix linter issues | ||||
* | Mapping dev schema to initial migration | Jake Ellowitz | 2018-12-05 | 3 | -1/+18 |
| | |||||
* | Configure linter with --format stylish and fix linter errors | Alex Browne | 2018-12-05 | 11 | -6/+80 |
| | |||||
* | Configure TypeORM for migrations. Add new package.json scripts. | Alex Browne | 2018-12-05 | 3 | -26/+11 |
| | |||||
* | Rename Transaction.ts to transaction.ts | Alex Browne | 2018-12-05 | 3 | -0/+0 |
| | | | | | | Rename Relayer.ts to relayer.ts Rename Block.ts to block.ts | ||||
* | Add better error handling for immediately invoked async functions | Alex Browne | 2018-12-05 | 4 | -85/+20 |
| | |||||
* | Rename table and column names | Alex Browne | 2018-12-05 | 9 | -97/+171 |
| | |||||
* | Reorganize entities. Make scripts work from any directory. | Alex Browne | 2018-12-05 | 13 | -12/+36 |
| | |||||
* | Split index.ts into multiple scripts in scripts/ and detect last known block ↵ | Alex Browne | 2018-12-05 | 4 | -92/+95 |
| | | | | when pulling events | ||||
* | Remove unused function parameter in index.ts script | Alex Browne | 2018-12-05 | 1 | -2/+2 |
| | |||||
* | Use bigint for gasUsed and gasPrice in Transaction | Alex Browne | 2018-12-05 | 2 | -5/+7 |
| | |||||
* | Update relayer code to use new relayer-registry format | Alex Browne | 2018-12-05 | 4 | -6/+14 |
| | |||||
* | Implement fetching and parsing relayer info | Alex Browne | 2018-12-05 | 4 | -6/+106 |
| | |||||
* | Implement support for getting and parsing blocks and transactions | Alex Browne | 2018-12-05 | 5 | -0/+149 |
| | |||||
* | chore: Fix tslint config. | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | Fix bugs in merge_v2_events script and disable verbose logging | Alex Browne | 2018-12-05 | 2 | -2/+5 |
| | |||||
* | Enable verbose logging | Alex Browne | 2018-12-05 | 1 | -1/+1 |
| | |||||
* | Rename index.ts -> merge_v2_events | Alex Browne | 2018-12-05 | 1 | -0/+0 |
| | |||||
* | Update script to work with existing v1 pipeline data | Alex Browne | 2018-12-05 | 8 | -36/+84 |
| | |||||
* | Update pipeline to use new @0x npm org for imports | Alex Browne | 2018-12-05 | 5 | -12/+12 |
| | |||||
* | Update to use ContractWrappers + Infura instead of Etherscan | Alex Browne | 2018-12-05 | 6 | -135/+71 |
| | |||||
* | Rebase and update to use new modularized artifacts | Alex Browne | 2018-12-05 | 4 | -2279/+2 |
| | |||||
* | Add tests for SRA order conversion | Alex Browne | 2018-12-05 | 2 | -4/+4 |
| | |||||
* | Add soruceUrl to SraOrder entity | Alex Browne | 2018-12-05 | 2 | -1/+4 |
| | |||||
* | Add preliminary support for scraping orders from SRA endpoints (no ↵ | Alex Browne | 2018-12-05 | 7 | -12/+133 |
| | | | | pagination, only RR support for now) | ||||
* | For event entities, rename address -> contractAddress and make it a primary key | Alex Browne | 2018-12-05 | 5 | -11/+19 |
| | |||||
* | Implement scraping and parsing exchange CancelUpTo events | Alex Browne | 2018-12-05 | 3 | -9/+45 |
| | |||||
* | Use multi-primary keys for event and filter null logIndexes | Alex Browne | 2018-12-05 | 4 | -6/+15 |
| | |||||
* | Implement scraping and parsing exchange cancel events | Alex Browne | 2018-12-05 | 5 | -10/+81 |
| | |||||
* | Make event parsing more functional and less class-based | Alex Browne | 2018-12-05 | 3 | -65/+21 |
| | |||||
* | Re-organize event parsing and decoding | Alex Browne | 2018-12-05 | 6 | -89/+120 |
| | |||||
* | Add support for decoding asset data | Alex Browne | 2018-12-05 | 4 | -36/+92 |
| | |||||
* | Add typeorm and begin inserting database records | Alex Browne | 2018-12-05 | 4 | -7/+78 |
| | |||||
* | Make contractAbi a parameter of getContractEventsAsync | Alex Browne | 2018-12-05 | 3 | -10/+26 |
| | |||||
* | Add tests for etherscan events | Alex Browne | 2018-12-05 | 2 | -9/+17 |
| | |||||
* | Restructure pipeline package. Create data-sources dir | Alex Browne | 2018-12-05 | 4 | -75/+96 |
| | |||||
* | Remove old code. Create function for getting contract events via etherscan | Alex Browne | 2018-12-05 | 22 | -1868/+2348 |
| | |||||
* | Rebase pipeline branch off development | Alex Browne | 2018-12-05 | 19 | -0/+1870 |