Way to get existing data and organize in your own use

in #teamaustralia5 years ago (edited)

As an individual investor in Australia stock market who want to establish your own trading system, one of the most important input is market data. However, market data is not cheap, and market data vendors' clients are mostly those institutes and fund managers. Their data is too fine for most individual investors and most people don't like to pay so much for things overqualified. There are ways to get some data for free which are public for private research. I will describe how to use some technology to download those data and format it in .csv which is wide used by many people. This is an outline.

  1. how to get financial data from yahoo finance including historical price, balance sheet, income and cash report, and how to keep this up to date.
  2. how to get delayed real time price directly from ASX.
  3. If you have an existing trading system which need rest API data input, how to organize and convert these data into format you need.
  4. to make your data accessible wherever you are, create an instance in aws for free.
  5. build a python running environment in aws EC2.
  6. use putty to get access to your EC2 instance.
  7. use winSCP to download/upload your program with aws.
  8. launch your software with nginx, gunicorn.
  9. configure crontab in aws to keep your historical data up to date.

Coin Marketplace

STEEM 0.30
TRX 0.12
JST 0.033
BTC 64344.02
ETH 3142.36
USDT 1.00
SBD 4.01