Finance website Data aggregation

Experts provide stock recommendations every day through various channels (TV, Twitter, Print media etc) We need a solution which will gather all the recommendations from websites on a daily basis. Eg: [login to view URL] [login to view URL] [login to view URL] [login to view URL] we need to gather the following information from websites like above : 1. Stock name / ticker symbol 2. Recommendation date and stock price when it was recommended 3. Name of provider: this could be an individual expert for the firm 4. Target price 5. Buy / Sell - Is the recommendation to buy or sell 6. Stop loss price 7. Any other usefull information. The project is : 1. Find a number of structured / unstructured data soruces to gather this trade recommendation information. This can be obtained by calling API or downloaded or scrapped from the web. 2. Build a platform which gets this information on a daily basis - This should take care of the data sources already visited and not process them again. it should be easy to add more data sources and schedule their data collection too. For eg: if you can make a crawl plan/data conversion plan for each of the websites then adding new website is easy. 3. Run the platform to get this information and store it in a database. 4. Data collection should be legal and ethical - there should be limits on how many times API is called or a data source is visited. all data collected should be with name of place/person from which it was collected so that we can reference it accordingly. More the data sources and trading calls you can accumulate, higher will ne your chances of winning. Java, AWS, Python for scrapping or any other technologies which you are comfortable with can be used.