Hi,
- I am a developer with extensive practical experience in Data Warehousing and Data Integration projects building ETL (Extract, Transform and Load) jobs using open-source tool 'Talend for Data Integration', which is a Java code generator tool that builds programs out of workflow and data flow designs. And I also know the challenges of automating the gathering and consolidation of several data sources (Web services, CSV, XLS) into a data warehouse.
For this project, I can develop a master ETL job that will:
- Connect to SharePoint using standard Talend SOAP components, or plain JDBC connection.
- Poll for changes on each of your Sharepoint lists based on business rules,
- Retrieve Updated/New items from each list,
- Perform row transfomation and filtering if required,
- Insert rows into target database tables,
- Orchestrate all steps above.
Deliverable will be a packaged Java program (JAR) that can be scheduled daily or even run on demand.
Look forward to hearing from you.
Kind regards,
Yordan B