Using chalice framework, we could create a function that is triggered whenever there is an event in S3. This event will trigger an action, which could be used process the data. I extensively use lambda using python in my full time job, to process large data. I could do this for you.