title: Running Big Queries on Athena using Lambda
body: <p>As we know that Lambda timeouts after 15 minutes of execution. I am looking for a way to execute an Athena query which is on a really huge dataset. Invoking the query from Lambda will introduce the problem of Lambda timing out before the query is processed. My ultimate goal is to invoke the query and to know when the query is complete so I could process the results. Could a state machine be used to query Athena? or does Lambda function by only invoking the athena and not waiting for results, I'll query the athena for results after the duration in which I expect the query to run? Any other ideas would be appreciated.</p>