2

A solution I am working on requires that I request 100k plus data rows from Athena in a spring api. I am led to believe that only 1000 rows at a time are provided by default. Wondering if anyone has experience with a similar operation and how to request large datasets from Athena without paging

John Rotenstein
  • 241,921
  • 22
  • 380
  • 470
mikelus
  • 927
  • 11
  • 25
  • 1
    Possibly helpful for you: [(AWS) Athena: Query Results seem too short](https://stackoverflow.com/questions/48328908/aws-athena-query-results-seem-too-short) Specifically https://docs.aws.amazon.com/athena/latest/APIReference/API_GetQueryResults.html – sorifiend Jun 03 '21 at 23:31
  • 1
    Athena saves the results of queries to an Output location in S3. I wonder if you can run the query, then download the results from S3 instead of through the API? See: [Working with Query Results, Output Files, and Query History - Amazon Athena](https://docs.aws.amazon.com/athena/latest/ug/querying.html) – John Rotenstein Jun 04 '21 at 03:12

0 Answers0