title: How to ensure incremental refresh includes the whole day's data?
body: <p>Suppose my incremental refresh is configured to refresh last 1 day data. This means when the ondemand/scheduled refresh runs, it will pull in the data for that day from 00:00 to time of day when the refresh runs.</p>
  <p>Suppose I have scheduled refresh configured at 8am and 8pm. This means that 8am refresh will pull data from 00:00 to 08:00. Then later when the 8pm refresh runs, it will clear the existing data for the day and pull data for 00:00 to 20:00</p>
  <p>The next day when the refresh runs then it will pull the data for 00:00 to 08:00. This means that data from 20:00 to 00:00 for each day is lost (not included in the dataset).</p>
  <p>Is it advisable to run the refresh at 23:59 so that all data for the day is included? I am concerned because a scheduled refresh is not always guarenteed to run exactly on schedule and it can take upto 1 hour based on resource availability.</p>
  <p>But then what if data is entered in the source system at 23:59:45 (45th second). Is there any way to configure the schedule so as to not loose this data?</p>
  <p>What is the solution in order to ensure that the whole days data is included in the dataset?</p>