I’m experimenting changing our dataset with an Athena connector to dynamoDB from DIRECT_QUERY to SPICE, since DIRECT_QUERY is very slow. Ideally we would want an incremental refresh happening every time our lambda adds a batch of items to dynamoDB. But even when setting it as below I am getting 500 internal error during the deployment on my personal account.
const qsPerfMetricsDataSet = new CfnDataSet(this, 'qsPerfMetricsDataSet', {
awsAccountId: this.account,
name: PERF_METRICS_DATA_SET_ID,
dataSetId: PERF_METRICS_DATA_SET_ID,
importMode: 'SPICE',
physicalTableMap: {
'qsDataSetPhysicalTableMap' : qsPerfMetricsDataSetPhysicalTableMap
},
permissions: [{
principal: quickSightPrincipalArn,
actions:[
"quicksight:CreateIngestion",
"quicksight:CancelIngestion",
"quicksight:DescribeDataSet",
"quicksight:DescribeDataSetPermissions",
"quicksight:PassDataSet",
"quicksight:DescribeIngestion",
"quicksight:ListIngestions",
],
}],
});
const schedule = new CfnRefreshSchedule(this, PERF_METRICS_REFRESH_SCHEDULE_ID, {
awsAccountId: this.account,
dataSetId: PERF_METRICS_DATA_SET_ID,
schedule: {
refreshType: "FULL_REFRESH",
scheduleFrequency: {
interval: "DAILY",
timeOfTheDay: "15:00",
timeZone: "UTC",
}
},
});
2:40:25 PM | CREATE_FAILED | AWS::QuickSight::RefreshSchedule | aptperfmetricsrefreshschedule
Resource handler returned message: "Service returned error code InternalFailure (Service: QuickSight, Status Code: 500, Request ID: a4af4b
39-4743-4696-be41-b3802b7c6ada)" (RequestToken: a04b026a-1066-45b8-e825-f7a83b7310c1, HandlerErrorCode: GeneralServiceException)
Any advice?