This is the show create table for the table I am trying to query,
CREATE EXTERNAL TABLE srbrs_vest_activations
(
site
string COMMENT âfrom deserializerâ,
area
string COMMENT âfrom deserializerâ,
workcell
structworkcellid:string,workcelltype:string,workcelllocation:string,workcelldisplayid:string COMMENT âfrom deserializerâ,
processid
string COMMENT âfrom deserializerâ,
eventguid
string COMMENT âfrom deserializerâ,
eventtimestamp
timestamp COMMENT âfrom deserializerâ,
eventsequencenumber
bigint COMMENT âfrom deserializerâ,
eventsequencescopeid
string COMMENT âfrom deserializerâ,
device
structdeviceid:string,devicetype:string,devicedisplayid:string,devicelocation:string,parentdeviceid:string COMMENT âfrom deserializerâ,
issynthetictelemetry
boolean COMMENT âfrom deserializerâ,
payload
struct<systemkey:structcustomer:string,site:string,area:string,vestid:string,vestname:string,vesttype:string,userid:string,badge1name:string,badge2name:string,badge1fwversion:string,badge2fwversion:string,floortype:string,starttime:timestamp,eventtimestamp:timestamp,endtime:timestamp,processingtime:timestamp> COMMENT âfrom deserializerâ)
PARTITIONED BY (
pt_event_date
date)
ROW FORMAT SERDE
âorg.apache.hive.hcatalog.data.JsonSerDeâ
WITH SERDEPROPERTIES (
âpathâ=âsite,area,workcell,processId,eventGuid,eventTimestamp,eventSequenceNumber,eventSequenceScopeId,device,isSyntheticTelemetry,payloadâ,
âtimestamp.formatsâ=âyyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z',yyyy-MM-dd'T'HH:mm:ss'Z'â)
STORED AS INPUTFORMAT
âorg.apache.hadoop.mapred.TextInputFormatâ
OUTPUTFORMAT
âorg.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormatâ
LOCATION
âs3://ar-data-lake-prodna-835942842132/metric-data/ardl_common_prodna/srbrs_vest_activationsâ
TBLPROPERTIES (
âclassificationâ=âjsonâ,
âcompressionTypeâ=ânoneâ,
âprojection.enabledâ=âtrueâ,
âprojection.pt_event_date.formatâ=âyyyy-MM-ddâ,
âprojection.pt_event_date.rangeâ=âNOW-2YEARS,NOWâ,
âprojection.pt_event_date.typeâ=âdateâ)
I did have to add myself as Lake formation admin on the standard QS Account in order for queries to run I believe I have done the same by adding libs-admin-access as well as a data lake administrator unless there is something I am missing? Here is a snip of the data lake administrators showing libsAdminAccess was added but I am still not able to get data pulling with Athena on QuickSight
And yes that is correct I am able to query this data on Athena without an issues it is only on QuickSight that I am having problems getting data to pull