I just wanted to know if there are any tools to automate and validate data in quicksight dashboards. Can it be done using selenium?
Thanks in advance!
1 Like
Hi @Hasini - Welcome to AWS QuickSight community and thanks for posting the question. I believe to validate the data from QuickSight Dashboard, you need to export via excel or pdf and then you can use any tool to validate this. There is NO automated way. Imagine you have a graph, without seeing the graphs, its very difficult to validate the results.
By saying that tagging @Jesse @Max for their feedback.
Regards - Sanjeeb
Thanks for the reply!
Hi @Hasini - If the above recommendation helped you, can you please mark it as solution so that it will help wider forum of QuickSight.
Regards - Sanjeeb
Hi Sanjeeb,
IS there any way to validate the look and feel of the dashboard… layout, proper color coding etc…(not manual)
1 Like
Hi @Hasini - You can export a dashboard in pdf where you can validate the color and other formatting. I believe it has to be manual check, not sure about automation.
Regards - Sanjeeb
1 Like
Hi Sanjeeb,
We are trying to interact Quicksight dashboard elements for Charts or Graphs using Selenium and it is giving NoSuchElementException though elements are recognizable using same xpath from inspect.
Hi @Hasini - I am doubtful whether you can validate the charts and visuals of QuickSight via selenium. Looks very interesting use case for me. As per my understanding the look and feel are manual process, however let’s hear from other experts in the community.
Hi @Karthik_Tharmarajan @Koushik_Muthanna @ArunSanthosh @Max @David_Wong @Naveed @eperts - Please provide your expert advise on this.
Regards - Sanjeeb
Hi @Hasini - There were a couple questions so I’ll address both.
There are two kinds of testing for BI that I’m familiar with from my experience as a BI Developer.
-
Element placement & UI - This is where the QA Engineer takes a screenshot of the dashboard before and after the code release and confirms everything looks good. It can be automated by a variety of tools.
-
Data accuracy - This is where the QA Engineer validates the data model and the data. The way i’ve seen this being performed is using Selenium, finding the chart element and then creating a csv output.
In regards to 2) this forum won’t be of much help with Selenium specific questions unfortunately.
1 Like
Hi @Hasini,
Adding on to response from Evangelos @eperts -
Selenium has put together a list of resources that you can leverage to get help on it’s usage - Support | Selenium
When using tools like selenium to automate UI testing, use data-automation-id/context fields in QuickSight pages to build the path as object ids can change. Even when using data-automation-id/context, we recommend that you use an intermediate mapping layer. These values aren’t expected to incur much changes. However, it isn’t guaranteed that they won’t ever change. Hence, having an intermediate mapping layer will minimize the effort needed in event of a change - as you will now have to just update one file instead of all your test cases.
Regards,
Arun Santhosh
4 Likes
@ArunSanthosh @eperts Thank you so much
I am able to access elements using data-automation-id. For data validation, trying out both ways to retrieve data for Charts or graphs using 1)View Summary data and 2)Export as csv from ellipsis menu.
With View Summary data, observed that all the elements of the grid are not loaded at once and only visible elements are loaded even on scroll. Not sure if the elements are hidden or a lazy loading. Can anyone confirm! and also suggest ways to access the data for charts or graphs or tables.
Export as csv is the route to go. View summary will load additional data based on scrolling.
Regards,
Arun Santhosh
1 Like
Hi @eperts , I’m a beginner as a QA. I just wanted to know for the Quicksight Dashboard what types of tools are best suited for Element placement & UI automated testing ?