Also, show an example of what you say as getting incorrect values at visual level; since you have already determined the problem and what your expected result is.
Your QS dataset has full outer-joins across all the tables which explains the issue.
If I follow your Power BI data model you want Left-Join between Calendar Date and your Fact tables (with Calendar being on the left of the join ). Same should be the case with the Reference Line table.
You should be able to change the join type from the Join Type section when you are defining the joins.