title,body,link,tags,view_count,is_answered,score,answer_count
Automating CSS Regression Testing with GEB,"<p>We have a suite of UI tests (Functional) that use GEB. However the code is legacy, not following CSS componentization and one change in CSS can have undetected side-effects in unrelated areas. Is there any plugin or workflow that can be integrated with GEB to provide Automating CSS Regression Testing?</p>

<p>In the JS world there exists BackStopJS for Javascript. Is there anything analogous for GEB?</p>
",https://stackoverflow.com/questions/54826336/automating-css-regression-testing-with-geb,"['css', 'geb', 'ui-testing', 'regression-testing']",90,True,0,1
Integration Percy visual regression testing status check with Github,"<p>I am trying to integrate Percy.io, a visual regression testing tool with Github status check. </p>

<p>I have signed up for free account with <a href=""https://percy.io/"" rel=""nofollow noreferrer"">Percy</a> and paid Github version.</p>

<p>I wanted to setup status check with Percy with each pull request as below suggested at <a href=""https://docs.percy.io/docs/github"" rel=""nofollow noreferrer"">percy doc on status check</a></p>

<p><a href=""https://i.stack.imgur.com/nD4F6.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/nD4F6.png"" alt=""enter image description here""></a></p>

<p>I have integrated Percy in Github
<a href=""https://i.stack.imgur.com/q56jG.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/q56jG.png"" alt=""enter image description here""></a></p>

<p>Added rules in Github
<a href=""https://i.stack.imgur.com/sQntO.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/sQntO.png"" alt=""enter image description here""></a></p>

<p>but still don't see check on pull request.
<a href=""https://i.stack.imgur.com/o9PD6.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/o9PD6.png"" alt=""enter image description here""></a></p>

<p>Added same project in percy.io too
<a href=""https://i.stack.imgur.com/XlnlY.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/XlnlY.png"" alt=""enter image description here""></a></p>

<p>Any Idea what I am missing over here?</p>
",https://stackoverflow.com/questions/58274802/integration-percy-visual-regression-testing-status-check-with-github,['github'],280,False,0,1
How to visual regression testing of Storybook with addon-knobs?,"<p>I'm examining a method for visual regression testing of nearly 1,000 components in a React project. And I'm thinking of using Storybook and BackstopJS to realize it, because many components were already implemented on the Storybook, I thought that I could solve it the fastest.</p>

<p>So then, extracting the Storybook scenario automatically, generated a TOC of <code>iframe.html</code> queries, and giving it to BackstopJS to realize this. This method looked like it worked, but there was a problem.</p>

<p>Most components in this project are stateless, and actions and state changes are clearly separated. Therefore, I used <a href=""https://www.npmjs.com/package/@storybook/addon-knobs"" rel=""nofollow noreferrer""><code>@storybook/addon-knobs</code></a> to check the state change manually. However, as the <a href=""https://github.com/storybooks/storybook/issues/3855"" rel=""nofollow noreferrer"">issue</a> is mentioned, it appears that knobs do not expect direct manipulation from URL and queries.</p>

<p>I gave up on the snapshot in iframe.html and thought about manipulating knobs from index.html. But the situation where the menu differences on the left pane are frequent and cannot be testing.</p>

<p>Do you have good ideas?</p>
",https://stackoverflow.com/questions/55291601/how-to-visual-regression-testing-of-storybook-with-addon-knobs,"['testing', 'regression-testing', 'storybook', 'backstop.js', 'visual-testing']",654,True,2,1
SUR regression: Testing if means of coefficients are equal to zero or not,"<p>I am running a SUR regression with returns of 80 different banks as dependent variables. The independent variables are always the same. You should be able to recreate the regression using the code below, if necessary to answer my questions, which are:</p>

<ol>
<li><p>How can I test whether the average of the coefficient for ""Event"" for all 80 banks in the sample is equal to zero or not?</p></li>
<li><p>How can I test whether subgroups in the sample, say the first 20 banks and the last 40 banks, have similar average coeffients for ""Event"" or if they are significantly different from each other?</p>

<pre><code>library(""systemfit"")
library(""plm"")
cyp3 &lt;- read.table(""https://pastebin.com/raw.php?i=/SpuUiaj7"", sep="";"", header=TRUE)
cyp3panel&lt;-pdata.frame(cyp3, c(""id"", ""t""))
cyp3sur&lt;-systemfit(returns ~ Price + Pre + Event + Post + Zpre1 + Zevent1 + Zpost1 + Zpre2 + Zevent2 + Zpost2 + Zpre3 + Zevent3 + Zpost3, method = ""SUR"",data = cyp3panel)
</code></pre></li>
</ol>

<p>Thanks for your help. Let me know if something is missing, please!</p>
",https://stackoverflow.com/questions/54378662/sur-regression-testing-if-means-of-coefficients-are-equal-to-zero-or-not,"['r', 'hypothesis-test']",288,True,1,1
What are different between Regression testing and test re running in Quality assurance?,"<p>I'm a beginner of software testing and I'm referring about testing type. Then I have met this question.</p>
",https://stackoverflow.com/questions/55390992/what-are-different-between-regression-testing-and-test-re-running-in-quality-ass,['testing'],55,False,0,3
Making my logistic regression testing accuracy closer to my training accuracy with Python,"<p>I have a basketball stats data set with 656 factors. I am using a logistic regression classifier to predict winners and losers (team 1 wins or team 2 wins) by subtracting team 1 stats from team 2 stats. Other than normalization how can I improve the accuracy of my testing set to get it closer to accuracy of training set or just improving accuracy in general?</p>

<p>I saw normalization as a possible solution, but since I am doing the difference of stats most of the values are in the same range</p>

<h3>Code:</h3>

<pre><code>X = final_data_array[:,:656]

Y = final_data_array[:,656]

X_train, X_test, Y_train, Y_test = train_test_split(X, Y)

logistic = LogisticRegression(solver='lbfgs', max_iter=4000000, multi_class='multinomial').fit(X_train, Y_train)

print(logistic.score(X_test, Y_test))

print(logistic.score(X_train, Y_train))

0.7818791946308725

0.9069506726457399
</code></pre>
",https://stackoverflow.com/questions/55484760/making-my-logistic-regression-testing-accuracy-closer-to-my-training-accuracy-wi,"['python', 'logistic-regression', 'hyperparameters']",701,True,0,1
How can we set up Maven project in GoCD?,"<p>I have worked with Jenkins before. But we moved to GoCD now. I want to run a simple Maven project periodically for regression testing purposes.</p>
",https://stackoverflow.com/questions/58324369/how-can-we-set-up-maven-project-in-gocd,"['maven', 'continuous-integration', 'go-cd']",596,True,2,2
Should I replace my master branch with my release branch or merge my release branch into my master branch?,"<p>I'm currently attempting to move my team to this <a href=""https://www.atlassian.com/git/tutorials/comparing-workflows/gitflow-workflow"" rel=""nofollow noreferrer"">gitflow workflow</a> and I am wondering if it's best to merge my release branch into my master branch once it's ready to go live or replace my master branch with my release candidate branch altogether. </p>

<p>We're doing all of our regression testing on the release candidate branch and are worried that my merging it into master it may affect it in some way making all of our regression testing ineffective.</p>

<p>Anyone ever had to deal with this before? </p>
",https://stackoverflow.com/questions/56534622/should-i-replace-my-master-branch-with-my-release-branch-or-merge-my-release-bra,"['workflow', 'git-flow']",595,True,0,1
Copying a Test Plan to Different Projects,"<p>I'm considering setting up a Project in Azure DevOps as Master Regression Test, which will have test plans, suites, test cases, steps, etc. I'd like to be able to copy the test plans into other projects during regression testing.</p>
",https://stackoverflow.com/questions/57332425/copying-a-test-plan-to-different-projects,['azure-devops'],1000,True,1,2
How Can Apache NiFi Flow Be Tested?,"<p>We have started using NiFi for a lot of our data pipeline jobs. One of things which is challenging in Nifi is to do regression testing of the changes to the flows.</p>
<p>What are the common ways to handle unit and functional testing of NiFi flows? Are there any frameworks?</p>
",https://stackoverflow.com/questions/57062240/how-can-apache-nifi-flow-be-tested,"['apache-nifi', 'apache-nifi-registry']",5530,True,6,1
Can I create automation testing in VS 2017 dotnet 4.7 using Selenium,"<p>I am going to automate regression testing in Visual Studio 2017 dotnet 4.7 platform using Selenium webdriver. What language (testing) could be the best choice if someone can help. Also, what steps do I need to follow in terms of any other plugins etc.</p>
",https://stackoverflow.com/questions/58458199/can-i-create-automation-testing-in-vs-2017-dotnet-4-7-using-selenium,"['visual-studio', 'selenium-webdriver', 'azure-automation']",28,False,0,0
Automating CSS Regression Testing with GEB,"<p>We have a suite of UI tests (Functional) that use GEB. However the code is legacy, not following CSS componentization and one change in CSS can have undetected side-effects in unrelated areas. Is there any plugin or workflow that can be integrated with GEB to provide Automating CSS Regression Testing?</p>

<p>In the JS world there exists BackStopJS for Javascript. Is there anything analogous for GEB?</p>
",https://stackoverflow.com/questions/54826336/automating-css-regression-testing-with-geb,"['css', 'geb', 'ui-testing', 'regression-testing']",90,True,0,1
How to integrate Percy.io with Gerrit (Repository Integrations)?,"<p>I am working on a Visual Regression Testing project, that requires Percy. I followed the instructions for Repository Integrations. The instructions only show 'Connect your GitHub or GitLab repositories to add visual testing to pull/merge requests.', but I want to integrate with Gerrit. And also Jenkins, I cannot find any relative stuff that helps me for the integration on manage Jenkins page as I follow the instructions on Percy.</p>
",https://stackoverflow.com/questions/55363672/how-to-integrate-percy-io-with-gerrit-repository-integrations,"['jenkins', 'integration', 'gerrit', 'visual-testing']",165,True,0,1
How to fix: Message: org.openqa.selenium.WebDriverException: chrome not reachable,"<p>I'm setting up Selenium based regression tests using ChromeDriver on a Jenkins ECS slave.</p>

<p>ChromeDriver is installedn on the ECS slave using Maven-plugin <code>""driver-binary-downloader-maven-plugin""</code></p>

<p>When logging in the docker container I see ChromeDriver installed in 
<code>/usr/bin/linux/googlechrome/64bit/chromedriver</code></p>

<p>Docker container is started with <code>--privileged</code></p>

<hr>

<p><strong>pom.xml</strong></p>

<pre class=""lang-xml prettyprint-override""><code>&lt;plugin&gt;
    &lt;groupId&gt;com.lazerycode.selenium&lt;/groupId&gt;
    &lt;artifactId&gt;driver-binary-downloader-maven-plugin&lt;/artifactId&gt;
    &lt;version&gt;1.0.17&lt;/version&gt;
    &lt;configuration&gt;
        &lt;rootStandaloneServerDirectory&gt;/usr/bin&lt;/rootStandaloneServerDirectory&gt;
        &lt;downloadedZipFileDirectory&gt;drivers/zips&lt;/downloadedZipFileDirectory&gt;
    &lt;/configuration&gt;
    &lt;executions&gt;
        &lt;execution&gt;
            &lt;phase&gt;pre-integration-test&lt;/phase&gt;
            &lt;goals&gt;
                &lt;goal&gt;selenium&lt;/goal&gt;
            &lt;/goals&gt;
        &lt;/execution&gt;
    &lt;/executions&gt;
&lt;/plugin&gt;
</code></pre>

<p><strong>BrowserDriverHolder.java</strong></p>

<pre class=""lang-java prettyprint-override""><code>private WebDriver createDriver(final String driverName, final String headless) {
    ChromeOptions options = new ChromeOptions();
    if (headless.toLowerCase().equals(""true"")) {
      options.addArguments(""headless"");
    }

    options.addArguments(""debug"");
    options.addArguments(""no-sandbox"");

    options.setBinary(""/usr/bin/linux/googlechrome/64bit/chromedriver"");
    System.setProperty(""webdriver.chrome.driver"", ""/usr/bin/linux/googlechrome/64bit/chromedriver"");
    options.addArguments(""window-size=1920,1080"");
    ChromeDriver driver = new ChromeDriver(options);

    driver.manage().window().maximize();
    driver.manage().timeouts().pageLoadTimeout(360, TimeUnit.SECONDS);
    driver.manage().timeouts().setScriptTimeout(360, TimeUnit.SECONDS);
    driver.manage().timeouts().implicitlyWait(30, TimeUnit.SECONDS);

    return driver;
}
</code></pre>

<hr>

<p>ECS container comes up successfully and starts regression testing, getting this error message:</p>

<pre><code>Starting ChromeDriver 2.33.506092 (733a02544d189eeb751fe0d7ddca79a0ee28cce4) on port 19809
Only local connections are allowed.
Starting ChromeDriver 2.33.506092 (733a02544d189eeb751fe0d7ddca79a0ee28cce4) on port 9515
Only local connections are allowed.
Message: org.openqa.selenium.WebDriverException: chrome not reachable
  (Driver info: chromedriver=2.33.506092 (733a02544d189eeb751fe0d7ddca79a0ee28cce4),platform=Linux 4.14.77-69.57.amzn1.x86_64 x86_64) (WARNING: The server did not provide any stacktrace information)
Command duration or timeout: 60.17 seconds
Build info: version: '3.8.1', revision: '6e95a6684b', time: '2017-12-01T18:33:54.468Z'
System info: host: 'ip-172-27-93-92.eu-central-1.compute.internal', ip: '172.27.93.92', os.name: 'Linux', os.arch: 'amd64', os.version: '4.14.77-69.57.amzn1.x86_64', java.version: '9.0.4'
Driver info: driver.version: ChromeDriver
    at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:488)
    at org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:214)
    at org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:166)
    at org.openqa.selenium.remote.JsonWireProtocolResponse.lambda$new$0(JsonWireProtocolResponse.java:53)
    at org.openqa.selenium.remote.JsonWireProtocolResponse.lambda$getResponseFunction$2(JsonWireProtocolResponse.java:91)
    at org.openqa.selenium.remote.ProtocolHandshake.lambda$createSession$0(ProtocolHandshake.java:123)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958)
    at java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:127)
    at java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:502)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:488)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
    at java.base/java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
    at java.base/java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:476)

</code></pre>

<p>ChromeDriver is running and listening on the given ports.</p>

<p>I'm struggling to find the solution, any help is appreciated.</p>
",https://stackoverflow.com/questions/56166215/how-to-fix-message-org-openqa-selenium-webdriverexception-chrome-not-reachabl,"['selenium', 'google-chrome', 'jenkins']",885,False,0,1
Integration Percy visual regression testing status check with Github,"<p>I am trying to integrate Percy.io, a visual regression testing tool with Github status check. </p>

<p>I have signed up for free account with <a href=""https://percy.io/"" rel=""nofollow noreferrer"">Percy</a> and paid Github version.</p>

<p>I wanted to setup status check with Percy with each pull request as below suggested at <a href=""https://docs.percy.io/docs/github"" rel=""nofollow noreferrer"">percy doc on status check</a></p>

<p><a href=""https://i.stack.imgur.com/nD4F6.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/nD4F6.png"" alt=""enter image description here""></a></p>

<p>I have integrated Percy in Github
<a href=""https://i.stack.imgur.com/q56jG.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/q56jG.png"" alt=""enter image description here""></a></p>

<p>Added rules in Github
<a href=""https://i.stack.imgur.com/sQntO.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/sQntO.png"" alt=""enter image description here""></a></p>

<p>but still don't see check on pull request.
<a href=""https://i.stack.imgur.com/o9PD6.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/o9PD6.png"" alt=""enter image description here""></a></p>

<p>Added same project in percy.io too
<a href=""https://i.stack.imgur.com/XlnlY.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/XlnlY.png"" alt=""enter image description here""></a></p>

<p>Any Idea what I am missing over here?</p>
",https://stackoverflow.com/questions/58274802/integration-percy-visual-regression-testing-status-check-with-github,['github'],280,False,0,1
Puppeteer resize before screenshot is causing flaky visual diff tests,"<p>I am using BackstopJS for visual regression testing. Backstop uses Puppeteer as the test engine. Some screenshots are inconsistent because the viewport is being resized when Puppeteer takes a screenshot. My app has animations whenever the viewport is resized. Is there any way around this?</p>

<p>I've tried increasing the window and viewport size so that no elements are offscreen and Puppeteer doesn't need to resize the window. I've also tried setting scrollheight on the window to 0 for both x and y.</p>
",https://stackoverflow.com/questions/54368957/puppeteer-resize-before-screenshot-is-causing-flaky-visual-diff-tests,"['javascript', 'screenshot', 'puppeteer', 'backstop.js']",1176,True,0,1
Run Chrome with a different user -Katalon and groovy,"<p>I am using katalon and groovy for test automation.</p>

<p>We have a module where I need to login with different users and test the functionality.I am looking to automate the regression testing of this module but the challenge for me here is to automate the login as different user scenario, also I couldn't find any scripts that support different user login for groovy or java .</p>

<p><a href=""https://forum.katalon.com/t/run-chrome-with-a-different-user-than-the-one-who-started-katalon/15421/7"" rel=""nofollow noreferrer"">https://forum.katalon.com/t/run-chrome-with-a-different-user-than-the-one-who-started-katalon/15421/7</a></p>

<p>Please advise.</p>

<pre><code>public IWebDriver CreateNewBrowserFor(string Who)
{
    //Decide which of Selenium nodes we want to connect to 
    string CapabilitiesOfTargetUser;
    if(Who.Equals(""user1""))
    {
        //We need to control a browser for user1 on his node
        CapabilitiesOfTargetUser = ""platform=Mac;browserName=firefox"";
    }
    else if(Who.Equals(""me""))
    {
        //We need to control a browser for me on my node
        CapabilitiesOfTargetUser = ""platform=WINDOWS"";
    }
    else
    {
        throw new ArgumentException();
    }

    //Create a Selenium DesiredCapabilities object that contains our choosen capabilities
    Dictionary&lt;string, object&gt; RequestedCapabilities = new Dictionary&lt;string, object&gt; ();
    string[] CapabilitiesArray = CapabilitiesOfTargetUser.Split(';');
    foreach(string KeyValuePair in CapabilitiesArray)
    {
        string key = KeyValuePair.Split('=').First().Trim();
        string value = KeyValuePair.Split('=').Last().Trim();
        RequestedCapabilities[key] = value;
    }
    DesiredCapabilities Capabilities = new DesiredCapabilities(RequestedCapabilities);

    //Create the RemoteWebDriver. Selenium's hub will ensure that this RemoteWebDriver is
    //actually controlling a new browser on the correct machine
    return  new RemoteWebDriver
    (
         new Uri(""http://localhost:4444/wd/hub"")
       , Capabilities
       , new TimeSpan(0, 0, 50)
    );
}
</code></pre>
",https://stackoverflow.com/questions/54867691/run-chrome-with-a-different-user-katalon-and-groovy,"['selenium-webdriver', 'groovy', 'katalon-studio']",271,False,1,0
Vue.js moduler build,"<p>We have project of around 100 pages. We are migrating our front end to some emerging technology. We almost have finalized Vue.js(with vue cli). Vue CLI is building project in one build.js. We have a problem with that. We have frequent requirement changes. So after every small change, we will have to upload whole build js and that will need regression testing of the whole project. Is there any way that build will be module wise? So that only changed module need to be uploaded on live after changes.</p>
",https://stackoverflow.com/questions/55546216/vue-js-moduler-build,"['javascript', 'vue.js', 'build', 'vue-component']",75,True,2,1
Can I get my React component to render conditionally with renderToStaticMarkup?,"<p>I have a list of components that I'm preparing for automated visual regression testing (VRT) and have a system set up to do that rendering them individually with <code>ReactDOM.renderToStaticMarkup</code> for the tests to reference. </p>

<p>On the visual side, theses components are sometimes wrapped in a <code>WrapperComponent</code> with extra styles to display them differently when viewed on screen for human eyes.</p>

<p>Is there a way to make the <code>WrapperComponent</code> aware of its renderer (so to speak), so that I can conditionally omit the <code>WrapperComponent</code> from the markup that's sent to VRT?</p>

<p>Essentially I'd to do something like:</p>

<pre><code>ReactDOM.renderToStaticMarkup(componentPossiblyWithWrapperComponentInside)
</code></pre>

<p>In the <code>WrapperComponent</code>:</p>

<pre><code>class WrapperComponent extends React.Component {
  render() {
    return isBeingRenderedForVRT ?
      this.props.children :
      (
      &lt;div className='wrapper-component-for-human-screens'&gt;
        {this.props.children}
      &lt;/div&gt;
    )
  }
}
</code></pre>
",https://stackoverflow.com/questions/56657716/can-i-get-my-react-component-to-render-conditionally-with-rendertostaticmarkup,['reactjs'],109,False,0,0
shake - how to copy all contents of a directory,"<p>I want to use shake for regression testing and I have to set up the test directory. I would like to copy a directory with fonts into the test directory and included a <code>need</code> on the target directory and then copy the files but my code gives the error: </p>

<pre><code>Probably due to calling 'need' on a directory. Shake only permits 'need' on files.
</code></pre>

<p>I tried to get <code>needs</code> on the single files, but do not succeed. I have </p>

<pre><code>        fontFiles1 &lt;- getDirectoryFiles (templatesD&lt;/&gt;""et-book"" ) [""/**/*""]
        need $ map (\f -&gt; staticD&lt;/&gt;""et-book""&lt;/&gt;f) fontFiles1 
</code></pre>

<p>and then :</p>

<pre><code>  (staticD&lt;/&gt;""et-book/**"") %&gt; \out -&gt;
        copyFileChanged  (replaceDirectory out (templatesD&lt;/&gt;""et-book"")) out
</code></pre>

<p>but this does not include all the subdirectories under <code>et-book</code>. </p>

<p>What is the right way to do this? Should I just copy all directory content over (with e.g. System.Path from fsutils)?</p>
",https://stackoverflow.com/questions/54437839/shake-how-to-copy-all-contents-of-a-directory,['shake-build-system'],75,True,0,1
Should I upgrade from .NET Framework 4.5.1?,"<p>At work, I inherited a few WPF applications that target .NET Framework 4.5.1.
But .NET Framework 4.5.1 is no longer supported on any OS as mentioned <a href=""https://support.microsoft.com/en-us/help/17455/lifecycle-faq-net-framework"" rel=""nofollow noreferrer"">here</a></p>

<p>Our clients use Windows 7/8.1/10 and they all have .NET Framework 4.5.2 or above. Since .NET Framework 4.5.2 or higher versions are in-place updates for .NET Framework 4.5, the WPF applications all run fine.</p>

<p>Should I update the WPF applications to target .NET 4.5.2 at the least? Cost of update is minor development work but a lot of time doing regression testing. </p>
",https://stackoverflow.com/questions/55110151/should-i-upgrade-from-net-framework-4-5-1,"['.net', '.net-4.5']",503,False,0,0
Specflow - What is the testing type which is covered as part of feature file/BDD,"<p>This might be a sort of stupid question, but still trying to find my understanding on BDD Specflow .
In my experience across Specflow - seen different companies using Specflow to capture scenarios/test across-</p>

<ul>
<li>Component level Testing </li>
<li>Functional Testing </li>
<li>System Integration Testing</li>
<li>Regression Testing</li>
</ul>

<p>So say for example my feature below for System Integration test coverage-</p>

<pre><code>Given An active account exists
When I  fill up a form &amp; submit a new investment (submitted but not approved)
Then Check the record inserted into a specific table
And new transaction displayed in Holdings report
And new transaction not displayed in cash balance report (as not yet approved)
</code></pre>

<p>In some companies they practice to break it down further-Component</p>

<p>Separate out above scenario to 2 features like below - </p>

<ol>
<li><p>One validating till inserted to database</p>

<pre><code>Given An active account exists
When I  fill up a form &amp; submit a new investment (submitted but not approved)
Then Check the record inserted into a specific table
</code></pre></li>
<li><p>The other Checking the reports</p>

<pre><code>Given A new Investment is recorded
        When we run the reports
        Then new transaction displayed in Holdings report
        And new transaction not displayed in cash balance report (as not yet approved)
</code></pre></li>
</ol>

<p>Which of the above is right way of writing Specflow features? Whats best practice?</p>
",https://stackoverflow.com/questions/57703488/specflow-what-is-the-testing-type-which-is-covered-as-part-of-feature-file-bdd,"['c#', 'automated-tests', 'bdd', 'specflow']",171,True,2,1
"Jmeter reports - How can I create a report that will list all samplers, in the order they ran, with success or fail results","<p>We are using Jmeter for non-regression testing. We want a report with all samplers listed, in the order they ran, and with succes or fail. If fail, we want it to list the reason (which asserts failed and why).</p>

<p>This is the behavior we were getting with old Jmeter using a view result tree outputting to a xml file, and then using the XSL Jmeter transform to create a html report.</p>

<p>In the new report framework, I have not been able to find a way to reproduce this. All types of reports seems to do aggregations.</p>
",https://stackoverflow.com/questions/54809225/jmeter-reports-how-can-i-create-a-report-that-will-list-all-samplers-in-the-o,['jmeter'],83,True,1,1
Vue js - How to iterate an array inside an array?,"<p>I need some dynamic select boxes when given a certain count.
For that I have used two arrays - </p>

<pre class=""lang-none prettyprint-override""><code>(i)Array of index (count)
(ii)Array of values.
</code></pre>

<p>For first one I have used a v-model (as it need some dynamic input boxes) and second I have just used key and took out its value.</p>

<p>I have tried doing it with single iteration using second array but it failed regression testing.</p>

<p><div class=""snippet"" data-lang=""js"" data-hide=""false"" data-console=""true"" data-babel=""false"">
<div class=""snippet-code"">
<pre class=""snippet-code-js lang-js prettyprint-override""><code>new Vue({
  el: '#app',
  data: {
    count: 3,
    call: [1, 2, 3],
    sms: [4, 5, 6]
  }
})</code></pre>
<pre class=""snippet-code-html lang-html prettyprint-override""><code>&lt;script src=""https://cdn.jsdelivr.net/npm/vue/dist/vue.min.js""&gt;&lt;/script&gt;
&lt;div id=""app""&gt;
  &lt;div class=""field""&gt;
    &lt;label class=""label is-small""&gt;Total Count&lt;/label&gt;
    &lt;div class=""control""&gt;
      &lt;input type=""text"" v-model=""count""&gt;
      &lt;div class=""field"" v-for=""k in Number(count)""&gt;
        &lt;select class=""input"" v-model=""call[k]""&gt;
          &lt;option value="""" selected&gt;Select Call Hours&lt;/option&gt;
          &lt;option v-for=""hour in 24""&gt;{{hour}}&lt;/option&gt;
        &lt;/select&gt;
        &lt;select class=""input"" v-model=""sms[k]""&gt;
          &lt;option value="""" selected&gt;Select SMS Hours&lt;/option&gt;
          &lt;option v-for=""hour in 24""&gt;{{hour}}&lt;/option&gt;
        &lt;/select&gt;
      &lt;/div&gt;
    &lt;/div&gt;
  &lt;/div&gt;
&lt;/div&gt;</code></pre>
</div>
</div>
</p>

<p>This is a part of a form, it works correctly while newly adding data but while editing the values do not appear properly. The first index of call and sms array is left out each time.</p>
",https://stackoverflow.com/questions/57567230/vue-js-how-to-iterate-an-array-inside-an-array,['vue.js'],368,True,0,1
JMeter test report,"<p>I'm using JMeter for integration and non-regression testing. 
The tests are automated and reports are working. </p>

<p>But since it is scenario testing and not performance testing the report doesn't give real business added value for that kind of tests.</p>

<p>My question: Is there any way to have a scenario (transaction controller based)reporting? </p>

<p>For the moment, to have some more meaningful result, transactions controllers and dummy sampler are used.</p>

<p>What we would like to have is the number of success/failure scenarios of the last test run. And also an history of success/failures per test run (1 by day).</p>

<p>Thank you for your advices.</p>
",https://stackoverflow.com/questions/54887240/jmeter-test-report,"['jmeter', 'report']",395,True,1,2
How can I run Wraith and Bash commands from my electron app?,"<p>I'v trimmed my code to make it easier to read, I hope you can help.</p>

<p>I am building a visual regression testing application through electron. Ideally user can run wraith test from a GUI. </p>

<p>I am close to setting it up and I just need the application to be able to run wraith and bash commands through Electron.</p>

<p>I've tried using<br>
<code>const exec = require(""child_process"").exec</code><br>
with no success, maybe theres something I'm missing.</p>

<p>My <code>test.sh</code> file is</p>

<pre><code>#!/bin/sh
echo ""Hello World again""
cd ..
wraith capture config.yaml
</code></pre>

<p>i've tried:</p>

<p><code>exec('node ./test.sh');</code></p>

<p>and </p>

<pre><code>var myscript = exec('bash ./test.sh');
myscript.stdout.on('data',function(data){
    console.log(data);
});
myscript.stderr.on('data',function(data){
    console.log(data);
});
</code></pre>

<p>These console.log/echo the <code>Hello World</code> msg but none of the remaining commands seem to run.</p>

<p>Is there a method to run a bash script from Electron the same way you would run <code>bash ./test.sh</code> from your command line?</p>

<p>Your help is much appreciated.</p>

<p>Thank you</p>

<p>Moe</p>
",https://stackoverflow.com/questions/56537199/how-can-i-run-wraith-and-bash-commands-from-my-electron-app,"['javascript', 'bash', 'electron']",299,True,1,1
testNG priorities not followed,"<p>In the testNG.xml file, I have 10+ test classes (within a test-suite tag) for regression testing.  I, then,  have ordered the automated tests of several test classes in a particular sequence by using the priority=xxx in @Test annotation.  The priority values within a particular class are sequential - but each test class has different ranges.  For example:</p>

<pre><code>testClass1 : values are from 1-10 
testClass2 : values are from 11-23    
testClass3 : values are from 31-38 
. 
. 
. 
lastTestClass : values are from 10201-10215
</code></pre>

<p>The purpose of this is to have a particular sequence in which the 10+ test-classes are executed.  There is one test-class that I need to be executed towards the end of the test execution - so, the priorities in that class range from 10201-10215. However, this particular test-class gets tested right after the 1st class with priorities from 1-10.</p>
",https://stackoverflow.com/questions/59294345/testng-priorities-not-followed,"['selenium', 'testng']",288,True,1,2
Need to reduce multiple else if in python,"<p>I'm trying to automate regression testing for basic html websites using selenium-webdriver using python. I wrote a function that will take input from an excel to determine the type of locator of an element on the webpage which goes like this:</p>

<pre><code>            if locator_type == ""ID"":
                web_element = self.__driver.find_element_by_id(element)
            elif locator_type == ""NAME"":
                web_element = self.__driver.find_element_by_name(element)
            elif locator_type == ""XPATH"":
                web_element = self.__driver.find_element_by_xpath(element)
            elif locator_type == ""TAG_NAME"":
                web_element = self.__driver.find_element_by_tag_name(element)
            elif locator_type == ""LINK_TEXT"":
                web_element = self.__driver.find_element_by_link_text(element)
            elif locator_type == ""CLASS_NAME"":
                web_element = self.__driver.find_element_by_class_name(element)
            elif locator_type == ""PARTIAL_LINK_TEXT"":
                web_element = self.__driver.find_element_by_partial_link_text(element)
</code></pre>

<p>This is so that the we could specify the locator type and give actual locator('element') so that selenium could try to find the web element on the web-page. Is there any way to reduce the elif statements or any other better way to write this part? </p>

<p><a href=""https://stackoverflow.com/questions/31748617/too-many-if-statements"">Too many if statements</a></p>

<p>I tried the method in the above link but it didn't help me. Kindly help me resolve this.</p>

<p><strong>EDIT</strong>
I tried create a dict like this</p>

<pre><code>locator_dict = {
'ID' : driver.find_element_by_id(element),
'NAME' : driver.find_element_by_name(element)}
</code></pre>

<p>then i received an error saying that element is not defined</p>
",https://stackoverflow.com/questions/55228751/need-to-reduce-multiple-else-if-in-python,"['python', 'python-3.x', 'selenium-webdriver']",164,True,4,2
How to run a stage only when build is launched manually,"<p>My team owns a non regression testing project. In this project, there is  code and non regression test. Like classic project we want to analyse our code with linter or other tools. But we don't want to run our tests on each branch for each commit, they last hours. 
We want to launch these tests manually.</p>

<p>To run test exclusively on master we have this in our Jenkinsfile:</p>

<pre><code>stage(""Test"") {
            when {branch ""master""}

            steps {

               sh 'pipenv run pytest -n5 --dist=loadscope --junitxml report.xml |
            }
            post {
              always {
                junit 'report.xml'
              }
            }
        }
</code></pre>

<p>But once we merge our branch into master, a build on master is triggered and the tests are launched.</p>

<p>To avoid this, I think I have to play with the triggeredBy parameter of the when block: <a href=""https://jenkins.io/doc/book/pipeline/syntax/"" rel=""nofollow noreferrer"">https://jenkins.io/doc/book/pipeline/syntax/</a></p>

<p>But I cannot find which triggeredBy map a manual launch event (event that is sent when we click on the run button within Jenkins interface).</p>
",https://stackoverflow.com/questions/58342111/how-to-run-a-stage-only-when-build-is-launched-manually,"['jenkins', 'jenkins-pipeline']",2226,True,2,2
Azure DevOps Archive Work Items (Test Cases),"<p>I've done some searching but can't find an answer to this.  In our current Test Case Management System, we have an option to archive Test Cases which are no longer relevant (eg because an API or UI option was removed).  The TC still exists, but just cannot be executed in any Test Suites any longer.</p>

<p>However, I cannot find any such option in Azure DevOps ... is there ?  The closest I can find is deleting a work item, but that's obviously not what I'm after.  I know that other work items (stories, epics, bugs etc) have a defined beginning and end, but TCs tend to stay around as long as they are relevant (for automation/regression testing etc), so I feel they should have a slightly different lifecycle than other work items.</p>

<p>Anybody found a way of doing this in Azure DevOps or found an alternate solution ?</p>
",https://stackoverflow.com/questions/58011842/azure-devops-archive-work-items-test-cases,"['azure-devops', 'integration-testing', 'testcase']",1458,True,1,1
How to benchmark two different versions of the same non-NuGet library in BenchmarkDotNet?,"<p>I'm trying to use BenchmarkDotNet to prepare performance regression testing for a library. This requires that I compare the same tests with an older (stable) version of the library. Now, there's an option to give <a href=""https://benchmarkdotnet.org/articles/samples/IntroNuGet.html"" rel=""nofollow noreferrer"">different versions of a NuGet package to a job</a>. There doesn't seem to be an option to reference different assemblies instead.</p>

<p>I've tried custom build configurations:</p>

<pre><code>  &lt;ItemGroup Condition=""'$(Configuration)' == 'Baseline'""&gt;
    &lt;Reference Include=""MyAssembly""&gt;
      &lt;HintPath&gt;lib\baseline\MyAssembly.dll&lt;/HintPath&gt;
    &lt;/Reference&gt;
  &lt;/ItemGroup&gt;

  &lt;ItemGroup Condition=""'$(Configuration)' != 'Baseline'""&gt;
    &lt;Reference Include=""MyAssembly""&gt;
      &lt;HintPath&gt;lib\current\MyAssembly.dll&lt;/HintPath&gt;
    &lt;/Reference&gt;
  &lt;/ItemGroup&gt;
</code></pre>

<p>but when trying to use those configurations from BenchmarkDotNet via</p>

<pre><code>    public static void Main(string[] args) {
      var summary = BenchmarkRunner.Run(typeof(Program).Assembly,
        DefaultConfig.Instance
          .With(Job.Default.WithCustomBuildConfiguration(""Baseline""))
          .With(Job.Default.WithCustomBuildConfiguration(""Current"")));
    }
</code></pre>

<p>I get build errors that indicate that the assembly is not referenced at all. BenchmarkDotNet also helpfully clears up any temporary artifacts it creates so I can't even look at the generated project file to figure out how that looked.</p>

<p>Would the only workaround here be to wrap the library in a NuGet package? Or is there something I'm overlooking in the (for this case seemingly sparse) docs?</p>

<p><a href=""https://github.com/dotnet/BenchmarkDotNet/issues/1197"" rel=""nofollow noreferrer"">This issue</a> seems to be vaguely related to the build errors I'm getting.</p>
",https://stackoverflow.com/questions/58990324/how-to-benchmark-two-different-versions-of-the-same-non-nuget-library-in-benchma,['benchmarkdotnet'],650,True,4,1
How to visual regression testing of Storybook with addon-knobs?,"<p>I'm examining a method for visual regression testing of nearly 1,000 components in a React project. And I'm thinking of using Storybook and BackstopJS to realize it, because many components were already implemented on the Storybook, I thought that I could solve it the fastest.</p>

<p>So then, extracting the Storybook scenario automatically, generated a TOC of <code>iframe.html</code> queries, and giving it to BackstopJS to realize this. This method looked like it worked, but there was a problem.</p>

<p>Most components in this project are stateless, and actions and state changes are clearly separated. Therefore, I used <a href=""https://www.npmjs.com/package/@storybook/addon-knobs"" rel=""nofollow noreferrer""><code>@storybook/addon-knobs</code></a> to check the state change manually. However, as the <a href=""https://github.com/storybooks/storybook/issues/3855"" rel=""nofollow noreferrer"">issue</a> is mentioned, it appears that knobs do not expect direct manipulation from URL and queries.</p>

<p>I gave up on the snapshot in iframe.html and thought about manipulating knobs from index.html. But the situation where the menu differences on the left pane are frequent and cannot be testing.</p>

<p>Do you have good ideas?</p>
",https://stackoverflow.com/questions/55291601/how-to-visual-regression-testing-of-storybook-with-addon-knobs,"['testing', 'regression-testing', 'storybook', 'backstop.js', 'visual-testing']",654,True,2,1
how to set from Jenkins pipeline the configuration to Mobile Center?,"<p>I have some scripts made for regression testing. I created the pipeline and put the isolated test's has a freestyle job.</p>

<p>In the jobs whit the MicroFocus plugin we can set the configuration, trow the wizzard, so we can select the device, the app and app version, etc, that prevails over the UFT script configuration saved on the script.<br>
At pipeline, we do not have that option, so automatically reads the configuration that are at the script and executed the test.</p>

<p>The point its to enable DEV team to run the scripts whit out the need to me reconfigure the scripts, saved and push to GIT whit the new build's they wanna test.</p>

<p>Basically this is my code:</p>

<pre><code>pipeline{
    agent{
       label 'NODE' // Put node
    }
    options {
        timeout(time: 30, unit: 'MINUTES')
    }
    stages{
        stage('Checkout') { 
            steps {
                checkout scm: [$class: 'GitSCM', branches: [[name: '*/master']], doGenerateSubmoduleConfigurations: false, extensions: [[$class: 'LocalBranch', localBranch: '**']], submoduleCfg: [], userRemoteConfigs: [[url: 'https://github.com/xxx']]]
            }
        }
        stage('Delete Report TC1'){ 
            steps{
              bat 'del /S /Q ""P:\\TA\\Mobile\\ANDROID\\PAGAMENTOS\\001. Recargas Telefonicas\\Report""' 
            }
        }
        stage('MOB-AND-PAGAMENTO-001'){ // Name of the test
            steps {
                uftScenarioLoad archiveTestResultsMode: 'ONLY_ARCHIVE_FAILED_TESTS_REPORT', fsUftRunMode: 'Normal', testPaths:  ""${env.WORKSPACE}"" + '''\\Mobile\\ANDROID\\PAGAMENTOS\\001. Recargas Telefonicas'''   
            }
        }
     }
}
</code></pre>

<p>The workaround for this that I'm trying is to call for the build, not the uftcenario. Something like this:</p>

<pre><code>pipeline{
    agent{
       label 'NODE' 
    } 
    options {
        timeout(time: 30, unit: 'MINUTES') 
    }
    stages{
        stage('Checkout') {
            steps {
                checkout scm: [$class: 'GitSCM', branches: [[name: '*/master']], doGenerateSubmoduleConfigurations: false, extensions: [[$class: 'LocalBranch', localBranch: '**']], submoduleCfg: [], userRemoteConfigs: [[url: 'https://github.com/xxx']]]
            }
        }
        stage('MOB-DCS-AND-CHEQUES-001'){ // The stage name
            steps {
                build 'MOB-DCS-AND-CHEQUES-001'   
            }
        }
        stage('MOB-DCS-AND-CHEQUES-002'){ // The stage name
            steps {
                build 'MOB-DCS-AND-CHEQUES-002'  
            }
        }
        stage('MOB-DCS-AND-CHEQUES-003'){ // The stage name
            steps {
                build 'MOB-DCS-AND-CHEQUES-003'  
            }
        }

    }
}
</code></pre>

<p>Don't know if this is the best way to do this.</p>

<p>Thank you
Best Regards</p>
",https://stackoverflow.com/questions/58199235/how-to-set-from-jenkins-pipeline-the-configuration-to-mobile-center,"['jenkins', 'hp-uft', 'mobile-center']",318,True,1,1
Determine if a handle points to an element of the screen (and not a printer etc),"<p>I'm looking for a way to identify if a handle references something on the/a screen (a screen, a window, a control, the entire virtual desktop, etc).</p>

<p>I'm trying to standardise the resolution of the interface so that I can consistently save it and do non-regression testing on it. So I've hooked a couple of system calls like <strong>GetDeviceCaps</strong> so that I can intercept the resolution and change it to a consistent 96DPI.</p>

<p>So far I've found <strong>GetObjectType</strong> that doesn't necessarily tell me if the object is part of the screen (comparing to <strong>OBJ_DC</strong> and <strong>OBJ_MemDC</strong>). Combining that with <strong>WindowFromDC</strong> I can get a slightly more indicative result, but it's still not perfect.</p>

<p>I thought maybe I could use <strong>EnumDisplayMonitors</strong> with null for the first two parameters, but it never seems to function.</p>

<p>Does anyone have a fool proof way of telling if a handle references a screen object or not?</p>

<p>Thank you in advance!
Loren</p>
",https://stackoverflow.com/questions/56889513/determine-if-a-handle-points-to-an-element-of-the-screen-and-not-a-printer-etc,"['user-interface', 'delphi', 'winapi', 'handle', 'regression-testing']",110,True,1,1
puppeteer&#39;s setContent function not making network requests for static files,"<p>I am currently trying to figure out how to render my React app within the puppeteer browser so that I could take a screenshot and perform visual regression testing in the future. Most of the ways I've seen this achieved was by starting up an express server and serving up the html page when a certain endpoint is requested. However, I'd like to avoid starting up a server if possible and would like to perhaps use something like ReactDOM.render within the puppeteer browser to render it like how React would. </p>

<p>So far, I've tried creating a build of the React app and then using puppeteer's page.setContent api to render out the build's index.html to the puppeteer browser directly. However, when I do this, the browser doesn't render anything on screen and does not make network requests for the static files.</p>

<p>This is what it looks like in puppeteer: 
<a href=""https://i.stack.imgur.com/q5E1M.png"" rel=""nofollow noreferrer"">puppeteer browser</a></p>

<p>This is the method with page.setContent:</p>

<pre><code>const buildHTML = await fs.readFileSync('build/index.html', 'utf8');

// create a new browser tab
const page = await browser.newPage();
await page.setViewport({ width: 1920, height: 1080 });

// set page's html content with build's index.html
await page.setContent(buildHTML);

// take a screenshot
const contentLoadingPageScreenshot = await page.screenshot({fullPage: true});
</code></pre>

<p>Also, if anyone knows of a better way to run an image snapshot test without having to start up a server, please let me know. Thank you.</p>
",https://stackoverflow.com/questions/57364320/puppeteers-setcontent-function-not-making-network-requests-for-static-files,"['javascript', 'node.js', 'reactjs', 'puppeteer', 'jest-image-snapshot']",3570,True,2,1
unable to clear select2,"<p>I have a select2 element that allows multiple selections. One of the options is ""none"" with a value of 0, which when selected should clear out any previously selected options.  The problem I'm having is while it's updating the data on the backend, the options displayed to the user remains.  For instance, I select apples but then select none. Apples stays displayed, however it's been removed from the values array and apples shows back up as an available option in the dropdown again. Though the integrity of the data is fine, to the user it could appear to have apples select two or more times. (hope that makes sense)</p>

<p>If I trigger a change event on <code>props_select</code> from outside this function, it works as expected and the user's view is updated. It's as if Select2 won't allow an update of the view while still executing the change function.</p>

<p>I'm using Select2 3.5, which I know is outdated but it's outside of my control. To update to a newer version would require security approval followed by months of regression testing (it sucks).</p>

<pre><code>$('#props_select').change(function(e){

    if( typeof e.added != 'undefined' &amp;&amp; e.added.id == '0'){
        $('#props_select').val([0]).trigger('change');

    }
});



&lt;div class=""select-filter""&gt;
    &lt;label for=""props_select""&gt;Equipment contains:&lt;/label&gt;
    &lt;select id=""props_select"" name=""props_select"" class=""form-control 
        form-control-lg"" multiple=""multiple""&gt;
        &lt;cfloop query=""myquery""&gt;
            // build options here
        &lt;/cfloop&gt;

        &lt;option value=""0""&gt;None&lt;/option&gt;
    &lt;/select&gt;
&lt;/div&gt;
</code></pre>
",https://stackoverflow.com/questions/57808497/unable-to-clear-select2,"['javascript', 'jquery', 'jquery-select2']",136,True,1,1
Check with JS if YouTube thumbnail was loaded,"<p>we set-up visual regression testing for our website (with BBC Wraith). Everything works well if the page has no youtube video embedded. If a page has one embedded it sometimes occurs that WRAITH takes a screenshot of the page before the YouTube Thumbnails was loaded. Of course, we could just extend the timeout for Wraith to wait a little longer for those pages in order to increase the chances the thumbnail is there already - but there might be a better solution.</p>

<p>Therefore we would like to understand if there is a way to find out, if the YouTube thumbnail was loaded. </p>

<p>Due to Same-origin policy we can't access the YouTube iframe with JS.</p>

<p><strong>Update:</strong>
I tried to use the YouTube iFrame API (<a href=""https://developers.google.com/youtube/iframe_api_reference?hl=en#Events"" rel=""nofollow noreferrer"">https://developers.google.com/youtube/iframe_api_reference?hl=en#Events</a>) and worked with onReady-Event. It is triggered when the player is ready to receive API-calls but this does not seem to require the thumbnail to be loaded.</p>

<p>Are there any other ideas? (e.g. check if the browser loaded a specific ressource from youtube etc.)</p>

<p>Thanks.</p>
",https://stackoverflow.com/questions/54782562/check-with-js-if-youtube-thumbnail-was-loaded,"['javascript', 'youtube', 'youtube-iframe-api']",377,False,0,1
How to separate web Elements from Page Object file,"<p>So I am following the page object model and have a class(Class A) that has elements and functions for a specific page. I also have a Test test class that uses Class A. currently I have at least 222 Web Elements for the Page because the page has many components to fill out for regression testing. As you can imagine, the Page object has hundreds of lines of code with just web elements at the top and the functions at the bottom. I want to know how I can seperate these web elements so that the code can be cleaner.</p>

<p>I've seen articles from guru99 on how you can put it in and XML but the way its being done in the article doesn't solve my issue because i would still need to initialize them some how or have 'driver.find(locator from XML)' everywhere and so the code would still be messy. </p>

<p>Page Object Class A</p>

<pre><code>    public class PageA extends BasePage{

      @FindBy(xpath=""//*[some xpath]"")
      WebElement inputField1
      @FindBy(xpath=""//*[some xpath]"")
      WebElement inputField2
      @FindBy(xpath=""//*[some xpath]"")
      WebElement inputField3


     public PageA(Webdriver driver){
       super(driver);
     }

      public void method1(){
        //do something
      }

    }
</code></pre>

<p>I want to be able to initialize the 222 Web Elements some where else so that code is cleaner</p>
",https://stackoverflow.com/questions/58437954/how-to-separate-web-elements-from-page-object-file,"['java', 'selenium-webdriver', 'pageobjects']",526,False,0,1
How to maintain 2 repositories in SAP WebIDE?,"<p>Scenario: I just had a go-live for SAP ui5 application. Now during the hyper care week, I don’t want to commit any changes of the upcoming sprint else will need to back them if urgent change needs to be pushed to prod. </p>

<p>There are multiple developers who will be working during next sprint and my challenge is- how to pull/push our changes in upcoming spring from all the developers without affecting the original application.</p>

<p>Also as we want testers to do some regression testing how to give them this application with new changes? For example, app A has all the changes that went to prod, now if tester wants to test the new changes, do we make a new temp app and deploy to it?</p>

<p>And lastly, once out of hyper care how to merge both the repositories. I know there are blogs on git web ide for the same, but either I did not read the correct blog or I need help with an example. I understand this is exactly the reason why we use GIT, but I think I have never been in this situation before.</p>
",https://stackoverflow.com/questions/58051998/how-to-maintain-2-repositories-in-sap-webide,"['git', 'sapui5', 'sap-web-ide']",148,False,1,0
I had to solve before being invited for the technical interview. could you guys take a look and advice me the proper answer?,"<p>Function takes two and only two characters as input. It returns 1 when each entered symbol is either letter or number and 0 in other cases.
Numbers are Hindu-Arabic numerals from 0 to 9. Letters are Latin, Cyrillic or Modern Greek alphabet.</p>

<p>The bug was found before, slogan is: ""Cyrillic letter can be treated as non-letter symbol""</p>

<p>Actions to reproduce:</p>

<p>Function input: ΑУ.</p>

<p>Expected output: 1. (Logic: only letters). </p>

<p>Observed output: 0.</p>

<p>The bug was fixed. Existing  tests  were  already  ran  as  a  regression test  after  bugfix, here   is   the  test report:</p>

<p>Input   Expected output Status
ΑΑ  1   Passed</p>

<p>1Α  1   Passed</p>

<p>11  1   Passed</p>

<p>Α$  0   Passed</p>

<p>(1  0   Passed</p>

<p>What tests cases will you do for bug's verification?
What tests cases will you propose to enforce regression testing of the function?
Negative tests like input less than 2 symbols and input more than 2 symbols are out of scope for both bug verification and additional regression test cases.
We will be glad to see your reasoning and argumentation as an addition, but the main thing is to provide test cases for both bug verification and additional regression test cases.</p>
",https://stackoverflow.com/questions/56953177/i-had-to-solve-before-being-invited-for-the-technical-interview-could-you-guys,"['testing', 'manual-testing']",216,False,0,0
Full AWS Stack System Testing in Python,"<p>I have lots of unit tests for individual components in my AWS Stack, but i'd like to do functional tests across multiple asynchronous systems.</p>

<p>These systems are asynchronous due to the queues they operate on. One application may take an event and generate multiple queue items in different queues to be processed downstream. Ultimately, i'd like to put an event in one end of my system and see the results at the other end of the system. I already do this manually, but there are many variations i'd like to test, and full-system regression testing for every feature release is becoming a bear to manage.</p>

<p>It often takes minutes for a unit of work to make it through all of the queues, streams, and processes and settle on the other side.</p>

<p><a href=""https://i.stack.imgur.com/XAFfP.png"" rel=""nofollow noreferrer""><img src=""https://i.stack.imgur.com/XAFfP.png"" alt=""function testing""></a></p>

<p>I do know <em>how</em> I could test something like this. But it's not very pretty.</p>

<pre><code>def test_event():
    event = { 'user_id': 1, 'action': 'like_post', 'data': {} }

    put_event_to_queue(event)

    retry_count = 0
    success = False
    while retry_count &lt; 3 and not success:
      time.sleep(60)

      if (is_action_in_rds()
          and is_action_in_elasticsearch()
          and is_action_in_athena()):
          success = True

      retry_count += 1

    self.assertTrue(success)
</code></pre>

<p>My approach would be to put something in the queue to process and check if the result exists after some arbitrary amount of time.</p>

<p>Would this be the standard approach? Is there a testing framework that lends itself best to this sort of testing?</p>
",https://stackoverflow.com/questions/55908333/full-aws-stack-system-testing-in-python,"['python', 'amazon-web-services', 'unit-testing', 'testing', 'continuous-integration']",32,False,0,0
Conditional repeated test in Protractor,"<p>I have started to use Protractor for automated regression testing and am new to the idea of asynchronous execution, promises, etc. I recently encountered a test that I can't figure out how to implement</p>

<p>In one web page there is a table with links in one column. When a link is clicked a box pops up with information regarding a certain item. This does not open a new webpage/tab/window but simply reveals more webpage elements and a done button to get rid of the popup. The test I am trying to implement is to make sure at least one of the links will reveal a certain element in the popup that it is associated with. In pseudo code I am trying to do:</p>

<p>click link->check for element->if element appears then finished testing->if element does not appear then loop and click next link->if no more links to test then test fails</p>

<p>I have done research about how promises and loops do not interact well, and after research have tried to use function closure and maps to achieve what I am trying to do without success. Does anyone have any suggestions for how to implement this test?</p>
",https://stackoverflow.com/questions/54190109/conditional-repeated-test-in-protractor,"['javascript', 'jquery', 'asynchronous', 'protractor']",97,False,0,1
How to get consistent dtypes after to_csv and read_csv?,"<p><strong>UPDATE</strong>:</p>

<p>TomNash's answer solves the question as asked. However, attempting to use it in my real problem led to issues with quoted column names, issues when there was missing data, etc. To circumvent this I'm using CJR's suggestion in the comments to simply pickle my DataFrames.</p>

<p><strong>ORIGINAL QUESTION BELOW</strong>:</p>

<p>I have a Panda's DataFrame in memory. I would like to be able to write it to file (using <code>to_csv</code>), then use <code>read_csv</code> to read the results into a new DataFrame. I would like the original DataFrame and the new ""from file DataFrame"" to have identical data types.</p>

<p>I've attempted to get this working by using the <code>quoting</code> and <code>quotechar</code> arguments for both <code>to_csv</code> and <code>read_csv</code>. However, this doesn't seem to do the trick.</p>

<p>I understand that for <code>read_csv</code> the <code>dtype</code> argument can be used to force data types, but this isn't practical for my use case (lots of auto-generated files used for regression testing).</p>

<p>Full example below.</p>

<p><code>tmp.py</code>:</p>

<pre class=""lang-py prettyprint-override""><code>import pandas as pd
from csv import QUOTE_NONNUMERIC
import sys

print('Python version information:')
print(sys.version)
print('Pandas version information:')
print(pd.__version__)

df1 = pd.DataFrame([['A', '100', 100], ['B', '200', 200]])
print('df1:')
print(df1.info())

df1.to_csv('tmp.csv', index=False, quoting=QUOTE_NONNUMERIC,
           quotechar='""')

df2 = pd.read_csv('tmp.csv', quoting=QUOTE_NONNUMERIC, quotechar='""')
print('df2:')
print(df2.info())
</code></pre>

<p>Output from running <code>tmp.py</code>:</p>

<pre class=""lang-py prettyprint-override""><code>Python version information:
3.7.3 (default, Jun 11 2019, 01:11:15) 
[GCC 6.3.0 20170516]
Pandas version information:
0.24.2
df1:
&lt;class 'pandas.core.frame.DataFrame'&gt;
RangeIndex: 2 entries, 0 to 1
Data columns (total 3 columns):
0    2 non-null object
1    2 non-null object
2    2 non-null int64
dtypes: int64(1), object(2)
memory usage: 128.0+ bytes
None
df2:
&lt;class 'pandas.core.frame.DataFrame'&gt;
RangeIndex: 2 entries, 0 to 1
Data columns (total 3 columns):
0    2 non-null object
1    2 non-null float64
2    2 non-null float64
dtypes: float64(2), object(1)
memory usage: 128.0+ bytes
None
</code></pre>

<ol>
<li>Column 1: As expected, the dtype is <code>object</code> for both DataFrames.</li>
<li>Column 2: Unexpected behavior. For <code>df1</code> the dtype is <code>object</code>, while for <code>df2</code> the dtype is <code>float64</code>.</li>
<li>Column 3: Expected behavior. <code>df1</code> has dtype <code>int64</code> while <code>df2</code> has dtype <code>float64</code>. As the <a href=""https://docs.python.org/3.7/library/csv.html#module-contents"" rel=""nofollow noreferrer"">csv module</a> describes, <code>csv.QUOTE_NONNUMERIC</code> ""Instructs the reader to convert all non-quoted fields to type float.""</li>
</ol>

<p>The contents of <code>tmp.csv</code> are below. Notice that the second column <strong>is quoted</strong>, so I would expect <code>read_csv</code> to give me an object.</p>

<p><code>tmp.csv</code>:</p>

<pre><code>0,1,2
""A"",""100"",100
""B"",""200"",200
</code></pre>
",https://stackoverflow.com/questions/56975273/how-to-get-consistent-dtypes-after-to-csv-and-read-csv,"['python', 'python-3.x', 'pandas', 'csv', 'dataframe']",716,True,4,1
How to Use Discord-Commando to Reply to Other Bots,"<p>In an effort to provide regression testing for my pre-existing bot on Discord, I'm trying to create another bot that sends timed messages in order to test the original bot.</p>

<p>For example, I would type ""!test"" into Discord, and the Testing Bot would send ""?start"" into the chat. This should trigger the Original Bot and have it reply to the Testing Bot.</p>

<p>Unfortunately, my Original Bot was created using Discord-Commando. Although normal Discord.js allows for replies to bots (<a href=""https://stackoverflow.com/questions/48320766/how-to-stop-discord-bot-respond-to-itself-all-other-bots-discord-bot-in-python"">and even itself as far as I've discovered</a>), Discord-Commando.js does not. At least, as far as my initial findings go.</p>

<p>I've scoured Google and Discord-Commando's documentation for examples of interactions between bots using Commando, but I couldn't find anything.</p>

<p>At most, I found that there is indeed a boolean flag in a bot's User object that identifies it as a bot (i.e. it has a boolean saying ""bot: true"") but that's about it. When trying to use methods in the Command object, none of them seem to trigger when the bot is given a command from another bot.</p>

<p>My ultimate question is that - is there a method that I could override that would allow my bots to essentially ""talk"" to each other while still using Discord-Commando? And if not, are there any recommendations on how to automate testing a Discord bot?</p>
",https://stackoverflow.com/questions/55271372/how-to-use-discord-commando-to-reply-to-other-bots,"['javascript', 'testing', 'bots', 'discord']",167,False,1,0
Python Requests library post interpreted by Django as GET for some reason,"<p>I'm trying to make a post request to our app's api for some regression testing, but for some reason when I make the request like so through requests, it's logged and interpreted as a GET request.</p>

<p>CODE:</p>

<pre class=""lang-py prettyprint-override""><code>requests.post({HTTP_PROTOCOL}://{APP_URL}/api/route/',
              headers={'Authorization': 'Bearer ' + access_token},
              json=DATA)
</code></pre>

<p>LOG:</p>

<pre><code>[Thu Jul 11 19:17:30 2019] GET /api/route/ =&gt; generated 2 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 162 bytes (1 switches on core 1)
</code></pre>

<p>When I make the request through Postman, however, the request works totally fine and comes back with the created object in JSON, and in the logs it's recorded as a POST.</p>

<p>The backend is currently written in Django, using Django Rest Framework for the REST API. Here is the Route in our <code>urls.py</code> file:</p>

<pre><code>url(r""^api/route/$"", DataListView.as_view())
</code></pre>

<p>And I know that the <code>DataListView</code> works, because Postman works totally fine with it.</p>

<p>I've had similar problems where it wouldn't work because I was posting to a route without the slash, and that's not the case here. I know I'm posting to the route with the trailing slash, as you can see for yourselves.</p>

<p>QUESTION: How do I get this to work? And why would it be working in Postman, but not using the <code>requests</code> library?</p>

<p>EDIT 1:
Here's the headers in the request if that gives any clues:</p>

<pre><code>{
    'User-Agent': 'python-requests/2.22.0',
    'Accept-Encoding': 'gzip, deflate',
    'Accept': '*/*',
    'Connection': 'keep-alive',
    'Authorization': 'Bearer &lt;access-token&gt;'
}
</code></pre>

<p>EDIT 2:
I just did this:</p>

<pre><code>print(resp.request.method)
</code></pre>

<p>and it printed out <code>GET</code>... No idea why. When I did it do my local server though, it printed out <code>POST</code>. Could it have something to do with the fact that I'm posting to a <code>https://</code> URL? This is bizzare.</p>

<p>From <a href=""https://stackoverflow.com/questions/26149181/python-requests-post-doing-a-get"">this</a>, it looks like maybe it's getting a 301 or 302 redirect that's causing this.</p>
",https://stackoverflow.com/questions/56996346/python-requests-library-post-interpreted-by-django-as-get-for-some-reason,"['python', 'django', 'django-rest-framework', 'python-requests']",370,True,2,1
Design for a Cloud Native Application in Azure for ML Insights and Actions,"<p>I have an idea whereby I intend to build a cloud native application for algorithmic trading, ideally by consuming all PaaS and SaaS (no IaaS), and I'd like to get some feedback on <em>how</em> I intend to build it.  The concept is pretty straight-forward in that I intend to consume financial trading data from an external SaaS solution via an API query, feed that data into various Azure PaaS solutions (most notably ML for modeling), and then take some action.  Here is a high-level diagram I've come up with so far:</p>

<p><a href=""https://i.stack.imgur.com/IWgjH.png"" rel=""nofollow noreferrer"">Solution Overview</a></p>

<p>As a note, while I'm familiar with Azure, I'm not a Azure cloud engineer and have limited experience in actually building solutions myself.  Subsequently, I intend to use this project as a foundation to further educate myself.</p>

<p>When starting on the build, I immediately questioned whether I should or shouldn't use Event Hubs.  Conceptually it makes sense, in that I'm decoupling the production of a data stream from the consumption of it.  Presumably, this facilitates less complications when / if I need to update the data feed(s) in the future.  I also thought about where the data is stored... should it be a SQL database, or more simply, an Azure Table?  The idea here is that the trading data will need to be stored for regression testing as my iterate through my models.  All that said, looking for some insights from anybody that may have experience in this space.</p>

<p>Thanks!</p>
",https://stackoverflow.com/questions/58896045/design-for-a-cloud-native-application-in-azure-for-ml-insights-and-actions,"['azure', 'machine-learning', 'azure-table-storage', 'algorithmic-trading', 'azure-postgresql']",52,True,0,1
Can you tag individual examples in a scenario outline in SpecFlow?,"<p>Scenario outlines are very handy for creating data driven tests, but the number of scenarios increases with the number of examples. I've gotten in the habit of tagging scenarios to make it easier to filter on major features of our application.</p>

<p>I would like to set up a ""smoke test"" that hits all the major use cases. Some of these use cases are captured in scenario outlines that perform boundary testing on dates or numbers, but I just want to hit that <em>one</em> prototypical case within the examples.</p>

<p>For instance say we've got a feature allowing us to add job openings to a job (basically a ""hiring opportunity"" versus ""we have warm bodies filling this position"").</p>

<p>On screen we have two form fields for the minimum experience: years and months. The user should not enter more than 11 months in the months field, otherwise they should put something in the years field (e.g. 18 months should actually be 1 year and 6 months).</p>

<pre><code>@job-openings
Scenario Outline: Adding a job opening with experience
    Given a job exists
    When I add a job opening requiring &lt;years&gt; years and &lt;months&gt; months experience
    Then a job opening should exist requiring &lt;years&gt; years and &lt;months&gt; months experience

Examples:
    | years | months |
    | 0     | 1      |
    | 0     | 11     |
    | 1     | 0      |
    | 2     | 6      | # &lt;-- the ""prototypical"" example I want to tag
    | 99    | 0      |
    | 99    | 11     |
    | 100   | 0      |
</code></pre>

<p>Having those examples hitting the boundaries of the acceptable values for years and months is definitely useful from a regression testing standpoint, but not when performing a ""smoke test"" of the system. It would be nice to run a single example in the scenario outline that represents a typical use case. As some background info, we have a PowerShell script that developers use to run automated tests of all sorts, and a general ""smoke test"" hitting all the major features would be useful.</p>

<p><strong>Is there a way to tag an individual example in a scenario outline?</strong></p>
",https://stackoverflow.com/questions/57992278/can-you-tag-individual-examples-in-a-scenario-outline-in-specflow,"['specflow', 'gherkin']",3549,True,4,2
Selenium tests running in parallel causing error: invalid session id,"<p>Looking to get some help around making my tests Parallelizable. I have a selenium c# setup that uses a combination of NUnit, C# and selenium to run tests in sequence locally on my machine or on the CI server. </p>

<p>I've looked into Parallelization of testing before but have been unable to make the jump, and running in a sequence was fine. </p>

<p>At the moment when I add the NUnit [Parallelizable] tag, I get an 'OpenQA.Selenium.WebDriverException : invalid session id' error, based on the reading I've done I need to make each new driver I call unique. However, I'm uncertain on how to do this? or even start for that matter... is this even possible within my current set up?</p>

<p>My tests are currently doing limited smoke tests and just removing the repetitive regression testing against multiple browsers, however, I foresee a need to vastly expand my coverage of testing capability.</p>

<p>I will probably be looking at getting Browserstack or Sauselab in the long term but obviously, that requires funding, and I need to get that signed off, so I will be looking to get it running locally for now.</p>

<p>here is a look at the basic set up of my code</p>

<p>test files:</p>

<p>1st .cs test file</p>

<pre><code>{
    [TestFixture]
    [Parallelizable]
    public class Featur2Tests1 : TestBase
    {
        [Test]
        [TestCaseSource(typeof(TestBase), ""TestData"")]
        public void test1(string BrowserName, string Environment, string System)
        {
            Setup(BrowserName, Environment, System);

            //Run test steps....
        }

        [Test]
        [TestCaseSource(typeof(TestBase), ""TestData"")]
        public void test2(string BrowserName, string Environment, string System)
        {
            Setup(BrowserName, Environment, System);

            //Run test steps....
        }
    }
}
</code></pre>

<p>2nd .cs test file</p>

<pre><code>{
    [TestFixture]
    [Parallelizable]
    public class FeatureTests2 : TestBase
    {
        [Test]
        [TestCaseSource(typeof(TestBase), ""TestData"")]
        public void test1(string BrowserName, string Environment, string System)
        {
            Setup(BrowserName, Environment, System);

            //Run test steps....
        }

        [Test]
        [TestCaseSource(typeof(TestBase), ""TestData"")]
        public void test2(string BrowserName, string Environment, string System)
        {
            Setup(BrowserName, Environment, System);

            //Run test steps....
        }
    }
}
</code></pre>

<p>TestBase.cs where my set up for each test</p>

<pre><code>{ 
    public class TestBase
    {
        public static IWebDriver driver;

        public void Setup(string BrowserName, string Environment, string System)
        {
            Driver.Intialize(BrowserName);
            //do additional setup before test run...
        }

        [TearDown]
        public void CleanUp()
        {
            Driver.Close();          
        }

        public static IEnumerable TestData
        {
            get
            {
                string[] browsers = Config.theBrowserList.Split(',');
                string[] Environments = Config.theEnvironmentList.Split(',');
                string[] Systems = Config.theSystemList.Split(',');
                foreach (string browser in browsers)
                {
                    foreach (string Environment in Environments)
                    {
                        foreach (string System in Systems)
                        {
                            yield return new TestCaseData(browser, Environment, System);
                        }
                    }
                }
            }
        }
    }
}
</code></pre>

<p>The IEnumerable TestData comes from a file called config.resx and contains the following data:</p>

<ul>
<li>{Name}: {Value} </li>
<li>theBrowserList:  Chrome,Edge,Firefox</li>
<li>theEnvironmentList:  QA </li>
<li>theSystemList:   WE</li>
</ul>

<p>This is where I create my driver in Driver.cs</p>

<pre><code>{
    public class Driver
    {
        public static IWebDriver Instance { get; set; }

        public static void Intialize(string browser)
        {
            string appDirectory = Directory.GetParent(AppDomain.CurrentDomain.BaseDirectory).Parent.Parent.Parent.FullName;
            string driverFolder = $""{appDirectory}/Framework.Platform/bin/debug"";
            if (browser == ""Chrome"")
            {
                ChromeOptions chromeOpts = new ChromeOptions();
                chromeOpts.AddUserProfilePreference(""safebrowsing.enabled"", true);
                chromeOpts.AddArgument(""start-maximized"");
                chromeOpts.AddArgument(""log-level=3"");
                Instance = new ChromeDriver(driverFolder, chromeOpts);
            }
            else if (browser == ""IE"")
            {
                var options = new InternetExplorerOptions { EnsureCleanSession = true };
                options.AddAdditionalCapability(""IgnoreZoomLevel"", true);
                Instance = new InternetExplorerDriver(driverFolder, options);
                Instance.Manage().Window.Maximize();
            }
            else if (browser == ""Edge"")
            {
                EdgeOptions edgeOpts = new EdgeOptions();
                Instance = new EdgeDriver(driverFolder, edgeOpts);
                Instance.Manage().Window.Maximize();
                Instance.Manage().Cookies.DeleteAllCookies();
            }
            else if (browser == ""Firefox"")
            {
                FirefoxOptions firefoxOpts = new FirefoxOptions();
                Instance = new FirefoxDriver(driverFolder, firefoxOpts);
                Instance.Manage().Window.Maximize();
            }
            else { Assert.Fail($""Browser Driver; {browser}, is not currently supported by Initialise method""); }
        }


        public static void Close(string browser = ""other"")
        {
            if (browser == ""IE"")
            {
                Process[] ies = Process.GetProcessesByName(""iexplore"");
                foreach (Process ie in ies)
                {
                    ie.Kill();
                }
            }
            else
            {
                Instance.Quit();
            }
        }
    }
}
</code></pre>
",https://stackoverflow.com/questions/54214264/selenium-tests-running-in-parallel-causing-error-invalid-session-id,"['c#', 'selenium', 'nunit']",13015,True,2,4
Snapshot testing PDFs,"<h2>The Problem</h2>

<p>I'm trying to do some really quick snapshot testing of PDFs. Our system generates them using Spire.PDF and sends them to DocuSign encoded in base64. My snapshots take the generated base64 and compare it against ""known good"" to see if anything changed.</p>

<p>This process has been, so far, 100% reproducible on my computer and a co-workers computer. But when we put the tests up on Jenkins, the tests fail. Looking deeper into the problem, the same test cases with the same base documents generate <em>completely different bytes</em>, while also generating <em>identical looking</em> PDFs.</p>

<h2>Some Details</h2>

<p>Or things I've ruled out. Or other thoughts.</p>

<ul>
<li>At some point in the process I have to convert to string and back, and I've checked that the encoding on my computer and Jenkins is the same.</li>
<li>I've replaced any ""random"" meta data values like created date and ID in the PDF with static values so snapshots are possible.</li>
<li>I'm open to other ideas of snapshot testing that can be done quickly! I'm looking for a ""quick win"" to reduce the amount of regression testing we need to do every release on this stuff, and not a ""comprehensive testing solution"". </li>
<li>The build environment is destroyed every build and recreated, while my computer is not. </li>
<li>I haven't checked that the versions of Spire are the same (because it's a weekend and I don't have dev ops permissions and politics...), but both processes are getting the library using NuGet so I don't have any reason why they might be different.</li>
<li>We're licensing Spire using the embedded resource method, and neither generated PDF implies it is a trial version. </li>
</ul>
",https://stackoverflow.com/questions/59009931/snapshot-testing-pdfs,"['pdf-generation', 'docusignapi', 'spire.doc']",65,False,0,0
Any suggestions on software development along the lines of quality assurance?,"<p><strong>SUMMARY</strong></p>

<p>The software I am working is an engineering analysis tool for renewable energy systems. It tests power outputs and things of this nature. </p>

<p>My current job task has been to test different configurations of said systems (i.e. use a evaporative cooling condenser instead of the default radiative cooling condenser via a drop down menu on the user interface) to ensure that the release version of this software functions across all spectrums as it should.</p>

<p>So far the process has been very simple to test: changing one factor of the base model and testing if the code functions properly as it should via the outputs generated. </p>

<p><strong>How I need to pivot</strong></p>

<p>But now we want to start testing combinations of tests. This change of workflow will be very tedious and time consuming for we are considering a factorial design approach in order to map out my plan of attack for what configurations to test, to ensure that <em>all the code</em> functions properly when changing multiple things. This could create <strong>many</strong> different types of configurations I will need to manually test.</p>

<p>All in all, does anyone have any suggestions for an alternative approach? I've been reading up on alternative software testing methods, but am not entirely sure if things like: regression testing, smoke testing, or sanity checks are better for this scenario or not. </p>

<p>Thanks!</p>

<h1><strong>EDIT</strong></h1>

<p>The software I am testing is being used on Visual Studios where I am utilizing the Google Test framework to manually test my system configurations.</p>

<p>Currently, each test that I create for a certain concentrated solar power system configuration demands that I manually find the difference in code (via WinMerge) between the default configuration (no changes made) to the alternative configuration. I use the code differences in Google Test Framework to simulate what that alternative config. should output by testing it against the accepted output values. </p>

<p>It's only going to get more complicated, with an aspect of manual user interface needed ... or so it seems to me. </p>

<p>How can I automate such a testing suite, when I'm needed to do so much back end work? </p>
",https://stackoverflow.com/questions/57011556/any-suggestions-on-software-development-along-the-lines-of-quality-assurance,"['unit-testing', 'googletest', 'software-design', 'vs-unit-testing-framework', 'regression-testing']",49,True,-1,1
