Having a problem with Mouse Drag action in WorkFusion recorder

mouse-drag

#1

Error executing finishPoint

 com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=finishPoint.ftl,id=36,name=Optional[finishPoint],parent=34,arguments=ActionArguments[imageName=[C:\\Users\\Marlon Smith\\workfusion-workspace\\rpae_project\\1&1mail subject line, template and random selection\\1522404826847-anchor.apng],fullImageName=[1522404826847.png],xsi:type=[finishPoint],controlName=[Message],pollingInterval=[300],active=[true],modifiers=[256],when=[1522404826847],button=[1],offsetX=[-16],paramString=[NativeMouseEvent{type=RELEASE, button=1, position=(662, 400), clickCount=0} NativeInputEvent{window=WindowData {pId=7640, hWnd=3147644, title='1and1Mail - Send email', className='Tfrm_StartWizard', position=(570, 227), height=585, width=780}, control=ControlData {hControl=2557708, name='Message', className='TGroupBox', value='', position=(578, 377), height=378, width=764, displayed=true, enabled=false, itemType='', itemStatus='', frameworkId='Win32', ancestors=''}, modifiers=256, when=1522404826847}],delay=[0],controlClassName=[TGroupBox],x=[662],y=[400],actionDetails=[(Left-button )],awaitTimeout=[5000]]]
      at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:54)
      at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:30)
      at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:17)
      at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:53)
      at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:153)
      at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:113)
      at java.lang.Thread.run(Thread.java:745)
  Caused by: org.openqa.selenium.WebDriverException: Image does not found : 1522404826847-anchor.apng
Command duration or timeout: 0 milliseconds
Build info: version: '8.5.0.3', revision: 'd87d4f32f3', time: '2018-02-23T12:31:39.262Z'
System info: host: 'DESKTOP-IHKMJMC', ip: '192.168.1.102', os.name: 'Windows 10', os.arch: 'amd64', os.version: '10.0', java.version: '1.8.0_121'
Driver info: com.freedomoss.crowdcontrol.webharvest.selenium.wrapper.RemoteDriverWrapper
Capabilities [{imageSimilarityThreshold=0.8, extra.executor.id={Name=RPA Recorder}, CLOSE_ALL_WINDOWS=false, browserName=universal, javascriptEnabled=true, extra.capabilities.context={"browserType":"universal","startInPrivate":false,"blockImages":false,"maximizeOnStartup":false,"customCapabilities":{"platform":"WINDOWS","javascriptEnabled":true,"SEARCH_ALL_WINDOWS":true,"CLOSE_ALL_WINDOWS":false,"imageSimilarityThreshold":"0.8"},"executorId":{"Name":"RPA Recorder"}}, platformName=WINDOWS, SEARCH_ALL_WINDOWS=true, platform=WINDOWS}]
Session ID: 306d4171-b696-48d3-9fbb-37282ce83c70
      at sun.reflect.GeneratedConstructorAccessor72.newInstance(Unknown Source)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      at org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:216)
      at org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:168)
      at org.openqa.selenium.remote.http.JsonHttpResponseCodec.reconstructValue(JsonHttpResponseCodec.java:41)
      at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:82)
      at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:45)
      at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:164)
      at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:656)
      at org.openqa.selenium.remote.RemoteWebDriver.executeScript(RemoteWebDriver.java:592)
      at com.workfusion.rpa.helpers.RPA.executeScript(RPA.java:825)
      at com.workfusion.rpa.helpers.RPA.executeGroovyScript(RPA.java:873)
      at com.workfusion.rpa.helpers.ImageElement.findImageCoordinates(ImageElement.java:155)
      at com.workfusion.rpa.helpers.ImageElement.getCoordinates(ImageElement.java:68)
      at com.workfusion.rpa.helpers.UiElement.getCoordinates(UiElement.java:1032)
      at org.openqa.selenium.internal.Locatable$getCoordinates.call(Unknown Source)
      at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
      at Script37.run(Script37.groovy:6)
      at com.workfusion.studio.rpa.recorder.playback.shell.GroovyShellWrapper.executeScript(GroovyShellWrapper.java:90)
      at com.workfusion.studio.rpa.recorder.playback.player.PlaybackContext.executeScript(PlaybackContext.java:65)
      at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.executeBehavior(TemplateAction.java:35)
      at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:46)
      at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:30)
      at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:17)
      at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:53)
      at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:153)
      at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:113)
      at java.lang.Thread.run(Thread.java:745)
  Caused by: java.util.NoSuchElementException: Image does not found : 1522404826847-anchor.apng
      at sun.reflect.GeneratedConstructorAccessor45.newInstance(Unknown Source)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:83)
      at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrapNoCoerce.callConstructor(ConstructorSite.java:105)
      at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:60)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:235)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:247)
      at Script1$1.call(Script1.groovy:12)
      at Script1$1.call(Script1.groovy)
      at com.workfusion.common.utils.SynchUtils.withFocusLock(SynchUtils.java:47)
      at com.workfusion.common.utils.SynchUtils$withFocusLock.call(Unknown Source)
      at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
      at Script1.run(Script1.groovy:5)
      at groovy.lang.GroovyShell.evaluate(GroovyShell.java:585)
      at groovy.lang.GroovyShell.evaluate(GroovyShell.java:623)
      at groovy.lang.GroovyShell.evaluate(GroovyShell.java:594)
      at com.workfusion.autoit.driver.AutoItDriver.executeGroovyScript(AutoItDriver.java:243)
      at com.workfusion.autoit.driver.AutoItDriver.executeScript(AutoItDriver.java:211)
      at com.workfusion.autoit.driver.AutoItDriver.executeScript(AutoItDriver.java:187)
      at com.workfusion.universal.driver.UniversalDriver.executeScript(UniversalDriver.java:149)
      at org.openqa.selenium.remote.server.handler.ExecuteScript.call(ExecuteScript.java:54)
      at org.openqa.selenium.remote.server.handler.WebDriverHandler.handle(WebDriverHandler.java:41)
      at org.openqa.selenium.remote.server.rest.ResultConfig.handle(ResultConfig.java:133)
      at org.openqa.selenium.remote.server.JsonHttpCommandHandler.handleRequest(JsonHttpCommandHandler.java:202)
      at org.openqa.selenium.remote.server.InMemorySession.execute(InMemorySession.java:98)
      at org.openqa.selenium.remote.server.WebDriverServlet.lambda$handle$0(WebDriverServlet.java:231)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)

#2

@marlonsflAlEuk Make sure you have the correct image in the Mouse drag action


#3

Thank you.

this did solve the problem initially and the process worked fine. Then the same issue arose again. i Fixed it again and it worked a few times before developing the same fault. Is there a way I can get it to work permanently?


#4

Are you sure the screeт doesn’t change and the image is correct?


#5

Hi the screen doesnt change or move around in any way however despite this, I have to keep re adjusting the image and mouse action every 2 or 3 playbacks.


#6

Could you zip and share your recording here? We’ll have a look.


#7

@marlonsflAlEuk Did you manage to solve this issue? If not - please share your recording here, we’ll look into it.


#8