Mouse / Keystroke doesn't work


#1

Hello
I have problem with mouse / keystroke when the bp schedule in control tower
the mouse/keystroke doesn’t work when i click download button on sap but i already added time wait before/after the action
any have idea ?


#2

Are there any errors in the process error log? Or is it registered as a successful action, but in fact it is not done?


#3

When i run in studio its run normally but when i run in CT “the highlight” not working and the error log in CT

Blockquote org.webharvest.exception.PluginException: [urn:uuid:CCE9683F8B1E0FFEEA15440872850035572] robotics-flow executePlugin exception: [nodeId=http://127.0.0.1:15410] com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=SwitchWindowAction.ftl,id=2,name=Optional[SwitchWindowAction],parent=1,nextSibling=7,children=[3, 4, 5, 6],arguments=ActionArguments[modeType=[SELECTED],delay=[0],timeoutMs=[0],xsi:type=[recorder:SwitchWindowAction, recorder:SwitchWindowAction],active=[true],actionDetails=[(SAP Easy Access SAP R/3 System)],title=[SAP Easy Access SAP R/3 System],clazz=[SAP_FRONTEND_SESSION]]] at com.freedomoss.crowdcontrol.webharvest.plugin.selenium.RoboticsFlowPlugin.executePlugin(RoboticsFlowPlugin.java:116) at org.webharvest.runtime.processors.WebHarvestPlugin.execute(WebHarvestPlugin.java:125) at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:127) at org.webharvest.runtime.Scraper.execute(Scraper.java:169) at org.webharvest.runtime.Scraper.execute(Scraper.java:182) at com.freedomoss.crowdcontrol.webharvest.executor.LocalWebharvestTaskExecutor.executeWebHarvestTask(LocalWebharvestTaskExecutor.java:187) at com.freedomoss.crowdcontrol.webharvest.executor.LocalWebharvestTaskExecutor.executeWebHarvestTask(LocalWebharvestTaskExecutor.java:97) at com.workfusion.service.machine.BotRecordExecutionService.process(BotRecordExecutionService.java:168) at com.workfusion.service.machine.BotRecordExecutionService.process(BotRecordExecutionService.java:139) at com.workfusion.service.machine.BotRecordExecutionService.processSubmissionWithAllocationLogger(BotRecordExecutionService.java:118) at com.workfusion.service.machine.BotRecordExecutionService.lambda$processRecord$0(BotRecordExecutionService.java:97) at com.workfusion.utils.thread.NamedThreadTemplate.executeWithNamedThread(NamedThreadTemplate.java:10) at com.workfusion.service.machine.BotRecordExecutionService.processRecord(BotRecordExecutionService.java:97) at com.workfusion.service.machine.thread.RecordProcessThread.run(RecordProcessThread.java:28) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.webharvest.exception.PluginException: com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=SwitchWindowAction.ftl,id=2,name=Optional[SwitchWindowAction],parent=1,nextSibling=7,children=[3, 4, 5, 6],arguments=ActionArguments[modeType=[SELECTED],delay=[0],timeoutMs=[0],xsi:type=[recorder:SwitchWindowAction, recorder:SwitchWindowAction],active=[true],actionDetails=[(SAP Easy Access SAP R/3 System)],title=[SAP Easy Access SAP R/3 System],clazz=[SAP_FRONTEND_SESSION]]] at com.freedomoss.crowdcontrol.webharvest.plugin.recorder.RecorderPlugin.executePlugin(RecorderPlugin.java:109) at org.webharvest.runtime.processors.WebHarvestPlugin.execute(WebHarvestPlugin.java:125) at org.webharvest.runtime.processors.BaseProcessor.run(BaseProcessor.java:127) at org.webharvest.runtime.processors.BodyProcessor.execute(BodyProcessor.java:27) at org.webharvest.runtime.processors.WebHarvestPlugin.executeBody(WebHarvestPlugin.java:246) at com.freedomoss.crowdcontrol.webharvest.plugin.selenium.RoboticsFlowPlugin.executePlugin(RoboticsFlowPlugin.java:105) ... 16 more Caused by: com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=SwitchWindowAction.ftl,id=2,name=Optional[SwitchWindowAction],parent=1,nextSibling=7,children=[3, 4, 5, 6],arguments=ActionArguments[modeType=[SELECTED],delay=[0],timeoutMs=[0],xsi:type=[recorder:SwitchWindowAction, recorder:SwitchWindowAction],active=[true],actionDetails=[(SAP Easy Access SAP R/3 System)],title=[SAP Easy Access SAP R/3 System],clazz=[SAP_FRONTEND_SESSION]]] at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:54) at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:28) at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:15) at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:53) at com.freedomoss.crowdcontrol.webharvest.plugin.recorder.RecorderPlaybackProcess.start(RecorderPlaybackProcess.java:79) at com.freedomoss.crowdcontrol.webharvest.plugin.recorder.RecorderPlugin.play(RecorderPlugin.java:123) at com.freedomoss.crowdcontrol.webharvest.plugin.recorder.RecorderPlugin.executePlugin(RecorderPlugin.java:104) ... 21 more Caused by: org.openqa.selenium.NoSuchWindowException: Window '[CLASS:SAP_FRONTEND_SESSION;TITLE:SAP Easy Access SAP R/3 System]' is not found Build info: version: '9.0.0.4', revision: 'e6e278acd9', time: '2018-06-19T14:40:11.651Z' System info: host: 'RPA-PROD-02', ip: '10.2.51.192', os.name: 'Windows Server 2012', os.arch: 'amd64', os.version: '6.2', java.version: '1.8.0_121' Driver info: driver.version: unknown Command duration or timeout: 0 milliseconds at sun.reflect.GeneratedConstructorAccessor8406.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:216) at org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:168) at org.openqa.selenium.remote.http.JsonHttpResponseCodec.reconstructValue(JsonHttpResponseCodec.java:41) at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:82) at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:45) at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:164) at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:656) at org.openqa.selenium.remote.RemoteWebDriver$RemoteTargetLocator.window(RemoteWebDriver.java:1026) at com.workfusion.rpa.helpers.RPA.switchToExistingWindow(RPA.java:204) at org.codehaus.groovy.vmplugin.v7.IndyInterface.selectMethod(IndyInterface.java:232) at Script3_genScript_21647.run(Script3_genScript_21647.groovy:7) at com.workfusion.studio.rpa.recorder.playback.shell.GroovyShellWrapper.executeScript(GroovyShellWrapper.java:90) at com.workfusion.studio.rpa.recorder.playback.player.PlaybackContext.executeScript(PlaybackContext.java:65) at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.executeBehavior(TemplateAction.java:33) at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:46) ... 27 more Caused by: org.openqa.selenium.NoSuchWindowException: Window '[CLASS:SAP_FRONTEND_SESSION;TITLE:SAP Easy Access SAP R/3 System]' is not found Build info: version: '9.0.0.4', revision: 'e6e278acd9', time: '2018-06-19T14:40:11.651Z' System info: host: 'RPA-PROD-02', ip: '10.2.51.192', os.name: 'Windows Server 2012', os.arch: 'amd64', os.version: '6.2', java.version: '1.8.0_121' Driver info: driver.version: unknown Build info: version: '9.0.0.4', revision: 'e6e278acd9', time: '2018-06-19T14:40:11.651Z' System info: host: 'RPA-PROD-02', ip: '10.2.51.192', os.name: 'Windows Server 2012', os.arch: 'amd64', os.version: '6.2', java.version: '1.8.0_121' Driver info: driver.version: unknown at com.workfusion.autoit.driver.WindowsFinder.window(WindowsFinder.java:56) at com.workfusion.autoit.driver.WindowManager.window(WindowManager.java:157) at com.workfusion.universal.driver.UniversalTargetLocator.window(UniversalTargetLocator.java:42) at org.openqa.selenium.remote.server.handler.SwitchToWindow.call(SwitchToWindow.java:60) at org.openqa.selenium.remote.server.handler.SwitchToWindow.call(SwitchToWindow.java:26) at org.openqa.selenium.remote.server.handler.WebDriverHandler.handle(WebDriverHandler.java:41) at org.openqa.selenium.remote.server.rest.ResultConfig.handle(ResultConfig.java:133) at org.openqa.selenium.remote.server.JsonHttpCommandHandler.handleRequest(JsonHttpCommandHandler.java:203) at org.openqa.selenium.remote.server.InMemorySession.execute(InMemorySession.java:98) at org.openqa.selenium.remote.server.WebDriverServlet.lambda$handle$0(WebDriverServlet.java:231) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more

Mouse%20Click


#4

According to the log, the bot cannot find this window, but I cannot see it on the screenshot you shared.
Does it switch to this window earlier in the script?


#5

no the switch window show up after i run step 40-60
the problem is when i click mouse the mouse not move to object i want it seem like skip that process and the CT capture error log windows


#6

Do you use mouse click on an image?


#7

no i use mouse click by window element


#8

Can you share the screenshot of the Mouse click action and the window on which it has to click it?


#9

here


#10

Could you also share your recording (with no sensitive information) so we could see how to access this window, or explain how to find it in SAP so we could test it from our side?

If you don’t want to share the recording on the forum you can send it in a private message or to rpaexpress@workfusion.com .