LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Desktop (https://www.linuxquestions.org/questions/linux-desktop-74/)
-   -   can I record desktop actions for frequently used complex app interactions? (https://www.linuxquestions.org/questions/linux-desktop-74/can-i-record-desktop-actions-for-frequently-used-complex-app-interactions-4175531135/)

SaintDanBert 01-15-2015 03:04 PM

can I record desktop actions for frequently used complex app interactions?
 
IMPORTANT -- I don't want a desktop screen video.

Can anyone give me a clue how to accomplish this?

Every so often, I launch several desktop apps and go through several steps that I've polished over time and learned the nuances. I would really love to go through this process, record the collection of
  • click,
  • drag,
  • drop,
  • copy,
  • cut,
  • paste,
  • double-click,
  • point here,
  • move to that window,
  • ... ad nauseum
Once recorded,
  • I'd like to play-back the recording to do all of those steps automatically.
  • I'd like to have a desktop launcher to activate that play-back.
  • I'd like to somehow parameterize that playback with details such as date, time, day-name, month-name, etc.

Thanks in advance,
~~~ 8d[:-o] Dan

boogerballs 01-15-2015 06:47 PM

I don't know of any macro software for linux, a google search led me to this:
https://xnee.wordpress.com/
I've never tried this, though. I can't tell you whether it works well or not.

You could probably script it all in python using a library like this to send keyboard + mouse events
http://python-evdev.readthedocs.org/en/latest/

It can be made way better and more complicated, though. For instance, you could check whether windows are minimized or not, and also check their size, position, etc.

Don't know much about doing that, though. I assume it would be different for each DE and probably each window manager.

SaintDanBert 01-20-2015 02:28 PM

Quote:

Originally Posted by boogerballs (Post 5301583)
I don't know of any macro software for linux, a google search led me to this:
https://xnee.wordpress.com/
I've never tried this, though. I can't tell you whether it works well or not.

I'll check this out...

Quote:

Originally Posted by boogerballs (Post 5301583)
You could probably script it all in python using a library like this to send keyboard + mouse events
http://python-evdev.readthedocs.org/en/latest/

It can be made way better and more complicated, though. For instance, you could check whether windows are minimized or not, and also check their size, position, etc.

I know about this/these libraries. I was hoping that there was some way to collect all of the events -- open/close window, mouse click, copy/cut/past, key entry -- into some sort of file. The file could either inform a script generator to use those libraries, or it could be parsed to drive a control program.

Thanks in advance,
~~~ 0;-Dan

orasis 01-22-2015 02:21 AM

GNU Xnee

SaintDanBert 01-22-2015 12:02 PM

Quote:

Originally Posted by orasis (Post 5304900)
GNU Xnee

As you suggested, I found: GNU Xnee that says, "Xnee is a suite of programs that can record, replay and distribute user actions under the X11 environment. Think of it as a robot that can imitate the job you just did." Other information about Xnee can be found here Full Xnee description.

This looks exactly like what I want.

NOTE that it is an X11 (X-windows) tool suite, and "X11" is what is underneath

X-Windows System description

... and ...

The X-Open Group

most of the desktop screen behaviors. I say, "most" because recent efforts see X11 and antique because it is client-server which limits performance and extreme fancy display things. This means that some of the modern desktop environment actions and behaviors might not play nicely...

... but they might. Hurray!

I'll report on my progress.
Has anyone got practical experience with GNU Xnee?

Many MANY THANKS, orasis and boogerballs,
~~~ 0;-Dan


All times are GMT -5. The time now is 11:33 PM.