Ranking Test Automation Tools - Tier List

Test Automation tools are great. But there is a problem. They all kind of do the same things. So we need to definitively rank them and make sure they know where they stand so they can improve.

[papikaoss]

I completely agreed with this tier list, based on my experience. Thanks for sharing your experience with these tools.

[MrDragon]

I didnt get where you put robotframeowork exactly

[testertech]

Hi there, I also tried comparing TA tools and ranking them so I sort of know what you are getting at, I didn't use a tier list which is an interesting take. You asked for feedback about some of the tools on your list, so here's my 2 cents: - Cucumber is a BDD framework so not really well put on this list tbh. Also what do you mean with having to create an account, you can just use it as a library without the need for an account. - Robot Framework is a keyword based TA solution it's mainly Python based. It's really fast to create scripts since it's a complete framework for multiple SUT technologies you get out of the box. - Agree with you on Playwright, it's awesome for sure. Lastly, I would like to note that there are hundreds of TA tools out there so this is not all of them.

[nileshgaikwad]

Do automation tool also needs a comparison on the basis of the memory consumption, how fast they are, parallel execution. which are your top choices. do people use UI automation tools for web scraping/crawling for sites which needs user interaction.
I'm new to this. Nice list..!! best part is the ranking..

[MrArchisman]

Hi, Could you please shed some light on D365 Automation using Playwright (C#) which uses xrm library.

[Lethcode]

Did I get it wrong? What tools did I miss? Am I just too perfect?

[Martin-tdtz]

I used Katalon Studio a lot and it deserves a better tier. Very underrated Testmanagement Tool with A+ Support, very fast, best API Testintegration, Cucumber support, POM, TDD, Drag and Drop Refactoring, Testrecording to fasten development. The only downside is the Java Language you have to fiddle with. Freeware does the job perfectly. I will only switch to Playwright, if it supports Gherkin language in Python. But I agree with you on the other points. Nice list!