OpenAI Computer-Using Agent

17 points by cosbgn 1 year ago | 10 comments

aliljet 1 year ago |

I genuinely wonder if this kind of use case is going to completely upend UX testing. There's something dynamic, perhaps poorly so, that would change the way prescriptive, painfully locked UX tests work...

ravedave5 1 year ago | |

Depends on the pricing & speed. I think you'd use this to create scripts that would run frequently, then on failure you'd have this evaluate if there were changes and if so create a new script.

efnx 1 year ago | |

It would depend on the reliability of the model to produce deterministic results. So far that’s been pretty tough.

binarymax 1 year ago |

Well, looks like they doubled down on the whole "computer use/ing" language, which is a total misnomer.

Now pardon me while I body use to get some coffee.

daft_pink 1 year ago |

If I order their $200 a month plan can I use this today?

daft_pink 1 year ago | |

The answer is yes, but I misunderstood when reading this and thought it actually could use my computer when it just runs its own browser.

oidar 1 year ago |

ByteDance dropped an open source computer using AI today as well.

TechDebtDevin 1 year ago | |

I thought this was funny from the UI-TARS ReadME:

``` ## Note - Use Chinese in `Thought` part. - Summarize your next action (with its target element) in one sentence in `Thought` part.

## User Instruction """

```

deadbabe 1 year ago |

Can it play a game?

daft_pink 1 year ago | |

How about a nice game of chess?