Goodbye programmers: Team of AI bots develops software in 7 minutes instead of 4 weeks

[Windwaver]

https://vulcanpost.com/843379/team-of-ai-bots-develops-software-in-7-minutes-instead-of-4-weeks/

Back in July, a team of researchers proved that ChatGPT is able to design a simple, producible microchip from scratch in under 100 minutes, following human instructions provided in plain English.

Last month, another group — working at universities in China and the US — decided to take a step further and cut the humans out of the creative process almost completely.

Instead of relying on a single chatbot providing answers to questions asked by a human, they created a team of ChatGPT 3.5-powered bots, each assuming a different role in a software agency: CEO, CTO, CPO, programmer, code reviewer, code tester, and graphics designer.

Each one was briefed about its role and provided details about their behaviour and requirements for communication with other participants, e.g. “designated task and roles, communication protocols, termination criteria, and constraints.”

Other than that, however, ChatDev’s — as the company was named — artificial intelligence (AI) team would have to come up with its own solutions, decide which languages to use, design the interface, test the output, and provide corrections if needed.

Once ready, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.

The dream CEO

The bots were to follow an established waterfall development model, with tasks broken up between designing, coding, testing, and documenting of work done, with each of them assigned their roles throughout the process.

What I found particularly interesting is the exclusion of CEO from the technical aspects of the process. His role is to provide the initial input and return for the summary, while leaving techies and designers to do their jobs in peace — quite unlike in the real world!

I think many people would welcome our new overlords, who are instructed not to interfere with the job until it’s really time for them to. Just think how many conflicts could be avoided!

Once the entire team was ready to go, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.

Here’s an example of fully artificial conversation between all of the “members”:

Later, followed by i.a. this exchange between the CTO and the programmer:

These conversations continued at each stage before its completion and information being passed for interface design, testing, and documentation (like creating a user manual).

Time is money

After running 70 different tasks through this virtual AI software dev company, over 86 per cent of the produced code was executed flawlessly. The remaining about 14 per cent faced hiccups due to broken external dependencies and limitations of ChatGPT’s API — so, it was not a flaw of the methodology itself.

The longest time it took to complete a single task was measured at 1030 seconds, so a little over 17 minutes — with an average of just six minutes and 49 seconds across all tasks.

This, perhaps, is not all that telling yet. After all, there are many tasks, big and small, in software development, so the researchers put their findings in context:

“On average, the development of small-sized software and interfaces using CHATDEV took 409.84 seconds, less than seven minutes. In comparison, traditional custom software development cycles, even within agile software development methods, typically require two to four weeks, or even several months per cycle.”

At the very least, then, this approach could shave off weeks of typical development time — and we are only at the very beginning of the revolution, with still not very sophisticated AI bots (and this wasn’t even the latest version of ChatGPT).

And if time wasn’t enough of a saving, the basic costs of running each cycle with AI is just… $1. A dollar.

Even if we factor in the necessary setup and input information provided by humans, this approach still provides an opportunity for massive savings.

Goodbye programmers?

Perhaps soon, but not yet. Even the authors of the paper admit that even though the output produced by the bots was most often functional, it wasn’t always exactly what was expected (though it happens to humans too — just think of all the times you did exactly what the client asked and they were still furious).

They also recognised that AI itself may exhibit certain biases, and different settings it was deployed with were able to dramatically change output, in extreme cases rendering it unusable. In other words, setting the bots up correctly is a prerequisite to success. At least today.

So, for the time being, I think we’re going to see a rapid rise in human-AI cooperation rather than outright replacement.

However, it’s also difficult to escape the impression that through it we will be raising our successors and, in not so distant future, humans will be limited to only setting goals for AI to accomplish, while mastering programming languages will be akin to learning Latin.

[Mkl22]

Terminator- Rise of the machines. 

[Sosaria]

Already now there is no longer need to learn ms office applications  beyond the very basics.

Whatever you want to do in whatever ms office application, just ask chatgpt and it can even do macros for you.

All those skill-up courses offering to teach word, excel, powerpoint, all overnight close shop.

Those days of Excel - Basic/Intermediate/Advanced courses will be gone. Soon to be followed by the numerous Excel gurus on their youtube channels.

Edited October 26, 2023 by Sosaria

[Sosaria]

On 10/26/2023 at 9:45 PM, Windwaver said:

https://vulcanpost.com/843379/team-of-ai-bots-develops-software-in-7-minutes-instead-of-4-weeks/

Back in July, a team of researchers proved that ChatGPT is able to design a simple, producible microchip from scratch in under 100 minutes, following human instructions provided in plain English.

Last month, another group — working at universities in China and the US — decided to take a step further and cut the humans out of the creative process almost completely.

Instead of relying on a single chatbot providing answers to questions asked by a human, they created a team of ChatGPT 3.5-powered bots, each assuming a different role in a software agency: CEO, CTO, CPO, programmer, code reviewer, code tester, and graphics designer.

Each one was briefed about its role and provided details about their behaviour and requirements for communication with other participants, e.g. “designated task and roles, communication protocols, termination criteria, and constraints.”

Other than that, however, ChatDev’s — as the company was named — artificial intelligence (AI) team would have to come up with its own solutions, decide which languages to use, design the interface, test the output, and provide corrections if needed.

Once ready, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.

The dream CEO

The bots were to follow an established waterfall development model, with tasks broken up between designing, coding, testing, and documenting of work done, with each of them assigned their roles throughout the process.

What I found particularly interesting is the exclusion of CEO from the technical aspects of the process. His role is to provide the initial input and return for the summary, while leaving techies and designers to do their jobs in peace — quite unlike in the real world!

I think many people would welcome our new overlords, who are instructed not to interfere with the job until it’s really time for them to. Just think how many conflicts could be avoided!

Once the entire team was ready to go, the researchers then fed their virtual team with specific software development tasks and measured how it would perform both on accuracy and time required to complete each of them.

Here’s an example of fully artificial conversation between all of the “members”:

Later, followed by i.a. this exchange between the CTO and the programmer:

These conversations continued at each stage before its completion and information being passed for interface design, testing, and documentation (like creating a user manual).

Time is money

After running 70 different tasks through this virtual AI software dev company, over 86 per cent of the produced code was executed flawlessly. The remaining about 14 per cent faced hiccups due to broken external dependencies and limitations of ChatGPT’s API — so, it was not a flaw of the methodology itself.

The longest time it took to complete a single task was measured at 1030 seconds, so a little over 17 minutes — with an average of just six minutes and 49 seconds across all tasks.

This, perhaps, is not all that telling yet. After all, there are many tasks, big and small, in software development, so the researchers put their findings in context:

“On average, the development of small-sized software and interfaces using CHATDEV took 409.84 seconds, less than seven minutes. In comparison, traditional custom software development cycles, even within agile software development methods, typically require two to four weeks, or even several months per cycle.”

At the very least, then, this approach could shave off weeks of typical development time — and we are only at the very beginning of the revolution, with still not very sophisticated AI bots (and this wasn’t even the latest version of ChatGPT).

And if time wasn’t enough of a saving, the basic costs of running each cycle with AI is just… $1. A dollar.

Even if we factor in the necessary setup and input information provided by humans, this approach still provides an opportunity for massive savings.

Goodbye programmers?

Perhaps soon, but not yet. Even the authors of the paper admit that even though the output produced by the bots was most often functional, it wasn’t always exactly what was expected (though it happens to humans too — just think of all the times you did exactly what the client asked and they were still furious).

They also recognised that AI itself may exhibit certain biases, and different settings it was deployed with were able to dramatically change output, in extreme cases rendering it unusable. In other words, setting the bots up correctly is a prerequisite to success. At least today.

So, for the time being, I think we’re going to see a rapid rise in human-AI cooperation rather than outright replacement.

However, it’s also difficult to escape the impression that through it we will be raising our successors and, in not so distant future, humans will be limited to only setting goals for AI to accomplish, while mastering programming languages will be akin to learning Latin.

I will replace the CEO first with AI. Biggest cost saving for the company  

[Soya]

On 10/26/2023 at 10:52 PM, Sosaria said:

Already now there is no longer need to learn ms office applications  beyond the very basics.

Whatever you want to do in whatever ms office application, just ask chatgpt and it can even do macros for you.

All those skill-up courses offering to teach word, excel, powerpoint, all overnight close shop.

Those days of Excel - Basic/Intermediate/Advanced courses will be gone. Soon to be followed by the numerous Excel gurus on their youtube channels.

Donch say ah. I ever saw Skillsfuture got course on 'How to use an iphone'....

 

 

[RadX]

Goodbye CECA?

[Kb27]

that's scary.

can they invent new OS ?

like we need a few hundred each month .. 😀

[Heartbreakid]

Is humankind trying to be smart by introducing AI or being stupid? Because one way or the other, when these AIs are doing jobs human can do, it is going to be more challenging to have jobs for humans. 

[Watwheels]

AI so satki? But who developed AI?

Tbh I have yet seen anything overtaken the human brain so far. Better, faster, cheaper than humans, yes perhaps but overtaken humans....not really. Anything AI also need human's input into the system. Can you make love to the AI? When it is time you can do that then I will say it's smth otherwise, no. 

[Sosaria]

On 10/27/2023 at 7:24 AM, Heartbreakid said:

Is humankind trying to be smart by introducing AI or being stupid? Because one way or the other, when these AIs are doing jobs human can do, it is going to be more challenging to have jobs for humans. 

But TFR is plunging is most developed countries where most of these jobs are situated. Also industrial and labour issues cause problems and disruption. So it makes sense to augment manpower productivity loss with AI.

[Inlinefour]

SkyNet FTW 😆😆😆 

 

my friend was wondering why AI can't replace those multi million Jiak Liao Bee huh 🙈🙉🙊 

 

don't tell me SkyNet actually own by them 😂😂😂

 

after watching Terminator guess Machine can really destroy mankind 😁😁😁

[kobayashiGT]

They can shorten our working time so we can have more time to enjoy. 

[Kopites]

And we will be seeing that dated ugly cumbersome technology in our ride soon.

Thank you LTA. 🤔

[Mustank]

https://www.pcmag.com/news/come-together-ai-enhanced-final-beatles-song-drops-nov-2

[Arogab]

Please have AI to replace what I am doing now. Include surfing MCF. Then I go fishing 

[Jamesc]

Goodbye programmers?

What nonsense!

And who programmed the team of AI bots?

A programmer!

[mersaylee]

Let all bots evolve until fully self sufficient and do all the jobs...for free...we all can relac one corner shake legs, smoke ciggy, drink perrier, la kopi, join simi ccbhood, surf MCF full time...no need money for anything...just order ong lai...😁

[Inlinefour]

On 10/27/2023 at 10:34 AM, Jamesc said:

Goodbye programmers?

What nonsense!

And who programmed the team of AI bots?

A programmer!

 

SkyNet is run by Terminator 🙊🙉🙈 

 

He will be back as US President 😆😆😆