The World of "AI Agents" the Good the Bad and the Ugly

Data Swami

Business Member
  • Business Listing
    I figured I would share with you guys my experience building out a "business operating" system with a number of AI/opensource tools that I could host myself and not be reliant on any subscription other than OpenAI.

    Now this isnt using GPTs in the nice UI that Chatgpt has but fully customised agents dedicated to doing what i want on a day to day basis.

    What I learnt from it has been alot and I cant lie there have been many a time I wanted to throw the box out the window. For context i hosted Openclaw on a virtual machine on my own server. Setting it up wasnt too bad but definitely not for a non technical person. Especially since this was the first time id properly attacked Linux in anger.

    The way i set things up was a bit different to standard setups of openclaw that just use 1 agent to do everything I wanted specialised "agents" in a sort of business structure. So a CEO and below that the different branches of the "leadership" positions and initially specialised agents per type of work.

    So here is the "Bad" what i learnt in this specific case was that many agents gets messy. In total i had 58 "agents" each with a specific job and workflow that it would do. The problem came with orchestrating them all. Individually they were fine but orchestrating at that many levels meant things became confused if I just wanted it to run one of the skills. So lesson learnt was to have the specialisation but keep it to those "leadership" roles as otherwise they were just there not doing much apart form orchestrating approvals.

    The Ugly then is as most of these tools are open source managing the underlying tools updates was a bit of a hassle. Config files change here there and everywhere meaning you have to manually update things like ordering of the openai accounts you have linked, or security changes here and there. These can be managed if you set things up in a way to not update your main system first but as this was an experiment with these tools you have to see how things would go if someone who had not clue would work it. The other "Ugly" issue that could happen is if you are using API keys then the cost can skyrocket. I have used the open AI login for this and its definitely saved me on API fees. So that is something to really watch out for but also setting the models to lower cost of local models also helps with certain things.

    And now we get to the Good. Once you setup your skills there is so much power to be had. For instance I have linked my setup to a number of Discord bots to allow me to communicate from wherever I am without opening up the interface to the world and only I am a member of the discord server. The workflows i have setup mean that every morning all of the socials for the day are ready for approval, if anything needs rewriting I can give my instructions and its all tracked in my logs. All PR actitivties are dealt with including alerts to write and responses to write with again ability to rewrite or approve. There is alot more that I have automated but i wont list everything but as it has the ability to use browser automation within reason anything is possible to be automated as long as you know the "flow". And then even better set it up to self learn with input form you.

    So whats the lesson? This is in no way something to be done by the faint of heart or a solopreneur/small sme. The ways to fall over the complexity and the opportunities for security and reputational risk are too great.

    However its also incredibly powerful setup for an SME Owner. Want to repurpose your content on tiktok and youtube? Have a workflow setup that will take that video you recorded, snip it up and send it out. Want to keep your socials active have it automate producing what content to post and approve what goes out or get it to rewrite and have it all in your "brand voice" and scheduled at each platforms best time for your users. Reddit is another great example of where a business can share their expertise but its a damn slog to manually search for what you should be answering so make it easier with either showing threads to answer and show off you biz or draft the responses too and get them posted for you.

    Im gonna keep playing and building tools for myself and also see how this "Operating System" can be easily made ive only really scratched the surface as I am starting to look at "trading bots", other locally hosted things like TwentyCRM, Mautic for email sequences etc. But i definitely see an opportunity for small businesses to really power past other businesses within their niches by taking advantage of these solutions as long as they are setup right for them especially with the understanding of how the SMEs work within their business. So rather than a usually SSAS tool that they have to work around it can become something that works for them and works to their style.

    I know a couple of you guys have had a play with Openclaw too how has your experience been I know some of you struggled with getting it to do complex things which i have found ways around especially with how I have various knowledge bases stored. But how have you found it for the past few months and what have you manage to build?
     

    Newchodge

    Moderator
  • Business Listing
    Nov 8, 2012
    22,673
    8
    7,981
    Newcastle
    I figured I would share with you guys my experience building out a "business operating" system with a number of AI/opensource tools that I could host myself and not be reliant on any subscription other than OpenAI.

    Now this isnt using GPTs in the nice UI that Chatgpt has but fully customised agents dedicated to doing what i want on a day to day basis.

    What I learnt from it has been alot and I cant lie there have been many a time I wanted to throw the box out the window. For context i hosted Openclaw on a virtual machine on my own server. Setting it up wasnt too bad but definitely not for a non technical person. Especially since this was the first time id properly attacked Linux in anger.

    The way i set things up was a bit different to standard setups of openclaw that just use 1 agent to do everything I wanted specialised "agents" in a sort of business structure. So a CEO and below that the different branches of the "leadership" positions and initially specialised agents per type of work.

    So here is the "Bad" what i learnt in this specific case was that many agents gets messy. In total i had 58 "agents" each with a specific job and workflow that it would do. The problem came with orchestrating them all. Individually they were fine but orchestrating at that many levels meant things became confused if I just wanted it to run one of the skills. So lesson learnt was to have the specialisation but keep it to those "leadership" roles as otherwise they were just there not doing much apart form orchestrating approvals.

    The Ugly then is as most of these tools are open source managing the underlying tools updates was a bit of a hassle. Config files change here there and everywhere meaning you have to manually update things like ordering of the openai accounts you have linked, or security changes here and there. These can be managed if you set things up in a way to not update your main system first but as this was an experiment with these tools you have to see how things would go if someone who had not clue would work it. The other "Ugly" issue that could happen is if you are using API keys then the cost can skyrocket. I have used the open AI login for this and its definitely saved me on API fees. So that is something to really watch out for but also setting the models to lower cost of local models also helps with certain things.

    And now we get to the Good. Once you setup your skills there is so much power to be had. For instance I have linked my setup to a number of Discord bots to allow me to communicate from wherever I am without opening up the interface to the world and only I am a member of the discord server. The workflows i have setup mean that every morning all of the socials for the day are ready for approval, if anything needs rewriting I can give my instructions and its all tracked in my logs. All PR actitivties are dealt with including alerts to write and responses to write with again ability to rewrite or approve. There is alot more that I have automated but i wont list everything but as it has the ability to use browser automation within reason anything is possible to be automated as long as you know the "flow". And then even better set it up to self learn with input form you.

    So whats the lesson? This is in no way something to be done by the faint of heart or a solopreneur/small sme. The ways to fall over the complexity and the opportunities for security and reputational risk are too great.

    However its also incredibly powerful setup for an SME Owner. Want to repurpose your content on tiktok and youtube? Have a workflow setup that will take that video you recorded, snip it up and send it out. Want to keep your socials active have it automate producing what content to post and approve what goes out or get it to rewrite and have it all in your "brand voice" and scheduled at each platforms best time for your users. Reddit is another great example of where a business can share their expertise but its a damn slog to manually search for what you should be answering so make it easier with either showing threads to answer and show off you biz or draft the responses too and get them posted for you.

    Im gonna keep playing and building tools for myself and also see how this "Operating System" can be easily made ive only really scratched the surface as I am starting to look at "trading bots", other locally hosted things like TwentyCRM, Mautic for email sequences etc. But i definitely see an opportunity for small businesses to really power past other businesses within their niches by taking advantage of these solutions as long as they are setup right for them especially with the understanding of how the SMEs work within their business. So rather than a usually SSAS tool that they have to work around it can become something that works for them and works to their style.

    I know a couple of you guys have had a play with Openclaw too how has your experience been I know some of you struggled with getting it to do complex things which i have found ways around especially with how I have various knowledge bases stored. But how have you found it for the past few months and what have you manage to build?
    Can you assess the environmental cost of what you have done so far? Or can AI do that for you, if asked?
     
    Upvote 0

    Data Swami

    Business Member
  • Business Listing
    Can you assess the environmental cost of what you have done so far? Or can AI do that for you, if asked?
    Environmental cost is pretty small as i am locally hosting it so local models run on my own hardware with the exception of the unknown cost of what an OpenAI subscription usage is. I could ask for an indepth calculation but i expect it to be alot less than the environmental cost of running a car
     
    Upvote 0

    Newchodge

    Moderator
  • Business Listing
    Nov 8, 2012
    22,673
    8
    7,981
    Newcastle
    Environmental cost is pretty small as i am locally hosting it so local models run on my own hardware with the exception of the unknown cost of what an OpenAI subscription usage is. I could ask for an indepth calculation but i expect it to be alot less than the environmental cost of running a car
    I read somewhere that the amount of electricity needed by AI is more than that of a small country, plus a huge amount of water? This gives some idea https://www.technologyreview.com/2025/05/20/1116327/ai-energy-usage-climate-footprint-big-tech/
     
    Upvote 0

    Data Swami

    Business Member
  • Business Listing
    I read somewhere that the amount of electricity needed by AI is more than that of a small country, plus a huge amount of water? This gives some idea https://www.technologyreview.com/2025/05/20/1116327/ai-energy-usage-climate-footprint-big-tech/
    So for the big data centres yes definitely alot of power required alongside everything else needing more electricity as we become more reliant on it. But my own instance no where near that level of usage and even environmental impact of a car is a very exaggerated estimate.
     
    Upvote 0

    Newchodge

    Moderator
  • Business Listing
    Nov 8, 2012
    22,673
    8
    7,981
    Newcastle
    So for the big data centres yes definitely alot of power required alongside everything else needing more electricity as we become more reliant on it. But my own instance no where near that level of usage and even environmental impact of a car is a very exaggerated estimate.
    Sorry do you mean you are not using the AI agents?

    I am very concerned that, given the existing environmental challenges, using AI automatically for relatively little return is a dangerous attitude.
     
    Upvote 0

    Data Swami

    Business Member
  • Business Listing
    Sorry do you mean you are not using the AI agents?

    I am very concerned that, given the existing environmental challenges, using AI automatically for relatively little return is a dangerous attitude.
    No i am saying because i am locally hosting my AI Agents that the actual environmental impact is very small especially as I can use my local hardware over a datacentre. The unknown is actually how much 1 subscription has on the environment.

    And for little return? How do you calculate that? I have saved myself hours upon hours of time with what i have built so far. And we will see what happens with the trading bots and other products i build.

    AI Data Centres are a concern for their environmental impact just like regular datacentres as they are growing with the volume of data in the world. That doesnt even scratch the surface with needing more data for things like working out Fusion for energy generation and we need a whole heap of other types of computing which i wont get into detail to use with that alongside AI to help get us past that point. And the building of these AI data centres should be very strict in regards to their impact on the environment and the grid and must not be given preferential rates etc they should ensure measures to manage their impact. But then the way gov does that with regular businesses is pretty shoddy too with the Carbon credit deals etc.
     
    • Like
    Reactions: YasmeenLondon
    Upvote 0

    YasmeenLondon

    Business Member
    Business Listing
    Jul 25, 2022
    181
    92
    London
    yasmeencreative.com
    I am very concerned that, given the existing environmental challenges, using AI automatically for relatively little return is a dangerous attitude.
    Many people use AI to help them run their businesses, personally I use AI to save me hours of work, which allows me to dedicate that time saved into either my other businesses or my family, this is a very high return, and this is exactly why technology is important because it allows us to do more in the same 24 hours.

    The same argument was also used on mobile networks, road infrastructure, travel, consumerism and the list is endless.

    Do you use a mobile phone? do you travel? do you use WhatsApp? do you send emails? Do you buy from amazon or do you shop online? all these actions have significant environmental footprints.
     
    • Like
    Reactions: Data Swami
    Upvote 0

    Data Swami

    Business Member
  • Business Listing
    Many people use AI to help them run their businesses, personally I use AI to save me hours of work, which allows me to dedicate that time saved into either my other businesses or my family, this is a very high return, and this is exactly why technology is important because it allows us to do more in the same 24 hours.

    The same argument was also used on mobile networks, road infrastructure, travel, consumerism and the list is endless.

    Do you use a mobile phone? do you travel? do you use WhatsApp? do you send emails? Do you buy from amazon or do you shop online? all these actions have significant environmental footprints.
    Ahhh nice how have you specifically been using it for yourself? Tried anything like openclaw?
     
    Upvote 0

    YasmeenLondon

    Business Member
    Business Listing
    Jul 25, 2022
    181
    92
    London
    yasmeencreative.com
    Ahhh nice how have you specifically been using it for yourself? Tried anything like openclaw?
    Yes sir, a friend demonstrated open claw to me and within the hour I reformatted an old M1 MacBook Air I had lying around and I've been using it since.
     
    Upvote 0

    Data Swami

    Business Member
  • Business Listing
    Yes sir, a friend demonstrated open claw to me and within the hour I reformatted an old M1 MacBook Air I had lying around and I've been using it since
    haha nice :) i bought myself an old corporate server a long time ago and just hosting it on there with a few graphics cards in there too to get it working on local language models and lets me host a bunch of other self hosted things like databases, crm system, email campaign system etc
     
    • Like
    Reactions: YasmeenLondon
    Upvote 0

    Keynote Speech

    Free Member
    Business Listing
    So here is the "Bad" what i learnt in this specific case was that many agents gets messy. In total i had 58 "agents" each with a specific job and workflow that it would do. The problem came with orchestrating them all. Individually they were fine but orchestrating at that many levels meant things became confused if I just wanted it to run one of the skills. So lesson learnt was to have the specialisation but keep it to those "leadership" roles as otherwise they were just there not doing much apart form orchestrating approvals.
    That’s a really interesting breakdown, especially the bit about orchestration becoming the real headache rather than the agents themselves.

    It feels like a lot of these setups start off with the idea of loads of specialised agents, but in reality it just gets messy quite quickly. I’ve seen similar where keeping things simpler and focusing on a few solid workflows tends to work better long term.

    The cost side is a good point as well. It’s easy to get carried away with what it can do and forget how quickly usage can creep up.

    Have you found a decent balance yet between keeping it flexible and keeping it manageable, or is that still the tricky part?
     
    Upvote 0

    Latest Articles

    Join UK Business Forums for free business advice