Web Crawling capabilities in AI Agent Chat
complete
kferrero
AI Agent struggling, Initially tells me it can't do web research but reminding it that it can it eventually does. Then researches and provides me results that appear to be from someone else's question. I swapped over to chatgpt directly at openai.com and asked ChatGPT-4 the same question and it nailed it on the first try.
My request was fairly simple, to do web research on 6 hyperlinks, extract recipes and then compile into a shopping list. Taskade "researcher" AI Agent gave me a shopping list for 6 unrelated random meals.
See ChatGPT conversation to see how easily it got this right, I don't understand how Taskade AI agent totally missed the mark. I've noticed over the past few days its been really struggling, providing blank responses or getting stuck and I Have to nudge it a few times to get it to start responding again.
Log In
Dionis Loire
complete
This is available in agent chat now.
dthakur
Dionis Loire will this web crawler will always update the website they crawl regularly when that website get updated or donwe have to manually resync ?
Also will it crawl only that url or the subwebsite under that url also ?
Narek Zograbian
dthakur: It will not re-crawl when the website updates. You'll need to manually sync. It will also only crawl the link you provide—it will not crawl subdomains or additional pages.
Narek Zograbian
Merged in a post:
Network access for AI
lt34556653
I would like Taskade to enable internet access for AI agents. This feature would be particularly useful for allowing the AI to retrieve real-time information, such as the current date.
Narek Zograbian
Merged in a post:
Taskade AI Chat with OpenAI plugins
dr.hafeez
The Taskade AI evidently has limitations, confined to the fundamental functionalities of GPT-4 without the ability to browse the web. Integrating web searching capabilities within the chat would be highly advantageous. I feel as though id like to no have to jump back to openai site and start using plugins there when ideally it should all be integrated into taskade.
John at Taskade
planned
Thanks again for all your feedback! We'd love to hear any comments or use cases you have, so please share them right here in this post. Stay tuned for more updates from us.
Don't forget to check out our latest changelog for all the new features and improvements: https://www.taskade.com/blog/updates/.
Narek Zograbian
Merged in a post:
Able/unable to preform web searches under the agents tab.
grahamw
Usually, when using a command which has web search enabled within an agent window, it will refuse to search the web. However, I don't know how, but I was able to get it to search the web. I'm not sure if this is an intended feature, or it is not supposed to have web search (given that it doesn't let me search after I cleared the chat).
Narek Zograbian
Merged in a post:
Allow web access by default for AI agents.
yasser.sharaf
After contacting support, agents don't access the internet by default and I have to define commands to allow the agent to access the internet. As a developer, this is not useful and developers always look for AI agents with the ability to access the internet by default.
Narek Zograbian
Would you like the agents to crawl or scrape the web?
What sort of functionality are you looking for?
yasser.sharaf
Narek Zograbian what I need is to ask the agent about something recently released like Laravel 11 and get recent answers related to it so it should be able to access Laravel 11 docs to find answers without defining commands. That's what most users need from AI agents. So whether you call it scrape or crawl, we care about the end result.
yasser.sharaf
Narek Zograbian I also tried the same question using a command with web search enabled but still, the agent can't find the answer.
yasser.sharaf
Narek Zograbian Go ahead and try it yourself. Very disappointing.
Narek Zograbian
yasser.sharaf: We're working on this. It's a complex feature and I think we'll merge this over with another feature request.
yasser.sharaf
Narek Zograbian but why isn't it working with the command when I enable web search?
Narek Zograbian
yasser.sharaf: That should work at the project-level but not in the agent chat yet.
r
ryantaskade
Merged in a post:
Enable Web Access for Agent
rickysad
Give the agent access to the web and real-time info. Right now, this is only available at the command level.
There should be an option for it to search the web for answers when we're chatting with the agent.
r
ryantaskade
Hi kferrero,
I noticed that you are attempting to provide hyperlinks to the agent for it to crawl. To clarify, are you trying to achieve this within the AI chat?
If so, please note that the agent doesn't have web searching capabilities directly within the chat. This capability is present in the custom commands (if activated).
As a workaround, you can paste those links within the Agent's knowledge tab using the "Add Link" button. This will allow the agent to crawl the links and have that information in its context to answer your questions.
I've updated the title of this post to reflect a feature request regarding having web crawl capabilities directly within the AI agent chat. Please let me know if I am understanding your request correctly.
kferrero
ryantaskade: Hey Ryan, no so I created a bulleted list of hyperlinks in a project, highlighted them all and then used slash command. In the past this has worked to give the assistant all of the information I want it to process. If I am mistaken, or if that's not the case please let me know. I still haven't quite figured out exactly how everything works in Taskade hah.
r
ryantaskade
kferrero: Hi kferrero,
I appreciate the clarification. The AI assistant found in the editor does not have web search capabilities. Our AI assistant is configured to always provide replies, and in situations where it lacks information, it might generate responses that are not accurate or relevant to the topic.
If you need assistance with your use case, feel free to reach out to support@taskade.com, and I can provide guidance on how to best utilize our AI features.
kferrero
ryantaskade: Makes sense, thanks!
supermario_ai
Narek Zograbian: Look familiar Fam? 🤣
elliscwc: How much effort is it to port the project level api web search into project chat? 😊
❤️
r
ryantaskade
supermario_ai: Hello Mario,
To elaborate further on this matter, the challenge isn't just the technical complexity when integrating the same API into the chat. Alongside it, there are difficulties in properly sanitizing input data to ensure the AI accurately understands messages.
Additionally, the extra processing and web search queries involved could increase the cost of each chat message sent.
Providing an option to toggle the tool for the chat is also something we need to carefully consider.
These are some of the aspects we take into account when evaluating features like this.
Best regards,
supermario_ai
ryantaskade: Appreciate you taking the time to educate me, that's not low hanging fruit by any stretch of the imagination! Sometimes the Juice isn't worth the Squeeze!
In other news, I made an agent Command that self-generates its commands based on the agents' instructions, ill tag you!
❤️💯
mac_isleof.ai
ryantaskade
I keep hearing how the Ai isn’t able for what ever reason … then I go to ChatGPT and presto.
So everything you guys are saying as to “WHY” the bot doesn’t do this makes no sense when we can get ChatGPT to do it! 🤷♂️
mac_isleof.ai
As a follow-up I decided to ask a custom gpt because these custom GPTs appear to be what Taskade is using for the Ai agents.
Sooooo, a custom gpt from ChatGPT returns similar behavior. My apologies for seeming to be overly critical of Taskade. It appears this is something that originates with ChatGPT custom gpt limitations.
r
ryantaskade
Hi there, thank you for the feedback, i've updated this post title and moved it the appropriate board as the suggestion is targetted at incorporating more of the plugins offered in OpenAi into Taskade.
Load More
→