Skip to content

Instantly share code, notes, and snippets.

@anonhostpi
Last active May 13, 2023 01:18
Show Gist options
  • Save anonhostpi/97d4bb3e9535c92b8173fae704b76264 to your computer and use it in GitHub Desktop.
Save anonhostpi/97d4bb3e9535c92b8173fae704b76264 to your computer and use it in GitHub Desktop.
AutoGPT Conversation Trackers

Description:

Tracks AutoGPT Conversations and Categorizes them for easy access

  • mainly used by anonhostpi to track common issues with AutoGPT

A lot of issues/prs/discussions end up getting recreated, because contributors struggle to find previous issues

Since I am a junkie for issue tracking, I have created this public gist to help others navigate AutoGPT's repo.

- my discord name: anonhostpi 

Don't Like How Developer/Community Convos are Presented Here?

You can find this tracker both as a gist and as a repo:

Github Gists presents files linearly, while the repo presents them in a folder structure.

Gists are easier to read, but repos are easier to contribute to

Interesting and Fun Tools:

Microsoft's GPT2 Neuron Viewer - a tool to visualize the neurons of GPT2

Moderator Links:

https://dontasktoask.com/

Maintainer Links (of this repo):

Reading Group Links:

Re-Arch Work:

Issues:

  • #3652 - (Re-Arch) Plugin API work

Pull Requests:

  • #4005 - (Re-Arch) Status Tracking
  • #3995 - (Re-Arch) Plugin API Work
  • #3986 - (Re-Arch) More Message Broker Work
  • #3969 - (Re-Arch) Hello World
  • #3919 - (Re-Arch) Budget Manager Proposal
  • #3853 - (Re-Arch) Work to Decouple Logging into its own Interface.
  • #3850 - (Re-Arch) Abstraction for the Language Model
  • #3831 - (Re-Arch) Message Broker
    • Inter-Agent API
  • #3824 - (Re-Arch) Work to separate commands into plugins
  • #3805 - (Re-Arch) Introduce a Configuration Abstraction for the Re-Arch
  • #3795 - (Re-Arch) Introduce the Workspace Base Class
  • #3790 - (Re-Arch) Planner Interface work
  • #3717 - (Re-Arch) Agent State Encapsulation

Useful Links:

Gist | Alt | Label

Documentation Proposals

Issues:

  • #3939 - Proposal to update install instructions with activator
  • #3841 - Proposal to update the issue template to reflect when to send debug logs
  • #3839 - Proposal to update the wiki to include challenges

Pull Requests:

  • #3997 - Fix typo in getting started docs
  • #3989 - Fix for Memory Challenge Docs
  • #3764 - Add challenges to wiki

Useful Links:

Gist | Alt

Recursive Self-Improvement Proposals:

Issues:

  • #3917 - Challenge Creator Challenge
  • #3912 - Challenge Solver Challenge
  • #3847 - Proposal to add framework to generate failing tests from debug logs
  • #3842 - Proposal to add Self-Feedback-based Logging
  • #15 - Proposal to recursively improve AutoGPT
  • #11 - Proposal to improve generated texts with reflection

Pull Requests:

Useful Links:

Gist | Alt

Code Decoupling/Inversion of Control Proposals:

  • These proposals would need a Re-Arch.

Issues:

  • #3858 - Proposal to put prompts into a dictionary
  • #3775 - Proposal to separate the math calculation functions into their own plugin
  • #3593 - Proposal to separate the planner and executor into 2 separate agents.

Useful Links:

Gist | Alt

Codebase Simplification Proposals:

Pull Requests:

  • #2799 - Proposal to Reduce/Simplify agent_manager.py

Useful Links:

Gist | Alt

Built-in Prompt Improvement Proposals:

Issues:

  • #3858 - Proposal to put prompts into a dictionary

Pull Requests:

Useful Links:

Gist | Alt

API Access Problems:

Issues:

  • #3823 - Banned Region - China

Useful Links:

Gist | Alt | Label

Common Responses:

Un-Supported Regions:

Current list of unsupported regions (may be inaccurate, please check with your API provider and your local ordinance)

**A.** Afghanistan
**B.** Bahrain, Belarus, Burma (Myanmar)
**C.** Central African Republic, Chad, China, Cuba
**E.** Eritrea, Ethiopia
**I.** Iran
**K.** Kazahkstan, North Korea
**L.** Laos, Libya
**M.** Macedonia, Marshall Islands, Mauritius, Micronesia, Burma (Myanmar)
**N.** Nauru, Nepal, North Korea
**P.** Palau
**R.** Russia
**S.** Saint Kitts and Nevis, Saint Lucia, Saint Vincent and Grenadines, Somalia, South Sudan, Sudan, Syria
**T.** Tonga, Turkmenistan
**U.** Ukraine, Uzbekistan
**V.** Venezuela
**Y.** Yemen

API Disconnect/Connectivity Problems:

Issues:

  • #3977 - Errno 101 - Network is unreachable
  • #3728 - Connection Aborted - Remote end closed connection without response
  • #3607 - Proposal to handle 401+/500+ errors from the OpenAI Python module
  • #2937 - Request Timed Out
  • #2862 - Connection Aborted - Remote end closed connection without response
  • #2553 - HTTP Response Code 500 from OpenAI Python module
  • #2241 - Connection Aborted - Remote end closed connection without response
  • #1010 - Errno 101 - Network is unreachable

Useful Links:

Gist | Alt

Common Responses:

Make sure to check http://status.openai.com/ and recommend checking 3rd parties like downdetector: https://downdetector.com/status/openai/

API Authorization Problems:

  • Error Code 104: Bad Gateway usually means bad API Key

Discussions:

  • #1311 - Invalid OpenAI API Key

Issues:

  • #4084 - Invalid OpenAI API Key
  • #1914 - OpenAI Key not set
  • #644 - Invalid OpenAI API Key

Pull Requests:

  • #1304 - Proposal to add OpenAI paid account requirement to README.md

Useful Links:

Gist | Alt | Label

Common Responses:

It is important to note that [chat.openai.com][chat] and [platform.openai.com][platform] are not the same tools. Billing for one is completely different from the other.

Whenever making changes to [https://platform.openai.com][platform], you'll need to verify that the key didn't change or to regenerate one if needed.

[chat]:https://chat.openai.com/
[platform]:https://platform.openai.com

Notes:

as found in #4084, having duplicate OPEANAI_API_KEY entries in the .env file can cause the Invalid API Key error.

Cost/Rate-Limit Handling

Issues:

  • #3897 - "DOUBLE CHECK CONFIGURATION" error
  • #1841 - Proposal to chunk prompts and gracefully handle token overflows
  • #1441 - API Rate Limit Reached - --debug flag related bug
  • #1252 - API Rate Limit Reached - Failed to Get Response (Dupe of #1189)
  • #1227 - auto-gpt.json
  • #1203 - chat_completion - Failed to Get Response
  • #1189 - API Rate Limit Reached - Failed to Get Response
  • #1174 - auto-gpt.json
  • #1073 - auto-gpt.json
  • #1047 - API Rate Limit Reached
  • #585 - API Rate Limit Reached
  • #425 - API Rate Limit Reached
  • #235 - API Rate Limit Reached
  • #189 - API Rate Limit Reached
  • #79 - API Rate Limit Reached
  • #75 - API Rate Limit Reached

Pull Requests:

  • #4127 - Proposal to monitor token limits
  • #3919 - (Re-Arch) Budget Manager Proposal
  • #3313 - Budget Remaining Report Proposal
  • #1304 - Proposal to add OpenAI paid account requirement to README.md
  • #214 - Proposal to "backoff" when OpenAI API caps out/throttles requests

Useful Links:

Gist | Alt | Label: Chunking | Label: Cost

Common Responses:

Rate Limit errors occur from 1 of 3 typical problems: Your usage of the API is way to high, you don't have a paid account, or you have hit your maximum financial usage for the month.

To clarify, [platform.openai.com][platform] and [chat.openai.com][chat] are two different tools with their own set of billings. You need to have a paid account on [platform.openai.com][usage] to use the API.

Please check your [API Usage and Billing here][usage], and please consult [the OpenAI wiki on their _various_ rate limits][wiki].

Closing issue as this is a limitation with your OpenAI Account.

[platform]:https://platform.openai.com/
[chat]:https://chat.openai.com/
[wiki]:https://platform.openai.com/docs/guides/rate-limits/what-are-the-rate-limits-for-our-api
[usage]:https://platform.openai.com/account/billing/overview

LLM/LLM-API Proposals:

Issues:

  • #3942 - Proposal to add 3rd party OpenAI API support
  • #3959 - Request to add Azure-deployed OpenAI API support
  • #3105 - Proposal to add Bing AI

Pull Requests:

  • #45 - Efforts to add gpt-3.5

Useful Links:

Gist | Alt

Twitter API

Issues:

  • [#2588][2588] - send_tweet - Forbidden
  • [#2194][2194] - send_tweet - Forbidden

Useful Links:

Gist | Alt

Memory Backend Proposals and Issues:

Issues:

  • #3859 - Redis Memory on Local install not working
  • #3844 - Proposal to log memory usage
  • #3838 - Memory Challenge
  • [#2916][2916] - Pinecone - Failed to Connect
  • #328 - Pinecone - Failed to Connect

Pull Requests:

  • #3989 - Fix for Memory Challenge Docs
  • #2128 - Proposal to use a custom memory manager GPTCache

Useful Links:

Gist | Alt

Agent Self-Moderation Proposals:

Issues:

  • #3916 - Proposal to Self-Regulate through Observer Agents
  • #3842 - Proposal to add Self-Feedback-based Logging
  • #3466 - Proposal to add constraints awareness
  • #789 - Proposal to add risk awareness

Pull Requests:

Useful Links:

Gist | Alt

Multiagent/Multitasking Proposals:

Issues:

  • #3945 - Command Multitasking Proposal

Pull Requests:

Useful Links:

Gist | Alt

TTS/STT Proposals:

Pull Requests:

  • #3885 - Proposal to add plain speech
  • #3568 - Proposal to add StreamElements TTS
  • #3566 - Proposal to make MacOS TTS configurable

Useful Links:

Gist | Alt

Save-State/Caching and also Logging Proposals:

  • linking loging and save-state, because both involve similar goals

Issues:

  • #3933 - Proposal to save state to disk via Python Pickle
  • #3847 - Proposal to add framework to generate failing tests from debug logs
  • #3844 - Proposal to log memory usage
  • #3843 - Proposal to log user input
  • #3842 - Proposal to add Self-Feedback-based Logging
  • #3717 - (Re-Arch) Agent State Encapsulation
  • #822 - Proposal to save state and continue later
  • #430 - Resume state on connection loss restored

Pull Requests:

  • #4033 - Sync -> Async Testing of ApiManager
  • #3868 - Implementation of #3842
  • #3867 - Implementation of #3843
  • #3853 - (Re-Arch) Work to Decouple Logging into its own Interface.
  • #3697 - Log Summary
  • #3695 - Add logs for challenges
  • #3605 - Proposal to add logs for challenges and debugging
  • #3554 - Cassette fix on http/prompts
    • helps improve reliability of regression tests

Useful Links:

Gist | Alt

Git Operations:

Pull Requests:

  • #3815 - Proposal to add git operations
  • #364 - Proposal to add git operations and add react support

Useful Links:

Gist | Alt

Web Automation Capability:

Discussions:

  • #918 - How to use with login-only websites?

Issues:

  • #3936 - Challenge to test web and web form
  • #3904 - Can't get google_search to be invoked
  • #1949 - Benign Selenium Error (Selenium logging is not disabled)
  • #1606 - Benign Selenium Error (Selenium logging is not disabled)

Pull Requests:

  • #3757 - Proposal to add Chrome and Chromedriver paths to .env
  • #3551 - Proposal to improve web browsing prompts
  • #3519 - Various fixes for Selenium
  • #3058 - Proposal to add EdgeDriver Support with a download manager
  • #2286 - Fix Selenium bypassing proxy variables
  • #2066 - Proposal to add optional drivers to .env
  • #1988 - Proposal to add Edgedriver support

Useful Links:

Gist | Alt

Bitcoin Operations:

Pull Requests:

  • #749 - Proposal to add bitcoin commands

Useful Links:

Gist | Alt

Static File Parsing:

Discussions:

  • #3938 - Inquiry about XML parsing
  • #2285 - Excel and PDF parsing

Issues:

  • #1930 - How to parse PDF and TXT files

Useful Links:

Gist | Alt

Program Language Support:

Issues:

  • #3901 - Regression Test via Simple Contact Form
    • used to test basic language support
  • #2775 - Proposal to add support for other languages

Useful Links:

Gist | Alt

Spoken Language Support:

Discussions:

  • #471 - Proposal to add support for other languages

Issues:

  • #1563 - Proposal to add support for other languages

Useful Links:

Gist | Alt

Software QA Testing:

  • Includes:
    • Challenges & Tests
    • Benchmarks & Metrics

Issues:

  • #3937 - Adaptability Challenge
  • #3936 - Challenge to test web and web form
  • #3935 - Another Debug Challenge
  • #3917 - Challenge Creator Challenge
  • #3912 - Challenge Solver Challenge
  • #3907 - Proposal to enforce using default commands when testing
  • #3906 - Test Order
    • Specifics about how to run these tests/challenges
  • #3901 - Regression Test via Simple Contact Form
  • #3900 - Proposal to add async tooling to tests
  • #3883 - Proposal to use automatic AutoGPT config by default
  • #3871 - Psychological Challenge
  • #3863 - Parallel Testing proposal
  • #3847 - Proposal to add framework to generate failing tests from debug logs
  • #3839 - Proposal to update the wiki to include challenges
    • specify what challenges are as opposed to other forms of tests
  • #3838 - Memory Challenge
  • #3837 - Information Retrieval
  • #3836 - Python Debug Challenge
  • #3835 - Building Challenges
  • #3813 - Python Debug Challenge (Duplicate of #3836)

Pull Requests:

  • #4033 - Sync -> Async Testing of ApiManager
  • #3989 - Fix for Memory Challenge Docs
  • #3985 - Document Failing Memory Challenge C
  • #3982 - Proposal to add benchmarks
  • #3969 - (Re-Arch) Hello World
  • #3870 - Support for Concurrent Testing with pytest-xdist (fix for #3863)
  • #3865 - Python Debug Challenge
  • #3804 - Python Debug Challenge
  • #3764 - Add challenges to wiki
  • #3695 - Add logs for challenges
  • #3605 - Add logs for challenges and debugging
  • #3554 - Cassette fix on http/prompts
    • helps improve reliability of regression tests

Useful Links:

Gist | Alt

Team Requests/Help Wanted:

Issues:

  • #3835 - Building Challenges
  • #1454 - Managing Github Issues

Useful Links:

Gist | Alt

Docker and Environment Problems:

  • Includes mostly Docker issues, but also includes other problems related to sys and net administration

Issues:

  • #3977 - Docker Connection Resets (likely bad proxy)
  • #3735 - Problem with executing created files
  • #3341 - Docker Connection Resets (likely bad proxy)

Pull Requests:

  • #3875 - Fix docker setup in setup.md
  • #3713 - Add Option to Decontainerize Python Execution

Useful Links:

Gist | Alt

General Networking

Issues:

  • #182 - How to setup and configure proxy?

Useful Links:

Gist | Alt

Security-Related Proposals

Pull Requests:

  • #3950 - Command Blacklist and Whitelisting

Useful Links:

Gist | Alt

Execute Command Bugs:

Issues:

  • #3994 - Looping on unknown command ("command name")
  • #1557 - Looping on unknown command (execute_local_command)

Useful Links:

Gist | Alt

Prompt Looping Bugs:

Issues:

  • #3855 - Google Scraping causes infinite loop
  • #3943 - File Exist on Non-Existent File causes infinite loop

Useful Links:

Gist | Alt

File System Bugs:

Issues:

  • #4034 - Duplicate of #4029
  • #4029 - Not Writing to Output File
  • #3943 - File Exist on Non-Existent File causes infinite loop
  • #3705 - Absolute path access to same directory
  • #3514 - Failures to write/rewrite to a file
  • #3419 - Writing to file outside workspace

Pull Requests:

Useful Links:

Gist | Alt

JSON Bugs:

Issues:

  • #4052 - JSONDecodeError in summary_memory.py
  • #3978 - JSONDecodeError in summary_memory.py
  • #3744 - JSONDecodeError in summary_memory.py
  • #3716 - JSON issues with commands

Pull Requests:

  • [#4104][4104] - fix JSONDecodeError in summary_memory.py
  • #3996 - fix JSONDecodeError in summary_memory.py
  • #3923 - fix JSONDecodeError in summary_memory.py

Useful Links:

Gist | Alt

General Python-related Bugs:

Issues:

  • #3992 - spelling mistake in string
  • #3987 - missing distro module
  • #3984 - multiple missing modules
  • #3944 - spawn run-web.sh does not work
  • #3088 - missing auto_gpt_plugin_template
  • #2773 - numpy_ops failure to load

Pull Requests:

  • #3580 - pyobjc missing on Mac OSnavigation

Useful Links:

Gist | Alt

Unsorted:

Discussions:

  • #4028 - Uncited Notes for System Prompts and Memory
  • #3991 - Spam for a slot gambling game

Pull Requests:

  • #3866 - Unknown (Not proposed in English)
  • #3993 - Unexplained Concept Map in Spanish?

Useful Links:

Gist | Alt

MIT License

Copyright (c) 2023 Toran Bruce Richards

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment