Commit Graph

324 Commits

Author SHA1 Message Date
Luneye 23127acab2
Update Bing.py - Removed unnecessary "await" statements that could potentially lead to errors 2023-11-04 17:52:59 +01:00
Heiner Lohaus dfefd22aa1 Add exec_js helper def 2023-11-03 22:24:35 +01:00
Heiner Lohaus 65b5227500 Fix NotImplementedError on WIn 2023-11-03 21:36:50 +01:00
H Lohaus 85ca16d77f
Merge pull request #1181 from hlohaus/arkose
Use asyncio subprocess in OpenaiChat
2023-10-29 19:58:56 +01:00
Luneye b993bc00fa
Update ChatBase.py - Added jailbreak (enabled by default), Removed list incorrect responses 2023-10-29 18:34:12 +01:00
Heiner Lohaus cc301a3dd8 Use asyncio subprocess in OpenaiChat 2023-10-28 19:02:39 +02:00
Heiner Lohaus dc04ca9306 Add arkose_token to OpenaiChat 2023-10-28 07:21:00 +02:00
Heiner Lohaus 79cf039a88 Update config supports_message_history 2023-10-27 22:59:14 +02:00
Heiner Lohaus 0d1ae405cc Add Llama2 Providers / Models 2023-10-26 21:43:20 +02:00
Tekky ffa36c49e4
Merge pull request #1153 from AndPim4912/ChatBase-incorrect-responses
Extract keywords from incorrect responses
2023-10-25 16:55:36 +01:00
Tekky a167970d76
Merge pull request #1149 from Luneye/patch-4
[suggestion] Adding new parameter to check if a provider 'natively' supports mesage history
2023-10-25 14:07:40 +01:00
razrab 5ad48d9181 Extract keywords from incorrect responses
The text of error responses is dynamically created by LLM. Need determine by keywords for more precise identification.
2023-10-25 13:04:34 +03:00
Luneye 4bb751d989
Indicated support of message history in GptForLove.py 2023-10-24 23:46:54 +02:00
Luneye 2f539d0601
Indicated support of message history in Bing.py 2023-10-24 23:44:44 +02:00
Luneye e93887aff8
Indicated support of message history in ChatBase.py 2023-10-24 23:43:08 +02:00
Luneye 7a2c8e4cd3
Indicated support of message history in FreeGpt.py 2023-10-24 23:42:16 +02:00
Luneye 0b43c13268
Indicated support of message history in GPTalk.py 2023-10-24 23:41:08 +02:00
Luneye c43f82e966
Indicated support of message history in Yqcloud.py 2023-10-24 23:40:15 +02:00
Luneye c839597c6d
Indicated support of message history in You.py 2023-10-24 23:39:29 +02:00
Luneye aee8d5e628
Indicated support of message history in FakeGpt.py 2023-10-24 23:37:59 +02:00
Luneye 7f6d85f861
Indicated support of message history in ChatForAi.py 2023-10-24 23:36:48 +02:00
Luneye dc798b520d
Indicated support of message history in ChatgptX.py 2023-10-24 23:30:07 +02:00
Tekky 6363353670
Merge pull request #1146 from AndPim4912/GetGpt-debian-compat
Update GetGpt provider for Debian python3-pycryptodome compatibility
2023-10-24 19:42:11 +01:00
Tekky 4c276c7ed6
Merge pull request #1145 from AndPim4912/chatbase-invalid-response
Add support for detecting incorrect responses in ChatBase API requests.
2023-10-24 19:41:56 +01:00
Heiner Lohaus 979904166f
Update MyShell.py 2023-10-24 18:58:12 +02:00
razrab 87f8007345 Update GetGpt provider for Debian python3-pycryptodome compatibility
Try to import AES from Cryptodome.Cipher if Crypto.Cipher caused error.
2023-10-24 19:30:57 +03:00
razrab fd2b52823b Add support for detecting incorrect responses in ChatBase API requests. 2023-10-24 18:30:24 +03:00
Luneye 63ae5bb2cd
[suggestion] Adding new parameter to check if provider supports message history
What are your thoughts on introducing a parameter that allows us to promptly verify whether the provider supports message history? I also considered adding a parameter to indicate whether a provider can perform web searches.
2023-10-24 16:35:45 +02:00
Shubh Gajjar f0f5cb05f9
Update FreeGpt.py
Changed older domain url with the working new url
2023-10-24 13:47:55 +05:30
Luneye 21e56a1af8
Bugfix Bing.py - Resolved Issues with system prompt, Bing personalities and enabled all supported user requests
I used this repository (https://github.com/waylaidwanderer/node-chatgpt-api/) as a reference to fix all the bugs related to Bing "personality." I included all the required fields in the allowedMessageTypes and optionsSets (as well as sliceIds) to allow it to respond to any requests it actually supports.

Will also finish the code to fully implement the image generation functionality.
2023-10-23 14:00:36 +02:00
ⲘrṨhส∂ow 3982f39424
'Refactored by Sourcery' (#1125)
Co-authored-by: Sourcery AI <>
2023-10-23 09:46:25 +02:00
Tekky 955fb4bbaa
Merge pull request #1124 from hlohaus/fake
Improve helper
2023-10-22 22:55:32 +01:00
Tekky 33fcf907b6
Merge pull request #1122 from Luneye/patch-2
Major Update for Bing - Supports latest bundle version and image analysis
2023-10-22 22:54:14 +01:00
Heiner Lohaus 598255fa26 Debug logging support
Async browse access token
2023-10-22 23:53:18 +02:00
Heiner Lohaus 3ae90b57ed Improve get_cookies helper 2023-10-22 20:01:14 +02:00
Heiner Lohaus fc15181110 Fix ChatgptAi Provider 2023-10-22 17:13:13 +02:00
Luneye c400d02024
Major Update for Bing - Supports latest bundle version and image analysis
Here it is, a much-needed update to this service which offers numerous functionalities that the old code was unable to deliver to us.

As you may know, ChatGPT Plus subscribers now have the opportunity to request image analysis directly from GPT within the chat bar. Bing has also integrated this feature into its chatbot. With this new code, you can now provide an image using a data URI, with all the following supported extensions: jpg, jpeg, png, and gif!

**What is a data URI and how can I provide an image to Bing?**

Just to clarify, a data URI is a method for encoding data directly into a URI (Uniform Resource Identifier). It is typically used for embedding small data objects like images, text, or other resources within web pages or documents. Data URIs are widely used in web applications.

To provide an image from your desktop and retrieve it as a data URI, you can use this code: [GitHub link](https://gist.github.com/jsocol/1089733).

Now, here is a code snippet you can use to provide images to Bing:

```python
import g4f

provider = g4f.Provider.Bing
user_message = [{"role": "user", "content": "Hi, describe this image."}]

response = g4f.ChatCompletion.create(
    model = g4f.models.gpt_4,
    provider = g4f.provider,  # Corrected the provider value
    messages = user_message,
    stream = True,
    image = "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQEASABIAAD/4RiSRXhpZgAASUkqAAg..."  # Insert your full data URI image here
)

for message in response:
    print(message, flush=True, end='')
```

If you don't want to analyze the image, just do not specify the image parameter.

Regarding the implementation, the image is preprocessed within the Bing.py code, which can be resource-intensive for a server-side implementation. When using the Bing chatbot in your web browser, the image is preprocessed on your computer before being sent to the server. This preprocessing includes tasks like image rotation and compression. Although this implementation works, it would be more efficient to delegate image preprocessing to the client as it happens in reality. I will try to provide a JavaScript code for that at a later time.

As you saw, I did mention in the title that it is in Beta. The way the code is written, Bing can sometimes mess up its answers. Indeed, Bing does not really stream its responses as the other providers do. Bing sends its answers like this on each iteration:

"Hi,"
"Hi, this,"
"Hi, this is,"
"Hi, this is Bing."

Instead of sending each segment one at a time, it already adds them on each iteration. So, to simulate a normal streaming response, other contributors made the code wait for the next iteration to retrieve the newer segments and yield them. However, this method ignores something that Bing does.

Bing processes its responses in a markdown detector, which searches for links while the AI answers. If it finds a link, it saves it and waits until the AI finishes its answer to put all the found links at the very end of the answer. So if the AI is writing a link, but then on the next iteration, it finishes writing this link, it will then be deleted from the answer and appear later at the very end. Example:

"Here is your link reference ["
"Here is your link reference [^"
"Here is your link reference [^1"
"Here is your link reference [^1^"

And then the response would get stuck there because the markdown detector would have deleted this link reference in the next response and waited until the AI is finished to put it at the very end.

For this reason, I am working on an update to anticipate the markdown detector.
So please, if you guys notice any bugs with this new implementation, I would greatly appreciate it if you could report them on the issue tab of this repo. Thanks in advance, and I hope that all these explanations were clear to you!
2023-10-22 15:59:56 +02:00
Heiner Lohaus 78f93bb737 Add rate limit error messages 2023-10-22 15:15:43 +02:00
Heiner Lohaus 63cda8d779 Fix increase timeout
Add Hashnode Provider
Fix Yqcloud Provider
2023-10-22 14:22:33 +02:00
Heiner Lohaus 4225a39a49 Enable Liaobots and ChatForAi again 2023-10-22 09:04:14 +02:00
Heiner Lohaus 13e89d6ab9 Fix MyShell Provider 2023-10-22 08:57:31 +02:00
Heiner Lohaus a3af9fac3e Add FakeGpt Provider
Update providers in models
2023-10-22 01:22:25 +02:00
abc ae8dae82cf ~ | g4f `v-0.1.7.2`
patch / unpatch providers
2023-10-21 00:52:19 +01:00
abc dad69d24ce ~
minor changes
2023-10-20 19:28:46 +01:00
abc d4ab83a45b ~
automatic models fetching in GUI.
2023-10-19 15:14:48 +01:00
hs_junxiang 042ee7633b Fix: debug.logging not work in retry provider 2023-10-19 10:15:38 +08:00
ostix360 24f7495f24 Add timeout 2023-10-17 09:29:12 +02:00
abc 5b240665fb ~ | add `g4f.Provider.GeekGpt` 2023-10-16 14:34:00 +01:00
abc 4a3b663ccd ~ | remove non-working providers 2023-10-16 00:47:10 +01:00
Heiner Lohaus c1adfbee8e Add Llama2 and NoowAi Provider 2023-10-15 19:10:25 +02:00
Tekky 8bdbb9e9cd
~ | Merge pull request #1068 from hlohaus/fre
Fix Opchatgpts and ChatForAi Provider
2023-10-14 14:36:47 +01:00
abc 1f8293250e ~
fix chatbase (bad) and remove from auto selection
2023-10-14 14:36:24 +01:00
Heiner Lohaus 13ffdcd61a Fix Opchatgpts and ChatForAi Provider
Deprecate Vitalentum and Aivvm Provider
2023-10-14 00:31:48 +02:00
Heiner Lohaus 5048f01e26 Deprecate ChatForAi 2023-10-12 21:02:51 +02:00
Heiner Lohaus 1e8bbaaaa9 Add ChatgptLogin, ChatgptFree and GptChatly Provider 2023-10-12 20:28:54 +02:00
hs_junxiang 19346ba9ba Fix: GptGo json.decoder.JSONDecodeError 2023-10-12 10:53:30 +08:00
abc f74ca10fbd ~ | g4f v-0.1.6.1
some bug fixes
2023-10-11 18:56:53 +01:00
abc c9c573a6e6 ~ | remove DeepAi 2023-10-10 22:04:42 +01:00
abc 8964d15dc3 ~ | g4f `v-0.1.5.8` 2023-10-10 15:48:56 +01:00
Tekky e06012ae06
~ | Merge pull request #1029 from hlohaus/die
Some small fixes
2023-10-10 15:30:05 +01:00
Commenter123321 a77848429e make user agent easily changeable in deepai 2023-10-10 15:21:38 +02:00
Commenter123321 e049176324 fix deepai :) 2023-10-10 15:18:41 +02:00
Commenter123321 4d4ad976ec remove unused import in Bing.py 2023-10-10 14:49:25 +02:00
Commenter123321 3de672d023 Aivvm is the best provider no cap 2023-10-10 14:22:13 +02:00
Commenter123321 0e4297494d Merge remote-tracking branch 'origin/main'
# Conflicts:
#	g4f/Provider/Aivvm.py
#	g4f/models.py
2023-10-10 14:15:12 +02:00
Heiner Lohaus 53192b86b1 Some small fixes 2023-10-10 09:49:29 +02:00
Commenter123321 417ce27422
Update Aivvm.py 2023-10-10 09:13:18 +02:00
abc 1883d55147 ~
Conversion from str Provider to g4f.Provider
2023-10-09 23:45:29 +01:00
Commenter123321 58c45522ea add cool testing for gpt-3.5 and and gpt-4 2023-10-09 20:53:31 +02:00
Commenter123321 119817c963 Merge remote-tracking branch 'origin/main'
# Conflicts:
#	g4f/Provider/Aivvm.py
2023-10-09 18:02:06 +02:00
Heiner Lohaus c6b33e527c Add Proxy Support and Create Provider to Readme
Add proxy support to many providers
2023-10-09 13:33:20 +02:00
Heiner Lohaus e46b5fe043 Add proxy support to all providers 2023-10-09 10:22:17 +02:00
Heiner Lohaus 6401084fd0 Add Messages and AsyncResult typing
Add system_message in Yqcloud
2023-10-08 13:59:56 +02:00
Heiner Lohaus 4a9d7714ad Add Cromicle to provider list 2023-10-08 11:39:19 +02:00
abc 92e1ec6f4f ~ | `v-0.1.5.5`
Aiivm working again
2023-10-07 21:21:34 +01:00
Heiner Lohaus 3430b04f87 Remove Aivvm from working providers 2023-10-07 19:10:26 +02:00
Heiner Lohaus dfdb759639 Improve code with ai 2023-10-07 19:00:45 +02:00
Heiner Lohaus f7bb30036e Improve code by AI 2023-10-07 10:17:43 +02:00
Heiner Lohaus 4fa6e9c0f5 Add GptGod Provider
Remove timeout from aiohttp providers
Disable Opchatgpts and ChatgptLogin provider
2023-10-07 09:02:48 +02:00
Heiner Lohaus 1238d9a638 Add GPTalk and GptForLove Provider 2023-10-07 04:03:36 +02:00
Heiner Lohaus af9ed889c1 Fix timeout in create_async 2023-10-06 18:21:56 +02:00
abc c8835b15d4 ~ 2023-10-06 12:21:42 +01:00
hs_junxiang dbf54769e0 Fix: TypeError: 'type' object is not subscriptable 2023-10-06 15:50:16 +08:00
Tekky 6dc2502740
Merge branch 'main' into bom 2023-10-05 19:02:06 +01:00
Heiner Lohaus 88d2cbff09 Add AiAsk, Chatgpt4Online, ChatgptDemo
and ChatgptX Provider
Fix Bing, Liaobots and ChatgptAi Provider
Add "gpt_35_long" model and custom timeout
2023-10-05 05:13:37 +02:00
Hexye 3b418e8cc5
Update Cromicle.py 2023-10-04 22:51:41 +02:00
Hexye eb13f3b01d
Create Cromicle.py 2023-10-04 22:45:34 +02:00
abc 0bd5730bcd ~ | g4f v-0.1.4.8 - Fixed `g4f.Provider.Bing`
implemented new "X-Sydney-EncryptedConversationSignature" found in headers from "turing/conversation/create"
2023-10-04 21:04:31 +01:00
Tekky 6eb3fa3e5f
~ | Merge pull request #982 from hlohaus/fetch
Fix fetch_access_token in openai
2023-10-04 10:40:18 +02:00
Heiner Lohaus 6a61cf8116 Sort providers in new dirs 2023-10-04 07:20:51 +02:00
Heiner Lohaus 136770e05b Use custom user dir 2023-10-04 03:15:17 +02:00
Heiner Lohaus 5b2efa4aaf Fix fetch_access_token in openai 2023-10-03 23:53:17 +02:00
Tekky d9e527eb32
Merge pull request #975 from hlohaus/mmm
Bing Updates:
2023-10-03 23:04:10 +02:00
Heiner Lohaus be9b8f796c Add streaming in openai chat
Fetch access token with chromedriver
2023-10-03 22:12:56 +02:00
Heiner Lohaus 252f595b6a Bing Updates:
Add retry create conversation
Removed get_cookies fallback
Add creative tone parameter
2023-10-02 22:43:36 +02:00
Tekky c915050ac7
Merge pull request #971 from Giancarlo-Ma/main
feat: allow to add custom header to deepai
2023-10-02 18:56:00 +02:00
Heiner Lohaus ff4d9ae584 Add Phind Provider
Add release_curl in url_cffi requets
Support create image response in Bing
2023-10-02 17:01:15 +02:00
Giancarlo-Ma ba7d5015dc
feat: add custom header to deepai 2023-10-02 21:47:21 +08:00
Tekky c9e4c9ce00
~ | Merge pull request #968 from st4rted/patch-1
fix typo in payload
2023-10-02 12:20:37 +02:00
Heiner Lohaus d116f04322 Fix: There is no current event loop in thread 2023-10-02 06:47:07 +02:00
Heiner Lohaus 2dbeb54608 Remove fake_useragent module 2023-10-02 02:06:33 +02:00
Heiner Lohaus eb0e2c6a93 +Curl +Async +Stream Requests
Update Model List
2023-10-02 02:04:22 +02:00
st4rted 3485e357ac
fix typo in payload 2023-10-01 19:55:27 -04:00
Heiner Lohaus 7b9ad21de8 Change event loop policy on windows
Support more versions from curl_cffi
2023-10-01 20:29:57 +02:00
Commenter123321 f8411aa1e1 aivvm's no life creator keeps patching it, but I'm just better 😉 2023-10-01 19:12:33 +02:00
Heiner Lohaus bb481a03ab Disable Wewordle Provider
Update Ylokh Provider
Improve StreamRequest
2023-10-01 10:36:09 +02:00
Heiner Lohaus 261fac86dc Disable PerplexityAi Provider 2023-10-01 06:41:00 +02:00
Heiner Lohaus 98895e5b09 Update HuggingChat to new api
Impersonate Aivvm Provider
Add ChatForAi and FreeGpt Provider
Update AItianhuSpace Provider
Improve StreamRequest Support
Update get_event_loop Helper
2023-10-01 06:38:11 +02:00
Commenter123321 7181f2897b Fix Aivvm and add new models in models.py 2023-09-29 16:21:18 +02:00
Heiner Lohaus 3c2755bc72 Add ChatgptDuo and Aibn Provider
Add support for "nest_asyncio",
Reuse event_loops with event_loop_policy
Support for  "create_async" with synchron provider
2023-09-26 10:03:37 +02:00
Heiner Lohaus 72c3ff7a25 AItianhuSpace Provider with GPT 4 added
Reduced chunksize to better text completion
2023-09-26 01:02:02 +02:00
Heiner Lohaus 348670fe35 "create_async" support for BaseProvider,
by using ThreadPoolExecutor
Default Model for Vercel
2023-09-26 00:52:29 +02:00
Heiner Lohaus f1b6880f7e Add Myshell Provider
Remove auto proxy prefix
2023-09-25 15:52:19 +02:00
Heiner Lohaus 4edd7518de Fix: Aivvm: KeyError: ''
and TypeError: issubclass() arg 1 must be a class
2023-09-23 15:35:17 +02:00
abc bf78b4d033 ~ | improve Vercel & g4f.Completion.create 2023-09-23 11:33:44 +01:00
abc 6c2e3cc53c ~ | improve Vercel & g4f.Completion.create
added `.Completion.create` class.

```py
response = g4f.Completion.create(
    model='text-davinci-003', prompt="Hello")

print(response)
```
2023-09-23 11:16:19 +01:00
abc af9fc19938 ~ 2023-09-23 10:58:13 +01:00
Tekky 1215d30bf4
Delete g4f/Provider/Vercel.py 2023-09-23 10:54:38 +01:00
Heiner Lohaus a3ecabb00e Improve Vercel Provider:
- Fix endless loop
 - Add proxy, async support
 - Add default model
 Fix HuggingChat Provider
2023-09-23 11:42:30 +02:00
abc d4acc23c0b ~ | Update Vercel Provider 2023-09-23 01:31:46 +01:00
abc 42a02c3d2d ~ | new providers
Somwhat fix Aivvm provider, which looks to have a working gpt-4

kinda unstable
2023-09-23 00:44:09 +01:00
abc d320efd2ff ~ | Fix DeepAi 2023-09-22 23:48:39 +01:00
Heiner Lohaus e9f96ced9c Add RetryProvider 2023-09-21 20:10:59 +02:00
Heiner Lohaus 951a1332a7 Fix create_event_loop function
Add PerplexityAi Provider
2023-09-20 23:06:52 +02:00
Heiner Lohaus f90741c10b Improve code style in async support 2023-09-20 17:31:25 +02:00
Heiner Lohaus 587f4ad2c9 Add "create_event_loop" helper 2023-09-20 15:01:33 +02:00
Heiner Lohaus 55577031d5 Add check_running_loop requirement
Add create_async function in ChatCompletion
Use SelectorEventLoop on windows
2023-09-20 14:52:50 +02:00
Heiner Lohaus 82bd6f9180 Cache "snlm0e" in Bard
Improve error handling in ChatgptLogin
Fix async example in readme
2023-09-20 06:12:34 +02:00
Tekky a54291cb7c
~ | Merge pull request #914 from hlohaus/lesh
~ | Add GptGo Provider, Fix AItianhu Provider
2023-09-18 23:54:28 +01:00
abc bae9c432db ~ 2023-09-18 23:50:47 +01:00
Heiner Lohaus 3b8dfff974 Improve event loop 2023-09-18 07:15:43 +02:00
Heiner Lohaus e8d7bcd045 Add GptGo Provider, Fix AItianhu Provider 2023-09-18 03:21:12 +02:00
Tekky 73ec30a3f0
~ 2023-09-17 22:51:22 +01:00
Tekky 78bfbe717d
Revert "Fix type hint" 2023-09-17 22:23:54 +01:00
MIDORIBIN c6f2277906 fix typo: provider -> Provider 2023-09-16 10:36:47 +09:00
Heiner Lohaus 618addd001 Disable not working providers:
EasyChat, Equing, GetGpt, Liaobots and Wuguokai
No and random best provider for a model
Update providers in Readme
2023-09-12 04:40:10 +02:00
Heiner Lohaus d6382a2145 Add new providers: Aivvm, Vitalentum and Ylokh 2023-09-12 00:47:03 +02:00
Heiner Lohaus c2741a9a86 Add ChatBase Provider 2023-09-10 19:06:46 +02:00
Heiner Lohaus ddb6fa30d9 Add CodeLinkAva Provider, Improve test_async.py 2023-09-09 23:07:00 +02:00
Heiner Lohaus 7a9b719573 Fix imports in Bing 2023-09-05 17:35:51 +02:00
Heiner Lohaus 5ca47b44b2 Add to many provider async and stream support, Fix Ails, AItianhu, ChatgptAi, ChatgptLogin Provider, Add fallback cookies to Bing, Improve OpenaiChat Provider 2023-09-05 17:27:24 +02:00
Tekky ae9702ecf0
~ | Merge pull request #876 from Lin-jun-xiang/join_messages
~ | Following PEP8, use `.join()` to process `messages`
2023-09-05 14:26:08 +01:00
hs_junxiang 17c9adf485 Join the messages
A better approach is to use the `.join()` method of strings, which reduces string concatenation operations and improves performance.
Additionally, using formatted strings (f-strings) makes the code cleaner and more readable.
2023-09-04 13:41:22 +08:00
msi-JunXiang 901595b10f type hints
Use `from __future__ import annotations avoid `dict` and `list` cause "TypeErro: 'type' object is not subscriptable".

Refer to the following Stack Overflow discussions for more information:
1.
https://stackoverflow.com/questions/75202610/typeerror-type-object-is-not-subscriptable-python
2.
https://stackoverflow.com/questions/59101121/type-hint-for-a-dict-gives-typeerror-type-object-is-not-subscriptable
2023-09-03 16:26:26 +08:00
Heiner Lohaus 3e6b1d6bef Set working=True in Liaobots, Fix bing provider, Update readme 2023-09-01 23:39:57 +02:00
abc a4fe9907d6 ~ | v-0.0.2.6 2023-08-28 21:13:47 +01:00
Tekky a11b5baaa4
Merge branch 'main' into hugging 2023-08-28 21:08:09 +01:00
Luneye 01294db699
Merge branch 'main' into patch-1 2023-08-28 16:55:36 +02:00
Luneye a3851150b7
Update Bing.py
Fixed some errors in my previously precipitated commit.
2023-08-28 16:41:59 +02:00
Luneye 87c7db73a2
Update Bing.py
Added support the async function

Will implement proper cookie retrieval later but Bing is working for now
2023-08-28 16:31:18 +02:00