Ever since its release, ChatGPT (built on GPT-3.5 API) has taken the internet by storm and made many developers experiment in building an open-source alternative. Finally, there is a way one can build a ChatGPT-like chatbot using open-source alternative to GPT-3 (175 billion parameters) – i.e. Google’s PaLM (540 billion parameters), alongside reinforcement learning with human feedback (RLHF) built on PyTorch. 

Check out a work-in-progress chatbot, similar to ChatGPT here.

The code is built exclusively for Python language and is implementable for PyTorch. Developers can build their own chatbot by training PaLM like an autoregressive transformer and then training the reward model using human feedback.

The main contributor for the code, Phil Wang (lucidrains) has also made alternatives to AlphaFold 2, DALL-E2, and Imagen, with PyTorch implementation and has more than 200 repositories on GitHub.

Read: Top 7 ChatGPT Alternatives

Another machine learning researcher and expert Yannic Kilcher is also building Open-Assistant, an open-source alternative to ChatGPT on Python — something to look forward to in the coming months. 

Other ChatGPT-like Chatbots 

While ChatGPT has been making noise as Google Killer, Google is silently working on building a tangible product with real use cases. Recently, in collaboration with DeepMind, it introduced MultiMedQA (built on PaLM), a ChatGPT-like chatbot for healthcare.

Just a few days ago, there was another alternative made for ChatGPT that overcame its biggest limitation of being disconnected from the internet, Chatsonic. Though it works on the same architecture as ChatGPT, GPT-3.5, the ability to connect to the internet allows users to converse with it on real-time events.