Anthropic AI, founded by former OpenAI researchers, has unveiled its latest and advanced chatbot, Claude 2, taking direct aim at its competitors like ChatGPT and Google Bard. With only five months passing since the launch of its predecessor, Claude 2 comes with several remarkable improvements, offering longer and more nuanced responses, and displaying superior performance, impressively scoring in GRE reading and writing exams.
One of Claude 2’s outstanding features is its ability to digest an impressive 100,000 tokens, equivalent to approximately 75,000 words, in a single prompt. This substantial leap from Claude’s previous 9,000 token limit provides the AI with a unique advantage, enabling it to deliver responses in a highly contextual and improved manner.
Claude 2 has undergone rigorous testing in various domains, including law, mathematics, and coding. According to Anthropic, the chatbot achieved an impressive 76.5% in the multiple-choice section of the Bar exam, surpassing GPT-3.5’s score of 50.3%. Additionally, Claude 2 outperformed over 90% of graduate school applicants in the GRE reading and writing exams. Furthermore, it demonstrated its advanced computational abilities by scoring 71.2% on the Codex HumanEval Python coding test and 88.0% on GSM8k grade-school math problems.
One of Claude’s distinctive traits is its “constitution,” which draws inspiration from the Universal Declaration of Human Rights. This constitution allows the AI to self-improve without human feedback, identify and rectify improper behavior, and adapt its conduct accordingly, demonstrating an ethical approach to AI development.
In comparing Claude 2 to its competitors, ChatGPT and Google Bard, let’s examine some key specifications:
ChatGPT vs Bard vs Claude
In the battle of AI prompts, we pitted three powerful contenders against each other: ChatGPT, Bard, and Claude. Here’s a rundown of how they fared in different scenarios:
Understanding foreign languages:
We tested their language comprehension by asking the meaning of a Spanish slang phrase. Claude proved to be the most accurate, providing a careful explanation. ChatGPT offered a satisfactory response, while Bard declined to answer, citing its inability to speak Spanish. However, when we rephrased the prompt, Bard delivered a better response than ChatGPT, although not as extensive as Claude’s.
Up-to-date information:
To assess their real-time information capabilities, we inquired about the price of Bitcoin on that day. Both ChatGPT and Claude lacked internet connectivity, rendering them unable to provide up-to-date information. However, Claude hallucinated a response with incorrect details, potentially misleading users. Google Bard, on the other hand, furnished the correct and current information, showcasing its up-to-date data retrieval abilities.
Context handling:
In this test, we challenged the models with a large text excerpt from the Bible and asked specific questions from the provided text. As expected, only Claude excelled, managing to process the extensive prompt and offering an accurate reply. Despite taking around 2 minutes to analyze the content, Claude demonstrated its adeptness at handling context-rich tasks, without resorting to cheating or skirting the question.
Non-verbal abilities:
While AI language models are not primarily designed for math tasks, we decided to put them to the test. We asked the models to create a payment plan for clearing credit card debts and rank which cards to use and avoid. Claude delivered the most comprehensive plan. However, it made a mistake by recommending prioritizing the card with the highest APR, potentially leading to suboptimal financial decisions.
Strengths and weaknesses
Claude 2:
Strengths:
Weaknesses:
ChatGPT:
Strengths:
Weaknesses:
Google’s Bard:
Strengths:
Weaknesses:
Conclusion
With the ever-expanding array of options in the field of AI language models and chatbots, there’s no need to limit oneself to being a devoted ChatGPT enthusiast or exclusively align with Google’s offerings.
If the $20 price tag for ChatGPT Plus gives you pause, consider exploring Claude as a viable alternative. Claude’s capabilities are on par with GPT-4, and it’s likely to outperform GPT-3.5, which is available in the free version of ChatGPT. For most users, Claude proves to be a better choice than Google Bard.
A standout feature of Claude is its ability to analyze PDFs and files with various extensions, a functionality that’s comparable to the paid plugins available in the ChatGPT Plus subscription. So, before committing to ChatGPT 4 and investing financially, it’s worth giving Claude a try, as it might save you some money while offering comparable functionality.
Each AI chatbot has its own strengths and weaknesses, making them more suitable for specific tasks. Claude excels at handling large datasets but may not be ideal for tasks requiring real-time data access. On the other hand, ChatGPT boosts creativity, making it an excellent option for tasks demanding specific language support. Its plugin store, though requiring payment, is highly valuable for those willing to invest. Bard, meanwhile, stands out for its factual accuracy and real-time data capabilities, making it a reliable choice for certain use cases.
In the end, there’s no need to limit yourself to just one option. Embrace the diversity of AI chatbots available and utilize them all based on your specific needs and requirements. Each of them brings unique strengths to the table, empowering users to make the most of the rich landscape of AI language models and chatbot technology.