Monday, May 27, 2024

Chat with RTX: An AI Chatbot for Local PCs from Nvidia, Capable of Summarizing Documents and Videos

BizNETAppsChat with RTX: An AI Chatbot for Local PCs from Nvidia, Capable of Summarizing...

Nvidia, a leading global AI chip manufacturer, has launched an AI chatbot application that runs locally on PCs. This application, named Chat with RTX, features interesting capabilities that can assist users in various ways.

Summarizing Documents and Videos

One of the main features of Chat with RTX is its ability to summarize documents uploaded by users in .txt, .pdf, .doc/.docx, and .xml formats. Users can request a summary of these documents by sending them to the application, and the application will provide a brief and concise summary.

Google Launches Gemini 1.5, Advanced Language Model for AI Chatbots

Google has just announced the launch of its latest large language model (LLM), named Gemini 1.5. This language model is used to run the...

Sora, OpenAI’s Text-to-Video Application: What are its Potential and Dangers?

OpenAI, a leading artificial intelligence (AI) company, has just introduced Sora, a text-to-video application that can transform text into videos with realistic or imaginative...

Mozilla Lays Off 60 Employees: Focus on Firefox Mobile and AI

The non-profit company behind the Firefox browser, Mozilla, recently laid off 60 employees, or about five percent of its total workforce. This layoff is...

In addition to documents, Chat with RTX can also summarize YouTube videos by embedding their links. This application can provide important information from the video, such as the title, duration, description, and key points. The application can also provide recommendations for tourist spots or cake-making tutorials from YouTube creator videos by analyzing the content and keywords of the video.

Advanced Technology and High Specifications

Chat with RTX uses retrieval augmented generation (RAG) technology and Nvidia TensorRT-LLM software that harnesses the power of AI. This technology allows the application to search for and generate relevant and accurate information from the documents or videos provided by the user.

To run this application, users need a minimum device specification that is quite high, namely a GPU with 8 GB VRAM, 16 GB RAM, Windows 10 or 11, and Nvidia GPU drivers version 535.11 or newer. This application also requires 35 GB of storage space and does not require an internet connection when in use.

This application is free to download, although it is still in demo version. However, users must be patient during the installation process, and this application can sometimes be power-hungry. In addition, this application does not remember the context of the conversation, so users cannot ask follow-up questions from questions that have already been asked.

YouTube video

A Safer and More Private AI Chatbot

Chat with RTX is similar to Google’s Gemini chatbot or OpenAI’s ChatGPT, which also have document or video summarizing features. However, unlike cloud applications, Chat with RTX is a personal digital assistant that works locally on the user’s PC.

This means that this application does not send user data to Nvidia servers or other third parties, making it safer and more private. Users do not need to worry about their data privacy, as this application only accesses data directly provided by the user.

Nvidia’s Step to Retain Clients

The launch of Chat with RTX is one of Nvidia’s steps to retain their clients who plan to develop AI chip projects while continuing to collaborate with Nvidia. Nvidia is developing a special business unit focused on designing and selling semi-custom AI chips, which are developed collaboratively between Nvidia and the client.

Using Nvidia’s IP blocks as a basis, clients also have the option to integrate third-party IP blocks according to their needs. Nvidia estimates a market potential of USD 30 billion for this special business unit.

In addition, Nvidia is also partnering with Cisco, a network infrastructure provider, to offer technology solutions that make it easier for companies to build their own internal AI computing infrastructure while expanding the reach of AI technology beyond large data center providers.

Cisco will provide M7 server computers that use Nvidia’s latest processors, software, AI models, and development tools from Nvidia. Cisco will also provide its own cloud-based service to monitor and manage the system.

This collaboration opens the door to the use of Nvidia technology in various sectors, while Cisco can capitalize on the growing use of AI that has made Nvidia one of the world’s most valuable chipmakers.

Google Launches Gemini 1.5, Advanced Language Model for AI Chatbots

Google has just announced the launch of its latest large language model (LLM), named Gemini 1.5. This language model is used to run the...

Horror Film M3GAN 2.0 Postponed, Here’s Why and Some Interesting Facts

The horror thriller M3GAN, produced by James Wan, successfully made audiences shiver and crave more. The film, which tells the story of a killer...

Baldur’s Gate 3 Wins Game of the Year at DICE Awards 2024

The DICE Awards 2024 have announced their winners, and Baldur's Gate 3 has emerged as the best game of the year. This RPG game,...

Cutouts: An Instagram Feature That Lets You Create Stickers from Videos

Instagram has released a new feature that is appealing to its users. This feature, called Cutouts, allows users to create moving stickers from videos. These...

Sora, OpenAI’s Text-to-Video Application: What are its Potential and Dangers?

OpenAI, a leading artificial intelligence (AI) company, has just introduced Sora, a text-to-video application that can transform text into videos with realistic or imaginative...