Connect with us

Tech

Stanford researchers terminate ChatGPT-like OpenAI two months after launch

Published

1 year ago

on

Researchers of artificial intelligence (AI) from Stanford managed to develop their ChatGPT chatbot demo Alpaca in less than two months but terminated it citing “hosting costs and the inadequacies of content filters” in the large language model’s (LLM) behaviour.

The termination announcement was made less than a week after it was released, as per Stanford Daily.

The source code of the ChatGPT model of Stanford — developed for less than $600 — is available publicly.

According to researchers, their chatbot model had a similar performance to OpenAI’s ChatGPT 3.5.

Scientists in their announcement said that their chatbot Alpaca is only for academic research and not for general use in the near future.

Alpaca researcher Tatsunori Hashimoto of the Computer Science Department said: “We think the interesting work is in developing methods on top of Alpaca [since the dataset itself is just a combination of known ideas], so we don’t have current plans along the lines of making more datasets of the same kind or scaling up the model,”

Alpaca was developed on Meta AI’s LLaMA 7B model and generated training data with the method known as self-instruct.

Adjunct professor Douwe Kiela noted that “As soon as the LLaMA model came out, the race was on.”

Kiela who also worked as an AI researcher at Facebook said that “Somebody was going to be the first to instruction-finetune the model, and so the Alpaca team was the first … and that’s one of the reasons it kind of went viral.”

“It’s a really, really cool, simple idea, and they executed really well.”

Hashimoto said that the “LLaMA base model is trained to predict the next word on internet data and that instruction-finetuning modifies the model to prefer completions that follow instructions over those that do not.”

The source code of Alpaca is available on GitHub — a source code sharing platform — and was viewed 17,500 times. More than 2,400 people have used the code for their own model.

“I think much of the observed performance of Alpaca comes from LLaMA, and so the base language model is still a key bottleneck,” Hashimoto stated.

As the use of artificial intelligence systems has been increasing with every passing day, scientists and experts have been debating over the publishing of the source code, data used by companies and their methods to train their AI models and the overall transparency of the technology.

He was of the view that “I think one of the safest ways to move forward with this technology is to make sure that it is not in too few hands.”

“We need to have places like Stanford, doing cutting-edge research on these large language models in the open. So I thought it was very encouraging that Stanford is still actually one of the big players in this large language model space,” Kiela noted. 

Related Topics:
Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Latest News

Moon train operations are planned by NASA.

Published

5 days ago

on

By

The goal is to construct the first lunar train system, which will enable safe, independent, and effective cargo transportation on the moon, according to robotics specialist Ethan Schaler of NASA’s Jet Propulsion Laboratory in Pasadena, California.

He went on, “The day-to-day functioning of a sustainable lunar base in the 2030s will depend heavily on a robust, long-lasting robotic transport system.”

The Flexible Levitation on a Track, or FLOAT, is the name of the proposed lunar rail system. According to NASA, the establishment of a railway system on the moon is “critical to the daily operations.”

According to the space agency, the primary objective of FLOAT is to offer transportation services in regions of the moon where astronauts are engaged in activities. To do this, cargoes of lunar soil and other materials will need to be transported to various regions of the moon.

Each robot will be able to transport cargo of various sizes and shapes at a pace of roughly 1 mph (1.61 km/h), according to Dr. Schaler.

Notably, NASA also declared new initiatives last month to create and test new vehicle models intended for moon exploration.

Continue Reading

Business

Pakistan’s lunar mission ‘ICUBE-Q’ reaches the moon orbit.

Published

1 week ago

on

By

Pakistan’s lunar mission (ICUBE-Q) entered orbit around the moon on Wednesday.

Pakistan’s historic lunar mission (ICUBE-Q) launched from Hainan, China, on Friday aboard China’s Chang’E6 spacecraft.

According to the IST, the satellite ICUBE-Q was planned and developed in partnership with China’s Shanghai University SJTU and Pakistan’s national space agency SUPARCO.

The ICUBE-Q orbiter is equipped with two optical cameras to image the lunar surface. ICUBE-Q has now been integrated into the Chang’e6 mission after successfully qualifying and testing it.

Chang’e6 is the sixth lunar exploration mission launched by China.

The launch event was streamed live on the IST website and social media platforms. Chang’6, China’s Lunar Mission, will land on the Moon’s far side to collect surface samples before returning to Earth for further research.

Continue Reading

Education

The establishment of IT labs in Islamabad’s educational establishments

Published

2 weeks ago

on

By

SIFC was established to improve the ease of doing business for potential investors through a “Whole of Government”Approach”—achieving optimal horizontal-vertical synergy and facilitation by the Pakistan Army—and to attract investments from friendly countries in selected sectors through an empowered organisation that serves as a “single-window” platform for facilitation.

The children will learn the newest skills in these state-of-the-art IT labs, expanding their employment prospects.

These IT laboratories will be constructed in sixteen degree colleges spread throughout various parts of Islamabad.

Students will take six-month courses in artificial intelligence (AI), game development, data science, and block chain in these IT labs.

Approximately 1,000 students will have access to courses in the first phase, which is being implemented in response to market demand.

The National Vocational and Technical Training Commission has worked with esteemed universities such as NUST, National Skills University, COMSATS, and NUML to produce these courses.

The second week of this month will mark the start of these classes. For these courses, about 3,600 students have signed up.

Continue Reading

Trending