In partnership with OpenAI, Microsoft consistently uses AI capabilities in its products and services. It looks like the software giant is also building a model for smaller scenarios. Microsoft Research has introduced a new artificial intelligence model called Orca that learns by imitating large language models. According to the research report, Orca was designed to overcome the limitations of smaller models by mimicking the reasoning processes of large base models such as the GPT-4.
Microsoft Orca is utterly fascinating
Language models like Orca can be optimized for specific tasks and trained using large language models like GPT-4. Due to its smaller size, Orca requires fewer computing resources to run and operate. Researchers can optimize their models for their own needs and run them independently without being tied to a large data center.
According to the research paper, Orca, an artificial intelligence model operating with 13 billion parameters, can emulate and learn from large language models such as GPT-4. Orca can learn explanations, step-by-step thought processes, and other complex instructions with the help of GPT-4, which is said to have over a trillion parameters.
While models such as uvulas were successful in mimicking verbal style, they often fell short of factual accuracy and complex thinking. But Orca is closing this gap by developing a 13-billion-parameter model that learns to mimic the reasoning process of larger models. The Orca far outstripped other open-source models in numerous benchmarks and tests, and matched GPT 4 in the thinking ability test.
Although the Orca is a smaller model, it ranks on par with ChatGPT on complex reasoning measures such as Big-Bench Hard (BBH). It also performs competitively in academic exams such as the SAT, LSAT, GRE, and GMAT, although it lags behind the GPT-4. As AI models like the Orca do bigger things with less size, these types of tools will shift towards more specialized uses. In fact, Orca is an important step for artificial intelligence that works locally on the phones we use.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie
Duration
Description
cookielawinfo-checkbox-analytics
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional
11 months
The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy
11 months
The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
Warning: file_put_contents(): Only -1 of 114689 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 2321 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 2600 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 22872 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 67957 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 1381 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 2686 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Warning: file_put_contents(): Only -1 of 5167 bytes written, possibly out of free disk space in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/file.cls.php on line 172
Fatal error: Uncaught ErrorException: md5_file(/home4/u9529282/technopixel.org/wp-content/litespeed/js/b1a01ae38bed8c81416428808e645aeb.js.tmp): failed to open stream: No such file or directory in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimizer.cls.php:140
Stack trace:
#0 [internal function]: litespeed_exception_handler(2, 'md5_file(/home4...', '/home4/u9529282...', 140, Array)
#1 /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimizer.cls.php(140): md5_file('/home4/u9529282...')
#2 /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimize.cls.php(837): LiteSpeed\Optimizer->serve('https://www.tec...', 'js', true, Array)
#3 /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimize.cls.php(382): LiteSpeed\Optimize->_build_hash_url(Array, 'js')
#4 /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimize.cls.php(264): LiteSpeed\Optimize->_optimize()
#5 /home4/u9529282/technopixel.org/wp-includes/class-w in /home4/u9529282/technopixel.org/wp-content/plugins/litespeed-cache/src/optimizer.cls.php on line 140