Meta launched largest ‘open’ AI model in history; Here’s why it matters
Sydney, Aug 2 (The Conversation): In the world of artificial intelligence (AI), a battle is underway. On one side are companies that believe in keeping the datasets and algorithms behind their advanced software private and confidential. On the other are companies that believe in allowing the public to see what’s under the hood of their sophisticated AI models.
Think of this as the battle between open- and closed-source AI.
In recent weeks, Meta, the parent company of Facebook, took up the fight for open-source AI in a big way by releasing a new collection of large AI models. These include a model named Llama 3.1 405B, which Meta’s founder and chief executive, Mark Zuckerberg, says is “the first frontier-level open source AI model”.
For anyone who cares about a future in which everybody can access the benefits of AI, this is good news.
The danger of closed-source AI – and the promise of open-source AI
Closed-source AI refers to models, datasets and algorithms that are proprietary and kept confidential. Examples include ChatGPT, Google’s Gemini and Anthropic’s Claude.
Though anyone can use these products, there is no way to find out what dataset and source codes have been used to build the AI model or tool.
While this is a great way for companies to protect their intellectual property and their profits, it risks undermining public trust and accountability. Making AI technology closed-source also slows down innovation and makes a company or other users dependent on a single platform for their AI needs. This is because the platform that owns the model controls changes, licensing and updates.
There are a range of ethical frameworks that seek to improve the fairness, accountability, transparency, privacy and human oversight of AI. However, these principles are often not fully achieved with closed-source AI due to the inherent lack of transparency and external accountability associated with proprietary systems.
In the case of ChatGPT, its parent company, OpenAI, releases neither the dataset nor code of its latest AI tools to the public. This makes it impossible for regulators to audit it. And while access to the service is free, concerns remain about how users’ data are stored and used for retraining models.
By contrast, the code and dataset behind open-source AI models is available for everyone to see.
This fosters rapid development through community collaboration and enables the involvement of smaller organisations and even individuals in AI development. It also makes a huge difference for small and medium size enterprises as the cost of training large AI models is colossal.
Perhaps most importantly, open source AI allows for scrutiny and identification of potential biases and vulnerability.
However, open-source AI does create new risks and ethical concerns.
For example, quality control in open source products is usually low. As hackers can also access the code and data, the models are also more prone to cyberattacks and can be tailored and customised for malicious purposes, such as retraining the model with data from the dark web.
An open-source AI pioneer
Among all leading AI companies, Meta has emerged as a pioneer of open-source AI. With its new suite of AI models, it is doing what OpenAI promised to do when it launched in December 2015 – namely, advancing digital intelligence “in the way that is most likely to benefit humanity as a whole”, as OpenAI said back then.
Llama 3.1 405B is the largest open-source AI model in history. It is what’s known as a large language model, capable of generating human language text in multiple languages. It can be downloaded online but because of its huge size, users will need powerful hardware to run it.
While it does not outperform other models across all metrics, Llama 3.1 405B is considered highly competitive and does perform better than existing closed-source and commercial large language models in certain tasks, such as reasoning and coding tasks.
But the new model is not fully open, because Meta hasn’t released the huge data set used to train it. This is a significant “open” element that is currently missing.
Nonetheless, Meta’s Llama levels the playing field for researchers, small organisations and startups because it can be leveraged without the immense resources required to train large language models from scratch.
Shaping the future of AI
To ensure AI is democratised, we need three key pilars:
-governance: regulatory and ethical frameworks to ensure AI technology is being developed and used responsibly and ethically
-accessibility: affordable computing resources and user-friendly tools to ensure a fair landscape for developers and users
-openness: datasets and algorithms to train and build AI tools should be open source to ensure transparency.
Achieving these three pillars is a shared responsibility for government, industry, academia and the public. The public can play a vital role by advocating for ethical policies in AI, staying informed about AI developments, using AI responsibly and supporting open-source AI initiatives.
But several questions remain about open-source AI. How can we balance protecting intellectual property and fostering innovation through open-source AI? How can we minimise ethical concerns around open-source AI? How can we safeguard open-source AI against potential misuse?
Properly addressing these questions will help us create a future where AI is an inclusive tool for all. Will we rise to the challenge and ensure AI serves the greater good? Or will we let it become another nasty tool for exclusion and control? The future is in our hands.
Let the Truth be known. If you read VB and like VB, please be a VB Supporter and Help us deliver the Truth to one and all.
What’s the difference between a heart attack and cardiac arrest?
One’s about plumbing, the other wiring
Gold Coast (The Conversation): In July 2023, rising US basketball star Bronny James collapsed on the court during practice and was sent to hospital. The 18-year-old athlete, son of famous LA Lakers’ veteran LeBron James, had experienced a cardiac arrest.
Many media outlets incorrectly referred to the event as a “heart attack” or used the terms interchangeably.
A cardiac arrest and a heart attack are distinct yet overlapping concepts associated with the heart.
With some background in how the heart works, we can see how they differ and how they’re related.
Understanding the heart
The heart is a muscle that contracts to work as a pump. When it contracts it pushes blood – containing oxygen and nutrients – to all the tissues of our body.
For the heart muscle to work effectively as a pump, it needs to be fed its own blood supply, delivered by the coronary arteries. If these arteries are blocked, the heart muscle doesn’t get the blood it needs.
This can cause the heart muscle to become injured or die, and results in the heart not pumping properly.
Heart attack or cardiac arrest?
Simply put, a heart attack, technically known as a myocardial infarction, describes injury to, or death of, the heart muscle.
A cardiac arrest, sometimes called a sudden cardiac arrest, is when the heart stops beating, or put another way, stops working as an effective pump.
In other words, both relate to the heart not working as it should, but for different reasons. As we’ll see later, one can lead to the other.
Why do they happen? Who’s at risk?
Heart attacks typically result from blockages in the coronary arteries. Sometimes this is called coronary artery disease, but in Australia, we tend to refer to it as ischaemic heart disease.
The underlying cause in about 75 per cent of people is a process called atherosclerosis. This is where fatty and fibrous tissue build up in the walls of the coronary arteries, forming a plaque. The plaque can block the blood vessel or, in some instances, lead to the formation of a blood clot.
Atherosclerosis is a long-term, stealthy process, with a number of risk factors that can sneak up on anyone. High blood pressure, high cholesterol, diet, diabetes, stress, and your genes have all been implicated in this plaque-building process.
Other causes of heart attacks include spasms of the coronary arteries (causing them to constrict), chest trauma, or anything else that reduces blood flow to the heart muscle.
Regardless of the cause, blocking or reducing the flow of blood through these pipes can result in the heart muscle not receiving enough oxygen and nutrients. So cells in the heart muscle can be injured or die.
But a cardiac arrest is the result of heartbeat irregularities, making it harder for the heart to pump blood effectively around the body. These heartbeat irregularities are generally due to electrical malfunctions in the heart. There are four distinct types:
1. ventricular tachycardia: a rapid and abnormal heart rhythm in which the heartbeat is more than 100 beats per minute (normal adult, resting heart rate is generally 60-90 beats per minute). This fast heart rate prevents the heart from filling with blood and thus pumping adequately
2. ventricular fibrillation: instead of regular beats, the heart quivers or “fibrillates”, resembling a bag of worms, resulting in an irregular heartbeat greater than 300 beats per minute
3. pulseless electrical activity: arises when the heart muscle fails to generate sufficient pumping force after electrical stimulation, resulting in no pulse
4. asystole: the classic flat-line heart rhythm you see in movies, indicating no electrical activity in the heart.
Cardiac arrest can arise from numerous underlying conditions, both heart-related and not, such as drowning, trauma, asphyxia, electrical shock and drug overdose. James’ cardiac arrest was attributed to a congenital heart defect, a heart condition he was born with.
But among the many causes of a cardiac arrest, ischaemic heart disease, such as a heart attack, stands out as the most common cause, accounting for 70 per cent of all cases.
So how can a heart attack cause a cardiac arrest? You’ll remember that during a heart attack, heart muscle can be damaged or parts of it may die. This damaged or dead tissue can disrupt the heart’s ability to conduct electrical signals, increasing the risk of developing arrhythmias, possibly causing a cardiac arrest.
So while a heart attack is a common cause of cardiac arrest, a cardiac arrest generally does not cause a heart attack.
What do they look like?
Because a cardiac arrest results in the sudden loss of effective heart pumping, the most common signs and symptoms are a sudden loss of consciousness, absence of pulse or heartbeat, stopping of breathing, and pale or blue-tinged skin.
But the common signs and symptoms of a heart attack include chest pain or discomfort, which can show up in other regions of the body such as the arms, back, neck, jaw, or stomach. Also frequent are shortness of breath, nausea, light-headedness, looking pale, and sweating.
What’s the take-home message?
While both heart attack and cardiac arrest are disorders related to the heart, they differ in their mechanisms and outcomes.
A heart attack is like a blockage in the plumbing supplying water to a house. But a cardiac arrest is like an electrical malfunction in the house’s wiring.
Despite their different nature both conditions can have severe consequences and require immediate medical attention.
