Behind the plot to break Nvidia's grip on AI by targeting software

Big draw: Nvidia chief executive officer Jensen Huang speaking at an industry event in California. Some big tech companies are trying to show developers how to migrate away from Nvidia’s dominance in AI. — Bloomberg

Exclusive: Behind the plot to break Nvidia's grip on AI by ...

 [1/2]A smartphone with a displayed NVIDIA logo is placed on a computer motherboard in this illustration taken March 6, 2023. REUTERS/Dado Ruvic/Illustration/File Photo Purchase Licensing Rights

Nvidia's grip on AI by targeting software.html

Alliance seeks to use alternative open source software 

SAN FRANCISCO: Nvidia earned its US$2.2 trillion market cap by producing artificial-intelligence (AI) chips that have become the lifeblood powering the new era of generative AI developers from startups to Microsoft, OpenAI and Google parent Alphabet .

Almost as important to its hardware is the company’s nearly 20 years’ worth of computer code, which helps make competition with the company nearly impossible. More than four million global developers rely on Nvidia’s Cuda software platform to build AI and other apps.

Now a coalition of tech companies that includes Qualcomm, Google and Intel plans to loosen Nvidia’s chokehold by going after the chip giant’s secret weapon: the software that keeps developers tied to Nvidia chips.

They are part of an expanding group of financiers and companies hacking away at Nvidia’s dominance in AI.

“We’re actually showing developers how you migrate out from an Nvidia platform,” Vinesh Sukumar, Qualcomm’s head of AI and machine learning, said in an interview with Reuters.

Starting with a piece of technology developed by Intel called OneAPI, the UXL Foundation, a consortium of tech companies, plans to build a suite of software and tools that will be able to power multiple types of AI accelerator chips, executives involved with the group told Reuters.

The open-source project aims to make computer code run on any machine, regardless of what chip and hardware powers it.

“It’s about specifically – in the context of machine learning frameworks – how do we create an open ecosystem, and promote productivity and choice in hardware,” Google’s director and chief technologist of high-performance computing, Bill Magro, said in an interview.

Google is one of the founding members of UXL and helps determine the technical direction of the project, Magro said.

UXL’s technical steering committee is preparing to nail down technical specifications in the first half of this year. Engineers plan to refine the technical details to a “mature” state by the end of the year, executives said.

These executives stressed the need to build a solid foundation to include contributions from multiple companies that can also be deployed on any chip or hardware.

Beyond the initial companies involved, UXL will court cloud-computing companies such as Amazon.com and Microsoft’s Azure, as well as additional chipmakers.

Since its launch in September, UXL has already begun to receive technical contributions from third parties that include foundation members and outsiders keen on using the open-source technology, the executives involved said.

Intel’s OneAPI is already usable, and the second step is to create a standard programming model of computing designed for AI.

UXL plans to put its resources toward addressing the most pressing computing problems dominated by a few chipmakers, such as the latest AI apps and high-performance computing applications.

Those early plans feed into the organisation’s longer-term goal of winning over a critical mass of developers to its platform.

UXL eventually aims to support Nvidia hardware and code, in the long run.

When asked about the open source and venture-funded software efforts to break Nvidia’s AI dominance, Nvidia executive Ian Buck said in a statement: “The world is getting accelerated. New ideas in accelerated computing are coming from all across the ecosystem, and that will help advance AI and the scope of what accelerated computing can achieve.”

The UXL Foundation’s plans are one of many efforts to chip away at Nvidia’s hold on the software that powers AI. Venture financiers and corporate dollars have poured more than US$4bil into 93 separate efforts, according to custom data compiled by PitchBook at Reuters’ request.

The interest in unseating Nvidia through a potential weakness in software has ramped up in the last year, and startups aiming to poke holes in the company’s leadership gobbled up just over US$2bil in 2023 compared with US$580mil from a year ago, according to the data from PitchBook.

Success in the shadow of Nvidia’s group on AI data crunching is an achievement that few of the startups will be able to achieve.

Nvidia’s Cuda is a compelling piece of software on paper, as it is full-featured and is consistently growing both from Nvidia’s contributions and the developer community. — Reuters

Source link\

RAELATED

Experts: Adapt to AI, don't fear it

Cook tells forum AI is key for climate battle

Techies believed behind crimes

Dutch PM begins working visit to China amid chip tensions in spotlight; expansion of cooperation expected

Prime Minister of the Netherlands Mark Rutte is on a working visit to China from Tuesday to Wednesday, at a time when the Netherlands' chip export policy has been in the spotlight. Chinese analysts pointed out that Rutte's visit is perfectly timed, as his country's largest company, the semiconductor equipment maker ASML, is seeking to expand outside the Netherlands after raising concerns about the country's business climate.

China's economic prospects, opening-up pledges help global growth, stability as Boao Forum kicks off annual meeting

The Boao Forum for Asia (BFA) convened its annual conference in Boao, South China's Hainan Province on Tuesday, with officials and other participants calling for unity and cooperation in Asia and around the world to jointly tackle rising regional and global challenges, ranging from trade protectionism to geopolitical tension.

At Boao Forum, Asian central bank officials eye greater use of local currencies to fend off risks

Central bank officials and financial regulators from several Asian countries on Wednesday called for expanding currency swap arrangements through both bilateral and multilateral mechanisms to support cross-border trade and investment and reduce reliance on the US dollar, as part of the region's efforts to bolster financial safety nets and fend ...

At Boao Forum, Asian central bank officials eye greater use of local currencies to fend off risks

Central bank officials and financial regulators from several Asian countries on Wednesday called for expanding currency swap arrangements through both bilateral and multilateral mechanisms to support cross-border trade and investment and reduce reliance on the US dollar, as part of the region's efforts to bolster financial safety nets and fend off risks.

Related posts

YTL AI Cloud to deploy advanced supercomputer

ts:

Washington and Nvidia should not be ‘Catch me if you can’, Chinese companies could also produce high-end products similar to Nvidia's A100...

 

Washington and Nvidia should not be ‘Catch me if you can’, Chinese companies could also produce high-end products similar to Nvidia’s A100…

Boom time for Malaysian AI

Jack Ma's Alibaba to take on Kuala Lumpur’s traffic Artificial Intellligence project

Alibaba Cloud, which set up a datacentre in Malaysia last year, is considering a second one to further develop a local ecosystem, its president Simon Hu said. — Reuters

https://youtu.be/MwixREUJOI0

Jack Ma's Life Advice Will Change Your Life (MUST WATCH) 

https://youtu.be/lYGGpc2mMno

KUALA LUMPUR: Alibaba Group will set up a traffic control system harnessing artificial intelligence for Malaysia's capital Kuala Lumpur, its first such service outside China, as the e-commerce giant pushes to grow its cloud computing business.

Alibaba Cloud, the cloud computing arm of Alibaba Group, said on Monday it plans to make live traffic predictions and recommendations to increase traffic efficiency in Kuala Lumpur by crunching data gathered from video footage, traffic bureaus, public transportation systems and mapping apps.

It is partnering with state agency Malaysia Digital Economy Corporation (MDEC) and the Kuala Lumpur city council to roll out the technology, which would be localised and integrated with 500 inner city cameras by May.

The partnership comes after Alibaba founder Jack Ma and Malaysian Prime Minister Najib Razak launched an "e-hub" facility last year, part of an initiative aimed at removing trade barriers for smaller firms and emerging nations.

Alibaba Cloud, which set up a data centre in Malaysia last year, is considering a second one to further develop a local ecosystem, its president Simon Hu said on Jan 29.

He declined to elaborate on the company's total investments made and planned for in Malaysia, but said it was "no small amount" and that the investments would continue if there was demand for cloud computing technologies.

MDEC's chief executive officer Yasmin Mahmood said there was no estimate of City Brain's impact on traffic in Kuala Lumpur yet. The traffic management system in the Chinese city of Hangzhou had resulted in reports of traffic violations with up to 92% accuracy, emergency vehicles reaching their destinations in half the time and overall increase in traffic speed by 15%.

Najib has forged close ties with China in recent years. Last year, the Malaysian leader announced a slew of infrastructure projects, many funded by China, as he worked up momentum towards a general election he must call by the middle of this year. — Reuters

Related :  Alibaba To Take On Kuala Lumpur's Traffic In First Foreign Artificial Intelligence Project

Relaterd Post

Jack Ma advisor to Malaysian Govt on digital economy to start with e-FTZ

Goodbye, Silicon Valley

Greener pastures: Wang at his company’s headquarters in Shanghai. The successful Silicon Valley alumni was lured back to China by the promise of a brighter future.

Chinese-born talents are abandoning California for riches back home with the rise of China's new titans.

A FEW years ago, Wang Yi was living the American dream. He had graduated from Princeton, landed a job at Google and bought a spacious condo in Silicon Valley.

But one day in 2011, he sat his wife down at the kitchen table and told her he wanted to move back to China. He was bored working as a product manager for the search giant and felt the pull of starting his own company in their homeland.

It wasn’t easy persuading her to abandon balmy California for smog-choked Shanghai.

“We’d just discovered she was pregnant,” said Wang, now 37, recalling hours spent pacing their apartment. “It was a very uneasy few weeks before we made our decision, but in the end she came around.”

His bet paid off: his popular English teaching app Liulishuo or LingoChamp raised US$100mil (RM397mil) in July, putting him in the growing ranks of successful Silicon Valley alumni lured back to China by the promise of a brighter future. His decision is emblematic of an unprecedented trend with disquieting implications for Valley stalwarts from Facebook Inc to Alphabet Inc’s Google.

US-trained Chinese-born talent is becoming a key force in driving Chinese companies’ global expansion and the country’s efforts to dominate next-generation technologies like artificial intelligence and machine learning. Where college graduates once coveted a prestigious overseas job and foreign citizenship, many today gravitate towards career opportunities at home, where venture capital is now plentiful and the government dangles financial incentives for cutting-edge research.

“More and more talent is moving over because China is really getting momentum in the innovation area,” said Ken Qi, a headhunter for Spencer Stuart and leader of its technology practice.

“This is only the beginning.” Chinese have worked or studied abroad and then returned home long enough that there’s a term for them – “sea turtles”. But while a job at a US tech giant once conferred near-unparalleled status, homegrown companies – from giants like Tencent Holdings Ltd to up-and-comers like news giant Toutiao – are now often just as prestigious. Baidu Inc – a search giant little-known outside of China – convinced ex-Microsoft standout Qi Lu to helm its efforts in AI, making him one of the highest-profile returnees of recent years.

Alibaba Group Holding Ltd’s coming-out party was a catalyst. The e-commerce giant pulled off the world’s largest initial public offering in 2014 – a record that stands – to drive home the scale and inventiveness of the country’s corporations.

Alibaba and Tencent now count among the 10 most valuable companies in the world, in the ranks of Amazon.com Inc and Facebook.

Chinese venture capital rivals the United States: three of the world’s five most valuable startups are based in Beijing, not California.

Tech has supplanted finance as the biggest draw for overseas Chinese returnees, accounting for 15.5% of all who go home, according to a 2017 survey of 1,821 people conducted by think-tank Centre for China & Globalisation and jobs site Zhaopin.com. That’s up 10% from their last poll, in 2015.

Not all choose to abandon the Valley. Of the more than 850,000 AI engineers across America, 7.9% are Chinese, according to a 2017 report from LinkedIn.

That naturally includes plenty of ethnic Chinese without strong ties to the mainland or any interest in working there. However, there are more AI engineers of Chinese descent in the United States than there are in China, even though they make up less than 1.6% of the American population.

Yet the search for returnees has spurred a thriving cottage industry.

In WeChat and Facebook cliques, headhunters and engineers from the diaspora exchange banter and animated gifs. Qi watches for certain markers: if you’ve scored permanent residency, are childless or the kids are prepping for college, expect a knock on your digital door.

Jay Wu has poached over 100 engineers for Chinese companies over the past three years. The co-founder of Global Career Path ran online communities for students before turning it into a career. The San Francisco resident now trawls more than a dozen WeChat groups for leads.

“WeChat is a good channel to keep tabs on what’s going on in the circle and also broadcast our offline events,” he said.

Ditching Cupertino or Mountain View for Beijing can be a tough sell when China’s undergoing its harshest Internet crackdown in history. But its tech giants hold three drawcards: faster growth in salaries, opportunity and a sense of home.

China’s Internet space is enjoying bubbly times, with compensation sometimes exceeding American peers’. One startup was said to have hired an AI engineer for cash and shares worth as much as US$30mil (RM119mil) over four years.

For engineers reluctant to relinquish American comforts, Chinese companies are going to them. Alibaba, Tencent, Uber-slayer Didi Chuxing and Baidu are among those who have built or are expanding labs in Silicon Valley.

Career opportunities, however, are regarded as more abundant back home. While Chinese engi-

neers are well represented in the Valley, the perception is that comparatively fewer advance to the top rungs, a phenomenon labelled the “Bamboo Ceiling”.

“More and more Chinese engineers who have worked in Silicon Valley for an extended period of time end up finding it’s much more lucrative for them career-wise to join a fast-rising Chinese company,”

says Hans Tung, a managing partner at venture firm GGV who’s organised events to poach talent.

“At Google, at LinkedIn, at Uber, at AirBnB, they all have Chinese engineers who are trying to figure out ‘should I stay, or should I go back’.”

More interesting than prospects for some may be the sheer volume of intimate data available and leeway to experiment in China.

Tencent’s WeChat, built by a small team in months, has become a poster-child for in-house creative licence.

Modern computing is driven by crunching enormous amounts of data, and generations of state surveillance has conditioned the public to be less concerned about sharing information than Westerners.

Local startup SenseTime for instance has teamed with dozens of police departments to track everything from visages to races, helping the country develop one of the world’s most sophisticated surveillance machines.

China’s 751 million Internet users have thus become a massive petri dish.

Big money and bigger data can be irresistible to those itching to turn theory into reality.

Xu Wanhong left Carnegie Mellon University’s computer science PhD programme in 2010 to work on Facebook’s news feed.

A chance meeting with a visiting team from Chinese startup UCAR Technology led to online friendships and in 2015, an offer to jump ship. Today he works at Kuaishou, a video service said to be valued at more than US$3bil (RM12bil), and commutes from 20km outside Beijing. It’s a far cry from the breakfast bar and lush spaces of Facebook’s Menlo Park headquarters.

“I didn’t go to the US for a big house. I went for the interesting problems,” he said.

Then there are those for whom it’s about human connection: no amount of tech can erase the fact that Shanghai and San Francisco are separated by an 11-hour flight and an even wider cultural chasm.

Chongqing native Yang Shuishi grew up deifying the West, adopting the name Seth and landing a dream job as a software engineer on Microsoft’s Redmond campus.

But suburban America didn’t suit a single man whose hometown has about 40 times Seattle’s population.

While he climbed the ranks during subsequent stints at Google and Facebook, life in America remained a lonely experience and he landed back in China.

“You’re just working as a cog in the huge machine and you never get to see the big picture.

“My friends back in China were thinking about the economy and vast social trends,” he said.

“Even if I get killed by the air and live shorter for 10 years, it’ll still be better.” - Bloomberg

Related Link:

Next Crisis Will Start in Silicon Valley - Bloomberg

Chinese workers abandon Silicon Valley for riches back home ...

Facebook Brings 'Chat bots' to Messenger

SAN FRANCISCO: Facebook on Tuesday extended its reach beyond online socializing by building artificial-intelligence powered “bots” into its Messenger application to allow businesses to have software engage in lifelike text exchanges.

The move announced at the leading online social network’s annual developers conference in San Francisco came as the number of monthly users of Messenger topped 900 million and the Silicon Valley company works to stay in tune with mobile Internet lifestyles.

“We think you should be able to text message a business like you would a friend, and get a quick response,” Facebook co-founder and chief Mark Zuckerberg said as he announced that developers can build bots that could even be better than real people at natural language text conversations.

Bots are software infused with the ability to “learn” from conversations, getting better at figuring out what people are telling them and how best to respond.

The bots could help Facebook over time monetize its messaging applications and get a start on what some see as a new way of interacting with the digital world, potentially shortcutting mobile applications and sidestepping search.

“Our goal with artificial intelligence is to build systems that are better than people at perception -- seeing, hearing, language and so on,” Zuckerberg said while laying out a long-term vision for Facebook. A look at the number and types of services that titans such as Facebook, Google and Apple have rolled out in the last couple of years, it appears the companies are “trying to dominate the customers’ mobile moments,” Forrester analyst Julie Ask told AFP.

Getting smarter

Artificial intelligence is already used in Messenger to recognize faces in pictures, suggesting recipients for messages and for filtering out spam texts. “Soon, we are going to be able to do even more,” Zuckerberg said.

He promised a future in which Facebook AI would be able to understand what is in pictures, video or news articles and use insights to recommend content members of the social network might like.

Bot-building capabilities will be in a test mode with Facebook approving creations before they are released, according to vice president of messaging products David Marcus.

Some of the latest tools include one for the creation of “high-end, self-learning bots,” along with ways for them to be brought to people’s attention at Messenger, Marcus said.

“If you want to build more complex bots, you can now use our bot engine,“ Marcus told a packed audience of developers.

“You feed it samples of conversation, and it’s better over time. You can build your bot today.”

The list of partners launching Messenger bots included Business Insider, which said it will use the technology to deliver news stories to people in real-time.

“We are excited about this new offering because we know that messaging apps are exploding in popularity,” Business Insider said in a story at its website announcing the move.

Cloud computing star Salesforce planned to use the platform to help businesses have “deeper, more personalized and one-to-one customer journeys within the chat experience,” said Salesforce president and chief product officer Alex Dayon.

Bridges, not walls

Zuckerberg laid out a future for Facebook that, aside from Messenger, included ramping up live video streaming and diving into virtual reality.

“We think we are at the edge of the golden age of video,” Zuckerberg said.

Facebook opened its Live platform to allow developers to stream video content from their applications to audiences at the social network.

Zuckerberg demonstrated with a drone that flew over those seated, streaming live video to Facebook while he spoke.

Messenger and Live will be built out further in coming years, along with virtual reality technology at Facebook-owned Oculus, according to Zuckerberg.

When his daughter takes her first steps, Zuckerberg said he planned to record it in 360-degree video so family and friends can experience it in virtual reality as if they were there for the moment.

At one point, Zuckerberg’s comments took on a political tone, with the Facebook chief maintaining that the mission to connect the world is more important than ever given rhetoric about building walls and fearing those who are different.

“If the world starts to turn inward, then our community will have to work even harder to bring people together,” Zuckerberg said.

“Instead of building walls, we can build bridges,” he added, in an apparent reference to the fiery rhetoric of Donald Trump. - AFP