OpenAI introduces IndQA, designed to evaluate AI systems on Indian culture, languages
Bengaluru (PTI): OpenAI on Tuesday introduced IndQA, a benchmark dataset designed to measure how well AI models understand and reason about questions on Indian culture, languages and context.
IndQA evaluates knowledge and reasoning about Indian culture and everyday life in Indian languages, it said.
According to OpenAI, IndQA includes 2,278 questions across 12 languages and 10 cultural domains, created in partnership with 261 domain experts from across India.
Unlike traditional benchmarks, IndQA's questions are natively written, not translated, reflecting the nuances of how people in India actually think, speak, and ask questions, it said.
"At OpenAI, we believe AI should be useful for all of humanity. That means AI must understand local cultures, languages, histories and contexts -- not just the Western world. India is a country of immense diversity, with many languages, traditions, and cultural nuances. For AI to be truly valuable here, it must understand that richness," Srinivas Narayanan, CTO, B2B Applications, OpenAI told reporters here.
Announcing the launch of IndQA, Narayanan said, it has been created with a curated dataset that captures India's cultural and historical context.
"This dataset helps our models understand Indian nuances more deeply. The experts also provide evaluation rubrics, so we can measure how well the AI performs on culturally grounded questions. Our goal is to take this as a playbook and use it in other countries too. We have been working with India in this way," he said.
Narayanan added that IndQA also underscores OpenAI's growing commitment to the Indian ecosystem, where local developers, educators, and creators are shaping how AI is being adopted and built for the world.
According to OpenAI, IndQA covers a broad range of culturally relevant topics, such as architecture and design, arts and culture, everyday life, food and cuisine, history, law and ethics, literature and linguistics, media and entertainment, religion and spirituality, and sports and recreation--with items written natively in Bengali, English, Hindi, Hinglish, Kannada, Malayalam, Marathi, Odia, Tamil, Telugu, Gujarati, and Punjabi.
Each datapoint includes a culturally grounded prompt in an Indian language, an English translation for auditability, rubric criteria for grading, and an ideal answer that reflects expert expectations, it added.
Let the Truth be known. If you read VB and like VB, please be a VB Supporter and Help us deliver the Truth to one and all.
A 99-run loss is unacceptable: Hayden blames batting horror
Ahmedabad (PTI): Gujarat Titans' batting coach Matthew Hayden was scathing about their 99-run defeat to Mumbai Indians, blaming a "horror" batting display and poor death bowling for the heavy loss in the IPL.
From being 44/3 in 5.5 overs, MI hammered 73 runs in the last four overs to post a challenging 199/5 here on Monday. In reply, GT were bundled out for 100.
"I expect our margins to be a lot smaller than 100 (99). That is an unacceptable scorecard for our batting unit," the legendary Australian opener told media in the post-match interaction.
"It was just a horrible day for us today. Truth be told, there was nothing good about this day, really, apart from Rabada's performance with the ball. so we've got some work to do, definitely."
GT boast a strong batting line-up in Sai Sudharsan (759 runs), Shubman Gill (717), and Jos Buttler (538). They have also added New Zealand’s explosive Glenn Phillips in the middle order alongside Shahrukh Khan and Rahul Tewatia.
"When you look down at our batting line-up, we've got wonderful players that have to be in a better mindset and better position to take their opportunities. That is our expectations and has been since the conception of this Gujarat Titans franchise...
"So you can't be sitting here and being happy about, a 100-run (99) margin game in a 20-over game. I mean, back in my day, 100 runs was almost a winning total in 50-over cricket!"
The 54-year-old said GT lost the game in the powerplay.
"Well, middle order was undoubtedly exposed today. When they're coming in with six overs, you know that you're in deep trouble. The thing about the power plays is that you can't win it from there, especially in a run chase, but you can definitely lose it, and we lost it in the power play," he said.
Shahrukh (35 off 25 balls) and Tewatia (49 off 42) have not fared well this season and Hayden feels the duo along with Phillips (67 off 54 balls) have been struggling because the top order has been below its best.
"The relevance behind balls faced when you look at, for example, someone like Glenn Phillips -- his record in T20 cricket is an impressive strike rate and you'll take that all day long in the majority of games," Hayden said.
"However, you need an upfront batting effort where you consistently taking the lion's share of the batting. We shouldn't be allowing, Tiwu (Tewatia) or Shahrukh or these guys lots of balls. That's not their role. That's not what they train for."
Hayden said GT has an aggressive and adaptable unit but their execution fell apart on the day.
"We are a very good thinking batting unit. We're not a conservative batting unit. You don't go out and get 200s as often as we do being conservative. But they're an adaptive batting unit. ...they've got their roles and they play them and today they simply didn't.
"So the worry isn't just today about the middle order. It'd be unfair to say that, they were going to go on and score 13 runs an over because by that stage, I felt like as a batting coach, I was on the mast and the boat was sinking."
It was poorly executed bowling effort
=======================
Hayden also pointed to poor execution in the death overs.
"I feel like one-dimensional is very unfair on a world-class bowling attack, but I will take on board it was a poorly executed bowling effort this evening.
"When you look back at those last four overs, that was just a 'horror story' -- 73 off the last four is unacceptable as world-class players. That bowling line-up has to reflect on that performance... It was purely an executional thing."
He added that GT were below par with the ball on a surface that didn’t fully justify the high total.
"We're very average with the ball, firstly, on a wicket that I really felt was probably a 175-type wicket.
"When you look historically at this black soil pitch on No. 5, it's a 200-wicket for the loss of five batters. That's been its winning first-inning score, and today it wasn't that wicket (199/5)... It was visible that it had cracks in it. It was visible that it was up and down.
"So credit also has to go to Tilak Varma, who put in a wonderful performance. It wasn't a cookie-cutter type performance. It was a dominant performance down the ground. He read the play nicely. He was able to pick up and play with power and precision."
Hayden said the chase was still within reach but poor shot selection proved costly.
"And when you reflect on our own batting, we had one side of the ground that was a little more inaccessible than the other, and we lost, what, three wickets into the bigger side of that boundary.
"And it wasn't an impossible total. 200 still is a total that I would back our three world-class players at the top of the order to etch into that a bit more and then allow our more sort of game players. An opportunity to set out their stalls and bat deep into the innings."
