Profiling Java Applications using Async Profiler and Flame Graphs

Introduction A key requirement of a data exchange is good platform performance. Deciding what is good performance is usually determined by the data characteristics and query statistics. Serving a hundred small JSON documents per second may be considered slow, while serving a hundred 5-minute-long video files per second could be considered as excellent performance. There are various metrics which can …

Continue Reading

Differential Privacy for Smart Cities

Many of the keystone applications running a “smart” city will require data sharing between parties with heterogenous interests. As an example, let’s imagine an “intelligent” transport management system (ITMS) that might optimise end-to-end transit times, measure and mitigate air pollution, manage city-wide transport carbon emissions, minimize traffic congestion and signal waiting times, support planning and building new infrastructure, etc. This …

Continue Reading

Are you holding onto a valuable asset – a High Value Dataset?

  • December 23, 2022
  • Blog
  • 0 Comments

The world has become increasingly digital and a very high volume of data is being generated and consumed of late. It is therefore important that the data owners are able to identify whether the dataset they have is a High Value Dataset (HVD) or not. This blog is therefore an attempt to provide a template for distinguishing an HVD. The Definition: The datasets …

Continue Reading

Defining Metrics to Assess the Quality of Data

  • December 20, 2022
  • Blog
  • 0 Comments

In the previous post, we explored the reasons that a Data Quality Assessment (DQA) framework is important for a data exchange platform such as IUDX. We looked at how such a DQA framework/tool would be modularly designed and positioned in the existing IUDX architecture, and the benefits to both upstream and downstream stakeholders. In this post, we will discuss the …

Continue Reading

Technology and the changing nature of governance

March 2020 changed the face of the world indelibly and set in motion a series of changes in every aspect of our lives, from how we work, to how we access the most basic of amenities. In terms of digital transformation, the world achieved in mere months, what it set out to do in a matter of years! The world …

Continue Reading

Immutable Database Open Source (immudb) Gains Widespread Adoption

Today, Codenotary revealed that both large and small businesses as well as cloud service providers have adopted immudb, the first and only open source enterprise-class database with data immutability at scale. No data can be compromised thanks to the tamper-proof database; records can be updated but never modified or removed, so there is always a history for tracing. Codenotary has …

Continue Reading

GOVT OF TELANGANA INKS AGREEMENT WITH IISC TO BUILD AGRICULTURAL DATA EXCHANGE

Hyderabad/Bangalore, September 5: The Government of Telangana and the Indian Institute of Science (IISc), Bengaluru have signed an agreement to jointly create India’s first Agricultural Data Exchange (ADEx). ADEx will be built upon India Urban Data Exchange (IUDX), a pioneer in enabling the use of data for public good. IUDX was also created in IISc in partnership with the Ministry of …

Continue Reading

IUDX for e-Governance

One of the fundamental responsibilities of the government is to provide services and benefits to its citizens. These services and benefits may be welfare-centric schemes like Direct Benefit Transfer (DBT), regulatory services abiding by the law, statutory services, and consumer utility services such as water supply, electricity, and other basic amenities. In FY 22-23, there has been a total of …

Continue Reading

The Importance of Data Quality for a Data Exchange Platform

The global economy is ever-increasingly reliant on the data that drives it and the ecosystem surrounding data is rapidly growing in size and scope. Data is used to frame and enact policies, drive better governance, run businesses and perform data science. India Urban Data Exchange (IUDX) forms part of this data ecosystem by facilitating seamless exchange of data and in …

Continue Reading