Sudhir Kumar Suthar

The quality of data and its ability to explain various indicators has been a debatable issue in developmental discourse for ages. Along with the Census data, the only other method used has been the survey data for this purpose. Shamika Ravi (IE July 07, 2023, and July 13, 2023) has highlighted some of the problems with the survey data and these criticisms have also been accepted by the other experts despite their reservations about specific examples (Sen IE July 10, 2023, Mohanan and Kundu July 12, 2023). There seems to be an agreement with the larger questions she raised with regard to problems associated with the methodology part.

A major reason behind this agreement on problems with survey data is the inherent structural issues with surveys as a method of data collection. Most of the time, economists and statisticians look up to refined techniques or methods of sampling as a solution to the problems of surveys. Nevertheless, it is time to look beyond the traditional forms of data collection and consider alternative methods to understand the quality, availability, and accessibility of various services or government programs and schemes, the purpose for which surveys like NSSO, NFHS, PLFS, or other surveys are used generally. 

Although for macro-level data collection relevance of survey data cannot be denied but there are other ways of collecting data for specific purposes. In social science research, there is already a larger consensus in favor of a multimethod approach to research and data collection instead of relying on any one method. Having multiple methods help cross-check the validity of a specific kind of data. Besides, it also provides scope for incorporating responses that otherwise may not be possible to record through a survey method. However, government agencies are still working with the traditional methodology due to its specific requirement of household-level macro data sets.

All three writings on the issue agree with the problem of higher non-response rates. Higher non-response rates are also correlated with the level of wealth in a society. However, there are other factors as well. For instance, a survey also includes a very monotonous and time taking process of filling out a long questionnaire. A survey requires a respondent to take out at least ten to fifteen minutes and respond. In the case of urban areas, it is really difficult to conduct a survey and ask people to spare time, settle and respond. Besides, the survey questionnaire requires a certain kind of sensibility and above all interest in data collection.

The Centre for Political Studies has been organizing such opinion surveys for the last twenty years. The students do complain about the apathy and disinterested attitudes of people in Delhi’s posh colonies or multistory apartments. In such a situation, we encourage them to think of alternative ways of collecting the data. In some cases, it did work and students were able to come up with very useful conclusions paving the way for long-term research and analysis.

As Pronab Sen highlighted that the data collection also depends upon its usage. Different surveys in India are conducted periodically to understand people’s access to various services, availability of facilities, consumption behavior, and so on. For the specific purpose of measuring various government programs/schemes or services, two more methods of data collection can be considered. One is the consumer, user satisfaction survey and, second is the collection of various case studies, narratives, and interviews. Both these methods are less time taking and can be used for having a more interactive discussion with the respondents. This may help minimize the problem of low response rates, especially in the case of cities. Both these methods can be substantiated with two examples.

The first method is widely used by market entities. When we use a banking service, or purchase a product, we are asked to fill up a survey or respond to few questions. Such surveys do help in understanding the nature of services and how people are responding to it. Usage of such methods can be extremely useful in measuring the everyday efficiency of various services. Similar methods can be used to measure efficiency of various offices, government departments etc. in case of institutional evaluation (e.g. NAAC evaluation or universities) such methods are already being tested. A more organized and institutionalized way of collecting such data can be further useful for improving government services and programs.

The second method of narratives or case studies can also be useful in this regard. Though it may not be very useful for the purpose of macro-level data, it can still be used for verification of macro-level data. Take for example the debate on Agricultural Producers Marketing Committees or what is popularly known as mandi’s in India. When the debate was around the abolition of APMCs and their economic relevance, there were other qualitative narrative-based studies (like Mekhala Krishnamurthy’s work) that highlighted how mandi’s transformed farmers’ lives in qualitative ways. Besides, during the 11^th and 12^th five-year plan the erstwhile planning commission had started using various case studies related to successful examples of governance systems in various states of India.

Regular collection of such case studies and narratives may help the policy makers in identifying prevailing gaps or emerging strong points in the implementation of a policy or how users are utilizing a particular public office or space. Such methods also help understand a more nuanced way of functioning of various schemes. The problem of limited number of variables in traditional survey method can be minimized with the help of more qualitative data collection methods like interviews. For the purpose of government agencies, the interviews can be more structured while focusing on measurable outcomes instead of being open ended.

AI based data collection, usage of geo spatial data and analyzing narratives with the help of various modern software are also some of the ways in which India can think of improving its data collection system. Above all, there is a need to have more sensible and user-friendly process of data collection instead of looking it as a technical process merely. India is still using methodology that was introduced in the previous century. Using older indicators and methods is also necessary to ensure continuity of periodic data. However, requirements of a new society and economy also demands upgradation of methods, techniques and analysis.