Date: Wed, 03 Apr 2013 09:58:05 +0530 From: Upadhyay P K <pku@nic.in> Dear Moderator, Below message posted by me on 28th March was not published. Is there any reason? with regards P K Upadhyay NIC, Delhi ----- Original Message ----- From: Upadhyay P K <pku@nic.in> Date: Thursday, March 28, 2013 5:55 pm Subject: Re:Data Migration from One LMS to other and Non-cooperation of Vendors To: Swati Bhattacharyya <swati@iimcal.ac.in> Cc: "Dr. Rama K C Patro" <rkcpatro@iimtobu.ac.in>, lis-forum@ncsi.iisc.ernet.in Dear professional colleagues, Let me write my observation on this discussion for the benefit of LIS professionals. There are pros and cons of suggestions posted here. I make out these points for the sake of clarity: General Issues in Data Migration, Export, Import, Non-Cooperation, and Best Practices. 1. General Issues in Library Data Migration: In this discussion we are only considering one minute aspect of metadata migration of Books from Libsys to other LMS. But other parts are untouched like Journals, Circulation Data, Members records, Article Indexing, Budget, News Clips, Full text files, Images, Audio, Video, etc. Actually the task is increasing day by day due to Library ICT Modernization infrastructure, consolidation and cost optimization. There is a common assumption that whenever you migrate data from one system to another there is certain percentage loss of data if not well planned financially and technically. Actually, softwares are not at fault. Almost all softwares are having the export/import facility. But major issue is human intervention. Very rarely softwares are able to migrate/merge/import all library data automatically without any flaw or loss. Libsys, KOHA, NewGenlib, eGranthalaya, VTLS, Liberty, etc have export/ import facility, but no software can migrate all kinds of the above data automatically. It requires writing software/utility/programmes codes for importing software schema and structure. Who will pay for these efforts? MARCEdit, etc are the tools for exported data of bibliographic recordsonly, but not how to export from Libsys, etc. 2. Export in Excel, MARC21, XML from LMS softwares: Almost all software have export facility. Dr Pardeep Rai wrote that libsys software does not support in exporting data into other format such as CCF, Oracle or MySQL, etc. No question of exporting data directly to Oracle or MySQL. Each software has its own table schema and architecture using Oracle or SQL server or PostgreSQL or MySQL. Of course, Libsys has export facility in their Cataloging module to migrate data in CCF, EXCEL, MARC, Text. Actually more than 95% of Libsys Users are not using any backend database (SQL server or PostgreSQL or MySQL or Oracle) to avoid this type of non-cooperation from Libsys. They have purchased flat file system Libsys software and they have to be much dependant on Libsys for small-small things. 3. Import from Excel, MARC, XML in any LMS or DL: As I wrote no software has perfect automated system to import data/metadata. For example, to the best of my knowledge, Libsys has import facility for only books if you use their typical software without any backend database. Journals, article indexing, fulltext files, images, videos, circulation data, etc. But of course with the help of any Libsys/programmer you can migrate if data is available in softcopy structured format. This is the reason, vendors charge for their effort estimate. Another example, even if your data is in excel, fields may be named differently and data may be entered differently like two Authors separated by comma, sometimes both authors in different columns, then you need little programming to break the data according to new softwares� schema and tables. 4. Non-cooperation from vendors: As Dr Pardeep Rai wrote that Libsys is not cooperating. Dr. R K Ch Patro wrote that Libsys is charging Rs one lakh for migrating 10000 records. I also got similar grievances from four-five professional colleagues, but even then they manage migration without the cooperation of Libsys. NIC has migrated for around 30 libraries Libsys data to eGranthalaya. In eGranthalaya software there is a module for importing data from Excel, XML amd MARC. Dr Manjunath rightly said that your license agreement should be clear enough to take help from any vendors. I will also suggest Libsys to cooperate and not to remove/block the export module in case of not paying AMC with a fear of losing business, instead you will gain more business. Because India is a big country and requires 100s of Libsys like companies to achieve desired level of automation. 5. Best Practices in Data Migration: Following are my suggestion for balancing the issue, a. While purchasing/acquiring the software, ensure in License agreement for export in at least Excel, MARC21, and Structured text. Import is little tedious depending upon data sources, schema, quality, volume and structure but terms and conditions should spell for helping from importing data from at least Excel, Access, MARC, XML, or RDBMS. Vendors may charge some amount for importing when implementing the application softwares. b. Librarians should regularly( daily, monthly, yearly) take backup of database, copy at safe place (pen drive, another computer or network). c. Library Application software should be implemented preferably in web based manner with back end database (either SQL server or PostgreSQL or MySQL, or Oracle, etc) with hosting of data at your Internet service provider�s server with network security, data security and web site auditing. With regards P K Upadhyay NIC, New Delhi http://egranthalaya.nic.in , http://eglibnet.gov.in http://mcitconsortium.nic.in, http://home.nic.in ----- Original Message ----- From: Swati Bhattacharyya <swati@iimcal.ac.in> Date: Thursday, March 28, 2013 1:24 pm Subject: Re: [LIS-Forum] kindly mail 2 forum members To: "Dr. Rama K C Patro" <rkcpatro@iimtobu.ac.in> Cc: lis-forum@ncsi.iisc.ernet.in

Dear All:

May I request you, who are trying to take out data from Libsys, to let us know which version of Libsys are you currently using?

Sincerely, -- Swati Bhattacharyya Librarian Indian Institute of Management Calcutta Joka, Diamond Harbor Road Kolkata - 700104 Ph: +91-33-2467-8300/01 (extn: O:416; R: 106)

...

Dear Dr. Manjunath

I Agree with you,but not now. Like Dr. Pradeep I alos face the same problem with libsys, They are charging 1lac for conversion of 10k data. Secondly there are also so many library professionals (Worked with libsys) to whom I know, they can come volunterly and share their knowledge among others if any body organise training they may help, but those who have an urgency pl circulate a note/procedure/guideline form your side how to convert? So that they will go ahead. Regards Dr. R K Ch Patro, Librarian Institute for International Management & Technology (IIMT) Gurgoan 0124-4787111