{"id":1815,"date":"2014-10-27T23:02:38","date_gmt":"2014-10-27T23:02:38","guid":{"rendered":"https:\/\/techcafeteria.com\/new\/?p=1815"},"modified":"2014-10-31T12:34:50","modified_gmt":"2014-10-31T12:34:50","slug":"architecting-healthy-data-management-systems","status":"publish","type":"post","link":"https:\/\/techcafeteria.com\/?p=1815","title":{"rendered":"Architecting Healthy Data Management Systems"},"content":{"rendered":"<p>This article was originally published in the NTEN eBook &#8220;<a href=\"http:\/\/www.nten.org\/research\/collected-voices-data-informed-nonprofits\">Collected Voices: Data-Informed Nonprofits<\/a>&#8221; in January of 2014.<\/p>\n<h2><b><a href=\"http:\/\/techcafeteria.com\/new\/wp-content\/uploads\/2014\/10\/tape-403593_640.jpg\"><img fetchpriority=\"high\" decoding=\"async\" class=\"alignleft  wp-image-1829\" style=\"padding-right: 10px;\" src=\"http:\/\/techcafeteria.com\/new\/wp-content\/uploads\/2014\/10\/tape-403593_640.jpg\" alt=\"tape-403593_640\" width=\"381\" height=\"253\" srcset=\"https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/tape-403593_640.jpg 640w, https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/tape-403593_640-300x199.jpg 300w, https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/tape-403593_640-346x230.jpg 346w\" sizes=\"(max-width: 381px) 100vw, 381px\" \/><\/a>Introduction<\/b><\/h2>\n<p>The reasons why we want to make data-driven decisions are clear. \u00a0The challenge, in our cash-strapped, resource-shy environments is to install, configure and manage the systems that will allow us to easily and efficiently analyze, report on and visualize the data. \u00a0This article will offer some insight into how that can be done, while being ever mindful that the money and time to invest is hard to come by. \u00a0But we\u2019ll also point out where those investments can pay off in more ways than just the critical one: the ability to justify our mission-effectiveness.<\/p>\n<p>Right off the bat, acknowledge that it might be a long-term project to get there. \u00a0But, acknowledge as well, that you are already collecting all sorts of data, and there is a lot more data available that can put your work in context. \u00a0The challenge is to implement new systems without wasting earlier investments, and to funnel data to a central repository for reporting, as opposed to re-entering it all into a redundant system. \u00a0Done correctly, this project should result in greater efficiency once it\u2019s completed.<\/p>\n<p>Consider these goals:<\/p>\n<ul>\n<li>An integrated data management and reporting system that can easily output metrics in the formats that constituents and funders desire;<\/li>\n<li>A streamlined process for managing data that increases the validity of the data entered while reducing the amount of data entry; and<\/li>\n<li>A broader, shared understanding of the effectiveness of our strategic plans.<\/li>\n<\/ul>\n<p>Here are the steps you can take to accomplish these goals.<\/p>\n<h2><b>Taking Inventory<\/b><\/h2>\n<p>The first step in building the system involves ferreting out all of the systems that you store data in today. \u00a0These will likely be applications, like case or client management systems, finance databases, human resources systems and constituent relationship management (CRM) systems. \u00a0It will also include Access databases, Excel spreadsheets, Word documents, email, and, of course, paper. \u00a0In most organizations (and this isn\u2019t limited to nonprofits), data isn\u2019t centrally managed. \u00a0It\u2019s stored by application and\/or department, and by individuals.<\/p>\n<p>The challenge is to identify the data that you need to report on, wherever it might be hidden, and catalogue it. Write down what it is, where it is, what format it is in, and who maintains it. \u00a0Catalogue your information security: what content is subject to limited availability within the company (e.g., HR data and HIPAA-related information)? What can be seen organization-wide? What can be seen by the public?<\/p>\n<table>\n<tbody>\n<tr>\n<td><span style=\"color: #333399;\">Traditionally, companies have defaulted to securing data by department. While this offers a high-level of security, it can stifle collaboration and result in data sprawl, as copies of secured documents are printed and emailed to those who need to see the information, but don\u2019t have access. Consider a data strategy that keeps most things public (within the organization), and only secures documents when there is clear reason to do so.<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>You\u2019ll likely find a fair amount of redundant data. \u00a0This, in particular, should be catalogued. \u00a0For example, say that you work at a social services organization. \u00a0When a new client comes on, they\u2019re entered into the case management system, the CRM, a learning management system, and a security system database, because you\u2019ve given them some kind of access card. Key to our data management strategy is to identify redundant data entry and remove it. \u00a0We should be able to enter this client information once and have it automatically replicated in the other systems.<\/p>\n<h2><b>Systems Integration<\/b><\/h2>\n<p>Chances are, of course, that all of your data is not in one system, and the systems that you do have (finance, CRM, etc.) don\u2019t easily integrate with each other. \u00a0The first question to ask is, how are we going to get all of our systems to share with each other? One approach, of course, is to replace all of your separate databases with one database. \u00a0Fortune 500 companies use products from Oracle and SAP to do this, systems that incorporate finance, HR, CRM and inventory management. \u00a0Chances are that these will not work at your nonprofit; the software is expensive and the developers that know how to customize it are, as well. \u00a0More affordable options exist from companies like MicroSoft, Salesforce, NetSuite and IBM, at special pricing for 501(c)(3)\u2019s.<\/p>\n<h2><b>Data Platforms<\/b><\/h2>\n<p>A data platform is one of these systems that stores your data in a single database, but offers multiple ways of working with the data. \u00a0Accordingly, a NetSuite platform can handle your finance, HR, CRM\/Donor Management and e-commerce without maintaining separate data stores, allowing you to report on combined metrics on things like fundraiser effectiveness (Donor Management and HR) and mail vs online donations (E-commerce and Donor Management). \u00a0Microsoft\u2019s solution will incorporate separate products, such as Sharepoint, Dynamics CRM, and the Dynamics ERP applications (HR, Finance). \u00a0Solutions like Salesforce and NetSuite are cloud only, whereas Microsoft \u00a0and IBM can be installed locally or run from the cloud.<\/p>\n<h2><b>Getting from here to there<\/b><\/h2>\n<p>Of course, replacing all of your key systems overnight is neither a likely option nor an advisable one. \u00a0Change like this has to be implemented over a period of time, possibly spanning years (for larger organizations where the system changes will be costly and complex). As part of the earlier system evaluation, you\u2019ll want to factor in the state of each system. \u00a0Are some approaching obsoletion? \u00a0Are some not meeting your needs? Prioritize based on the natural life of the existing systems and the particular business requirements. Replacing major data systems can be difficult and complex &#8212; the point isn\u2019t to gloss over this. \u00a0You need to have a strong plan that factors in budget, resources, and change management. \u00a0Replacing too many systems too quickly can overwhelm both the staff implementing the change and the users of the systems being changed. \u00a0If you don\u2019t have executive level IT Staff on board, working with consultants to accomplish this is highly recommended.<\/p>\n<h2><b>Business Process Mapping<\/b><\/h2>\n<p><strong><strong><a href=\"http:\/\/techcafeteria.com\/new\/wp-content\/uploads\/2014\/10\/BPM_Example.png\"><img decoding=\"async\" class=\"alignright wp-image-1812 size-medium\" src=\"http:\/\/techcafeteria.com\/new\/wp-content\/uploads\/2014\/10\/BPM_Example-154x300.png\" alt=\"BPM_Example\" width=\"154\" height=\"300\" srcset=\"https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/BPM_Example-154x300.png 154w, https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/BPM_Example-118x230.png 118w, https:\/\/techcafeteria.com\/wp-content\/uploads\/2014\/10\/BPM_Example.png 314w\" sizes=\"(max-width: 154px) 100vw, 154px\" \/><\/a><\/strong><\/strong><\/p>\n<p>The success of the conversion is less dependent on the platform you choose than it is on the way you configure it. \u00a0Systems optimize and streamline data management; they don\u2019t manage the data for you. \u00a0In order to insure that this investment is realized, a prerequisite investment is one in understanding how you currently work with data and optimizing those processes for the new platform.<\/p>\n<p>To do this, take a look at the key reports and types of information in the list that you compiled and draw the process that produces each piece, whether it\u2019s a report, a chart, a list of addresses or a board report. \u00a0Drawing processes, aka business process mapping, is best done with a flowcharting tool, such as Microsoft Visio. \u00a0A simple process map will look like this:<\/p>\n<p>In particular, look at the processes that are being done on paper, in Word, or in Excel that would benefit from being in a database. \u00a0Aggregating information from individual documents is laborious; the goal is to store data in the data platform and make it available for combined reporting. \u00a0If today\u2019s process involves cataloguing data in an word processing table or a spreadsheet, then you will want to identify a data platform table that will store that information in the future.<\/p>\n<h2><b>Design Considerations<\/b><\/h2>\n<p>Once you have catalogued your data stores and the processes in place to interact with the data, and you\u2019ve identified the key relationships between sets of data and improved processes that reduce redundancy, improve data integrity and automate repetitive tasks, you can begin designing the data platform. \u00a0This is likely best done with consulting help from vendors who have both expertise in the platform and knowledge of your business objectives and practices.<\/p>\n<p>As much as possible, try and use the built-in functionality of the platform, as opposed to custom programming. \u00a0A solid CRM like Salesforce or MS CRM will let you create custom objects that map to your data and then allow you to input, manage, and report on the data that is stored in them without resorting to actual programming in Java or .NET languages. \u00a0Once you start developing new interfaces and adding functionality that isn&#8217;t native to the platform, things become more difficult to support. \u00a0Custom training is required; developers have to be able to fully document what they\u2019ve done, or swear that they\u2019ll never quit, be laid off, or get hit by a bus. And you have to be sure that the data platform vendor won\u2019t release updates that break the home-grown components.<\/p>\n<h2><b>Conclusion<\/b><\/h2>\n<p>The end game is to have one place where all staff working with your information can sign on and work with the data, without worrying about which version is current or where everything might have been stored. \u00a0Ideally, it will be a cloud platform that allows secure access from any internet-accessible location, with mobile apps as well as browser-based. \u00a0Further considerations might include restricted access for key constituents and integration with document management systems and business intelligence tools. But key to the effort is a systematic approach that includes a deep investment in taking stock of your needs and understanding what the system will do for you before the first keypress or mouse click occurs, and patience, so that you get it all and get it right. \u00a0It\u2019s not an impossible dream.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article was originally published in the NTEN eBook &#8220;Collected Voices: Data-Informed Nonprofits&#8221; in January of 2014. Introduction The reasons why we want to make data-driven decisions are clear. \u00a0The challenge, in our cash-strapped, resource-shy environments is to install, configure and manage the systems that will allow us to easily and efficiently analyze, report on<br \/><a class=\"moretag\" href=\"https:\/\/techcafeteria.com\/?p=1815\">+ Read More<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[422,2,79,82],"tags":[167,119,104,387,234,231,16,85,75],"class_list":["post-1815","post","type-post","status-publish","format-standard","hentry","category-articles","category-nptech","category-starred","category-tech","tag-bpm","tag-crm","tag-data","tag-data-management","tag-erp","tag-outcomes","tag-software","tag-strategy","tag-webdev"],"_links":{"self":[{"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/posts\/1815","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1815"}],"version-history":[{"count":4,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/posts\/1815\/revisions"}],"predecessor-version":[{"id":1830,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=\/wp\/v2\/posts\/1815\/revisions\/1830"}],"wp:attachment":[{"href":"https:\/\/techcafeteria.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1815"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1815"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techcafeteria.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1815"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}