Monthly Archives: October 2014

How Easy Is It For You To Manage, Analyze And Present Data?

apple-256262_640I ask because my articles are up, including my big piece from NTEN’s Collected Voices: Data-Informed Nonprofits on Architecting Healthy Data Management Systems. I’m happy to have this one available in a standalone, web-searchable format, because I think it’s a bit of a  signature work.  I consider data systems architecture to be my main talent; the most significant work that I’ve done in my career.

  • I integrated eleven databases at the law firm of Lillick & Charles in the late 90’s, using Outlook as a portal to Intranet, CRM, documents and voicemail. We had single-entry of all client and matter data that then, through SQL Server triggers, was pushed to the other databases that shared the data.  This is what I call the “holy grail” of data ,entered once by the person who cares most about it, distributed to the systems that use it, and then easily accessible by staff. No misspelled names or redundant data entry chores.
  • In the early 2000’s, at Goodwill, I developed a retail data management system on open source (MySQL and PHP, primarily) that put drill-down reporting in a web browser, updated by 6:00 am every morning with the latest sales and production data.  We were able to use this data in ways that were revolutionary for a budget-challenged Goodwill, and we saw impressive financial results.

The article lays out the approach I’m taking at Legal Services Corporation to integrate all of our grantee data into a “data portal”, built on Salesforce and Box. It’s written with the challenges that nonprofits face front and center: how to do this on a budget, and how to do it without a team of developers on staff.

At a time when, more and more, our funding depends on our ability to demonstrate our effectiveness, we need the data to be reliable, available and presentable.  This is my primer on how you get there from the IT viewpoint.

I also put up four articles from Idealware.  These are all older (2007 to 2009), they’re all still pretty relevant, although some of you might debate me on the RSS article:

This leaves only one significant piece of my nptech writing missing on the blog, and that’s my chapter in NTEN’s “Managing Technology To Meet Your Mission” book about Strategic Planning. Sorry, you gotta buy that one. However, a Powerpoint that I based on my chapter is here.

Architecting Healthy Data Management Systems

This article was originally published in the NTEN eBook “Collected Voices: Data-Informed Nonprofits” in January of 2014.


The reasons why we want to make data-driven decisions are clear.  The challenge, in our cash-strapped, resource-shy environments is to install, configure and manage the systems that will allow us to easily and efficiently analyze, report on and visualize the data.  This article will offer some insight into how that can be done, while being ever mindful that the money and time to invest is hard to come by.  But we’ll also point out where those investments can pay off in more ways than just the critical one: the ability to justify our mission-effectiveness.

Right off the bat, acknowledge that it might be a long-term project to get there.  But, acknowledge as well, that you are already collecting all sorts of data, and there is a lot more data available that can put your work in context.  The challenge is to implement new systems without wasting earlier investments, and to funnel data to a central repository for reporting, as opposed to re-entering it all into a redundant system.  Done correctly, this project should result in greater efficiency once it’s completed.

Consider these goals:

  • An integrated data management and reporting system that can easily output metrics in the formats that constituents and funders desire;
  • A streamlined process for managing data that increases the validity of the data entered while reducing the amount of data entry; and
  • A broader, shared understanding of the effectiveness of our strategic plans.

Here are the steps you can take to accomplish these goals.

Taking Inventory

The first step in building the system involves ferreting out all of the systems that you store data in today.  These will likely be applications, like case or client management systems, finance databases, human resources systems and constituent relationship management (CRM) systems.  It will also include Access databases, Excel spreadsheets, Word documents, email, and, of course, paper.  In most organizations (and this isn’t limited to nonprofits), data isn’t centrally managed.  It’s stored by application and/or department, and by individuals.

The challenge is to identify the data that you need to report on, wherever it might be hidden, and catalogue it. Write down what it is, where it is, what format it is in, and who maintains it.  Catalogue your information security: what content is subject to limited availability within the company (e.g., HR data and HIPAA-related information)? What can be seen organization-wide? What can be seen by the public?

Traditionally, companies have defaulted to securing data by department. While this offers a high-level of security, it can stifle collaboration and result in data sprawl, as copies of secured documents are printed and emailed to those who need to see the information, but don’t have access. Consider a data strategy that keeps most things public (within the organization), and only secures documents when there is clear reason to do so.

You’ll likely find a fair amount of redundant data.  This, in particular, should be catalogued.  For example, say that you work at a social services organization.  When a new client comes on, they’re entered into the case management system, the CRM, a learning management system, and a security system database, because you’ve given them some kind of access card. Key to our data management strategy is to identify redundant data entry and remove it.  We should be able to enter this client information once and have it automatically replicated in the other systems.

Systems Integration

Chances are, of course, that all of your data is not in one system, and the systems that you do have (finance, CRM, etc.) don’t easily integrate with each other.  The first question to ask is, how are we going to get all of our systems to share with each other? One approach, of course, is to replace all of your separate databases with one database.  Fortune 500 companies use products from Oracle and SAP to do this, systems that incorporate finance, HR, CRM and inventory management.  Chances are that these will not work at your nonprofit; the software is expensive and the developers that know how to customize it are, as well.  More affordable options exist from companies like MicroSoft, Salesforce, NetSuite and IBM, at special pricing for 501(c)(3)’s.

Data Platforms

A data platform is one of these systems that stores your data in a single database, but offers multiple ways of working with the data.  Accordingly, a NetSuite platform can handle your finance, HR, CRM/Donor Management and e-commerce without maintaining separate data stores, allowing you to report on combined metrics on things like fundraiser effectiveness (Donor Management and HR) and mail vs online donations (E-commerce and Donor Management).  Microsoft’s solution will incorporate separate products, such as Sharepoint, Dynamics CRM, and the Dynamics ERP applications (HR, Finance).  Solutions like Salesforce and NetSuite are cloud only, whereas Microsoft  and IBM can be installed locally or run from the cloud.

Getting from here to there

Of course, replacing all of your key systems overnight is neither a likely option nor an advisable one.  Change like this has to be implemented over a period of time, possibly spanning years (for larger organizations where the system changes will be costly and complex). As part of the earlier system evaluation, you’ll want to factor in the state of each system.  Are some approaching obsoletion?  Are some not meeting your needs? Prioritize based on the natural life of the existing systems and the particular business requirements. Replacing major data systems can be difficult and complex — the point isn’t to gloss over this.  You need to have a strong plan that factors in budget, resources, and change management.  Replacing too many systems too quickly can overwhelm both the staff implementing the change and the users of the systems being changed.  If you don’t have executive level IT Staff on board, working with consultants to accomplish this is highly recommended.

Business Process Mapping


The success of the conversion is less dependent on the platform you choose than it is on the way you configure it.  Systems optimize and streamline data management; they don’t manage the data for you.  In order to insure that this investment is realized, a prerequisite investment is one in understanding how you currently work with data and optimizing those processes for the new platform.

To do this, take a look at the key reports and types of information in the list that you compiled and draw the process that produces each piece, whether it’s a report, a chart, a list of addresses or a board report.  Drawing processes, aka business process mapping, is best done with a flowcharting tool, such as Microsoft Visio.  A simple process map will look like this:

In particular, look at the processes that are being done on paper, in Word, or in Excel that would benefit from being in a database.  Aggregating information from individual documents is laborious; the goal is to store data in the data platform and make it available for combined reporting.  If today’s process involves cataloguing data in an word processing table or a spreadsheet, then you will want to identify a data platform table that will store that information in the future.

Design Considerations

Once you have catalogued your data stores and the processes in place to interact with the data, and you’ve identified the key relationships between sets of data and improved processes that reduce redundancy, improve data integrity and automate repetitive tasks, you can begin designing the data platform.  This is likely best done with consulting help from vendors who have both expertise in the platform and knowledge of your business objectives and practices.

As much as possible, try and use the built-in functionality of the platform, as opposed to custom programming.  A solid CRM like Salesforce or MS CRM will let you create custom objects that map to your data and then allow you to input, manage, and report on the data that is stored in them without resorting to actual programming in Java or .NET languages.  Once you start developing new interfaces and adding functionality that isn’t native to the platform, things become more difficult to support.  Custom training is required; developers have to be able to fully document what they’ve done, or swear that they’ll never quit, be laid off, or get hit by a bus. And you have to be sure that the data platform vendor won’t release updates that break the home-grown components.


The end game is to have one place where all staff working with your information can sign on and work with the data, without worrying about which version is current or where everything might have been stored.  Ideally, it will be a cloud platform that allows secure access from any internet-accessible location, with mobile apps as well as browser-based.  Further considerations might include restricted access for key constituents and integration with document management systems and business intelligence tools. But key to the effort is a systematic approach that includes a deep investment in taking stock of your needs and understanding what the system will do for you before the first keypress or mouse click occurs, and patience, so that you get it all and get it right.  It’s not an impossible dream.


Techcafeteria’s Week Of Added Content

pile-154710_640As promised, I added about 40 of my guest posts here from the NTEN, Idealware, Earthjustice and LSC blogs. I also completely redid my categories and retagged every item, which is something I’d never done properly, so that, if you visit the blog, you can use the new sidebar category and tag cloud displays to find content by topic.

Included is my “Recommended Posts” category, which includes the posts that I think are among the best and the most valuable of what I’ve written. These are mostly nptech-related, with a few of the personal posts thrown in, along with some humor.

The newly-added content that is also in recommended posts includes:

Everything has been published by it’s original date, though, so if you’re really curious, you can find all the new stuff at these links:

I’m not finished — NTEN and Idealware have both given me permission to publish the longer articles that I’ve  written to the site.  So I will do that on a new “Articles” page.  These will include write-ups on document management, major software purchasing, data integration standards, RSS and system architecture.  Look for them this week.

Incoming Content – Apologies In Advance!

wave-357926_1280 RSS subscribers to this blog should take note that I’m apt to flood your feeds this weekend. Over the past few weeks, I’ve gathered 35 to 40 posts that  I’ve written for other blogs  that I’m adding here.  These are primarily posts that I wrote for the NTEN, Idealware, Earthjustice and Legal Services  Corporation blogs, but neglected to cross-post here at the  time. The publish dates run from mid 2006 to a few months ago. I’m also seeking  permission to republish some of my larger articles that are out there, so you’ll be seeing, at  least, my guide on “Architecting Systems to Support  Outcomes Management”, which has only been available as part of NTEN’s ebook “Collected Voices: Data-Informed  Nonprofits“.

Another part of this project is to rewrite my tags from scratch and re-categorize everything on the blog in a more useful fashion. With about 260 blog  posts, this is a size-able  book now,  It just lacks a good table of contents and index.

I’ll follow the flood with a post outlining what’s most worthwhile in the batch.  Look, too, for upcoming posts on the Map for Nonprofits and  Community IT Innovators blogs on Outsourcing IT and RFPs, respectively, which I’ll also cross-post here. Plans for upcoming Techcafeteria posts include the promised one on gender bias in nptech.  I’m also considering doing a personal series on the writers and artists that have most influenced me. Thoughts?

It’s Time For A Tech Industry Intervention To Address Misogyny

News junkie that I am, I see a lot of headlines.  And four came in over the last 30 hours or so that paint an astonishing picture of a  tech industry that is in complete denial about the intense misogyny that permeates the industry.  Let’s take them in the order that they were received:

First, programmer, teacher and game developer Kathy Sierra.  In 2007, she became well known enough to attract the attention of some nasty people, who set out to, pretty much, destroy her.  On Tuesday, she chronicled the whole sordid history on her blog, and Wired picked it up as well (I’m linking to both, because Kathy doesn’t promise to keep it posted on Serious Pony).  Here are some highlights:

  • The wrath of these trolls was incurred simply because she is a woman and she was reaching a point of being influential in the sector.
  • They threatened rape, dismemberment, her family;
  • They published her address and contact information all over the internet;
  • They made up offenses to attribute to her and maligned her character online;
  • Kathy suffers from epileptic seizures, so they uploaded animated GIFs to epilepsy support forums of the sort that can trigger seizures (Kathy’s particular form of epilepsy isn’t subject to those triggers but many of the forum members were).

The story gets more bizarre, as the man she identified as the ringleader became a sort of hero to the tech community in spite of this abhorrent behavior. Kathy makes a strong case that the standard advice of “don’t feed the trolls” is bad advice.  Her initial reaction to the harassment was to do just what they seemed to desire — remove herself from the public forums.  And they kept right after her.

Adria Richards, a developer who was criticized, attacked and harassed for calling out sexist behavior at a tech conference, then recounted her experiences on Twitter, and storified them here. Her attackers didn’t stop at the misogyny; they noted that she is black and Jewish as well, and unloaded as much racist sentiment as they did sexist.  And her experience was similar to Kathy Sierra’s.

These aren’t the only cases of this, by far.  Last month Anita Sarkeesian posted a vblog asking game developers to curb their use of the death and dismemberment of female characters as the “goto” method of demonstrating that a bad guy is bad. The reaction to her request was the same onslaught of rape and violence threats, outing of her home address, threats to go to her house and kill her and her children.

So, you get it — these women are doing the same thing that many people do; developing their expertise; building communities on Twitter, and getting some respect and attention for that expertise.  And ferocious animals on the internet are making their lives a living hell for it.  And it’s been going on for years.

Why hasn’t it stopped?  Maybe it’s because the leadership in the tech sector is in pretty complete denial about it.  This was made plain today, as news came out about two events at the Grace Hopper Celebration of Women in Computing conference running this week. The first event was a “White Male Allies Plenary Panel” featuring Facebook CTO Mike Schroepfer; Google’s SVP of search Alan Eustace; Blake Irving, CEO of GoDaddy; and Tayloe Stansbury, CTO of Intuit.  These “allies” offered the same assurances that they are trying to welcome women at their companies. A series of recent tech diversity studies show that there is a lot of work to be done there.  But, despite all of the recent news about Zoe Quinn, Anita Sarkeesian, etc., Eustace still felt comfortable saying:

“I don’t think people are actively protecting the [toxic culture] or holding on to it … or trying to keep [diverse workers] from the power structure that is technology,”

Later in the day, Satya Nadella, CEO of Microsoft, stunned the audience by stating:

“It’s not really about asking for the raise, but knowing and having faith that the system will actually give you the right raises as you go along.”

Because having faith has worked so well for equal pay in the last 50 years? Here’s a chart showing how underpaid women are throughout the U.S. Short story? 83% of men’s wages in the best places (like DC) and 69% in the worst.

Nadella did apologize for his comment. But that’s not enough, by a long shot, for him, or Eric Schmidt, or Mark Zuckerberg, or any of their contemporaries. There is a straight line from the major tech exec who is in denial about the misogyny that is rampant in their industry to the trolls who are viciously attacking women who try and succeed in it. As long as they can sit, smugly, on a stage, in front of a thousand women in tech, and say “there are no barriers, you just have to work hard and hope for the best”, they are undermining the efforts of those women and cheering on the trolls.  This is a crisis that needs to be resolved with leadership and action.  Americans are being abused and denied the opportunity that is due to anyone in this country. Until the leaders of the tech industry stand up and address this blatant discrimination, they are condoning the atrocities detailed above.

Postnote: The nonprofit tech sector is a quite different ballpark when it comes to equity among the sexes.  Which is not to say that it’s perfect, but it’s much better, and certainly less vicious. I’m planning a follow-up post on our situation, and I’ll be looking for some community input on it.


The Increasing Price We Pay For The Free Internet

The Price of Freedom is Visible HerePicture : Rhadaway.

This is a follow-up on my previous post, A Tale Of Two (Or Three) Facebook Challengers. A key point in that post was that we need to be customers, not commodities.  In the cases of Facebook, Google and the vast majority of free web resources, the business model is to provide a content platform for the public and fund the business via advertising.  In this model, simply, our content is the commodity.  The customer is the advertiser.  And the driving decisions regarding product features relate more to how many advertisers they can bring on and retain than how they can meet the public’s wants and needs.

It’s a delicate balance.  They need to make it compelling for us to participate and provide the members and content that the advertisers can mine and market.  But since we aren’t the ones signing the checks, they aren’t accountable to us, and, as we’ve seen with Facebook, ethical considerations about how they use our data are often afterthoughts.  We’ve seen it over and over, and again this week when they backed off on a real names policy that many of their users considered threatening to their well-being.  One can’t help but wonder, given the timing of their statement, how much new competitor Ello’s surge in popularity had to do with the retraction. After all, this is where a lot of the people who were offended by the real names policy went.  And they don’t want to lose users, or all of their advertisers will start working on Ello to make the Facebook deal.

Free Software is at the Heart of the Internet

Freeware has been around since the ’80’s, much of it available via Bulletin Boards and online services like CompuServe and AOL. It’s important to make some distinctions here.  There are several variants of freeware, and it’s really only the most recent addition that’s contributing to this ethically-challenged business model:

  • Freeware is software that someone creates and gives away, with no license restrictions or expectation of payment. The only business model that this supports is when the author has other products that they sell, and the freeware applications act as loss leaders to introduce their paid products.
  • Donationware is much like Freeware, but the author requests a donation. Donationware authors don’t get rich from it, but they’re usually just capitalizing on a hobby.
  • Freemium is software that you can download for free and use, but the feature set is limited unless you purchase a license.
  • Open Source is software that is free to download and use, as well as modify to better meet your needs. It is subject to a license that mostly insures that, if you modify the code, you will share your modifications freely. The business model is usually based on providing  training and support for the applications.
  • Adware is free or inexpensive software that comes with advertising.  The author makes money by charging the advertisers, not the users, necessarily.

Much of the Internet runs on open source: Linux, Apache, OpenSSL, etc. Early adopters (like me) were lured by the free software. In 1989, I was paying $20 an hour to download Novell networking utilities from Compuserve when I learned that I could get a command line internet account for $20 a month and download them from Novell’s FTP site. And, once I had that account, I found lots more software to download in addition to those networking drivers.

Adware Ascendant

Adware is now the prevalent option for free software and web-based services, and it’s certainly the model for 99% of the social media sites out there.  The expectation that software, web-based and otherwise, will be free originated with the freeware, open source and donationware authors. But the companies built on adware are not motivated by showing off what they’ve made or supporting a community.  Any company funded by venture capital is planning on making money off of their product.  Amazon taught the business community that this can be a long game, and there might be a long wait for a payoff, but the payoff is the goal.

Ello Doesn’t Stand A Chance

So Ello comes along and makes the same points that I’m making. Their revenue plan is to go to a freemium model, where basic social networking is free, but some features will cost money, presumably business features and, maybe, mobile apps. The problem is that the pricing has to be reasonable and, to many, any price is unreasonable, because they like being subsidized by the ad revenue. The expectation is that social media networks are free.  For a social network to replace something as established as Facebook, they will need to offer incentives, not disincentives, and, sadly, the vast majority of Facebook users aren’t going to leave unless they are severely inconvenienced by Facebook, regardless of how superior or more ethical the competition is.

So I don’t know where this is going to take us, but I’m tired of getting things for free.  I think we should simply outlaw Adware and return to the simple capitalist economy that our founders conceived of : the one where people pay each other money for products and services. Exchanging dollars for goods is one abstraction layer away from bartering. It’s not as complex and creepy as funding your business by selling the personal information about your users to third parties.  On the Internet, freedom’s just another word for something else to lose.