tag:blogger.com,1999:blog-215192382016-12-16T05:09:29.255-05:00Databases, Structures, and the Data ItselfA Discussion of Data Warehousing and Business Intelligence MethodsWes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.comBlogger123125tag:blogger.com,1999:blog-21519238.post-66558285354864002142012-11-18T22:38:00.001-05:002012-11-18T22:38:28.386-05:00Tablets and BI.........or BI and tablets.&nbsp; In this case, BI stands for business intelligence.&nbsp;&nbsp;&nbsp;&nbsp; So let's put on our thinking caps and get to work.<br /><br />One of the more recent presentation layers the past few years has been the tablet device.&nbsp; For better or worse, until recently "tablet" meant iPad in most circumstances.&nbsp;&nbsp; Nothing to dis Android, but iPad&nbsp; seems to have a higher corporate acceptance from my experience.&nbsp; <br /><br />In my many projects, I haven't yet had too many requests for tablet presentations.&nbsp;&nbsp;&nbsp;I know business users who are starting to request them although I remain surprised that in 2012 printed reports are still in wide usage!&nbsp;&nbsp;&nbsp;(I used to talk with a few coworkers in 2000 about how&nbsp;nice it would be to have mobile information).&nbsp;&nbsp; Thinking that I was missing the boat as I didn't own a tablet device, in March I purchased a iPad "3" to see what this BI tablet thing was all about.<br /><br />What I found is that tablets pose potential, especially for mobile users.&nbsp;&nbsp; I stopped in AT&amp;T this week to purchase my Nokia Lumia 920, and all the sales reps used iPads to process orders.&nbsp;&nbsp; Not really BI, but one could see the logical extension of usage.&nbsp;&nbsp; There are also some great Apple apps (Roam BI, anyone?) that show promise.&nbsp;&nbsp;&nbsp; The best business case I can think of is someone who needs information but not tethered to a desk, and someone who doesn't use a smartphone capable of displaying said information.&nbsp;&nbsp;&nbsp;&nbsp; This is the perfect tablet BI user.<br /><br />Another observation I have is that business users love Excel.&nbsp;&nbsp; Well duh, you say?&nbsp;&nbsp; I've seen users dump perfectly readable information from Cognos reports into a CSV file to import into Excel to manipulate the same data.&nbsp;&nbsp;&nbsp; I believe a lot has to do with familiarity - but to date it shows a large weakness in the tablet market being able to natively display Excel data.&nbsp;&nbsp; My thoughts are that the inability of the iPad to render correctly basic or complex Excel spreadsheets has limited the usage of the tablet as a BI consumption device thus far.<br /><br />But now there is a great device on the market, the Windows 8 tablets which cure this problem.&nbsp;&nbsp;&nbsp; A review of the Surface is coming soon, and how I expect the Surface to change the nature of the BI presentation layer.&nbsp; <br /><br />Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-28190374635493963532011-10-03T08:00:00.000-04:002011-10-03T08:00:09.082-04:00SQL Saturday - 3 Years LaterLast week I attended the SQL Saturday event in Orlando, the site of the original event in November 2007. I'll not forget that one because Andy scheduled me to be the last speaker of the day and in the back of my truck was all my hunting gear ready for a departure to north Florida after the event for a good couple days of deer hunting. My two sessions that day were two of the best I've done, which makes up for the very poor showing on the next day's deer hunting. <br /><br />The idea for SQL Saturday originally grew out of the code camps. Florida was one of the first states to implement code camps as early as 2005 statewide. The code camps were great and us SQL guys had to settle for having a SQL leaning track at the code camps. I thoroughly enjoyed spending 2006 and 2007 traveling around the state to speak at these events, and I occasionally still do. Brian Knight, Joe Healy, and myself had discussions about putting on a 'data camp' as early as summer 2006 and I even called around to a few hotels to inquire about a meeting room to run the event in October 2006. Well, alas, talk is all it was and in the meantime Andy W. and crew came up the wonderful idea of SQL Saturday and the rest is history. I quickly gathered a group together in Tampa by teaming up with the wonderful and community oriented Pam Shaw and we ran SQL Saturday #2 in Tampa in February 2008. It was a fun event, tiring, and a little stressful, but the first few events led us to where the event is today. Matter of fact, I just signed up to speak at SQL Saturday #100.<br /><br />There has been some discussion from event organizers wondering if this "code camp" thing is just a fad, and I can thoroughly say that it's not. It's really taken on a life of it's own and now there are code camps, SQL Saturday, Bar camps, Azure Camp, and soon to be Windows Phone camps. As camps split into more specialized areas there are some attendance drops but it also brings out new people who are interested in that particular technology. Techies always enjoy the free or low cost events to network and learn or relearn something, and the post parties certainly don't hurt either.<br /><br />If you haven't been to one of these events yet, I encourage you to find out when the next one is coming to a city near you, or even better, get a group together and host one yourself. Information on SQL Saturday can be obtained by clicking <a href="http://www.sqlsaturday.com">here</a>.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-81906004787914345612011-09-30T15:00:00.000-04:002011-09-30T15:00:04.971-04:00Data Models and Their ImportanceJust this week I had a discussion with a client who is looking to hire a data modeler. We spoke about his project, the number of facts and dimensions, and what he was looking for in a data modeler. I felt compelled to add the following analogy:<br /><br />"A data model is like the foundation of a house. Without a strong foundation, no amount of work or rework on the remainder will be correct, and it will frustrate you to failure, so get the foundation right the first time."<br /><br />Unfortunately I know this all too well. I have been part of a few projects on the ETL side that had poor data models, either models that weren't completely thought through or models that weren't designed for the end solution. A data modeler needs to work very closely with the business/functional analysts to understand the data that will be stored in the model, and develop an enterprise model that can be easily maintained and expanded.<br /><br />First, let's look at a typical data model. For this example, I'll use the star methodology. This is a simple fact table that contains surrogate keys that point to attributes in the dimensions. If you need to, review the difference between facts and dimensions <a href="http://en.wikipedia.org/wiki/Star_schema">here</a>. <br /><br />Our simple model is a grocery store. It has a date, customer, employee, and product dimension. It has a Sales fact table that lists each transaction. <br /><br />This is a simple model but it carries a lot of information. The data modeler should be thinking ahead as to which dimensions should be added in the future for a sales fact table. There should also be thought as to which fact measures could be added in the future.<br /><br />I've worked with clients who would design the exact model above and attempt to capture every possible fact and dimensional attribute the first release. DON'T try this! Just capture the majority of the dimensions which are needed to create a usable report, design the metrics (facts), and implement. Dimensions and facts can be easily added later if the tables are designed right, and this allows the IT department to deliver something quickly and get the business vested in the success of the project.<br /><br />The synopsis, if you have made it this far, is to focus on building a solid data model from the start, containing relevant dimensions and needed facts to get the dimensional model up and running. Never, never, and I'll repeat never shortchange on your data model to get something out the door quicker.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-32390466948140960972011-09-29T15:00:00.000-04:002011-09-29T15:00:04.422-04:00Windows Phone 7.5 - A Year in the MakingReaders will recall that last year I was excited about getting the Windows Phone 7.5. I even recall Nov 8, 2010 when the phone first went on sale - I awoke in a Marriott in downtown Durham, NC, and after a hectic day made a trip to the AT&amp;T store, only to find that they were sold out of the Samsung Focus which I had decided on. Patience was painful but worthwhile, as a black Friday sale at the local Microsoft store yielded a free-after-contract LG Quantum. It's been a full 10 months since that fateful day and I'm no less pleased with Windows Phone.<br /><br />Yesterday I was able to upgrade to Windows Phone 7.5. This is the first phone I've owned in almost 10 years that I am completely happy with. The hardware is great (LG), and the camera is excellent. Matter of fact, I don't carry a camera anymore as this one takes excellent pictures. The ability to sync with Zune keeps my podcasts up to date and the phone functions as a de-facto iPod. Except that its' better. I haven't really noticed much with Mango yet except that the colors are more vibrant and texts/emails have a different style to them.<br /><br />For those who are contemplating a business device but want to stay in the Windows ecosystem, I highly encourage you to check out a WP7 device. I have been asked about it multiple times in my travels and try to spend a few seconds showing the device in a positive light. I am also asked quite a bit about my Amazon Kindle. Did I mention the WP7 apps, there are plenty of apps for many items but I still prefer to use a mobile browser when possible.<br /><br />Suffice it to say that I'm incredibly excited about Windows Phone 8, Windows 8, and Windows Server 8. The combination O/S, phone, server, and tablet should be the perfect quad of devices. I'm not a Windows fanboy but it's hard to argue that any ecosystem is better in the dual, and often shared realms of business and pleasure.<br /><br />I'd enjoy hearing any comments about the Windows Phone experiences you have.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-76228531352248795342011-09-28T15:41:00.003-04:002011-09-28T15:48:02.429-04:00Is it 2011 or 2006?It's been five years since I originally started this blog, so I decided it was time for a redesign. One of the plans is to move this over within the corporate webpage so the first task was to get the colors matched up. A second tasks was to "modify" the name. I elected to remove the quasi-curse word from the title, and while I believe "damn" is catchy and not overly offensive, the clientele is professional and it's important to retain the professional image.<br /><br />One of my disappointments has been in the blog postings, mainly the quantity or lack thereof. It's just plain difficult to find the time to do a comprehensive writing, one that actually delivers value to the constituents. Well, here's my mea cupla. I'll try harder to write more often and also more quality postings. Business intelligence is such an interesting and dynamic field and there are many topics that I could write about which would deliver value to you, the readers. <br /><br />If you have any comments about the new layout, please let me know.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-31903644759430546342011-06-28T13:40:00.000-04:002011-06-28T13:40:00.340-04:00Picking the right laptopAnother topic back on the laptops, and I hope this will be my last for a while. Earlier this year I decided to pick up a MacBook Air to use when traveling. It's the lightest full laptop on the market and the size is a dream. The problems began quickly - first, I had to spend sometime installing BootCamp and setting up Windows 7 on it with all my software, as most macOS programs are useless for what I do. The problem I had with the laptop was the glossy screen - after just 30 minutes of use, I couldn't see well the rest of the day with severe eye strain. After a couple weeks I put it in the closet and a quick Bing search revealed that the exact same problems had been noted by others as well. I let a friend borrow it a few weeks who didn't have any issues, so just guessing my eyes are a little sensitive and the Apple store said it's perfect, so I resold it and decided to move back to my second choice, a Lenovo ThinkPad.<br /><br />I finally decided on a ThinkPad T420s. It's a full machine with a 14" screen, which is only 1 lb more than the MBA, with all the features of a laptop (DVD rom, removable battery, anti-glare screen, great screen resolution). Crucial provided me an additional 4GB of ram, so now I'm running a 8 GB ram machine that's a dream to carry and can natively run all the programs that I need. The Lenovo cost the same amount as the MBA so that's a double win. So to anyone who is contemplating a thin, light 14" laptop, I highly recommend checking out the Lenovo lineup.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-65089059904436722162011-06-27T13:24:00.003-04:002011-06-27T13:40:22.690-04:00Types of DataThis is a question I get asked quite a bit: "What are the different types of data that I can collect in my data warehouse?" Always an interesting topic, so I'll start by saying there are three basic types of data: empirical, anecdotal, and derived.<br /><br />The basic case for data warehousing starts with empirical data. This is data that is collected - Eg. "I sold 10 widgets this week". Most data warehouses are built off this type of data, because it's really a "fact", meaning that it's true. Not to be confused with dimensional modeling, as an address is also "empirical" in nature.<br /><br />A second type of data is derived. This is data that is created from another type of data. An example of derived data is "I sold 10 widgets this week for $1 each, therefore my total sales are $10 for the week". Derivation is the only way to perform a computation to get a picture. Think of aggregations as derived data.<br /><br />The third type of data, and one that is less common, is anecdotal. This is data that is oberserved or believed but without any scientific basis. Anecdotal data often has applications in business. Think of the example that a salesman is selling widgets to a retailer, which we shall call Mega-lo-mart, and the salesman knows through discussion with the Mega-lo-mart manager that they don't intend to buy widgets this year, anecdotal data would be the salesman's oberservation that "mega-lo-mart doesn't indend to buy widgets this year because they aren't selling well". There is no scientific evidence this is true, but think of the business case, where a salesman is wasting time trying to sell to someone who will not buy the widget. Thus, there is a case that anecdotal evidence could be used in a data warehouse application, as long as it's documented as such, to help drive decisions.<br /><br />I find these data types fascinating, especially the anecdotal nature. Sometimes it's difficult to determine which data type is particular type of data is, based on the way it was collected. That's our jobs as architects (typically a data modeler) who would analyze the data, work with business users to determine the applicability of the data, and build a dimensional model that contains all three types of data to present as a business intelligence applicaiton.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-3337105772165400212011-01-09T20:30:00.002-05:002011-01-09T20:39:25.459-05:00Using Windows Tools to Maximize ProductivityOne of the most important things for consultants to do is to maximize their time. Fortunately, there are a number of tools available to assist in this endeavor. I'm specifically focusing on Microsoft tools, namely Windows Phone and associated services to get more done in less time.<div><br /></div><div>Smart phones have really taken off. Of course, some of us have been using "smart" phones long before Apple came along and took credit for inventing it. </div><div><br /></div><div><i>Here's a list of three Windows tools that can be used to maximize productivity:</i></div><div><br /></div><div><b>Windows Phone</b> - Syncs with Hotmail, Hotmail calendar, and can use Outlook connector to sync with Outlook on a desktop. Use Zune software to sync up podcasts and music.</div><div><br /></div><div><b>Windows SkyDrive</b> - Upload your documents and photos to this secure online storage area, where they can be accessed from your WP or any internet-connected computer. This is a lifesaver when needing to access business documents on a client site or to edit using the WP.</div><div><br /></div><div><b>Office Online</b> - Last but not least, the ability to create, edit, and save Office documents on computers without the client software is huge. Office online doesn't have the full functionality of the client tools but it's enough for basic documents and has saved me more than once.</div><div><div><br /></div><div>I hope you consider using these tools to become more productive. They are all available for low or no cost and provide high return on time. </div></div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-65169810568322835552011-01-03T14:45:00.002-05:002011-01-03T15:09:38.728-05:00The Importance of GoalsWelcome to the first post of 2011. Ironically, or maybe not, I'm writing about goals today for software techies, and my first goal is to publish posts more frequently. <div><br /></div><div>It is very easy to get into patters of life that just happen and people, like energy, tend to follow the past of least resistance. This is especially apparent in corporate America, where people get hired as employees, suffer through yearly reviews, get raises every now and then, but (often) fail to build a comprehensive goal list. In corporate speak, this is called a "career path". I prefer the term "Career plan", because the employee is the responsible party for developing and executing his/her own career plan. Especially in the era of corporate downsizing, one should not and cannot let their career path be dictated by a single company.</div><div><br /></div><div>A career plan can be simple or detailed. It must be actionable. One plan might state "Advance to become Software Architect". This seems slightly lofty and possibly unreasonable, but with the right planning becomes a distinct possibility. Compare with the goal of "Advance to become Software Architect by presenting at a major conference, spending 5 hours a week networking with fellow architects, and publishing an article in a journal during the current year". The best case in this scenario is that you now have a plan and become a software architect and the worst case is that if you achieve all the goals you've set yourself up in a strong position to move into the role down the road.</div><div><br /></div><div>I would imagine that if you are reading this blog you've probably been doing some networking or attended a tech event. These two facts alone will put you in the "creme de la creme" as they both show initiative in expanding your boundaries. But never rest on your laurels, continue moving forward and setting new goals as you retire achieved ones.</div><div><br /></div><div>The best goals are SMART:</div><div>S - Specific (Get a MBA, Publish an article)</div><div>M - Measurable (Degree is conferred, article was published)</div><div>A - Actionable (Something that can actually be done)</div><div>R - Realistic (Something that you really can achieve in the time allotted)</div><div>T - Time driven (There is a time limitation in which to achieve the goal)</div><div><br /></div><div>The fact is that the software development lifecycle is alive and well, and this relates to techies as well. It's a "grow, learn, and achieve" industry versus a "stagnate and die" one. In which group do you consider yourself? What is your SMART career plan for this year?</div><div><br /></div><div><br /></div><div><br /></div><div><br /></div><div><br /></div><div> </div><div><br /></div><div> </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-29978259420050045282010-12-01T00:52:00.003-05:002010-12-01T01:01:35.330-05:00Windows Phone 7 has landedHello all, in my last post I spoke about wanting to get a Windows phone badly after suffering a year of Android. Suffering is a word I use lightly, it was never "that" bad, but after a year of app-centric software, I was really missing my WinMo phone. I even went so far as to get out my old HTC Touch Pro and carry it around a week to see if I could be comfortable with it, and sadly, while I loved the software, I did not like the phone itself so I chose to ride out the wait. Well, the wait is over.<br /><br />Last week I picked up the LG Quantum. It's the only Windows Phone 7 device with a slider keyboard, reminicent of my PPC-6700. Matter of fact, it reminds me a lot of that good ol 6700 in form and function, and that's a good thing. So while I'll do a full review, let's first start by looking at my requirements for a Windows phone:<br />- Ability to sync with Outlook/Hotmail<br />- Ability to sync Calendar/Tasks<br />- Windows Media Player<br />- Decent internet browser<br /><br />The WP7 platform does all of these except one. Tasks. Tasks are sorely missing from the O/S but I have faith that Microsoft is planning to add in this feature at some point. I've also learned to use the Zune software to sync the phone, and while I've never had a iPhone, it does seem like a knockoff in functionality ported from Apple. <br /><br />The user interface is great and a welcome relief from the app buttons of Android. I find the entire phone and features to be a breath of fresh air that will only get better with time.<br /><br />Some features I hope that MSFT includes in WP7:<br />- Tethering via bluetooth<br />- Tasks sync<br />- Additional SD Micro card storage<br />- Bing Maps with NavigationWes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-9348406554478138882010-10-14T19:55:00.002-04:002010-10-14T20:11:49.168-04:00Windows Phone is coming, and I can't waitIn December of last year I wrote about my purchase of a Google Android device (HTC Hero) and how I felt Windows 6.5 was outdated and that Microsoft had missed the boat on the mobile software. Here's my partial mea-culpa: Microsoft did miss the boat for a while at least but it seems to be a good thing, and here's why. (So I was wrong - Windows Mobile 6.5 is still very relevant)<div><br /></div><div>In the past I have owned three devices (all three made by HTC coincidentally) that ran Windows Mobile 5.0, 6.1, and 6.5, respectively. The common problem with these devices was lack of memory and seeming hardware issues. The first phone (PPC-6700) was my favorite of them, as it worked great until I dropped it (my bad) and then I started going through refurb hell with Sprint and upgraded. The second phone (Mogul) was better in all respects but a little dated in screen resolution, and the screen promptly developed large white spots that a quick Bing search revealed to be a common issue with overheating (phone design error) so the screen was unusable. I then was moved to a Touch Pro which worked fine but had a horrible form factor (thick on the depth and thin on the width) which made the screen very small and barely usable (form factor design flaw) along with horrible battery life (about 30-45 minutes of use per charge). After the issues with that phone I wrote off HTC devices and headed to the Sprint store, where a smooth talking sales guy suggested the HTC Hero with Android 1.6 (Cupcake). I figured I'd give it a shot based on the price ($69 w/contract) and was initially impressed. My honeymoon wore off quickly.</div><div><br /></div><div>Android is an interesting beast and I've since used the factory upgrade to Android 2.1 and I'm no less pleased with it. Windows Mobile 5 was a better O/S with more features that I found lacking in Android. Android, following Apple's lead, is a siloed O/S where everything is driven by apps. This means information doesn't flow well between applications, and the base O/S has hardly no functionality at all. So for everything I want to do, I have to go online, find an app that does it (or not), and install it and hope that it works. Not my idea of good usability.</div><div><br /></div><div>The biggest flaw is that there is no easy way to sync up outlook (that I've found) and keep contacts, mail, and tasks synced up. There is a download provided by google that runs on my PC to do this, but it's rickety and while it works, I still don't find the calendar app to be anything like what I had on Windows mobile.</div><div><br /></div><div>I've been watching the news as Windows Phone 7 gets near and now I am very excited about a phone that has full Outlook sync, Windows Live, Bing maps, a good native browser, and the potential for apps if necessary. The only downside is that the phones are initially only available on GSM (not bad in the long run) but the models available by AT&amp;T and T-Mobile haven't caught my eye like some I have seen overseas. Looks like I'll start watching ebay next week (Oct 20 release in Europe) to pick up one of the new phones unlocked. I'd even take Windows Mobile 6.5 on a good device over my current setup but looks like Microsoft might be showing up at the right time to make a decent dent in the smartphone market.</div><div><br /></div><div><br /></div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-32789792111430682352010-03-12T22:50:00.002-05:002010-03-12T22:54:35.092-05:00The Damn Data is Going Away....but not yetWhat a fun four years it has been. Last year I started a new push for the website (www.thedamndata.com) and installed forums and whitepapers but it became a full time job to keep the spam, porn, and Rx peddlers off the forums and I ended up shutting them down for a while. The best mistake I made was trying to check the website from my computer while connected into the client's network. It was an honest mistake but a valuable one. The dreaded words "Blocked" came from the proxy server. The browser had a message that it was inappropriate material for a work machine. I had been wondering why it was so difficult to get some more traffic to the site and it suddenly dawned on me that while the name is a little catchy, it's probably not appropriate from a corporate standpoint. I have a new name, a new website, and while this blog address will stay the same for now, you'll soon see the results of a rebranding for the blog and web portion.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-7518982800442345392009-12-07T11:38:00.003-05:002009-12-07T15:38:37.310-05:00Is Windows Mobile Relevant?There is an interesting read on <a href="http://www.betanews.com/joewilcox/article/Microsoft-dont-hang-up-on-Windows-Mobile-but-do-call-for-help/1259900059">BetaNews</a> about the Windows Mobile platform. Before I get flamed for being a Apple junkie, I'll say right now I do not have nor want an iPhone. The closed platform and interface do nothing for what I need.<div><br /></div><div>My current cellphone has been trending downhill for the past few months. It's an HTC Touch Pro device with WM 6.1, and I hacked it to run WM6.5 that I downloaded at xda-developers. Those great hobbyists do a wonderful job at packaging roms which unlock the full value of phones. I've tried a few different roms but the "Energy rom" line was the most stable and best one I've seen. </div><div><br /></div><div>Now I'm sure you're thinking "the phone worked fine until you hacked it". This is the opposite, the phone out of the box from Sprint was buggy, laggy, and was a fail at basic telephony. Not to mention the habit of draining the battery before lunchtime. By researching and installing a custom rom I was able to get another 6 months of use from the device, else I'm certain it would have ended smashed into a million pieces on a sidewalk somewhere. </div><div><br /></div><div>This leads us to today - WM is coming out with WM 7 next year. This is supposed to be an awesome system. WM 6.5 excels where Apple fails. It's open development, lots of good resources but on the flip side a lot of the usage is wonky and seems 2003-ish. I cannot wait for a better system in a year from now when I need a smartphone today.</div><div><br /></div><div>I purchased a HTC Hero last week running Android. Android is made by Google and is quickly gaining market share among smart devices. It didn't have a dedicated keyboard so I thought I would be bothered by the virtual keyboard, but so far it's not too bad. The phone works well and it seems that the flow and use of the software makes sense. It's much more user intuitive than the Microsoft platform as it exists today, but I'll wait for the newness to wear off before I comment on the overall package. If Microsoft is destined to have a presence in the mobile market, WM 7 must be a compelling "wow". </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-90795163890078319132009-12-06T09:24:00.002-05:002009-12-06T09:40:49.104-05:0014 Years and 1.2 Million Miles LaterLast night I had the great pleasure of flying on Southwest airlines into Kansas City. I haven't flown on Southwest much this year but when I had this opportunity I jumped on it. Boarding the flight was painless and I picked an aisle seat right over the wing to try and have a similar experience as before. We arrived at KC Airport at gate 31, and when I departed into the terminal, I had a strong feeling of deja-vu.<div><br /></div><div>It was June 1995. I want to say it was the 8th day of the month, but I'm not sure. A family member had purchased me a ticket to fly from KC-Chicago on Southwest. I had never flown on a commercial aircraft before and was a little nervous. I won't state my age or give away too much information, but I'll say I was "young". I left my car at my uncle's home and they took me to the airport, I checked in my bag, and waited for the flight. At that time Southwest used those old plastic number cards, and I believe I had a 'B' card. The plane was this huge light brown thing, later I learned it was a 737-200. We boarded the flight through gate 31 and I found a seat right behind the wing on the left side of the aircraft. I recall that flight had some seats that faced to the back, and there was a very attractive blonde girl in one of those seats who ordered a beer on the flight. I'm sure I had a Coke. My first feeling was the massive acceleration on take off, and the rest of the flight was an awesome experience for a young boy. </div><div><br /></div><div>One of the neat things about consulting and building a business is the opportunity to travel to distant locales. Some people enjoy traveling, some see it as part of the job, and some hate it. I understand all these perspectives. Last night as I recollected on my experience, I thought of the many airports I've visited since that day in June 1995. I thought of the planes I've flown on that would make a 737 look like a tiny toy. I thought about the many people I've met along the journey, both attractive ladies and nice guys. I then thought about what I know now vs. what I knew in 1995. It helped me to remember that the world is full of opportunities, that we all have a chance to make what we want, to live our dreams. I am living mine, talking, practicing, and helping companies become more efficient through the use of information technology and business intelligence. In June 1995 I was working at Walmart, thinking of how we (myself and the four other guys I worked with) could get bleach loaded onto shelves faster, work the stock faster, or sell more items through use of displays. Now I am thinking of how I can use IT to help a client complete financial audits. Wow, what a 14 years it's been. I'm certain that I will look back in another 14 years and saw that in 2009 I had no idea how great it would all become.</div><div><br /></div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-54002684376985416912009-10-30T07:43:00.000-04:002009-10-30T07:43:00.425-04:00Update on the Data Modeling Tool<div style="text-align: auto;"><span class="Apple-style-span" style="font-size: medium;">One of our clients was testing Toad Data Modeler to see if it would suffice as a replacement for CA ERWin to construct a dimensional model - the verdict is in, and it's "No." Toad Data Modeler does regular ER diagrams not not a dimensional model. Looks like CA ERWin is going to be the tool of choice for this client as well as many of our other clients. </span></div><div style="text-align: auto;"><span class="Apple-style-span" style="font-size: medium;"><br /></span></div><div style="text-align: auto;"><span class="Apple-style-span" style="font-size: medium;">Speaking of Toad for SQL Server, I'm not convinced there is a need for the product as SSMS is such a great tool. Microsoft really is sitting in a sweet spot right now by providing SSMS with the SQL Server license. Toad for Oracle is a necessity with the Oracle products. </span></div><span class="Apple-style-span" style="font-family: Tahoma, Verdana, Arial, sans-serif; font-size: 13px; color: rgb(68, 68, 68); "><a name="LETTER.BLOCK11" target="_blank" style="font-weight: inherit; text-decoration: underline; color: rgb(0, 104, 207); cursor: pointer; "></a></span>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-27964824921292420482009-10-28T09:00:00.001-04:002009-10-28T09:00:34.372-04:00Designing Quality ETL Processes<span class="Apple-style-span" style=" color: rgb(68, 68, 68); font-family:Tahoma, Verdana, Arial, sans-serif;font-size:13px;"><a name="LETTER.BLOCK11" target="_blank" style="font-weight: inherit; text-decoration: underline; color: rgb(0, 104, 207); cursor: pointer; "><table width="100%" id="ecxcontent_LETTER.BLOCK11" border="0" cellspacing="0" cellpadding="5" bg="" style="background-color: rgb(219, 232, 244); margin-bottom: 6px; color:#DBE8F4;"><tbody><tr><td valign="top" align="left" style="color: rgb(76, 63, 54); font-family:Verdana, Geneva, Arial, Helvetica, sans-serif;font-size:8pt;"><span style="line-height: normal; color: rgb(76, 63, 54); font-family: Verdana, Geneva, Arial, Helvetica, sans-serif; font-size: 8pt; font-family:Verdana,Geneva,Arial,Helvetica,sans-serif;font-size:78%;color:#4C3F36;"><div>ETL is the heart and soul of the data warehouse, so why does ETL job design and performance always seem to get little attention when schedules are tight? If it runs, it's fine, right? No! Follow the 'Durable Impact Top 5 Rules of ETL Design' below to develop quality ETL jobs and minimize your headaches with SQL Server Integration Services:</div><blockquote dir="ltr" style="margin-right: 0px; "><div>1. Always build jobs as modularized, stand alone components.</div><div> </div><div>2. Segregate jobs based on the importance of the data. Most needed data gets loaded first, etc.</div><div> </div><div>3. Build file extracts within a job and make every job restartable without having to restart the ETL process from the beginning. See #1 above.</div><div> </div><div>4. Parallelize only when necessary. With SSIS 2008, don't use manual parallelization, the backend engine is much improved removing the headaches of slow performance on large data sets.</div><div> </div><div>5. Use the tool best fit for the job. Example: When reading from databases, consider using the SQL ORDER BY command to presort data that must be sorted.</div></blockquote><div> </div><div>By following the 'Durable Impact Top 5 Rules for ETL Design' you can improve your performance and cut down on your support time. </div></span></td></tr></tbody></table></a></span>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-9452967742202580382009-10-26T19:28:00.002-04:002009-10-26T19:36:53.177-04:00It's a Great time to be in BIYes it is, a great time for BI. Why is this? BI saves customers money, customers spend a little money in a BI application or dashboard but save a lot more with intelligent data and all the good things that come with it. <div><div><div><br /></div><div>We just brought on a great person to fill the Marketing Services Consultant position at Durable Impact. Stay tuned for a blog introduction of this person and keep your eyes posted, we're soon going to be looking for at least five more SQL/BI Developers. Contact us on our webpage if you want to be notified when the positions open. It's always helpful to include a short paragraph or two about yourself and what interests you, so we have a good relationship from the beginning.</div><div><br /></div></div></div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-62624428287030277402009-10-17T22:20:00.002-04:002009-10-17T22:24:22.014-04:00Website ModeratorsThanks to everyone who attended my presentation today at SQL Saturday. It was a great crowd and I enjoyed it immensely.<div><br /></div><div>I am looking for one or possibly two website administrators. The position entails spending 1-2 hours per week working thedamndata forums. Your responsibilities will be to approve new users and posts, create postings, and remove inappropriate content. Again, this should only take one or two hours per week. The DI staff is doing it right now but it's keeping us busy dealing with spam bots, porn operators, and illegal prescription peddlers who continually wreck havoc on the website.</div><div><br /></div><div>This is an unpaid position, but as compensation for your time, you will receive a one-time $100 gift card to the retailer of your choice. We may provide other perks from time to time, but the primary reason we want someone is for their passion to speak and write about data and spend a few minutes assisting the website as required.</div><div><br /></div><div>Please email me using the contact us form at www.durableimpact.com if you are interested. </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-87035828233311516912009-10-16T18:17:00.002-04:002009-10-16T18:26:11.243-04:00Data Modeling ToolsMost software apps have a very strong following and drive strong opinions from the users, taking for instance Windows vs. Mac. Those who use Windows often don't understand Mac, and those who use Mac despise Windows. Data modeling is one tool where I haven't found this type of approach, almost everyone I've talked to either uses ERWin or has heard good things about it.<div><br /></div><div>I was working with a client this week who needs to get a data modeling tool. I've recently been working with some clients who have their own version of data modeling using Microsoft Visio and powerpoint slides, but this really isn't a good substitute for a true dimensional modeling tool. I've used ERWin in the past at a few clients and it's a great tool, allows one to reverse engineer the database, or better, to create a new model, creating the DDL for the model, and then versioning it for source control. The one problem with ERWin is that is isn't cheap, thus many look to Visio. Visio is a good tool in it's own right, but it's not a true data model tool yet. I suspect this is the direction that Microsoft is trying to go in and maybe with Visio 2010 it will meet that goal.</div><div><br /></div><div>One tool I was made aware of is Toad Data Modeler. Toad products are made by Quest Software, and I've been working with Toad for Oracle since the beginning. I'm very pleased with the Toad database products, and have already recommended to this client that they buy Toad for DB2, which they have done. I downloaded a version of Toad Data Modeler and my first take of the tool is that it's going to work great for what we need to do, and it's at a very attractive price point as well. </div><div><br /></div><div>I always stress to clients that they have a printed data model, typically where the developers can see it and visualize the relations between the tables in the model. </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-73991075274141245222009-10-06T07:30:00.001-04:002009-10-06T07:30:00.302-04:00Sales and Making SalesMy friend Andy had a blog posting last week about <a href="http://www.sqlservercentral.com/blogs/andy_warren/archive/2009/09/28/sales-people-amp-commission.aspx">sales guys</a> in the software field. Selling is always an interesting part of running a business and most likely the part that causes the most headaches, but without sales there is nothing else.<div><br /></div><div>I'm typically distrustful of most commission-based sales where I'm the consumer. This is true for auto sales or buying suits. I bought a suit last week at a major mall-based retailer and I asked the guy (after purchasing, bad on my part) if it was quality. He went to say something and then stopped, smiling and saying "everything we sell is quality". It's blanket statements like that that make me second-guess my purchase. </div><div><br /></div><div>I've stopped attending many industry events and meetings because they have turned into sales affairs. I attended one industry event where, of the approximately 60 attendees, at least 30 were sales guys hunting for leads and 20 were unemployed guys looking for work. The other 10 were people like me just trying to learn more about the product and maybe meeting a person or two in the process. I also wrote back in April about getting kicked out of an Oracle event that was a "briefing" but truly was a sales pitch. I've found a much different experience at true community events (like SQL Saturday), and while there is always the element of selling involved, it's not excessive. I have received a few unwanted emails from being on mailing lists coming out of these events, but that's more the exception than the norm. I hope that as SQL Saturday events grow they continue to stay true to their roots.</div><div><br /></div><div>This brings me to a conversation I had with a client recently. Selling consulting services is kind of like dating, sometimes it's smooth and sometimes it's not, sometimes there is a return phone call and sometime there is not. One of my major disappointments when first getting into this business is the amount of sales leads that seem very hot and then turn cold. It does come with the territory and one has to learn not to take it personally. Anyways, the client I was talking to described to me his process of choosing a company to perform the work. He spoke about other firms which had presented and how things had went with them. What it came down to, in his mind, was trust. I'm pretty plain-spoken which has it's strengths and weaknesses, but it worked in this case that this client believed what we (my partners and I) said, and our straight talk gave them a great sense of comfort. I can relate to that, as I stated earlier, I'm pretty reluctant when listening to sales pitches and always trying to understand all the angles of the discussion. It was pleasing to hear that at the end of the day, the time-honored traditions of honesty and integrity were able to overcome bigger names and slicker salesmen. </div><div><br /></div><div><br /></div><div><br /></div><div> </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com1tag:blogger.com,1999:blog-21519238.post-69609685794812235712009-10-03T21:54:00.004-04:002009-10-03T22:15:48.590-04:00A Bumpy FlightWhat was your first thought when you read the title "A bumpy flight"? Were you confused, trying to figure out if I was talking about the economy? Or did you think I was talking (as I do) in analogies? <div><br /></div><div>I was talking about both, and a true bumpy flight.</div><div><br /></div><div>In reality, I just returned from Dallas on <a href="http://flightaware.com/live/flight/AAL698/history/20091003/2217Z/KDFW/KTPA">this</a> flight. The 2 hour flight was quite bumpy the entire way, so much that the flight attendants were told to sit down multiple times and barely completed the meal services before landing. I find myself to be a fickle flier and the slightest bumps make me a little nervous, not really because of safety concerns, but I always think the next round of bumps will lead to one of those massive bumps we see on CNN causing multiple injuries. Thankfully we didn't twist a tail and I'm here to tell you about the time this past week that I used the "bumpy flight" analogy.</div><div><br /></div><div>We just started working with a large client on a data warehouse project. I will talk more about that later, but suffice it to say most would have heard of the name. A partner and I spent the past week working with the client on data discovery and trying to get them set up for the project. A critical part of the project is setting appropriate expectations. This company has never had a data warehouse before, so it's a "greenfield" development project. This is the best kind, from my opinion, because we get to do things right the first time. A majority of our projects to date have involved enhancing or repairing someone else's work so this is a welcome change as a different kind of challenge. Part of my duties this week were to work with senior management (CFO and Director level) to get an idea of what they wanted from the project and try to answer any questions they had about the process. I really enjoy working with management and listening to their concerns, that is true consulting at it's best. </div><div><br /></div><div>I had a great meeting with the chief product engineer. Part of answering the business questions requires a deep understanding of the business. This person had a lot of great comments and thoughts and our scheduled thirty minute meeting quickly turned into a great two hour discussion. Being a good engineer, he was very interested in risk factors for the project and wanted to know what risk mitigation plans I had prepared. It's true that starting any project risks missing a key requirement and the best way to mitigate that risk is to keep the business users as closely involved with the process as possible. He was satisfied with that answer and as a follow up comment I used an analogy that brings us to the title of this posting. I explained to him that a new data warehouse project will have it's growing pains and to expect them, I told them that "it's similar to a flight from Dallas to Tampa where it's bumpy the whole time. There will be times that we all wonder why the air isn't smooth and there will be bumps along the way but the safety of the aircraft is never in question and we have complete confidence we will arrive safely at our destination." </div><div><br /></div><div>I love analogies, especially when they come true. </div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-74471006017880668652009-06-09T16:36:00.002-04:002009-06-09T16:42:39.856-04:00SQL Server DBA / Reporting ServicesHello all, I'm going to keep this short today. DI is needing to grow our stable of consultants, and specifically I'm looking for a couple positions with the following:<div> - SQL Server DBA experience</div><div> - Experience with 2005 and/or 2008</div><div> - Prefer 2005 to 2008 upgrade experience</div><div> - SQL Server Reporting Services experience</div><div> - Reports in 2005 and/or 2008</div><div> - Using analysis services for cubes</div><div><br /></div><div>We will sponsor your MCDBA or other Microsoft certifications. The first test is to see if you can figure out the email address below! </div><div><br /></div><div>Please email me at: resumes at durable impact dot com so we can start a discussion.</div><div><br /></div><div><br /></div><div><br /></div><div><br /></div>Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-32278312721074073812009-06-01T05:47:00.001-04:002009-06-01T05:47:00.694-04:00Employee vs. Consultant, Topic: InsuranceToday we'll talk about the differences in insurance between working as an employee and working for yourself. Yesterday I explained the difference between contracting and consulting, but both types are considered (by the IRS) to be self-employeed unless they receive a W2, and then you're an employee<br /><br />Companies began providing insurance as a benefit to attract workers after the shortages in WW2. This benefit has grown into the extreme mess we call "health care" today in the United States. The problem here is that we spend the most on heathcare of any country yet do not receive the best care. Bear in mind, there will be a lot of economics discussion today, but it's necessary to understand the point.<br /><br />Employers, being the de-facto providers of health care, have a few advantages going for them. The first is adverse selection. Every company will have some people who require recurring care (cancer, diabetes, etc) and some people who require no care, so the insurance pool overall will skew towards the median care requirement being right in the middle. Thus, the portion of insurance for each person will be say, $200, of which the employer picks up $150 and the employee pays $50. (Assuming a single person here). The employee portion of $150 is considered a benefit (and a tax writeoff) to companies.<br /><br />Let's take the same person under a self-employed scenario. Now, this person knows their own health. We call this moral hazard. They know their favorite foods are cheese fries and buffalo wings. They also know their family history of heart disease. They do not reveal this to the insurance company though when this person purchases insurance for $200 a month, of which the insured is responsible for the entire amount.<br /><br />There is another self-employeed person who is very fit, has no history of family disease, eats healthy, but balks at paying $200 for heath insurance the person does not think he needs. This is where adverse selection comes into play, as only the sick people or people who believe they will need care buy insurance, and the healthy do not. That is why private cost plans are cost prohibitive. There are some ways around this, as credit unions and other firms try to "pool" people together to buy insurance at discounted rates, to "pull" both of the people (heathly and unhealthy) to buy insurance and average out the risk again. However, this still presents major problems for insurers, who are in the business to make a profit.<br /><br />Now we enter into the political debate as to whether to force people to buy insurance on the private market, providing the pooling mechanism, or to have the insurance provided by the federal government which again provides pooling. I'm not going to get into this futher except to state that either of those options is preferable to me versus the current option of employers providing insurance.<br /><br />For those who accept the risks of self-employment and need insurance, there are multiple things you can do. First is to buy a full plan on the open market, which is very cost prohibitive. There is something called a HSA (Health savings account) which when linked with a high-deductible plan, allows people to retain insurance for catastrophic occurences but also has high deductibles to discourage the overuse of the insurance. (If you're interested, this is what I do). If you're married to a partner who has corporate insurance, maybe the best option is to use that person's plan.<br /><br />If you're going to consider the cost of health insurance in your criteria, factor in the full cost. Employee contibution is $50 every two weeks, and private insurance is $100 a month. Therefore, the premium expense is equal. There are other costs to be factored in here, such as office visit deductibles, but remember that cash is king, and while on corporate insurance I had a prescription once that was a $37 co-pay, but only $21 cash price.<br /><br />If you're thinking of becoming self-employeed understand that there are options available to you, and with the looming discussion of health-care reform, the options may be more attractive and remove it as a key decision making point in the future.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-27003871484264496302009-05-31T05:33:00.001-04:002009-05-31T05:33:00.141-04:00Consultant vs. ContractorBefore we go any further in the "Employee vs. Consultant" discussion, I want to clarify a few things. There is a difference between consulting and contracting. Many times the words are used interchangably but this is not correct. I'm certain others will have a differing point of view, but here's mine.<br /><br />Contracting: hired to do specific tasks, not always a specific range of subject matter expertise needed, for a given duration, very little overview<br /><br />Consulting: hired specifically for expertise, asked to advise on processes and output, may do some tasks, but work closely with management and employees to instruct and guide<br /><br />When I first started out I was contracting, but then moved to consulting. Consulting is where you can really make a difference, contracting is more like being a temp employee. Just today I was participating in a conference call with a client, discussing the way a dimensional model is built. One of the attendees asked me why I put both the surrogate key and business key in the fact table, and I replied that I did it in case the surrogate keys were corruputed, to aid in rebuilding them and also for research. Another voice popped up and said that was a good standard for moving forward, and now it looks like that client will be using that process in the future.<br /><br />Contracting is different though, it's like signing a contract to run a couple thousand test plans against a new piece of software. That requires experience to execute the plans and report results. The difference is that during the requirements gathering and design review, a consultant who had worked with other systems in the industry was brought in to review and provide thoughts for product enhancement. It should be clear that there is a difference in executing a script and advising business process owners and management on features.<br /><br />There are key differences between contracting and consulting, and it's good to keep them in mind when reading my posts.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0tag:blogger.com,1999:blog-21519238.post-66811422236957765872009-05-30T05:04:00.001-04:002009-05-30T14:44:23.669-04:00Employee vs. Consultant, Topic: StabilityIt's been about a year ago when I wrote my first post about the differences and trade-offs between working for someone and working for yourself. My conclusion then was that you should add up the costs and benefits of everything and then make the best decision. The problem is that the true costs and benefits are obscured and it's hard to make an informed decision. I decided to expand on the topic and have a couple different posts exploring different dimensions of making the best decision for you.<br /><br />In December 2008 I received a phone call from a friend, the type of call that you never want to receive. He informed me that he had been let go from his corporate job. He's not too far from retirement and almost had his house paid off and was well thought of at his job, but the management had to make a decision that I'm sure was not easy. He was shell-shocked, but quickly recovered and found something with little overall loss in pay and benefits. His statement to me "I thought it would be my last job" was telling. In his mind, he was relatively safe, having traded some dollars in pay (though not much, he was doing quite well) for perceived stability. All of my clients have let people go since last year. I wonder how many of them believed they were safe too. More to the point, I wonder how many believed they were safe and traded a decent amount of salary for that security which they did not receive?<br /><br />What would you do if you have the choice of two jobs that<br />- Company A: $78,000 a year, history of mass layoffs and hire/fire shop<br />- Company B: $70,000 a year, history of never having a layoff<br />Consider all other benefits as being equal. What would your decision be?<br /><br />This is a true life scenario of another acquantance of mine. She picked company B, and two years later the company, well known for it's stability (both good and bad) was sold and everyone was laid off. In that two years, she traded $16,000 of salary for perceived stability. After taxes, you have a new Ford Focus. To be fair, there is no guarantee that she would have made two years at company A, but the economy was growing and during that time A did not have any known layoffs.<br /><br />The point of my exercise, in case you missed it, was to try and remove stability from the equation as much as possible, as stability is a factor that is so far outside of an employees' control. Look at local Tampa company <a href="http://www2.tbo.com/content/2009/may/22/sp-wellcare-will-cut-200-jobs-in-tampa/">WellCare</a>, a stable company that just did a massive layoff due to some fraud charges. How many DBA or business analysts had any control over that?<br /><br />Consulting hasn't been too much better over the past year. Many projects have been cut, cutback, delayed, etc and some consultants and contractors have been enjoying time at home. A consultant I know who lost a project was quite concerned and told me he only could survive 2 weeks without a steady gig, if that. Without knowing the details or being judgemental, that's not a good position to be in any way, but in that case being an employee might be a better route as generally layoffs include some kind of package or unemployement, where self-employed does not. (In case you're curious, he went exactly two weeks between projects).<br /><br />In conclusion, I recommend completely ignoring any discussion or talk about job stability and focusing on other aspects before you make your decision.<br /><br />Coming up next: Health care, the most dreaded expense.Wes Dhttp://www.blogger.com/profile/03801362902621931257noreply@blogger.com0