Showing posts with label Information. Show all posts
Showing posts with label Information. Show all posts

Monday, February 12, 2018

Part Three: The Analytics Strategy and Roadmap - A Use Case Driven Plan to Incrementally Build an Analytics Capability Powered by Big Data

In the previous blogs of this three-part series, I addressed a clear analytical divide that has grown in the industry, where relatively mature BI shops are at a definite advantage over most organizations that have yet to fully realize an analytics capability powered by big data. The first blog in this series identified the critical capabilities needed for analytical success with big data, and the many impediments, both technical and organizational, that are holding companies back.
Building on this idea in the second blog, I outlined why the attempt to take a ‘big bang’ approach to big data, by first putting all of the enterprise’s data into a data lake, is not likely to succeed because it returns little ROI in the short run and has major investment, governance, and skills requirements. Instead, I proposed establishing a multiplatform data warehouse environment (DWE) with an architecture pattern that's designed to accommodate immediate used cases with specific goals and measurable ROI, so the program can fund itself along the way.
In this approach, the requisite analytics capabilities will be gained through a managed transformation, an incremental build up in a phased approach, where the big data journey is mapped in clear, achievable but increasingly challenging milestones that induct the different nature and types of big data. The strategic roadmap on big data will be formulated based on these early successes, with more participation and sponsorship of the business when it starts to see value from this technology. That will help refine the tactical aspects of the strategy execution.
In this blog, I present a four-phased roadmap to get there, each phase building the pre-conditions to succeed with the next. The phases will of course overlap when work on a previous phase continues with other use cases. I will cite telecom use cases in the customer experience domain only to illustrate the comparative progression and analytical maturity in each phase.
We have presented a practical roadmap to big data and analytics adoption based on successful practices in industry. This plan presumes nothing and builds on successes at each phase generating the pre-conditions for the next.

The use-case driven approach starts with more technical IT driven challenges and matures eventually to departmental operational decisions and finally to strategic decision support. The maturity looks like this: Data Warehouse Off-Loading, 2) Operational BI, 3) Operational Analytics and 4) Strategic Analytics. The use cases will have to be evaluated in two major dimensions: the implementation capability and capacity needed, and the degree of organizational change required relating to their impact on current business processes.
In the early part of the transformation, the big data initiatives will be more technical in nature and localized at the department level. They will require the least additional skill and have positive, if minimal impact, to business processes. In the later stages, the evolving use cases will have wider business impact and will demand more capacity and technical and organizational capabilities in big data. The final stage involves analytics adoption for use in organizational strategic planning.
As the later stages involve use cases that are more operational and strategic in nature, which can impact processes across many departments, they will demand a more robust organizational change management program to manage the change across different participating groups and additional governance requirements. Large companies will have multiple big data teams, and as the organization builds more advanced big data capabilities, teams will need to come together for interdepartmental use cases.

Phase 1: Offload data and workloads from legacy systems and the enterprise data warehouse


Like most other IT systems, as data warehouses age, their design and enabling technologies can become un-scalable in terms of their economics and performance. Adopting multiplatform data warehouse environments would solve many data storage and performance issues, which is why it is one of the strongest trends in data warehousing today. In this phase, high volume detail transaction data storage and processing will be off-loaded to a Hadoop platform, reducing the storage and computing resource requirements of the relational data warehouse platform. From a business viewpoint, this is a non-disruptive task. It preserves existing investments in data warehousing, and (when done well) it extends the life of an expensive and useful system.
The off-loaded detail data, which is hardly exploitable in a traditional RDBMS will also become amenable to analytic exploitation because of the linearly scalable architecture of Hadoop, increasing the value of these detail data to the business: they will be able to get valuable insights from this detail data with the right questions. Organizations can also explore the possibility of monetizing these detail data. For example, location-based and movement-over-time data can be obtained from Call Data Records in the telecom industry. Inducting mainframe data and/or offloading the processing to Hadoop, active archiving of historical data also is other example of IT use cases for this phase.
This phase will require a relatively small investment in the big data cluster: between 6-10 nodes depending on the data volume to be off-loaded. In terms of investment and ROI, typically this phase will pay for itself in terms of reduction in infrastructure costs, improvement of performance of ETL processes and reports, and in the additional value in detail data.
The foundation of big data capabilities for the organization will be laid in this phase: IT will get a foothold in Hadoop skills on familiar existing structured data. Data governance policies will be applied to the data off-loaded to Hadoop, and in doing that, the finer aspects of practicing the data governance principles and policies will be sorted out, again, on familiar territory of the data. An Agile development methodology with DevOps should be inducted in this phase, delivering value as early as possible while streamlining the support functions to the big data program.

Phase 2: Operational BI (event processing)


While the first phase is based on batch processing, the next will be based on near-real-time and subsequently real-time processing—starting with processing structured data, progressing to semi-structured and unstructured data.
It can start with rule-based event processing use cases on structured data (like fraud detection for telecom), which can happen in near real time, and then move on to processing more voluminous structured data in a more real-time basis (like identifying potential Mobile Switching Center failures and re-routing more profitable customers to a different Mobile Switching Center in real-time to avoid service degradation).
Semi-structured and unstructured data can be inducted for real-time event processing after these successes. Some telecom use cases could include analyzing customer interactions captured by a call center application to identify the key problems customers are complaining about. Sentiment analysis on this data can provide the intensity of customer dissatisfaction around these problems. The text analytics can be further improved by transcribing the recorded calls and using transcripts for this analysis. Further, voice analytics can be applied on recorded calls to measure the customer’s mood associated with the complaints. These analyses will not only provide statistics on overall complaints, but will be able to identify dissatisfied high-value customers in real time.
In this phase, the algorithms are mainly rule-based and fairly deterministic in nature, and the use cases can be limited by actionability and deployment confined to a single department, typically the departments that are showing more traction with the big data initiative, thus improving the chance of building more accurate models and ensuring deployment and use in operations.
The organization will develop the Hadoop data integration skills for different types of data in this phase. They will now have gradually developed a fairly advanced data governance capability and should have established data management policies and processes around it for these more exotic data types. There will be more pervasive use of these data sets by analysts through self-service exposed in analytical sandboxes. The induction of these new data sets will be closely linked with business use cases, data management practice (in terms of data ownership and accountability), ensuring enough data quality, capturing business metadata, security and privacy aspects, etc. Ideally it should not have great impediments and should have the requisite backing from the quarter of the business that will benefit from the use case. The data management process should be formalized through these implementations, developing the requisite controls and artifacts.
These parts of the business will now have adopted the use of big data and would have started realizing benefits out of it. The organization will now be at the “Analytical Practitioners” level. The big data cluster will get much larger with induction of these new high-volume data sources, but ideally it will be funded by the departments deploying the use cases.

Phase 3: Operational analytics


In phase 2, the data lake has been hydrated with varied structured, semi-structured, and unstructured data, and insights have been obtained from them. Typically, these datasets will progressively provide the customer 360-degree view, aggregating data from all customer touch points.
In phase 3, these insights can be combined using advanced analytic techniques to obtain predictive operational intelligence. For example, customer churn models will be deployed based on various types of data obtained on customer interactions in the previous phase. Campaign management algorithms can be refined based on this addition information. Call center data volume in different categories can be forecasted based on historical patterns.
Until phase 2, the big data program was tactical and bottom-up. Now it needs to be met with a top-down strategy to be effective at this next level. The input data as well as actions out of the insights from the use cases will typically span across departments. Hence, the big data program will need to have strategic direction and sponsorship at this phase, ensuring leadership support for identifying which operational areas analytics can be used to improve customer experiences most effectively, and to ensure that the insights obtained drive and enhance the business processes involved.
This leadership is essential for gaining buy-in from managers in sales, service, and support functions applying such insights. Through such leadership, analytics professionals will be able to collaborate with business managers to refine the algorithms and gain feedback about what worked and what did not in applying the analytics in real-world sales, service, and support. Active participation from the business will also be needed in data governance in respect to usage of data and the related privacy issues, which will be more prevalent in this phase. But, success in the previous phases should ideally ensure this participation and sponsorship.
The role of data scientists and domain specialists will become critical in this phase, and the company will have to invest in these skills. The organization is now moving towards being insight driven. Here, the business owners are putting faith in the predications and forecasts from the predictive models, and the organization has the critical skill base and a robust data management capability. The people, the process, the data, and the technology is in place. They have become “Analytical Innovators”. Organizations will catch up with the advantage of competitors and probably break away from them based on the success in this phase.

Phase 4: Strategic analytics


In this phase, adoption of analytics pervades the organization, and the most critical business processes become insight driven. Now the CXOs consult the analytical insights in their decisions, and more strategic decisions also take the big data ‘outside in’ view into account. The enterprise planning becomes more agile by including external drivers derived from the big data, making it more responsive to changes in market conditions and customer behavior. For a telecom company, this would mean analytics driving their strategic planning on product mixes, new products, cell, tower planning, etc.
The gradual transformation of the decision-making culture culminates in use of data to make smarter business decisions to drive creativity and innovation, bringing it to the frontiers of the practice of analytics. At this point, analytics having a huge impact on the bottom line is an established correlation.

The next step in the big data journey


Success with advanced analytics has many daunting pre-requisites that put the relatively mature BI shops at clear advantage, yet an agile management culture tuned to the rapidly changing market conditions is going to be a pre-requisite to survival, if not success, in the next decade—adopting analytics is no longer a choice.
We have presented a practical roadmap to big data and analytics adoption based on successful practices in industry. This plan presumes nothing and builds on successes at each phase generating the pre-conditions for the next. It starts from IT use cases with no business impact, progressing to more and more impactful use cases as the requisite capability develops. This generic and high-level roadmap can be customized for an organization, depending on its business challenges and opportunities, its current analytical maturity, and its internal challenges towards big data adoption.

Thanks to Suman Ghosh from TCS for enlightening us on the concepts.
Source:-
K@run@

Sunday, December 2, 2012

DRDO Interview Questions for Electrical Engineers


Ramana my Friend's DRDO interview Questions:

Chairman:

1. What are the various experiments you have done in your machines lab
2. How the vibrations are produced from mobile phone when it is in that mode

Departmental Expert-1:

1. Why your eyes are in red colour, don't you have enough sleep yesterday night
2. what is your favorite subject
3. What is meant by zpf... this term is related to which machine
4. What is meant by reluctance motor
5. write the expression for power developed in salient pole synchronous motor?
6. what is meant by load angle in detail
7. Can you explain hunting breafly..?
8. Is there any method to reduce hunting...?
I think you studied power system analysis in your B.Tech....not power systems, power system analysis

9. what are the various quantities required for design of power system
10. Can you tell me the method for power system stability analysis
He gives clue for above question
11. Explain equal area criterion analysis method

Departmental expert-2:

1. this question related to communication subject
2. what is meant by stepper motor
3. how the steps can achieve
4. what is meant by BLDC motor
5. what is the constructional and operational difference between BLDC motor and DC motor
6. without the brushes and commutator how can you achieve the current reversal?
for the above question Departmental Expert-1 gives 50% answer as clue...
7. what is the purposes of commutator in DC machines
8. In diesel engine trains how the exact system is there inside
9. How can we get the supply for fans and lights in trains
10. Name the special generator used for above...?
for this question departmental expert-1 gives full answer

External expert:

1. instead of using AC transmission why we are using HVDC
2. What is the main adv. and dis adv. of HVDC
3. can you learn about the earth fault circuit breaker in houses
4. what is meant by MCB? how it works? which type of CB it is?

Departmental expert-1:

1. apart from the losses, cost etc etc..... the advantage of HVDC over any other....

..................................@@@000@@@...............................

Lastly the departmental expert-1 asks Well Mr. Ramana suppose if you are selected in this job, afterwards you got
other job based on B.Tech (example in ISRO that is also a R&d org.)then what do you do....

K@run@

Tuesday, November 20, 2012

Bike Riding Tips and Tricks

Now a days the youth are more passionate about their bikes and adventurous rides with it. The bikes and stunts are really a guy thing which drives the riders to crazy fun like nothing else. But they don’t realise the risk underneath their stunts until they are once experienced for. The following tips will be quite useful for the begginers who are going to be a good riders in future. With all senses a rider has to control the following:
 • Brake 
• Clutch 
• Acclerator 
• Signals lights 
• Sharp turns 
• 150 degree view ahead 
With perfection in these the ride will be under control and happy....but lacking in any thing of above may result in severe disasters.. Common mistakes by Riders: 
• Applying brakes while crossing sharp turns which result in skidding of vehicle. 
• Making the vehicle to run down street with engine off. 
• Not maintaining the center of mass of (bike+rider) jointly.
 • Careless ride by consuming alcohol.,etc.
If you can’t turn a crossing sharply then just apply brakes ahead and then slowly make the turn rather than skidding over the road. Riding the bike downwards with engine off makes the rider to loose control over the vehicle.Remember that an engine in On state works greatly than the engine in Off state.The person should understand his bike well enough to maintaine the center of gravity always aligned in correct manner.The following fig shows the difference
By carefull pressuring up your weight on the foot rest will do a great job under sharp turns. Always drive on the right side of the road and for some countries like India you should align yourself on the left side of the road as per the traffic signs and signals.Use hand signals when ever and where ever necessary.
YOUR DEAR ONES ARE WAITING AT HOME, THINK ABOUT THEM AND DRIVE SAFE. K@run@

Sunday, September 9, 2012

Thursday, July 5, 2012

HIGGS BOSAN---Proton sub particles

Great invention for the decade which gonna change the future......Higgs Bosan was discovered after blasting the protons......many scientists strived so hard for 50 years for this....including our indians....Named as Higgs BOSan after the Indian scientist BOSE
K@run@

Friday, March 2, 2012

Overview of WINDOWS 8

If you have been following all the good press around Windows 8 and are waiting to try it on your own computer, here’s the good news. The consumer preview version of Windows 8 (just a fancy name for beta software) is now available for download and it is very likely that your existing system specs are good enough to run Windows 8.


The System Requirements for Windows 8


According to the Windows 8 FAQ, any machine equipped with 1 GB of RAM, 16 GB of hard disk space and 1 GHz processor should be able to handle Windows 8. The minimum RAM requirements are 2 GB in case you would like to install the 64-bit version of Windows 8.


Should you download Windows 8 Setup or the ISO Image?


As you may have noticed on the Windows 8 download page, the installation of Windows 8 can be done in two ways.


You can either take the easiest route and download the Windows 8 Setup program – that’s also the default option.
Alternatively, you can download ISO Images of Windows 8.
If you are planning to install Windows 8 on your existing computer, either on a different partition (dual-boot) or just want to upgrade an older version of Windows to Windows 8, the default Setup program is a good choice.


Please note that that your installed software program will only be preserved if you are upgrading from Windows 7 to Windows 8. If your planning to install Windows 8 on top of Windows XP or Vista, only the files will be preserved but not the various software programs that you may have on the disk.


The ISO image may be more handy in other situations like:


Your computer has an x64 processor but is running the 32-bit version of Windows. If you want to install the 64-bit version of Windows 8, download the 64-bit ISO.
You have an iMac or MacBook and want to install Windows 8 on the Mac using Boot Camp software.
You want to install Windows 8 on multiple computers. Download the ISO, create a bootable DVD and boot the other system using this Windows 8 disk.
You want to run Windows 8 as a Virtual Machine inside your existing copy of Windows.
You are running Windows XP.
The universal product key for Windows 8 is NF32V-Q9P3W-7DR7Y-JGWRW-JFCK8.


Will my software programs run inside Windows 8?


Before grabbing the ISO image of Windows 8, quickly run this setup utility and it will show a list of all software programs and hardware drivers on your system that are compatible with Windows 8. Else you can visit this page to see a list of all known software that are found to be working with Windows 7.


What route should you take?


You can have Windows 8 on your computer in three ways – you can install Windows 8 side-by-side (also known as dual-boot), as a virtual machine (so that it runs inside your existing Windows just like any other software) or Windows 8 can be your main OS (there’s no going back then).


If you just want to try out Windows 8 but without disturbing any of your existing set-up, the safest bet is to use a Virtual Machine. If you have a vacant partition or don’t mind creating one (it’s easy), go for the dual-boot option. Else, if you have a spare computer, you can consider upgrading to Windows 8 overwriting the previous installation of Windows. Good luck!
K@run@

Sunday, January 8, 2012

Tricks with GOOGLE

All google Tricks :

GO TO GOOGLE....

1> Type in “Google Gravity” and click on “I’m Feeling Lucky”(wait a sec to experience the effect of gravity.)

2> Type in “elgoog”and click on “I’m Feeling Lucky” (the Mirror effect is on.)

3> Type in “Google Sphere” and click on “I’m Feeling Lucky” (see the spinning effect.

4> Type in “who is the cutest” and click on “I’m Feeling Lucky” (see who’s so cute and beautiful/handsome.)

5> Type in “Google Loco” and click on “I’m Feeling Lucky” (see what’s moving.)

6> Type in “ LOL Limewire” and click on “I’m Feeling Lucky” (see that you are as a pirate.)

7> Type in “Epic Google” and click on “I’m Feeling Lucky”

8> Type in “Rainbow google” and click on “I’m Feeling Lucky”

9> Type in “Google pacman” and click on “I’m Feeling Lucky”

10> Type in “Google color (Ex: pink,blue)” and click on “I’m Feeling Lucky”

11> Type in “weenie google” click on “I’m Feeling Lucky”
K@run@