Challenges Facing Government in Adopting and Implementing DataWarehouse

-

 Major Challenges Facing Government in Adopting and Implementing DataWarehouse

According to (Jiawei Han et al), major challenges faced by data warehouse while implementing effectively in government are: the need for scalability, reliability, security concerns, traditional and conventional practices, open standards and interoperability, resole potential legal issues, redefine the roles of IT workforce, access the Return on Investment (ROI) of data warehouse, lack of skilled manpower and technologies.

However, in the context of Nepal, the challenges facing the adoption and implementation of a data warehouse are mentioned here :

1) E-Readiness: As discussed earlier, Nepal has not succeeded to access its degree in the status of e-readiness.According to the Economic Intelligence Unit, Nepal is ranked 135th position out of 193. Hard work thus, is seen to overcome this situation. Healthy and careful strategies are needed to create an enabling environment to improve e-readiness.

2) Standardization: The concept of a data warehouse in e-governance is a new technology in the context of Nepal. No research and study are done in making government standards and protocols for the implementation of data warehouses in the e-governance of Nepal. The absence of such standards creates varied implementation models for the data warehouse designers and service providers. So, there will be a problem with compatibility. While lacking such standard protocols, effective implementation of a data warehouse cannot be assured.


3) Scalability: The need for IT resources is dynamic. The government may require less or high resources as per the workload on the system. A data warehouse is one of the most important technologies that affect the ability to maintain the level of flexibility without interruption.


4) Reliability: Reliability is another major challenge for the government in adopting and implementing data warehouse technology. The risk of data loss is always a crucial concern. Likewise, the anxiety of data unavailability and inaccessibility are other factors. Such risk and the blame fall under the responsibility of IT. A data warehouse should be resilient to internal and external system issues and provide faster uptime than the legacy system.


5) Technical skilled Manpower: It is seen that the government is going understaffed. And hence lacks sufficient skilled IT professionals. So while migrating to data warehouse technology, a huge number of IT resources will be required with different skills than those in the legacy system. There will be less manual work needed, both in data centers and in the other government units.


6) Regulatory Issues: The government should develop a standard for service implementation. A regulatory body is required which closely monitors the data warehouse maintenance, operation, and regulation.



7) Control: Data warehouse technology implementation centralizes all the infrastructure and services. So, the management of the data warehouse will be a great challenge for the government as there is a lack of sufficient skilled IT resources and manpower.


8) Legislation, Social, Political problems: The data warehouse concept is one of the best tools for a nation and the most powerful and legitimate tool to create advancement, transparency, and speedy in governance.


9) Security: Last but not least, security issues matter. Talking about reading, storing, accessing governmental data, i.e., very confidential one security issues arise. It is challenging to assure the government policy level personnel that the data warehouse is secured and privacy is maintained. Secure and efficient data exchange across the different government agencies and data warehouses, as well as secure application connectivity, is always the major security concern.

































Comments

Post a Comment

Popular posts from this blog

Suppose that a data warehouse for Big-University consists of the following four dimensions: student, course, semester, and instructor, and two measures count and avg_grade. When at the lowest conceptual level (e.g., for a given student, course, semester, and instructor combination), the avg_grade measure stores the actual course grade of the student. At higher conceptual levels, avg_grade stores the average grade for the given combination. a) Draw a snowflake schema diagram for the data warehouse. b) Starting with the base cuboid [student, course, semester, instructor], what specific OLAP operations (e.g., roll-up from semester to year) should one perform in order to list the average grade of CS courses for each BigUniversity student. c) If each dimension has five levels (including all), such as “student < major < status < university < all”, how many cuboids will this cube contain (including the base and apex cuboids)?

-
Image
a) A Snowflake Shema is shown in figure below: b) The specific OLAP operations to be performed: 1. Roll-up on course from course_id to department. 2. Roll-up on a student from student_id to university. 3. Dice on course, student with department ="CS" and university = "biguniversity" 4. Drill-down on a student from the university to student_name. c) N = 4 dimensions The cube will contain 54 = 625 cuboids.
Read more

Suppose that a data warehouse consists of the four dimensions; date, spectator, location, and game, and the two measures, count and charge, where charge is the fee that a spectator pays when watching a game on a given date. Spectators may be students, adults, or seniors, with each category having its own charge rate. a) Draw a star schema diagram for the data b) Starting with the base cuboid [date; spectator; location; game], what specific OLAP operations should perform in order to list the total charge paid by student spectators at GM Place in 2004?

-
Image
  b) The specific OLAP operations to be performed are: 1. Roll-up on date from date id to year. 2. Roll-up on spectator from spectator id to status. 3. Roll-up on location from location id to location name. 4. Roll-up on the game from game id to all. 5. Dice with status= “students”, location name= “GM Place”, and year=2004
Read more

Explain Parallel Efficiency of MapReduce.

-
Image
 PARALLEL EFFICIENCY OF MAP-REDUCE It is worth trying to figure out what is the parallel efficiency of MapReduce. Now let us assume that the data produced after the map phase is σ times the original data size D (σD), further, we assume that there are P processors which in turn perform map and reduce operations depending on which phase they are used in, so we do not have any wastage of processors. Also, the algorithm itself is assumed to do wD useful work, w is not necessarily a constant it could be D^2 or something like that, but the point is that there is some amount of useful work being done even if you have a single processor and that's wD. Now let us look at the overheads of doing the computation wD using MapReduce. After the map operation, instead of D data items, we have σD data items in P pieces, so each mapper writes data to their local disk. So, P there is some overhead associated with writing this data. Next, this data has to be read by each reducer before it can begin ...
Read more