The comparison between a Goldsmith and Data Management
Imagine a sparkling diamond ring, the perfect piece of jewelry where craftsmanship and precision come together. Before this diamond encased in a ring reaches the showcase, it has gone through a long process. This process is surprisingly similar to Data Management. Just as a goldsmith transforms rough diamonds into a magnificent jewel, a data professional ensures that raw data is transformed into valuable data products.
From raw material to polished value
The process starts at the source. Diamonds are mined, mainly in Africa. The rough gems are then collected and traded, with Antwerp playing a crucial role – some 85% of all rough diamonds pass through here. The diamonds are then sorted for different properties, and processed for a variety of applications, each with its own value, such as a beautiful ring, for example!
It’s no different for data. It is mined from all corners of an organization but also beyond, and brought together in a central place. After this, the data is sorted for different applications, and according to the application, specifically processed to finally become available as a data product
Just as a diamond in the rough has not yet revealed its true beauty, raw data without processing is not yet usable for its intended purpose. A lot has to happen before the diamond can truly shine.
‘Just as a rough diamond has not yet revealed its true beauty, raw data without processing is not yet usable for its intended purpose.’
The diamond and its equation with data
To fully express its beauty, a diamond needs a ring and a solid setting. You can also draw that parallel to data.
The diamond is like AI. It is the shining centerpiece that attracts the most attention and adds the greatest value. With AI, value is extracted from data in the form of efficiency in processes, increased productivity, innovation and growth.
A solid ring is like data governance. It forms the foundation and structure that holds everything together. Without a solid ring, the whole structure would fall apart. Just as data governance ensures clear rules and guidelines for managing data, the ring ensures the integrity and security of the whole structure.
The setting of the ring is like data management. It ensures that the diamond remains firmly in place and well presented. Good data management ensures that data is organized, accessible, usable and reliable.
The Aiken Pyramid
Another way to visualize the above, but purely focused on data, is with the Aiken pyramid. The Aiken pyramid offers a structured approach to data management, with each layer building on the previous one to create a solid foundation for advanced data applications.
Data governance forms the foundation of the pyramid. It provides clear rules, processes and structures that ensure data integrity and security. Without this foundation, the entire pyramid would collapse because there is no consistent and reliable basis for data management.
Data management capabilities build on this governance by making data well-organized, accessible, usable, and reliable. This includes aspects such as metadata management, data quality, data processing and data distribution, which ensure that data can be used efficiently and effectively. Good data management is essential to maximize the value of data and ensure compliance with data governance guidelines.
Best of Suite versus Best of Breed in the Context of the Aiken Pyramid
Both in the world of jewelry and in data management, consistency and precision are essential. Just as a jeweler uses different techniques and tools to create a perfect diamond ring, as a data manager you are also looking at a large set of ‘capabilities and tools to achieve effective use of data. The question is whether it is wise or necessary to buy a separate tool for everything or approach this in an integrated way. Do you buy a complete ring or do you see benefits in a separate ring, setting, diamond, and a tool kit to assemble the ring. When it comes to data, we speak of a ‘best of breed’ or ‘best of suite’ approach.
‘Do you buy a complete ring or do you see advantages in a separate ring, setting, diamond, and a tool kit to assemble the ring.’
The choice between a ‘best of suite’ and a ‘best of breed’ approach is a crucial decision for organisations looking to optimise their IT infrastructure. You can also analyse that choice using the Aiken pyramid.
Best of Suite
A ‘best of suite’ approach involves choosing an integrated set of applications from a single vendor. This suite typically offers a wide range of functionalities that work seamlessly with each other.
Advantages:
- Integration: The applications within the suite are designed to work well together, simplifying integration and data exchange between different systems.
- Easy management: As all applications come from the same vendor, IT infrastructure management is simpler and there is a single point of contact for support.
- Consistent user experience: Users benefit from a consistent interface and user experience across applications.
Disadvantages:
- Limited flexibility: The organisation is dependent on the functionalities provided by the suite, which can lead to limitations if specific needs are not covered.
- Vendor lock-in: It can be difficult and costly to switch to another vendor once the organisation has invested in a suite.
Best of Breed
A ‘best of breed’ approach means choosing the best applications for specific functions, regardless of vendor. This results in a mix of solutions that each excel in their own domain.
Advantages:
- Optimal functionality: Organisations can choose the best tools for each specific task, leading to higher quality and better performance.
- Flexibility: There is more freedom to choose and change vendors and solutions as the organisation’s needs evolve.
Disadvantages:
- Complex integration: Integrating different applications from different vendors can be challenging and often requires customisation.
- Management complexity: Managing multiple vendors and systems can be complex and time-consuming.
The Aiken Pyramid
The Aiken pyramid helps in understanding how these approaches fit within the different layers of an information system:
- Strategic level
This is where the organisation’s long-term vision and strategy is defined. A ‘best of suite’ approach can be attractive for its simplicity and consistency, while a ‘best of breed’ approach offers more flexibility to innovate and adapt to changing needs. - Tactical level
This level focuses on strategy implementation through projects and programmes. The choice between ‘best of suite’ and ‘best of broad’ will depend on the specific project requirements and the degree of integration needed. - Operational level
At this level, day-to-day activities are carried out. A ‘best of suite’ approach can ensure streamlined operations, while a ‘best of broad’ approach can lead to improved performance and efficiency in specific operational processes.
The choice between ‘best of suite’ and ‘best of breed’ depends on the organisation’s specific needs and goals. By using the Aiken pyramid as an analysis framework, organisations can make an informed decision that fits their strategic, tactical and operational requirements.
Conclusion
The journey from rough diamond to brilliant ring is a precise and complex process, as is the process of getting from raw data to valuable data products or effective AI applications. Without a careful approach, a diamond remains dull and out of focus – the same goes for data. With the right tools and techniques, you transform raw, disorganised information into a valuable source of insights.
The Aiken Pyramid provides a clear framework for this process, with each level contributing to the quality and value of data. AI is the icing on the cake, making high-quality data even more valuable by enriching it with intelligence and automation.
By applying the right strategies and technologies, you can ensure that your data is as radiant and valuable as a perfectly cut diamond. And with the rise of AI and automation, the process of data management and governance will only become more efficient and effective in the future. Just as goldsmiths continue to refine their techniques, data management is also evolving to deliver ever better and more reliable data.