What is big data architecture?
Big data architecture is the logical and / or physical layout / structure of how large data is stored, accessed and managed in a big data or IT environment.
It logically defines how the big data solution works, which core components (hardware, database, software, storage), information flow, security and more are used.
The big data architecture primarily serves as a key reference for big data infrastructures and solutions.
It is created by big data designers / architects before a big data solution is physically implemented. Creating a big data architecture usually requires an understanding of the company / organization and its big data requirements.
It also means connecting and organizing existing resources to meet big data needs. Big data architecture typically consists of four different levels:
Large data sources: The entire site that produces large amounts of data.
Messaging and Storage: The facility where big data is stored.
Big data analysis: tools that enable analysis via big data.
Big data consumption / usage: users / services that use the analyzed data.