SYSTEM AND METHOD OF DATA INGESTION AND PROCESSING FRAMEWORK
The present disclosure provides for a system (100) and method (250) that facilitates a robust and effective solution to an entity or an organization by enabling ingestion and processing of a set of data packets corresponding to large streaming and batched data in a big data eco-system that may be fast and may provide optimal throughput, rate control, throttle and embedded fault tolerance. The system (100) is equipped with a data ingestion module (110) to receive the set of data packets and extract a set of attributes pertaining to the nature of data from the set of data packets received and then poll a plurality of second computing devices (104) based on the set of attributes extracted; and, upon establishing polling, store the set of data packets in the plurality of second computing devices (104).