Big data processing is a set of technologies and methods for collecting, storing, processing and analyzing huge arrays of structured and unstructured data. This allows identifying hidden patterns, predicting trends and making informed management decisions.
FINTECH JSC is the developer of a technology unique on the Russian market for collecting, normalizing and processing big data, which allows integrating disparate, multi-format information into a unified information space. Our AIS design services include the development of data processing architecture.
This technology is of greatest interest to large government and corporate customers, providing information interaction between automated systems created at different times by different manufacturers, as well as information exchange with external international, intergovernmental, governmental, interdepartmental, departmental and other information systems, including those processing information constituting a state secret.
Big data collection and processing technologies
The essence of the technology is the creation of a data-centric information structure of geographically distributed secure data centers, which ensures compliance with the principle "data is primary, forms of data representation are secondary" (for comparison: most existing automated systems are format-centric, built on the principle "the form of data representation is primary, data is secondary").
This circumstance allows organizing the collection, processing, storage and transmission of data without being strictly tied to various kinds of templates and document forms: regardless of the forms used, the data will be in a strictly defined place and access to it will be ensured through the use of a unified address space. In addition, this property of systems built on the basis of the SintezM technology allows implementing the principle "single data entry, multiple data use" in practice.
Another technological advantage provided by the SintezM platform is that the customer does not need to involve a developer enterprise to describe and maintain the information fund, create numerous forms, report templates, thematic databases and screen forms. These tasks are solved by the data center operation service through the use of appropriate constructors and editors included in the delivery set of the SintezM information platform. At the same time, there is no change in the program code and, as a consequence, no need for additional thematic research, attestation and certification testing, or changes to system operating instructions.
Integration of information systems into a unified space
Information work in systems created on the basis of the SintezM platform consists of three main stages:
- Data collection — obtaining information from various sources, including external AIS
- Data normalization — bringing multi-format data to unified standards and structures
- Big data processing — analysis, storage and provision of information in the required form
Information interaction with external systems occurs similarly to the three stages listed: the data format of external (existing) automated systems is transmitted to the data center and recorded in the geographically distributed database of the information fund of the data center in the form of described information resources; in the process of information interaction, users (officials) of existing automated systems and the data center work with thematic databases in the data center, including data transmitted from external automated systems.
Big data analysis for decision making
Big data analysis allows identifying hidden patterns, predicting the development of situations and making informed management decisions. We provide tools for real-time data analysis, building predictive models and visualizing results. We also recommend reviewing our technical support services for data processing clusters.
Secure e-mail and crypto
Secure e-mail is built on the basis of certified cryptographic information protection tools (crypto) and ensures full confidentiality of correspondence, protection against interception and unauthorized access. Secure e-mail works in conjunction with transport subsystems and data storage systems for data centers, ensuring secure transmission and storage of information. Our attestation testing confirms the security of the secure mail infrastructure.
Key big data processing capabilities:
- Big data collection and processing from disparate sources
- Information system integration into a unified space
- Big data analysis — forecasting and decision making
- Data normalization — unification of formats and structures
- Information protection — processing of information constituting a state secret
Integration with other technologies
Big data processing in a secure data center is impossible without large-scale storage and fast data exchange. Data storage systems provide the required amount of disk space for accumulating and analyzing arrays, transport subsystems ensure high-performance data transmission between processing clusters, and control and management systems track the security and integrity of processed data.
Big data processing and protection
- AIS design and developmentDesign of the data processing architecture: parallel computing, ETL pipelines and analytics.
- Attestation testing of informatization facilitiesSecurity check of the big data processing environment for compliance with FSTEC.
- Certification testing of software and crypto toolsValidation of analytics and data processing tools for compliance with standards.
- Technical support and maintenanceMaintenance of data processing clusters, performance monitoring and troubleshooting.