What is it?
Flink is a computing platform for data stream processing, or data which constantly increases in amount. Data streams can be generated on a continuous basis, in large amounts, with breaks, in small amounts, and can also require a quick reaction. Flink can handle all these cases very well, providing excellent business insights which translate into better and faster growth.
It is a younger brother of Spark and Hadoop. Like them, it is scalable and enables fast processing of large amounts of data. It also enables connection with various data sources (Kafka, HDFS, Cassandra, HBase, SQL databases, etc.). And similarly, it fits with diverse IT environments, because it can be launched in the sames ones as Spark and Hadoop, in standalone mode, in a cluster, and of course in the cloud. Moreover, it offers both batch and stream processing.
Flink is available under an open-source license, which means one can freely analyze what is going on in the system. It has a thriving community, too, which makes it much easier to find solutions to problems. Despite its young age, it is a mature technology with numerous production launches in such companies as: ING, Ericsson, Alibaba, Uber, Zalando, Netflix, Telefonica.
What is it for?
Flink’s added value among older generation systems is its excellent support for data stream processing. Among all open source solutions, it offers the best support for reliable performance of data operations which require quick reaction with very low latency (e.g. detecting financial fraud on the basis of transactions). It is excellent at performing more complicated operations due to its innovative calculation status handling. Many of these are possible to implement in older systems (e.g. Spark), but only Flink gives such possibilities while maintaining very high performance. Flink is also faster when it comes to iterative calculations, such as machine learning.
Examples of use
monitoring network infrastructure, e.g. in order to detect anomalies
detecting financial fraud with latency as small as several milliseconds
telemetry, or e.g. monitoring the use of a service for billing purposes
pattern detection through complex event processing, e.g. when a user is filling in a form, but stops after reaching the 3rd page and does not come back
calculating the moving average for quantity in the past 30 minutes
IoT: monitoring sensors in vehicles, industrial and agricultural machines, using machine learning for fast fault detection
as a tool for a data science team to perform SQL queries on a data stream
See other technologies, which we use in this area
NoSQL / BigData
Millions of messages daily, one innovative solution - Communication Engine
BlueSoft has helped one of the biggest Polish telecoms operators in conducting a digital transformation.
Gigabytes of data arriving daily, terabytes of data processed in a dispersed Big Data ecosystem.
Drupal technology leveraged for Sprawiedliwi.org.pl portal gives an opportunity to display almost 1,000 stories of rescue with the use of modern mass media
BlueSoft has supported ING Bank Śląski in implementing a new platform for processing and analyzing data in real time.
Over 100 apllications use enterprise service bus built by BlueSoft
A scalable microservices-based integration platform in a cloud environment for handling large numbers of requests
BlueSoft has supported Raiffeisen Bank International in designing and implementing Advanced Analytics Workspace, an explorative, on-demand analytical environment.
First deployment of a card payment system upon parcel delivery on the Polish courier market (COD - Cash on Delivery) strengthens DPD’s position as market leader that is open to the client’s needs.
Users from more than 40 countries use the Zoetis application owing to a solution supplied by BlueSoft and leveraging Amazon Web Services
BlueSoft designed and implemented a service separation solution in HA architecture for WSO2 ESB
Over the years, Teleoperator has successfully implemented a number of complex projects with short “time to market”
BlueSoft has designed and implemented an innovative IT solution for Idea Bank SA. It ensures utilizing functionalities and relaying communications between IT systems constituting the first cloud banking system in Poland - “Idea Cloud”
LOT Polish Airlines builds relations with its clients more effectively using BlueSoft’s loyalty platform.