Data Processing & Analytics

Building Data Pipelines for Machine Learning/Deep Learning with Apache Kafka

Interesting slide presentation on using Apache Kafka Streams and Machine Learning:

For those contemplating these technologies this may be very useful.

Data Processing & Analytics

Kafka & Spark for Data Pipelines

For large-scale applications that process data efficiently, integrating messaging and analytic software is a must. Understanding options and selecting the proper architecture for systems that will implement data pipelines is the most important step.

Here is a great article for those contemplating building and implementing an architecture for a data pipeline:

Blockchain Business

Blockchain Use Case: Supply Chain

From discussing this topic with professionals who work in the logistics and supply chain industry the application of Blockchain there may be in its nascent stages. Despite that there is great interest in applying immutable ledger technology to the flow of goods and services. In researching this topic I came across this excellent guide for CIO’s researching the use of such technologies:

Quantum Cryptography

Quantum Computing and Blockchain

For those of us who follow both Blockchain and Quantum computing, the question of how cryptographically secure the Blockchain can remain in a world with reliable Quantum Computers is top of mind.

This article: explores some of the aspects of the intersection of these technologies and what the real threats to the hopes for a stable secure distributed ledger in the world of Quantum Computing might be.

Given Blockchain’s reliance on one-way mathematical functions that are hard to calculate “in reverse” a Quantum Computer in the wrong hands that can perform the factorization of a large prime number could wreak havoc with the Blockchain. An algorithm designed to provide the prime factorization of a large number otherwise know as “Shor’s algorithm” was demonstrated to run on a Quantum computing device by researchers at MIT. They also showed that it is possible to scale their design to handle larger and larger numbers given that they could apply enough resources to their design. The design they have is not ready to scale to large primes yet (according to the article above) but they are confident that it can be in the future.

Even if such a computer may be years away it shows that Quantum technology is possible and could one day disrupt the world of Blockchain. Other researchers feel that BlockChain won’t stand still however. New algorithms can be applied for Blockchain instead of the same one-way hash reliant functions that are used with conventional computers today.

For those interested, more reading on the subject of Quantum computing is available here:

For information on Shor’s algorithm interested readers can inspect this link from wikipedia:

Quantum Cryptography

Quantum computing: another point of view

This article: written by PRABIR PURKAYASTHA expresses a bit more optimism around quantum computing and real-world applications than other articles I have seen.

I find it interesting to think about the impact on public-private key cryptography if and when robust quantum computers are available outside of research laboratories. Experts I have spoken with think we are 5-10 years away from having ubiquitous and feasible quantum computing machines. They do speculate that the impact of these machines on the security of data that has been encrypted prior to their existence could be large.

Perhaps an entire new industry will emerge to “re-encrypt” data with different algorithms?

Quantum Computing Technology

On Quantum Computing

The general public has shown great interest in quantum computing. Largely due to explanations in the general press these machines seem increasingly powerful and “real”. I recently found this article that explains the technology better than anything I have seen elsewhere. The article is from IEEE Spectrum and is written by Mikhail Dyakonov .


Welcome to MaxCogito Inc.

The MaxCogito Inc. blog. Intended to identify areas of interest in a community concerned with content analysis, machine learning and protection of privacy.