Image for post
Image for post

In this article will go through two types of server-client codes.

One is over synchronous (multi process package) and the other is asynchronous (asyncore package), they do almost the same thing, the asynchronous one is more robust, and data does not get lost.

Try it out on your machine, play with settings a bit and see the synchronous server limits and data loss.

Synchronous server using multiprocess package.

import multiprocessing import socket import time HOST = "0.0.0.0" PORT = 9000 def handle(connection, address): try: while True: data = connection.recv(1024) connection.sendall(data + ' server time {}'.format(time.time())) except: pass finally: connection.close() class…

Image for post
Image for post
AWS Quicksight BI tool

Introduction:

Most business intelligence projects comes to help management view summarized data from company’s sources (applications etc.) and make better decisions as managers and decision makers.

In this case data comes from several web/mobile medical applications, on different topics, languages, media types, countries, units, etc.

Special case warning: Data can’t be reached by the administrator as it holds sensitive private medical data, so it must be anonymized before published (a subject for a different post).

Overview:

  • Collect the data to AWS S3 bucket using cron job script (not AWS Kinesis-Firehose or Kinesis-Data-Streams).
  • Invoke AWS server-less lambda for indexing metadata of the data-lake.

Ohad Gazit

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store