In this post, I will cover a tutorial that involves different moving pieces. It covers the following:
The example will expose a Spring Boot REST service that exposes csv file records from a directory. In …
in java · Fri 21 December 2018
RXJava is an extremely useful streaming framework (here is an example application using it for parallel processing of restful calls to both uber and lyft (RT_UBER_NYC_TAXI)). However, In this post, I will cover how you can reactively stream and process a CSV file.
Firstly, you can create a Flowable of …
in java · Sat 15 December 2018
In this post, I will share a few quick tips about scaling your Spark applications to larger datasets without having large executor memory.
in spark · Sat 15 December 2018
I have been working on ML projects that require image preprocessing and text extraction. To improve the quality of text extraction, there are many preprocessing steps that we need to do, they are elicited below. We use OpenCV for doing the preprocessing and tesseract-ocr for text extraction.
in Machine Learning · Sat 01 September 2018
Column ambiguity is quite common when you join two tables. Now this poses a unnecessary hassle when you want to select all the columns from both the tables whilst discarding the duplicate columns. The aforementioned problem is difficult to handle especially, if you have wide tables, where you would want …
in spark · Thu 12 April 2018