Hi,
I am Databricks certified spark developer with 13+ years of experience on JVM. I have extensive experience in developing streaming and batch applications with Apache Spark.
I have extensive experience in processing big data using Apache Spark and connecting to various datastores including Files on HDFS, HBase, Oracle, MySQL, Cassandra, and ElasticSearch.
In my past projects, I have developed a data warehouse offloading solution into Hadoop. This involved fetching data from multiple sources like Oracle, MySQL and storing into Hadoop based datalake.
I also have extensive experience in web technologies using Spring framework with java. In the past I have developed multiple modern applications that use one of the following ways to query and present data from Hadoop ecosystem components -
hive with JDBC to query from Spark Hive2 server
Use Impala with Hive JDBC driver
Use Apache Phoenix to organize and query data in HBase
I have extensive experience with ReactJS, AngularJS, D3JS to build rich dashboard.
With my past experiences in Spark, hadoop, data munging using spark, and web technologies I find the mentioned project exciting.
Please checkout my profile and past projects for more information.
Looking forward to talk to you.