Spark engineer

We are looking for an experienced engineer in distributed computing with our Data Science team. Our company produces a new generation of products for marketing automation. We have a skilled team, - two PhD in the field of research data. We do a lot for effective work of employees. You must have a working experience in distributed computing on the Spark, its tuning, determining performance bottleneck, architectural optimization of the application. From the obvious requirements - clean code and style, the concept of a good application architecture and data circuits, the ability to work with the tests, the use of common software development practices, a constant desire to improve. Technologies used: Scala, Spark, Amazon EMR You need: Knowledge of English at Intermediate level Ability to work with Git, Maven Knowing how to write various tests, the desire to do it It's good to have: Experience with Amazon EMR Experience with various products Hadoop stack (Hive, HBase, Drill, etc.) Read more about the product: We create of CRM "on steroids" for retail business. Business idea: to make the software, which at some point will operate as a closed harvester to improve the purchasing performance the audience as much as possible automatically - to receive data from retailers, to calculate the best deal, to connect with those that the producer has to choose channel communication strategy, run the campaign, taking into account historical data on previous interactions with users to communicate only with the user, who can be affected. Retailers give us access to the indentifitsirovannyh buyers, as well as historical data on the entire range of goods and all transactions of customers. Further included analyst, written in Spark, - basket clusters report, best offer in user category, channel modeling, next buy prediction, response modeling, uplift modeling and so on.