Big Data Engineer on Hadoop and Spark Ecosystem

AVIRA Soft SRL

22-01-2016 | EXPIRA LA 21-02-2016

Job expirat

RESPONSABILITATI

Avira is looking for experienced Hadoop and Spark developers to join us on our mission to leverage one of Europe's largest customer datasets.We work on large scale systems processing terrabytes of data every day, using a wide range of Hadoop tools ( like Spark, Hive, HBase, MapReduce, Kafka, Impala) and programming languages like Java, Scala, Python and Bash. Avira si moving toward a data-driven organization. Our challenges include both data science and engineering responsibilities.
As a Big Data Engineer, your job is to help build solutions that enhance the richness and quality of our product utilizing big data analytics techniques and machine learning algorithms. You will serve as a key technical resource in the full development cycle, end-to-end, from conception, design, implementation and trsting to documentation, delivery and maintenance. The team works in quick iterations, using the technologies and algorithms best suited for solving challenging problems such as event prediction, metric-based hypothesis validation.

Performance objectives

Starting from day one you will familiarize yourself with the main customer communication systems, their architecture and data collecting capabilities. Within the first 3 months, you understand the software and hardware architecture of the current running systems, and are working at the prototype of the profiling database, and collect relevant web data streams and optimize their storage.

A year into job you will design, implement and launch version one of Avira's Business Intelligence Hadoop-based system.


CERINTE

- university degree in computer science or equivalent work experience
- minimum 2 years work experience in software developemnt
- experience with Apache Hadoop or other distributed systems/parallel computing knowledge. Knowledge of Apache Spark is a plus
- experience with Java m Scala or Python
- experience with data-intensive projects that require coding performance optimizations ( in the code itself, in the database, or at an architectural level)
- experience with SQL on any relational database engine, Experience with Apache Hive or Impala is a plus.

Havinf any of the following constitutes an advantage
- NoSQL database experience (HBase, Cassandra, Couchbase, MongoDB or other)
- advanced MySQL knowledge
- Experience with multiple programming languages(Java, Scala, Python, Ruby, JavaScript, Bash)
- Experience with handling large amounts of data ( usage of Apache Lucence, Solr, ElasticSearch)
- An active interest in natural language processing, data mining, artificial intelligence and statistics
- if you are enthusiastic about broadening your technical expertise and have a desire to work in an environment that promotes creativity, research, innovation and fun, we would love to hear from you!


DESCRIEREA FIRMEI

Located in Bucharest - Romania, Avira was founded in 2004 by a dynamic core of security experts who is committed to the following values: security ethics, professional attitude, open spirit, pride and respect. These principles are meant to stand at the base of any long term
collaboration and partnership that Avira Soft will undertake.
Avira Soft gathered a team of more than 50 dynamic professionals who are permanently collaborating with the experimented specialists of Avira GmbH , Germany. We are a dynamic and creative team and our purpose is to produce high quality software.

We also impose some requirements for our candidates: creativity, technical knowledge, team working capabilities and the ability to finish the job on time.