Big Data Engineer

ScienceSoft is looking for a Big Data Engineer.

Visit our software development service page to learn about the approach and competencies of our team and get an idea of potential projects.

Responsibilities

  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities;
  • Implementing ETL process;
  • Monitoring performance and advising any necessary infrastructure changes;
  • Defining data retention policies.

Skills and Qualifications

  • Technical English;
  • 2+ years' experience in Python/Scala/Java;
  • Proficient understanding of distributed computing principles;
  • Experience with integration of data from multiple data sources;
  • Understanding of Lambda Architecture, along with its advantages and drawbacks;
  • Experience with building stream-processing systems;
  • Expirience with RDBMS;
  • Experience with NoSQL databases (HBase\Cassandra\MongoDB);
  • Knowledge of the Hadoop v2, MapReduce, HDFS (Cloudera\MapR\Hortonworks distribution);
  • Knowledge of Big Data querying tools (Pig\Hive\Impala);
  • Knowledge of Storm\Spark-Streaming;
  • Knowledge of various ETL techniques and frameworks;
  • Experience with various messaging systems (Kafka\RabbitMQ);
  • Experience with Spark;
  • Experience with Linux\Docker\Git\Jenkins.

Nice to have

  • Knowledge of AWS, Azure;
  • Machine learning experience.

We offer

  • Opportunity for professional self-realization;
  • Friendly and united team;
  • Days of paid vacation;
  • 100%-paid sick leave;
  • Sport-program;
  • Language courses and other corporate programs;
  • Medical insurance;
  • Competitive (official) salary.

Apply for this position

COVID-19 – An update to our clients
In the uncertain time of Coronavirus (COVID-19) outbreak, I want to assure you that ScienceSoft remains fully operational and dedicated to supporting the continuity of our customers’ businesses. Most of ScienceSoft’s employees work remotely, and we’re equipped to provide our services in new conditions, with no impact on the quality of service or communication.
In the uncertain time of Coronavirus (COVID-19) outbreak, I want to assure you that ScienceSoft remains fully operational and dedicated to supporting the continuity of our customers’ businesses. Most of ScienceSoft’s employees work remotely, and we’re equipped to provide our services in new conditions, with no impact on the quality of service or communication.
Stay safe and healthy,
Nikolay Kurayev,
Chief Executive Officer at ScienceSoft