Senior Data Engineer

Israel · Full-time · Senior

About The Position

Senior Data Engineer

Work environment

We are a team of WordPress designers and developers that are building the future of website design, pixel after pixel, div on top of div. We have thousands of happy and loyal customers. We are also growing at an amazing rate every month, with hundreds of new monthly users, and many challenges as well.

We are a company that is lead by design. A considerable part of our job is to improve how people from around the world create website, and give them the tools for a faster and better workflow. This is the place where you will be able to do your finest work

Responsibilities

  • Dealing with data on a huge scale
  • Logging events then storing it in a way that can be quickly retrieved later (either for batch processing, or user-facing key-value lookups) is non-trivial
  • Working with a number of off-the-shelf tools including Spark, EMR, DynamoDb, S3, RedShift, Mysql, but often push them past their limits
  • Keeping this data pipeline running smoothly and improving it is half the job, the other half is wrangling the data for application purposes
  • Join the datasets above in novel ways - Is MapReduce or Spark the right tool for the job? How much memory or compute resources are needed to load a new model on years of impression data? Will the job finish in 1 hour, 1 day, or 1 month? Should it run on one machine or dozens?
  • These are the types of questions you'll need to deal with so if you get excited by the idea of ripping through TB's of data, and making it easy for your teammates to do the same, this job is for you

 

Requirements

  • Bachelor's degree or higher in Computer Science
  • 5+ years data engineering experience (SQL, Python)
  • Fluent in Data Engineering (Specifically building data pipelines)
  • Comfortable programming in Linux Server-side development
  • Comfortable with databases, networking, servers
  • Experience with high volume, high availability production systems
  • Experience in modelling design and implementation
  • Experience with Spark, EMR, DynamoDb, RedShift, Mysql
  • Experience in reporting platforms like Tableau/Looker
  • Fast learner and versatile individual, willing to learn and explore new territories
  • Good verbal and written communication skills in English

Apply for this position